2024-05-09T05:38:51.664 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-09T05:38:51.665 DEBUG:teuthology.run:Teuthology command: teuthology --name pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi --owner scheduled_pdonnell@teuthology --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mds 2-workunit/suites/iozone}} --archive /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7699143 --verbose -- /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7699143/orig.config.yaml 2024-05-09T05:38:51.732 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-09T05:38:51.852 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7699143 branch: wip-pdonnell-testing-20240508.183908-debug description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mds 2-workunit/suites/iozone}} email: pdonnell@redhat.com first_in_suite: false job_id: '7699143' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-pdonnell-testing-20240508.183908-debug ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 5 session_timeout: 300 conf: client: client mount timeout: 600 client_shutdown_timeout: 120 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds oft prefetch dirfrags: true mds op complaint time: 180 mds verify scatter: true mds_dir_prefetch: true mds_sleep_rank_change: 5000000.0 mon client directed command retry: 5 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds osd ms inject socket failures: 2500 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon client directed command retry: 5 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds ms inject socket failures: 2500 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - Replacing daemon mds sha1: c9da4049f638c0f84bdd9b4e33c42e86046ac554 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs check-counter: counters: mds: - mds.exported - mds.imported install: ceph: flavor: default sha1: c9da4049f638c0f84bdd9b4e33c42e86046ac554 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240508.183908-debug sha1: c9da4049f638c0f84bdd9b4e33c42e86046ac554 owner: scheduled_pdonnell@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 1722 sha1: c9da4049f638c0f84bdd9b4e33c42e86046ac554 sleep_before_teardown: 0 subset: 67/512 suite: fs suite_branch: wip-pdonnell-testing-20240508.183908-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_c9da4049f638c0f84bdd9b4e33c42e86046ac554/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: c9da4049f638c0f84bdd9b4e33c42e86046ac554 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi072.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLBOhfkWxGaTPCMHW7ek6Zk+T02DHsBcO/UQ9q0wHS/wA2aT+MRqVaNbi1t3+PMacHBs6OcUqrOft9MtfQ3MJu0= smithi110.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBfOcSg3hESNznkB067uAx9DffDP+Oemodm6GOsRSa7LLK7FYgL9jIxuE3LY1G6kjWjZyVRi0Lyly4ao7F4C96w= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - mds_thrash: null - workunit: clients: all: - suites/iozone.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-08_22:06:20 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-09T05:38:51.852 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_c9da4049f638c0f84bdd9b4e33c42e86046ac554/qa; will attempt to use it 2024-05-09T05:38:51.853 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_c9da4049f638c0f84bdd9b4e33c42e86046ac554/qa/tasks 2024-05-09T05:38:51.853 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-09T05:38:51.857 INFO:teuthology.task.internal:Checking packages... 2024-05-09T05:38:51.886 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'c9da4049f638c0f84bdd9b4e33c42e86046ac554' 2024-05-09T05:38:51.887 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-09T05:38:51.887 INFO:teuthology.packaging:ref: None 2024-05-09T05:38:51.887 INFO:teuthology.packaging:tag: None 2024-05-09T05:38:51.887 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240508.183908-debug 2024-05-09T05:38:51.887 INFO:teuthology.packaging:sha1: c9da4049f638c0f84bdd9b4e33c42e86046ac554 2024-05-09T05:38:51.887 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-pdonnell-testing-20240508.183908-debug 2024-05-09T05:38:52.107 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3594-gc9da4049-1jammy 2024-05-09T05:38:52.109 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-09T05:38:52.115 INFO:teuthology.task.internal:no buildpackages task found 2024-05-09T05:38:52.116 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-09T05:38:52.181 INFO:teuthology.task.internal:Saving configuration 2024-05-09T05:38:52.211 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-09T05:38:52.218 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-09T05:38:52.244 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi072.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7699143', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-09 05:31:56.640765', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILc7YbBpXOOixYPlVJjg1eiLHBd1M6Kshha+keg+q33P'} 2024-05-09T05:38:52.268 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi110.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7699143', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-09 05:31:56.642574', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDqKz8DAqRf9rttzE9P7sykXEVYW5Y+YD29reetLsxtU'} 2024-05-09T05:38:52.268 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-09T05:38:52.276 INFO:teuthology.task.internal:roles: ubuntu@smithi072.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-05-09T05:38:52.277 INFO:teuthology.task.internal:roles: ubuntu@smithi110.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-05-09T05:38:52.277 INFO:teuthology.run_tasks:Running task console_log... 2024-05-09T05:38:52.372 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f21f133a3a0>, signals=[15]) 2024-05-09T05:38:52.372 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-09T05:38:52.379 INFO:teuthology.task.internal:Opening connections... 2024-05-09T05:38:52.379 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi072.front.sepia.ceph.com 2024-05-09T05:38:52.381 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T05:38:52.464 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi110.front.sepia.ceph.com 2024-05-09T05:38:52.465 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T05:38:52.543 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-09T05:38:52.551 DEBUG:teuthology.orchestra.run.smithi072:> uname -m 2024-05-09T05:38:52.556 INFO:teuthology.orchestra.run.smithi072.stdout:x86_64 2024-05-09T05:38:52.556 DEBUG:teuthology.orchestra.run.smithi072:> cat /etc/os-release 2024-05-09T05:38:52.604 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-05-09T05:38:52.604 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="Ubuntu" 2024-05-09T05:38:52.604 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="22.04" 2024-05-09T05:38:52.604 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-05-09T05:38:52.604 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_CODENAME=jammy 2024-05-09T05:38:52.605 INFO:teuthology.orchestra.run.smithi072.stdout:ID=ubuntu 2024-05-09T05:38:52.605 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE=debian 2024-05-09T05:38:52.605 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://www.ubuntu.com/" 2024-05-09T05:38:52.605 INFO:teuthology.orchestra.run.smithi072.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-05-09T05:38:52.605 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-05-09T05:38:52.605 INFO:teuthology.orchestra.run.smithi072.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-05-09T05:38:52.605 INFO:teuthology.orchestra.run.smithi072.stdout:UBUNTU_CODENAME=jammy 2024-05-09T05:38:52.606 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server 2024-05-09T05:38:52.630 DEBUG:teuthology.orchestra.run.smithi110:> uname -m 2024-05-09T05:38:52.635 INFO:teuthology.orchestra.run.smithi110.stdout:x86_64 2024-05-09T05:38:52.635 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release 2024-05-09T05:38:52.681 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-05-09T05:38:52.682 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="Ubuntu" 2024-05-09T05:38:52.682 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="22.04" 2024-05-09T05:38:52.682 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-05-09T05:38:52.682 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_CODENAME=jammy 2024-05-09T05:38:52.682 INFO:teuthology.orchestra.run.smithi110.stdout:ID=ubuntu 2024-05-09T05:38:52.683 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE=debian 2024-05-09T05:38:52.683 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://www.ubuntu.com/" 2024-05-09T05:38:52.683 INFO:teuthology.orchestra.run.smithi110.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-05-09T05:38:52.683 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-05-09T05:38:52.683 INFO:teuthology.orchestra.run.smithi110.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-05-09T05:38:52.683 INFO:teuthology.orchestra.run.smithi110.stdout:UBUNTU_CODENAME=jammy 2024-05-09T05:38:52.683 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server 2024-05-09T05:38:52.705 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-09T05:38:52.716 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-09T05:38:52.741 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-09T05:38:52.741 DEBUG:teuthology.orchestra.run.smithi072:> test '!' -e /home/ubuntu/cephtest 2024-05-09T05:38:52.744 DEBUG:teuthology.orchestra.run.smithi110:> test '!' -e /home/ubuntu/cephtest 2024-05-09T05:38:52.748 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-09T05:38:52.765 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-09T05:38:52.765 DEBUG:teuthology.orchestra.run.smithi072:> test -z $(ls -A /var/lib/ceph) 2024-05-09T05:38:52.790 DEBUG:teuthology.orchestra.run.smithi110:> test -z $(ls -A /var/lib/ceph) 2024-05-09T05:38:52.806 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-09T05:38:52.861 INFO:teuthology.run_tasks:Running task kernel... 2024-05-09T05:38:52.877 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-05-09T05:38:52.878 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-05-09T05:38:52.878 DEBUG:teuthology.orchestra.run.smithi072:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-09T05:38:52.878 DEBUG:teuthology.orchestra.run.smithi110:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-09T05:38:52.883 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T05:38:52.883 DEBUG:teuthology.orchestra.run.smithi072:> uname -r 2024-05-09T05:38:52.884 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T05:38:52.884 DEBUG:teuthology.orchestra.run.smithi110:> uname -r 2024-05-09T05:38:52.929 INFO:teuthology.orchestra.run.smithi072.stdout:5.15.0-56-generic 2024-05-09T05:38:52.929 INFO:teuthology.task.kernel:Running kernel on smithi072: 5.15.0-56-generic 2024-05-09T05:38:52.929 DEBUG:teuthology.orchestra.run.smithi072:> sudo apt-get clean 2024-05-09T05:38:52.930 INFO:teuthology.orchestra.run.smithi110.stdout:5.15.0-56-generic 2024-05-09T05:38:52.931 INFO:teuthology.task.kernel:Running kernel on smithi110: 5.15.0-56-generic 2024-05-09T05:38:52.931 DEBUG:teuthology.orchestra.run.smithi110:> sudo apt-get clean 2024-05-09T05:38:53.053 DEBUG:teuthology.orchestra.run.smithi110:> sudo apt-get update 2024-05-09T05:38:53.074 DEBUG:teuthology.orchestra.run.smithi072:> sudo apt-get update 2024-05-09T05:38:53.236 INFO:teuthology.orchestra.run.smithi072.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-05-09T05:38:53.339 INFO:teuthology.orchestra.run.smithi072.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-09T05:38:53.358 INFO:teuthology.orchestra.run.smithi110.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-09T05:38:53.358 INFO:teuthology.orchestra.run.smithi110.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-05-09T05:38:53.404 INFO:teuthology.orchestra.run.smithi110.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-05-09T05:38:53.422 INFO:teuthology.orchestra.run.smithi072.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-05-09T05:38:53.470 INFO:teuthology.orchestra.run.smithi072.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [458 kB] 2024-05-09T05:38:53.588 INFO:teuthology.orchestra.run.smithi072.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,421 kB] 2024-05-09T05:38:53.633 INFO:teuthology.orchestra.run.smithi072.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [246 kB] 2024-05-09T05:38:53.638 INFO:teuthology.orchestra.run.smithi072.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-05-09T05:38:53.642 INFO:teuthology.orchestra.run.smithi072.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,807 kB] 2024-05-09T05:38:53.667 INFO:teuthology.orchestra.run.smithi072.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-05-09T05:38:53.668 INFO:teuthology.orchestra.run.smithi072.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [307 kB] 2024-05-09T05:38:53.672 INFO:teuthology.orchestra.run.smithi072.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-05-09T05:38:53.672 INFO:teuthology.orchestra.run.smithi072.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [849 kB] 2024-05-09T05:38:53.680 INFO:teuthology.orchestra.run.smithi072.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [602 kB] 2024-05-09T05:38:53.687 INFO:teuthology.orchestra.run.smithi072.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-05-09T05:38:53.688 INFO:teuthology.orchestra.run.smithi072.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-05-09T05:38:53.688 INFO:teuthology.orchestra.run.smithi072.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-05-09T05:38:53.688 INFO:teuthology.orchestra.run.smithi072.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-05-09T05:38:53.697 INFO:teuthology.orchestra.run.smithi072.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-05-09T05:38:53.697 INFO:teuthology.orchestra.run.smithi072.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-05-09T05:38:53.766 INFO:teuthology.orchestra.run.smithi110.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,421 kB] 2024-05-09T05:38:53.769 INFO:teuthology.orchestra.run.smithi110.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-05-09T05:38:53.788 INFO:teuthology.orchestra.run.smithi072.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-05-09T05:38:53.908 INFO:teuthology.orchestra.run.smithi110.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [624 kB] 2024-05-09T05:38:53.926 INFO:teuthology.orchestra.run.smithi072.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [624 kB] 2024-05-09T05:38:54.110 INFO:teuthology.orchestra.run.smithi110.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,638 kB] 2024-05-09T05:38:54.127 INFO:teuthology.orchestra.run.smithi072.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,638 kB] 2024-05-09T05:38:54.192 INFO:teuthology.orchestra.run.smithi110.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [458 kB] 2024-05-09T05:38:54.209 INFO:teuthology.orchestra.run.smithi110.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [246 kB] 2024-05-09T05:38:54.219 INFO:teuthology.orchestra.run.smithi110.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-05-09T05:38:54.219 INFO:teuthology.orchestra.run.smithi110.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,807 kB] 2024-05-09T05:38:54.262 INFO:teuthology.orchestra.run.smithi110.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [307 kB] 2024-05-09T05:38:54.276 INFO:teuthology.orchestra.run.smithi110.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-05-09T05:38:54.277 INFO:teuthology.orchestra.run.smithi110.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,864 kB] 2024-05-09T05:38:54.278 INFO:teuthology.orchestra.run.smithi072.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [307 kB] 2024-05-09T05:38:54.293 INFO:teuthology.orchestra.run.smithi072.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-05-09T05:38:54.293 INFO:teuthology.orchestra.run.smithi072.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,864 kB] 2024-05-09T05:38:54.313 INFO:teuthology.orchestra.run.smithi110.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-05-09T05:38:54.314 INFO:teuthology.orchestra.run.smithi110.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [307 kB] 2024-05-09T05:38:54.326 INFO:teuthology.orchestra.run.smithi110.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-05-09T05:38:54.345 INFO:teuthology.orchestra.run.smithi110.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-05-09T05:38:54.346 INFO:teuthology.orchestra.run.smithi110.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [602 kB] 2024-05-09T05:38:54.346 INFO:teuthology.orchestra.run.smithi110.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [316 kB] 2024-05-09T05:38:54.351 INFO:teuthology.orchestra.run.smithi110.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-05-09T05:38:54.351 INFO:teuthology.orchestra.run.smithi110.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [849 kB] 2024-05-09T05:38:54.356 INFO:teuthology.orchestra.run.smithi072.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-05-09T05:38:54.356 INFO:teuthology.orchestra.run.smithi072.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [316 kB] 2024-05-09T05:38:54.364 INFO:teuthology.orchestra.run.smithi072.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-05-09T05:38:54.515 INFO:teuthology.orchestra.run.smithi110.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,073 kB] 2024-05-09T05:38:54.528 INFO:teuthology.orchestra.run.smithi072.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [702 kB] 2024-05-09T05:38:54.530 INFO:teuthology.orchestra.run.smithi110.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-05-09T05:38:54.938 INFO:teuthology.orchestra.run.smithi110.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-05-09T05:38:54.944 INFO:teuthology.orchestra.run.smithi110.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-05-09T05:38:54.945 INFO:teuthology.orchestra.run.smithi110.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-05-09T05:38:54.959 INFO:teuthology.orchestra.run.smithi110.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-05-09T05:38:54.962 INFO:teuthology.orchestra.run.smithi110.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-05-09T05:38:55.117 INFO:teuthology.orchestra.run.smithi072.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,073 kB] 2024-05-09T05:38:55.150 INFO:teuthology.orchestra.run.smithi110.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [702 kB] 2024-05-09T05:38:55.188 INFO:teuthology.orchestra.run.smithi110.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [245 kB] 2024-05-09T05:38:55.201 INFO:teuthology.orchestra.run.smithi110.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-05-09T05:38:55.202 INFO:teuthology.orchestra.run.smithi110.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-05-09T05:38:55.202 INFO:teuthology.orchestra.run.smithi110.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-05-09T05:38:55.204 INFO:teuthology.orchestra.run.smithi110.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-05-09T05:38:55.205 INFO:teuthology.orchestra.run.smithi110.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-05-09T05:38:55.205 INFO:teuthology.orchestra.run.smithi110.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-05-09T05:38:55.228 INFO:teuthology.orchestra.run.smithi072.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [245 kB] 2024-05-09T05:38:55.233 INFO:teuthology.orchestra.run.smithi110.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-05-09T05:38:55.236 INFO:teuthology.orchestra.run.smithi110.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-05-09T05:38:55.249 INFO:teuthology.orchestra.run.smithi072.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-05-09T05:38:55.250 INFO:teuthology.orchestra.run.smithi072.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-05-09T05:38:55.253 INFO:teuthology.orchestra.run.smithi072.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-05-09T05:38:55.254 INFO:teuthology.orchestra.run.smithi072.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-05-09T05:38:55.254 INFO:teuthology.orchestra.run.smithi072.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-05-09T05:38:55.255 INFO:teuthology.orchestra.run.smithi072.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-05-09T05:38:55.258 INFO:teuthology.orchestra.run.smithi072.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-05-09T05:38:55.263 INFO:teuthology.orchestra.run.smithi072.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-05-09T05:38:55.401 INFO:teuthology.orchestra.run.smithi110.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-05-09T05:38:55.429 INFO:teuthology.orchestra.run.smithi072.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-05-09T05:38:55.484 INFO:teuthology.orchestra.run.smithi110.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-05-09T05:38:55.511 INFO:teuthology.orchestra.run.smithi072.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-05-09T05:38:55.566 INFO:teuthology.orchestra.run.smithi110.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-05-09T05:38:55.592 INFO:teuthology.orchestra.run.smithi072.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-05-09T05:38:55.620 INFO:teuthology.orchestra.run.smithi110.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-05-09T05:38:55.672 INFO:teuthology.orchestra.run.smithi110.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-05-09T05:38:55.675 INFO:teuthology.orchestra.run.smithi072.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-05-09T05:38:55.710 INFO:teuthology.orchestra.run.smithi072.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-05-09T05:39:00.028 INFO:teuthology.orchestra.run.smithi110.stdout:Fetched 13.4 MB in 3s (5,289 kB/s) 2024-05-09T05:39:00.060 INFO:teuthology.orchestra.run.smithi072.stdout:Fetched 13.4 MB in 3s (5,235 kB/s) 2024-05-09T05:39:01.490 INFO:teuthology.orchestra.run.smithi110.stdout:Reading package lists... 2024-05-09T05:39:01.509 DEBUG:teuthology.orchestra.run.smithi110:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-09T05:39:01.569 INFO:teuthology.orchestra.run.smithi110.stdout:Reading package lists... 2024-05-09T05:39:01.770 INFO:teuthology.orchestra.run.smithi110.stdout:Building dependency tree... 2024-05-09T05:39:01.770 INFO:teuthology.orchestra.run.smithi110.stdout:Reading state information... 2024-05-09T05:39:01.932 INFO:teuthology.orchestra.run.smithi110.stdout:The following packages were automatically installed and are no longer required: 2024-05-09T05:39:01.933 INFO:teuthology.orchestra.run.smithi110.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-09T05:39:01.933 INFO:teuthology.orchestra.run.smithi110.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-09T05:39:01.933 INFO:teuthology.orchestra.run.smithi110.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-09T05:39:01.933 INFO:teuthology.orchestra.run.smithi110.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-05-09T05:39:01.933 INFO:teuthology.orchestra.run.smithi110.stdout: python2.7-minimal 2024-05-09T05:39:01.934 INFO:teuthology.orchestra.run.smithi110.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-09T05:39:01.934 INFO:teuthology.orchestra.run.smithi110.stdout:The following additional packages will be installed: 2024-05-09T05:39:01.934 INFO:teuthology.orchestra.run.smithi110.stdout: linux-generic linux-headers-5.15.0-106 linux-headers-5.15.0-106-generic 2024-05-09T05:39:01.934 INFO:teuthology.orchestra.run.smithi110.stdout: linux-headers-generic linux-image-5.15.0-106-generic 2024-05-09T05:39:01.935 INFO:teuthology.orchestra.run.smithi110.stdout: linux-modules-5.15.0-106-generic linux-modules-extra-5.15.0-106-generic 2024-05-09T05:39:01.936 INFO:teuthology.orchestra.run.smithi110.stdout:Suggested packages: 2024-05-09T05:39:01.936 INFO:teuthology.orchestra.run.smithi110.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-05-09T05:39:01.936 INFO:teuthology.orchestra.run.smithi110.stdout:Recommended packages: 2024-05-09T05:39:01.936 INFO:teuthology.orchestra.run.smithi110.stdout: thermald 2024-05-09T05:39:01.994 INFO:teuthology.orchestra.run.smithi110.stdout:The following NEW packages will be installed: 2024-05-09T05:39:01.994 INFO:teuthology.orchestra.run.smithi110.stdout: linux-headers-5.15.0-106 linux-headers-5.15.0-106-generic 2024-05-09T05:39:01.995 INFO:teuthology.orchestra.run.smithi110.stdout: linux-image-5.15.0-106-generic linux-modules-5.15.0-106-generic 2024-05-09T05:39:01.995 INFO:teuthology.orchestra.run.smithi110.stdout: linux-modules-extra-5.15.0-106-generic 2024-05-09T05:39:01.995 INFO:teuthology.orchestra.run.smithi110.stdout:The following packages will be upgraded: 2024-05-09T05:39:01.996 INFO:teuthology.orchestra.run.smithi110.stdout: linux-generic linux-headers-generic linux-image-generic 2024-05-09T05:39:02.057 INFO:teuthology.orchestra.run.smithi110.stdout:3 upgraded, 5 newly installed, 0 to remove and 316 not upgraded. 2024-05-09T05:39:02.057 INFO:teuthology.orchestra.run.smithi110.stdout:Need to get 113 MB of archives. 2024-05-09T05:39:02.057 INFO:teuthology.orchestra.run.smithi110.stdout:After this operation, 583 MB of additional disk space will be used. 2024-05-09T05:39:02.057 INFO:teuthology.orchestra.run.smithi110.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-106-generic amd64 5.15.0-106.116 [22.7 MB] 2024-05-09T05:39:02.304 INFO:teuthology.orchestra.run.smithi072.stdout:Reading package lists... 2024-05-09T05:39:02.323 DEBUG:teuthology.orchestra.run.smithi072:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-09T05:39:02.384 INFO:teuthology.orchestra.run.smithi072.stdout:Reading package lists... 2024-05-09T05:39:02.582 INFO:teuthology.orchestra.run.smithi110.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-106-generic amd64 5.15.0-106.116 [11.5 MB] 2024-05-09T05:39:02.586 INFO:teuthology.orchestra.run.smithi072.stdout:Building dependency tree... 2024-05-09T05:39:02.587 INFO:teuthology.orchestra.run.smithi072.stdout:Reading state information... 2024-05-09T05:39:02.695 INFO:teuthology.orchestra.run.smithi110.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-106-generic amd64 5.15.0-106.116 [63.9 MB] 2024-05-09T05:39:02.750 INFO:teuthology.orchestra.run.smithi072.stdout:The following packages were automatically installed and are no longer required: 2024-05-09T05:39:02.750 INFO:teuthology.orchestra.run.smithi072.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-09T05:39:02.750 INFO:teuthology.orchestra.run.smithi072.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-09T05:39:02.750 INFO:teuthology.orchestra.run.smithi072.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-09T05:39:02.750 INFO:teuthology.orchestra.run.smithi072.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-05-09T05:39:02.750 INFO:teuthology.orchestra.run.smithi072.stdout: python2.7-minimal 2024-05-09T05:39:02.750 INFO:teuthology.orchestra.run.smithi072.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-09T05:39:02.751 INFO:teuthology.orchestra.run.smithi072.stdout:The following additional packages will be installed: 2024-05-09T05:39:02.751 INFO:teuthology.orchestra.run.smithi072.stdout: linux-generic linux-headers-5.15.0-106 linux-headers-5.15.0-106-generic 2024-05-09T05:39:02.751 INFO:teuthology.orchestra.run.smithi072.stdout: linux-headers-generic linux-image-5.15.0-106-generic 2024-05-09T05:39:02.752 INFO:teuthology.orchestra.run.smithi072.stdout: linux-modules-5.15.0-106-generic linux-modules-extra-5.15.0-106-generic 2024-05-09T05:39:02.753 INFO:teuthology.orchestra.run.smithi072.stdout:Suggested packages: 2024-05-09T05:39:02.753 INFO:teuthology.orchestra.run.smithi072.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-05-09T05:39:02.753 INFO:teuthology.orchestra.run.smithi072.stdout:Recommended packages: 2024-05-09T05:39:02.753 INFO:teuthology.orchestra.run.smithi072.stdout: thermald 2024-05-09T05:39:02.800 INFO:teuthology.orchestra.run.smithi072.stdout:The following NEW packages will be installed: 2024-05-09T05:39:02.800 INFO:teuthology.orchestra.run.smithi072.stdout: linux-headers-5.15.0-106 linux-headers-5.15.0-106-generic 2024-05-09T05:39:02.800 INFO:teuthology.orchestra.run.smithi072.stdout: linux-image-5.15.0-106-generic linux-modules-5.15.0-106-generic 2024-05-09T05:39:02.800 INFO:teuthology.orchestra.run.smithi072.stdout: linux-modules-extra-5.15.0-106-generic 2024-05-09T05:39:02.801 INFO:teuthology.orchestra.run.smithi072.stdout:The following packages will be upgraded: 2024-05-09T05:39:02.801 INFO:teuthology.orchestra.run.smithi072.stdout: linux-generic linux-headers-generic linux-image-generic 2024-05-09T05:39:02.981 INFO:teuthology.orchestra.run.smithi072.stdout:3 upgraded, 5 newly installed, 0 to remove and 316 not upgraded. 2024-05-09T05:39:02.981 INFO:teuthology.orchestra.run.smithi072.stdout:Need to get 113 MB of archives. 2024-05-09T05:39:02.981 INFO:teuthology.orchestra.run.smithi072.stdout:After this operation, 583 MB of additional disk space will be used. 2024-05-09T05:39:02.981 INFO:teuthology.orchestra.run.smithi072.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-106-generic amd64 5.15.0-106.116 [22.7 MB] 2024-05-09T05:39:03.794 INFO:teuthology.orchestra.run.smithi110.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.106.106 [1,692 B] 2024-05-09T05:39:03.795 INFO:teuthology.orchestra.run.smithi110.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.106.106 [2,502 B] 2024-05-09T05:39:03.795 INFO:teuthology.orchestra.run.smithi110.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-106 all 5.15.0-106.116 [12.3 MB] 2024-05-09T05:39:03.936 INFO:teuthology.orchestra.run.smithi110.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-106-generic amd64 5.15.0-106.116 [2,876 kB] 2024-05-09T05:39:03.960 INFO:teuthology.orchestra.run.smithi110.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.106.106 [2,366 B] 2024-05-09T05:39:04.456 INFO:teuthology.orchestra.run.smithi110.stdout:Fetched 113 MB in 2s (55.8 MB/s) 2024-05-09T05:39:04.568 INFO:teuthology.orchestra.run.smithi072.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-106-generic amd64 5.15.0-106.116 [11.5 MB] 2024-05-09T05:39:04.640 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package linux-modules-5.15.0-106-generic. 2024-05-09T05:39:04.912 INFO:teuthology.orchestra.run.smithi072.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-106-generic amd64 5.15.0-106.116 [63.9 MB] 2024-05-09T05:39:06.655 INFO:teuthology.orchestra.run.smithi110.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-05-09T05:39:06.660 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../0-linux-modules-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-09T05:39:06.788 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking linux-modules-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-09T05:39:07.897 INFO:teuthology.orchestra.run.smithi072.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.106.106 [1,692 B] 2024-05-09T05:39:07.897 INFO:teuthology.orchestra.run.smithi072.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.106.106 [2,502 B] 2024-05-09T05:39:07.898 INFO:teuthology.orchestra.run.smithi072.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-106 all 5.15.0-106.116 [12.3 MB] 2024-05-09T05:39:08.339 INFO:teuthology.orchestra.run.smithi072.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-106-generic amd64 5.15.0-106.116 [2,876 kB] 2024-05-09T05:39:08.423 INFO:teuthology.orchestra.run.smithi072.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.106.106 [2,366 B] 2024-05-09T05:39:08.820 INFO:teuthology.orchestra.run.smithi072.stdout:Fetched 113 MB in 6s (20.2 MB/s) 2024-05-09T05:39:08.990 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package linux-image-5.15.0-106-generic. 2024-05-09T05:39:09.011 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../1-linux-image-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-09T05:39:09.014 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package linux-modules-5.15.0-106-generic. 2024-05-09T05:39:09.093 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-09T05:39:09.594 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-106-generic. 2024-05-09T05:39:09.614 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-09T05:39:09.652 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking linux-modules-extra-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-09T05:39:12.031 INFO:teuthology.orchestra.run.smithi072.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-05-09T05:39:12.035 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../0-linux-modules-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-09T05:39:12.113 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking linux-modules-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-09T05:39:15.277 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package linux-image-5.15.0-106-generic. 2024-05-09T05:39:15.298 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../1-linux-image-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-09T05:39:15.410 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-09T05:39:15.943 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-106-generic. 2024-05-09T05:39:15.963 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-09T05:39:16.002 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking linux-modules-extra-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-09T05:39:16.739 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../3-linux-generic_5.15.0.106.106_amd64.deb ... 2024-05-09T05:39:16.841 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking linux-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-09T05:39:17.200 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.106.106_amd64.deb ... 2024-05-09T05:39:17.328 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking linux-image-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-09T05:39:17.656 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package linux-headers-5.15.0-106. 2024-05-09T05:39:17.667 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../5-linux-headers-5.15.0-106_5.15.0-106.116_all.deb ... 2024-05-09T05:39:17.706 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking linux-headers-5.15.0-106 (5.15.0-106.116) ... 2024-05-09T05:39:23.575 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../3-linux-generic_5.15.0.106.106_amd64.deb ... 2024-05-09T05:39:24.061 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking linux-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-09T05:39:24.237 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package linux-headers-5.15.0-106-generic. 2024-05-09T05:39:24.273 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../6-linux-headers-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-09T05:39:24.311 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking linux-headers-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-09T05:39:24.397 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.106.106_amd64.deb ... 2024-05-09T05:39:24.520 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking linux-image-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-09T05:39:24.850 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package linux-headers-5.15.0-106. 2024-05-09T05:39:24.872 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../5-linux-headers-5.15.0-106_5.15.0-106.116_all.deb ... 2024-05-09T05:39:24.908 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking linux-headers-5.15.0-106 (5.15.0-106.116) ... 2024-05-09T05:39:27.397 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.106.106_amd64.deb ... 2024-05-09T05:39:27.541 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking linux-headers-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-09T05:39:27.908 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up linux-headers-5.15.0-106 (5.15.0-106.116) ... 2024-05-09T05:39:28.030 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up linux-headers-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-09T05:39:28.173 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up linux-headers-generic (5.15.0.106.106) ... 2024-05-09T05:39:28.301 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-09T05:39:29.644 INFO:teuthology.orchestra.run.smithi110.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-05-09T05:39:29.644 INFO:teuthology.orchestra.run.smithi110.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-05-09T05:39:29.644 INFO:teuthology.orchestra.run.smithi110.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-106-generic 2024-05-09T05:39:29.644 INFO:teuthology.orchestra.run.smithi110.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-106-generic 2024-05-09T05:39:29.829 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up linux-modules-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-09T05:39:31.256 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up linux-modules-extra-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-09T05:39:32.133 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package linux-headers-5.15.0-106-generic. 2024-05-09T05:39:32.170 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../6-linux-headers-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-09T05:39:32.216 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking linux-headers-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-09T05:39:32.657 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up linux-image-generic (5.15.0.106.106) ... 2024-05-09T05:39:32.766 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up linux-generic (5.15.0.106.106) ... 2024-05-09T05:39:32.898 INFO:teuthology.orchestra.run.smithi110.stdout:Processing triggers for linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-09T05:39:32.960 INFO:teuthology.orchestra.run.smithi110.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-05-09T05:39:32.960 INFO:teuthology.orchestra.run.smithi110.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-106-generic 2024-05-09T05:39:34.412 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.106.106_amd64.deb ... 2024-05-09T05:39:34.538 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking linux-headers-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-09T05:39:34.943 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up linux-headers-5.15.0-106 (5.15.0-106.116) ... 2024-05-09T05:39:35.065 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up linux-headers-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-09T05:39:36.643 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up linux-headers-generic (5.15.0.106.106) ... 2024-05-09T05:39:36.816 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-09T05:39:38.174 INFO:teuthology.orchestra.run.smithi072.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-05-09T05:39:38.174 INFO:teuthology.orchestra.run.smithi072.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-05-09T05:39:38.174 INFO:teuthology.orchestra.run.smithi072.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-106-generic 2024-05-09T05:39:38.174 INFO:teuthology.orchestra.run.smithi072.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-106-generic 2024-05-09T05:39:38.341 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up linux-modules-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-09T05:39:40.002 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up linux-modules-extra-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-09T05:39:41.405 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up linux-image-generic (5.15.0.106.106) ... 2024-05-09T05:39:41.506 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up linux-generic (5.15.0.106.106) ... 2024-05-09T05:39:41.661 INFO:teuthology.orchestra.run.smithi072.stdout:Processing triggers for linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-09T05:39:41.730 INFO:teuthology.orchestra.run.smithi072.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-05-09T05:39:41.730 INFO:teuthology.orchestra.run.smithi072.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-106-generic 2024-05-09T05:39:47.585 INFO:teuthology.orchestra.run.smithi110.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-05-09T05:39:47.585 INFO:teuthology.orchestra.run.smithi110.stdout:Sourcing file `/etc/default/grub' 2024-05-09T05:39:47.598 INFO:teuthology.orchestra.run.smithi110.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-09T05:39:47.620 INFO:teuthology.orchestra.run.smithi110.stdout:Generating grub configuration file ... 2024-05-09T05:39:47.940 INFO:teuthology.orchestra.run.smithi110.stdout:Found linux image: /boot/vmlinuz-5.15.0-106-generic 2024-05-09T05:39:47.959 INFO:teuthology.orchestra.run.smithi110.stdout:Found initrd image: /boot/initrd.img-5.15.0-106-generic 2024-05-09T05:39:48.346 INFO:teuthology.orchestra.run.smithi110.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-09T05:39:48.349 INFO:teuthology.orchestra.run.smithi110.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-09T05:39:48.417 INFO:teuthology.orchestra.run.smithi110.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-09T05:39:48.422 INFO:teuthology.orchestra.run.smithi110.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-09T05:39:48.570 INFO:teuthology.orchestra.run.smithi110.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-09T05:39:48.570 INFO:teuthology.orchestra.run.smithi110.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-05-09T05:39:48.570 INFO:teuthology.orchestra.run.smithi110.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-09T05:39:48.603 INFO:teuthology.orchestra.run.smithi110.stdout:done 2024-05-09T05:39:49.110 DEBUG:teuthology.orchestra.run.smithi110:> dpkg -s linux-image-generic 2024-05-09T05:39:49.134 INFO:teuthology.orchestra.run.smithi110.stdout:Package: linux-image-generic 2024-05-09T05:39:49.134 INFO:teuthology.orchestra.run.smithi110.stdout:Status: install ok installed 2024-05-09T05:39:49.134 INFO:teuthology.orchestra.run.smithi110.stdout:Priority: optional 2024-05-09T05:39:49.134 INFO:teuthology.orchestra.run.smithi110.stdout:Section: kernel 2024-05-09T05:39:49.134 INFO:teuthology.orchestra.run.smithi110.stdout:Installed-Size: 21 2024-05-09T05:39:49.134 INFO:teuthology.orchestra.run.smithi110.stdout:Maintainer: Ubuntu Kernel Team 2024-05-09T05:39:49.134 INFO:teuthology.orchestra.run.smithi110.stdout:Architecture: amd64 2024-05-09T05:39:49.134 INFO:teuthology.orchestra.run.smithi110.stdout:Source: linux-meta 2024-05-09T05:39:49.135 INFO:teuthology.orchestra.run.smithi110.stdout:Version: 5.15.0.106.106 2024-05-09T05:39:49.135 INFO:teuthology.orchestra.run.smithi110.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-106), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-05-09T05:39:49.135 INFO:teuthology.orchestra.run.smithi110.stdout:Depends: linux-image-5.15.0-106-generic, linux-modules-extra-5.15.0-106-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-09T05:39:49.135 INFO:teuthology.orchestra.run.smithi110.stdout:Recommends: thermald 2024-05-09T05:39:49.135 INFO:teuthology.orchestra.run.smithi110.stdout:Description: Generic Linux kernel image 2024-05-09T05:39:49.135 INFO:teuthology.orchestra.run.smithi110.stdout: This package will always depend on the latest generic kernel image 2024-05-09T05:39:49.135 INFO:teuthology.orchestra.run.smithi110.stdout: available. 2024-05-09T05:39:49.135 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-106-generic 2024-05-09T05:39:49.135 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-09T05:39:49.135 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-09T05:39:49.135 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-05-09T05:39:49.136 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi110.front.sepia.ceph.com, path=None, version=distro) 2024-05-09T05:39:49.136 DEBUG:teuthology.orchestra.run.smithi110:> sudo apt-get clean 2024-05-09T05:39:49.350 DEBUG:teuthology.orchestra.run.smithi110:> sudo apt-get update 2024-05-09T05:39:49.483 INFO:teuthology.orchestra.run.smithi110.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-09T05:39:49.495 INFO:teuthology.orchestra.run.smithi110.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-09T05:39:49.516 INFO:teuthology.orchestra.run.smithi110.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-09T05:39:49.597 INFO:teuthology.orchestra.run.smithi110.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-09T05:39:50.861 INFO:teuthology.orchestra.run.smithi110.stdout:Reading package lists... 2024-05-09T05:39:50.879 DEBUG:teuthology.orchestra.run.smithi110:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-09T05:39:50.938 INFO:teuthology.orchestra.run.smithi110.stdout:Reading package lists... 2024-05-09T05:39:51.139 INFO:teuthology.orchestra.run.smithi110.stdout:Building dependency tree... 2024-05-09T05:39:51.139 INFO:teuthology.orchestra.run.smithi110.stdout:Reading state information... 2024-05-09T05:39:51.317 INFO:teuthology.orchestra.run.smithi110.stdout:linux-image-generic is already the newest version (5.15.0.106.106). 2024-05-09T05:39:51.317 INFO:teuthology.orchestra.run.smithi110.stdout:The following packages were automatically installed and are no longer required: 2024-05-09T05:39:51.317 INFO:teuthology.orchestra.run.smithi110.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-09T05:39:51.317 INFO:teuthology.orchestra.run.smithi110.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-09T05:39:51.317 INFO:teuthology.orchestra.run.smithi110.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-09T05:39:51.318 INFO:teuthology.orchestra.run.smithi110.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-09T05:39:51.318 INFO:teuthology.orchestra.run.smithi110.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-09T05:39:51.318 INFO:teuthology.orchestra.run.smithi110.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-09T05:39:51.358 INFO:teuthology.orchestra.run.smithi110.stdout:0 upgraded, 0 newly installed, 0 to remove and 316 not upgraded. 2024-05-09T05:39:51.360 DEBUG:teuthology.orchestra.run.smithi110:> dpkg -s linux-image-generic 2024-05-09T05:39:51.418 INFO:teuthology.orchestra.run.smithi110.stdout:Package: linux-image-generic 2024-05-09T05:39:51.419 INFO:teuthology.orchestra.run.smithi110.stdout:Status: install ok installed 2024-05-09T05:39:51.419 INFO:teuthology.orchestra.run.smithi110.stdout:Priority: optional 2024-05-09T05:39:51.419 INFO:teuthology.orchestra.run.smithi110.stdout:Section: kernel 2024-05-09T05:39:51.419 INFO:teuthology.orchestra.run.smithi110.stdout:Installed-Size: 21 2024-05-09T05:39:51.419 INFO:teuthology.orchestra.run.smithi110.stdout:Maintainer: Ubuntu Kernel Team 2024-05-09T05:39:51.419 INFO:teuthology.orchestra.run.smithi110.stdout:Architecture: amd64 2024-05-09T05:39:51.419 INFO:teuthology.orchestra.run.smithi110.stdout:Source: linux-meta 2024-05-09T05:39:51.419 INFO:teuthology.orchestra.run.smithi110.stdout:Version: 5.15.0.106.106 2024-05-09T05:39:51.419 INFO:teuthology.orchestra.run.smithi110.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-106), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-05-09T05:39:51.419 INFO:teuthology.orchestra.run.smithi110.stdout:Depends: linux-image-5.15.0-106-generic, linux-modules-extra-5.15.0-106-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-09T05:39:51.419 INFO:teuthology.orchestra.run.smithi110.stdout:Recommends: thermald 2024-05-09T05:39:51.420 INFO:teuthology.orchestra.run.smithi110.stdout:Description: Generic Linux kernel image 2024-05-09T05:39:51.420 INFO:teuthology.orchestra.run.smithi110.stdout: This package will always depend on the latest generic kernel image 2024-05-09T05:39:51.420 INFO:teuthology.orchestra.run.smithi110.stdout: available. 2024-05-09T05:39:51.420 DEBUG:teuthology.orchestra.run.smithi110:> mktemp 2024-05-09T05:39:51.464 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/tmp.N1KoEKuOPB 2024-05-09T05:39:51.465 DEBUG:teuthology.orchestra.run.smithi110:> sudo cp /boot/grub/grub.cfg /tmp/tmp.N1KoEKuOPB 2024-05-09T05:39:51.521 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0666 /tmp/tmp.N1KoEKuOPB 2024-05-09T05:39:51.632 DEBUG:teuthology.orchestra.remote:smithi110:/tmp/tmp.N1KoEKuOPB is 10KB 2024-05-09T05:39:51.682 DEBUG:teuthology.orchestra.run.smithi110:> rm -fr /tmp/tmp.N1KoEKuOPB 2024-05-09T05:39:51.687 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-05-09T05:39:51.741 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-05-09T05:39:51.741 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-05-09T05:39:51.741 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-05-09T05:39:51.831 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-106-generic 2024-05-09T05:39:51.831 DEBUG:teuthology.orchestra.run.smithi110:> sudo update-grub 2024-05-09T05:39:53.301 INFO:teuthology.orchestra.run.smithi110.stderr:Sourcing file `/etc/default/grub' 2024-05-09T05:39:53.302 INFO:teuthology.orchestra.run.smithi110.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-09T05:39:53.318 INFO:teuthology.orchestra.run.smithi110.stderr:Generating grub configuration file ... 2024-05-09T05:39:53.510 INFO:teuthology.orchestra.run.smithi110.stderr:Found linux image: /boot/vmlinuz-5.15.0-106-generic 2024-05-09T05:39:53.515 INFO:teuthology.orchestra.run.smithi110.stderr:Found initrd image: /boot/initrd.img-5.15.0-106-generic 2024-05-09T05:39:53.828 INFO:teuthology.orchestra.run.smithi110.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-09T05:39:53.833 INFO:teuthology.orchestra.run.smithi110.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-09T05:39:53.876 INFO:teuthology.orchestra.run.smithi110.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-09T05:39:53.881 INFO:teuthology.orchestra.run.smithi110.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-09T05:39:54.002 INFO:teuthology.orchestra.run.smithi110.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-09T05:39:54.002 INFO:teuthology.orchestra.run.smithi110.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-05-09T05:39:54.002 INFO:teuthology.orchestra.run.smithi110.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-09T05:39:54.013 INFO:teuthology.orchestra.run.smithi110.stderr:done 2024-05-09T05:39:54.025 DEBUG:teuthology.orchestra.run.smithi110:> sudo shutdown -r now 2024-05-09T05:39:58.310 INFO:teuthology.orchestra.run.smithi072.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-05-09T05:39:58.310 INFO:teuthology.orchestra.run.smithi072.stdout:Sourcing file `/etc/default/grub' 2024-05-09T05:39:58.333 INFO:teuthology.orchestra.run.smithi072.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-09T05:39:58.346 INFO:teuthology.orchestra.run.smithi072.stdout:Generating grub configuration file ... 2024-05-09T05:39:58.644 INFO:teuthology.orchestra.run.smithi072.stdout:Found linux image: /boot/vmlinuz-5.15.0-106-generic 2024-05-09T05:39:58.688 INFO:teuthology.orchestra.run.smithi072.stdout:Found initrd image: /boot/initrd.img-5.15.0-106-generic 2024-05-09T05:39:59.019 INFO:teuthology.orchestra.run.smithi072.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-09T05:39:59.025 INFO:teuthology.orchestra.run.smithi072.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-09T05:39:59.110 INFO:teuthology.orchestra.run.smithi072.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-09T05:39:59.116 INFO:teuthology.orchestra.run.smithi072.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-09T05:39:59.395 INFO:teuthology.orchestra.run.smithi072.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-09T05:39:59.395 INFO:teuthology.orchestra.run.smithi072.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-05-09T05:39:59.396 INFO:teuthology.orchestra.run.smithi072.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-09T05:39:59.482 INFO:teuthology.orchestra.run.smithi072.stdout:done 2024-05-09T05:40:00.050 DEBUG:teuthology.orchestra.run.smithi072:> dpkg -s linux-image-generic 2024-05-09T05:40:00.083 INFO:teuthology.orchestra.run.smithi072.stdout:Package: linux-image-generic 2024-05-09T05:40:00.084 INFO:teuthology.orchestra.run.smithi072.stdout:Status: install ok installed 2024-05-09T05:40:00.084 INFO:teuthology.orchestra.run.smithi072.stdout:Priority: optional 2024-05-09T05:40:00.084 INFO:teuthology.orchestra.run.smithi072.stdout:Section: kernel 2024-05-09T05:40:00.084 INFO:teuthology.orchestra.run.smithi072.stdout:Installed-Size: 21 2024-05-09T05:40:00.084 INFO:teuthology.orchestra.run.smithi072.stdout:Maintainer: Ubuntu Kernel Team 2024-05-09T05:40:00.084 INFO:teuthology.orchestra.run.smithi072.stdout:Architecture: amd64 2024-05-09T05:40:00.084 INFO:teuthology.orchestra.run.smithi072.stdout:Source: linux-meta 2024-05-09T05:40:00.084 INFO:teuthology.orchestra.run.smithi072.stdout:Version: 5.15.0.106.106 2024-05-09T05:40:00.084 INFO:teuthology.orchestra.run.smithi072.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-106), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-05-09T05:40:00.084 INFO:teuthology.orchestra.run.smithi072.stdout:Depends: linux-image-5.15.0-106-generic, linux-modules-extra-5.15.0-106-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-09T05:40:00.084 INFO:teuthology.orchestra.run.smithi072.stdout:Recommends: thermald 2024-05-09T05:40:00.085 INFO:teuthology.orchestra.run.smithi072.stdout:Description: Generic Linux kernel image 2024-05-09T05:40:00.085 INFO:teuthology.orchestra.run.smithi072.stdout: This package will always depend on the latest generic kernel image 2024-05-09T05:40:00.085 INFO:teuthology.orchestra.run.smithi072.stdout: available. 2024-05-09T05:40:00.085 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-106-generic 2024-05-09T05:40:00.085 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-09T05:40:00.085 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-09T05:40:00.085 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-05-09T05:40:00.085 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi072.front.sepia.ceph.com, path=None, version=distro) 2024-05-09T05:40:00.085 DEBUG:teuthology.orchestra.run.smithi072:> sudo apt-get clean 2024-05-09T05:40:00.252 DEBUG:teuthology.orchestra.run.smithi072:> sudo apt-get update 2024-05-09T05:40:00.370 INFO:teuthology.orchestra.run.smithi072.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-09T05:40:00.493 INFO:teuthology.orchestra.run.smithi072.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-09T05:40:00.567 INFO:teuthology.orchestra.run.smithi072.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-09T05:40:00.650 INFO:teuthology.orchestra.run.smithi072.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-09T05:40:01.761 INFO:teuthology.orchestra.run.smithi072.stdout:Reading package lists... 2024-05-09T05:40:01.778 DEBUG:teuthology.orchestra.run.smithi072:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-09T05:40:01.838 INFO:teuthology.orchestra.run.smithi072.stdout:Reading package lists... 2024-05-09T05:40:02.039 INFO:teuthology.orchestra.run.smithi072.stdout:Building dependency tree... 2024-05-09T05:40:02.040 INFO:teuthology.orchestra.run.smithi072.stdout:Reading state information... 2024-05-09T05:40:02.221 INFO:teuthology.orchestra.run.smithi072.stdout:linux-image-generic is already the newest version (5.15.0.106.106). 2024-05-09T05:40:02.221 INFO:teuthology.orchestra.run.smithi072.stdout:The following packages were automatically installed and are no longer required: 2024-05-09T05:40:02.221 INFO:teuthology.orchestra.run.smithi072.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-09T05:40:02.221 INFO:teuthology.orchestra.run.smithi072.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-09T05:40:02.221 INFO:teuthology.orchestra.run.smithi072.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-09T05:40:02.221 INFO:teuthology.orchestra.run.smithi072.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-09T05:40:02.221 INFO:teuthology.orchestra.run.smithi072.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-09T05:40:02.222 INFO:teuthology.orchestra.run.smithi072.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-09T05:40:02.263 INFO:teuthology.orchestra.run.smithi072.stdout:0 upgraded, 0 newly installed, 0 to remove and 316 not upgraded. 2024-05-09T05:40:02.265 DEBUG:teuthology.orchestra.run.smithi072:> dpkg -s linux-image-generic 2024-05-09T05:40:02.281 INFO:teuthology.orchestra.run.smithi072.stdout:Package: linux-image-generic 2024-05-09T05:40:02.281 INFO:teuthology.orchestra.run.smithi072.stdout:Status: install ok installed 2024-05-09T05:40:02.281 INFO:teuthology.orchestra.run.smithi072.stdout:Priority: optional 2024-05-09T05:40:02.281 INFO:teuthology.orchestra.run.smithi072.stdout:Section: kernel 2024-05-09T05:40:02.281 INFO:teuthology.orchestra.run.smithi072.stdout:Installed-Size: 21 2024-05-09T05:40:02.281 INFO:teuthology.orchestra.run.smithi072.stdout:Maintainer: Ubuntu Kernel Team 2024-05-09T05:40:02.281 INFO:teuthology.orchestra.run.smithi072.stdout:Architecture: amd64 2024-05-09T05:40:02.281 INFO:teuthology.orchestra.run.smithi072.stdout:Source: linux-meta 2024-05-09T05:40:02.281 INFO:teuthology.orchestra.run.smithi072.stdout:Version: 5.15.0.106.106 2024-05-09T05:40:02.281 INFO:teuthology.orchestra.run.smithi072.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-106), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-05-09T05:40:02.282 INFO:teuthology.orchestra.run.smithi072.stdout:Depends: linux-image-5.15.0-106-generic, linux-modules-extra-5.15.0-106-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-09T05:40:02.282 INFO:teuthology.orchestra.run.smithi072.stdout:Recommends: thermald 2024-05-09T05:40:02.282 INFO:teuthology.orchestra.run.smithi072.stdout:Description: Generic Linux kernel image 2024-05-09T05:40:02.282 INFO:teuthology.orchestra.run.smithi072.stdout: This package will always depend on the latest generic kernel image 2024-05-09T05:40:02.282 INFO:teuthology.orchestra.run.smithi072.stdout: available. 2024-05-09T05:40:02.282 DEBUG:teuthology.orchestra.run.smithi072:> mktemp 2024-05-09T05:40:02.328 INFO:teuthology.orchestra.run.smithi072.stdout:/tmp/tmp.gdeRnjQCzE 2024-05-09T05:40:02.328 DEBUG:teuthology.orchestra.run.smithi072:> sudo cp /boot/grub/grub.cfg /tmp/tmp.gdeRnjQCzE 2024-05-09T05:40:02.384 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 0666 /tmp/tmp.gdeRnjQCzE 2024-05-09T05:40:02.519 DEBUG:teuthology.orchestra.remote:smithi072:/tmp/tmp.gdeRnjQCzE is 10KB 2024-05-09T05:40:02.532 DEBUG:teuthology.orchestra.run.smithi072:> rm -fr /tmp/tmp.gdeRnjQCzE 2024-05-09T05:40:02.538 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-05-09T05:40:02.592 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-09T05:40:02.592 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-05-09T05:40:02.592 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-05-09T05:40:02.689 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-106-generic 2024-05-09T05:40:02.689 DEBUG:teuthology.orchestra.run.smithi072:> sudo update-grub 2024-05-09T05:40:04.855 INFO:teuthology.orchestra.run.smithi072.stderr:Sourcing file `/etc/default/grub' 2024-05-09T05:40:04.866 INFO:teuthology.orchestra.run.smithi072.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-09T05:40:04.879 INFO:teuthology.orchestra.run.smithi072.stderr:Generating grub configuration file ... 2024-05-09T05:40:05.100 INFO:teuthology.orchestra.run.smithi072.stderr:Found linux image: /boot/vmlinuz-5.15.0-106-generic 2024-05-09T05:40:05.106 INFO:teuthology.orchestra.run.smithi072.stderr:Found initrd image: /boot/initrd.img-5.15.0-106-generic 2024-05-09T05:40:05.333 INFO:teuthology.orchestra.run.smithi072.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-09T05:40:05.338 INFO:teuthology.orchestra.run.smithi072.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-09T05:40:05.381 INFO:teuthology.orchestra.run.smithi072.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-09T05:40:05.386 INFO:teuthology.orchestra.run.smithi072.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-09T05:40:05.512 INFO:teuthology.orchestra.run.smithi072.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-09T05:40:05.512 INFO:teuthology.orchestra.run.smithi072.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-05-09T05:40:05.512 INFO:teuthology.orchestra.run.smithi072.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-09T05:40:05.545 INFO:teuthology.orchestra.run.smithi072.stderr:done 2024-05-09T05:40:05.547 DEBUG:teuthology.orchestra.run.smithi072:> sudo shutdown -r now 2024-05-09T05:40:24.089 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-05-09T05:40:24.089 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-05-09T05:40:24.090 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T05:40:35.562 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-05-09T05:40:35.562 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-05-09T05:40:35.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T05:40:42.654 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.110 2024-05-09T05:40:51.662 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-05-09T05:40:51.663 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T05:40:53.918 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-05-09T05:40:54.724 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.110 2024-05-09T05:41:02.926 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-05-09T05:41:02.927 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T05:41:05.982 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-05-09T05:41:06.849 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-05-09T05:41:06.850 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T05:41:17.990 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-05-09T05:41:17.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T05:41:36.414 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-05-09T05:41:39.025 DEBUG:teuthology.orchestra.run.smithi110:> true 2024-05-09T05:41:39.651 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-05-09T05:41:39.651 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-106-generic"... 2024-05-09T05:41:39.652 DEBUG:teuthology.orchestra.run.smithi110:> uname -r 2024-05-09T05:41:39.696 INFO:teuthology.orchestra.run.smithi110.stdout:5.15.0-106-generic 2024-05-09T05:41:39.697 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-106-generic vs 5.15.0-106-generic 2024-05-09T05:41:39.697 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-09T05:41:39.697 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-05-09T05:41:40.698 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-05-09T05:41:40.698 DEBUG:teuthology.orchestra.run.smithi110:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-09T05:41:40.794 INFO:teuthology.orchestra.run.smithi110.stdout:ttyS1 2024-05-09T05:41:40.875 DEBUG:teuthology.parallel:result is None 2024-05-09T05:41:51.416 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-05-09T05:41:51.417 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T05:41:51.419 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-05-09T05:42:09.419 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-05-09T05:42:09.420 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T05:42:09.656 DEBUG:teuthology.orchestra.run.smithi072:> true 2024-05-09T05:42:10.358 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-05-09T05:42:10.358 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-106-generic"... 2024-05-09T05:42:10.359 DEBUG:teuthology.orchestra.run.smithi072:> uname -r 2024-05-09T05:42:10.403 INFO:teuthology.orchestra.run.smithi072.stdout:5.15.0-106-generic 2024-05-09T05:42:10.404 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-106-generic vs 5.15.0-106-generic 2024-05-09T05:42:10.404 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-09T05:42:10.404 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-05-09T05:42:11.404 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-05-09T05:42:11.405 DEBUG:teuthology.orchestra.run.smithi072:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-09T05:42:11.516 INFO:teuthology.orchestra.run.smithi072.stdout:ttyS1 2024-05-09T05:42:11.542 DEBUG:teuthology.parallel:result is None 2024-05-09T05:42:11.542 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-09T05:42:11.549 INFO:teuthology.task.internal:Creating test directory... 2024-05-09T05:42:11.549 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-09T05:42:11.551 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-09T05:42:11.558 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-09T05:42:11.594 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-09T05:42:11.636 INFO:teuthology.task.internal:Creating archive directory... 2024-05-09T05:42:11.636 DEBUG:teuthology.orchestra.run.smithi072:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-09T05:42:11.638 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-09T05:42:11.743 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-09T05:42:11.750 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-09T05:42:11.750 DEBUG:teuthology.orchestra.run.smithi072:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-09T05:42:11.752 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-09T05:42:11.770 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-09T05:42:11.774 INFO:teuthology.orchestra.run.smithi072.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-09T05:42:11.778 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-09T05:42:11.784 INFO:teuthology.orchestra.run.smithi072.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-09T05:42:11.786 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-09T05:42:11.792 INFO:teuthology.task.internal:Configuring sudo... 2024-05-09T05:42:11.793 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-09T05:42:11.832 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-09T05:42:11.845 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-09T05:42:11.854 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-09T05:42:11.854 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-09T05:42:11.893 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-09T05:42:11.898 DEBUG:teuthology.orchestra.run.smithi072:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-09T05:42:11.944 DEBUG:teuthology.orchestra.run.smithi072:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-09T05:42:11.992 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-09T05:42:11.992 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-09T05:42:12.057 DEBUG:teuthology.orchestra.run.smithi110:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-09T05:42:12.063 DEBUG:teuthology.orchestra.run.smithi110:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-09T05:42:12.113 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-05-09T05:42:12.113 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-09T05:42:12.187 DEBUG:teuthology.orchestra.run.smithi072:> sudo service rsyslog restart 2024-05-09T05:42:12.189 DEBUG:teuthology.orchestra.run.smithi110:> sudo service rsyslog restart 2024-05-09T05:42:12.264 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-09T05:42:12.271 INFO:teuthology.task.internal:Starting timer... 2024-05-09T05:42:12.271 INFO:teuthology.run_tasks:Running task pcp... 2024-05-09T05:42:12.323 INFO:teuthology.run_tasks:Running task selinux... 2024-05-09T05:42:12.355 DEBUG:teuthology.task.selinux:Excluding smithi072: OS 'ubuntu' does not support SELinux 2024-05-09T05:42:12.355 DEBUG:teuthology.task.selinux:Excluding smithi110: OS 'ubuntu' does not support SELinux 2024-05-09T05:42:12.355 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-09T05:42:12.355 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-05-09T05:42:12.356 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-09T05:42:12.356 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-09T05:42:12.389 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-05-09T05:42:12.394 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-05-09T05:42:12.552 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-09T05:42:12.568 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-09T05:42:12.570 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi072.front.sepia.ceph.com,smithi110.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-09T05:49:23.529 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi072.front.sepia.ceph.com'), Remote(name='ubuntu@smithi110.front.sepia.ceph.com')] 2024-05-09T05:49:23.531 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-05-09T05:49:23.532 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T05:49:23.616 DEBUG:teuthology.orchestra.run.smithi072:> true 2024-05-09T05:49:23.694 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-05-09T05:49:23.695 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-05-09T05:49:23.695 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T05:49:23.779 DEBUG:teuthology.orchestra.run.smithi110:> true 2024-05-09T05:49:23.854 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-05-09T05:49:23.854 INFO:teuthology.run_tasks:Running task clock... 2024-05-09T05:49:23.869 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-09T05:49:23.869 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-09T05:49:23.870 DEBUG:teuthology.orchestra.run.smithi072:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-09T05:49:23.873 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-09T05:49:23.873 DEBUG:teuthology.orchestra.run.smithi110:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-09T05:49:23.899 INFO:teuthology.orchestra.run.smithi072.stdout: 9 May 05:49:23 ntpd[17263]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-05-09T05:49:23.899 INFO:teuthology.orchestra.run.smithi072.stdout: 9 May 05:49:23 ntpd[17263]: Command line: ntpd -gq 2024-05-09T05:49:23.899 INFO:teuthology.orchestra.run.smithi072.stdout: 9 May 05:49:23 ntpd[17263]: ---------------------------------------------------- 2024-05-09T05:49:23.899 INFO:teuthology.orchestra.run.smithi072.stdout: 9 May 05:49:23 ntpd[17263]: ntp-4 is maintained by Network Time Foundation, 2024-05-09T05:49:23.899 INFO:teuthology.orchestra.run.smithi072.stdout: 9 May 05:49:23 ntpd[17263]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-05-09T05:49:23.899 INFO:teuthology.orchestra.run.smithi072.stdout: 9 May 05:49:23 ntpd[17263]: corporation. Support and training for ntp-4 are 2024-05-09T05:49:23.900 INFO:teuthology.orchestra.run.smithi072.stdout: 9 May 05:49:23 ntpd[17263]: available at https://www.nwtime.org/support 2024-05-09T05:49:23.900 INFO:teuthology.orchestra.run.smithi072.stdout: 9 May 05:49:23 ntpd[17263]: ---------------------------------------------------- 2024-05-09T05:49:23.901 INFO:teuthology.orchestra.run.smithi072.stdout: 9 May 05:49:23 ntpd[17263]: proto: precision = 0.045 usec (-24) 2024-05-09T05:49:23.901 INFO:teuthology.orchestra.run.smithi072.stdout: 9 May 05:49:23 ntpd[17263]: basedate set to 2022-02-04 2024-05-09T05:49:23.901 INFO:teuthology.orchestra.run.smithi072.stdout: 9 May 05:49:23 ntpd[17263]: gps base set to 2022-02-06 (week 2196) 2024-05-09T05:49:23.901 INFO:teuthology.orchestra.run.smithi072.stdout: 9 May 05:49:23 ntpd[17263]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-09T05:49:23.902 INFO:teuthology.orchestra.run.smithi072.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-09T05:49:23.902 INFO:teuthology.orchestra.run.smithi072.stderr:restrict ::: KOD does nothing without LIMITED. 2024-05-09T05:49:23.904 INFO:teuthology.orchestra.run.smithi072.stdout: 9 May 05:49:23 ntpd[17263]: restrict ::: KOD does nothing without LIMITED. 2024-05-09T05:49:23.904 INFO:teuthology.orchestra.run.smithi072.stdout: 9 May 05:49:23 ntpd[17263]: Listen and drop on 0 v6wildcard [::]:123 2024-05-09T05:49:23.904 INFO:teuthology.orchestra.run.smithi072.stdout: 9 May 05:49:23 ntpd[17263]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-05-09T05:49:23.904 INFO:teuthology.orchestra.run.smithi072.stdout: 9 May 05:49:23 ntpd[17263]: Listen normally on 2 lo 127.0.0.1:123 2024-05-09T05:49:23.904 INFO:teuthology.orchestra.run.smithi072.stdout: 9 May 05:49:23 ntpd[17263]: Listen normally on 3 enp3s0f1 172.21.15.72:123 2024-05-09T05:49:23.904 INFO:teuthology.orchestra.run.smithi072.stdout: 9 May 05:49:23 ntpd[17263]: Listen normally on 4 lo [::1]:123 2024-05-09T05:49:23.904 INFO:teuthology.orchestra.run.smithi072.stdout: 9 May 05:49:23 ntpd[17263]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:b765%5]:123 2024-05-09T05:49:23.904 INFO:teuthology.orchestra.run.smithi072.stdout: 9 May 05:49:23 ntpd[17263]: Listening on routing socket on fd #22 for interface updates 2024-05-09T05:49:23.925 INFO:teuthology.orchestra.run.smithi110.stdout: 9 May 05:49:23 ntpd[17237]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-05-09T05:49:23.925 INFO:teuthology.orchestra.run.smithi110.stdout: 9 May 05:49:23 ntpd[17237]: Command line: ntpd -gq 2024-05-09T05:49:23.925 INFO:teuthology.orchestra.run.smithi110.stdout: 9 May 05:49:23 ntpd[17237]: ---------------------------------------------------- 2024-05-09T05:49:23.925 INFO:teuthology.orchestra.run.smithi110.stdout: 9 May 05:49:23 ntpd[17237]: ntp-4 is maintained by Network Time Foundation, 2024-05-09T05:49:23.925 INFO:teuthology.orchestra.run.smithi110.stdout: 9 May 05:49:23 ntpd[17237]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-05-09T05:49:23.925 INFO:teuthology.orchestra.run.smithi110.stdout: 9 May 05:49:23 ntpd[17237]: corporation. Support and training for ntp-4 are 2024-05-09T05:49:23.926 INFO:teuthology.orchestra.run.smithi110.stdout: 9 May 05:49:23 ntpd[17237]: available at https://www.nwtime.org/support 2024-05-09T05:49:23.926 INFO:teuthology.orchestra.run.smithi110.stdout: 9 May 05:49:23 ntpd[17237]: ---------------------------------------------------- 2024-05-09T05:49:23.926 INFO:teuthology.orchestra.run.smithi110.stdout: 9 May 05:49:23 ntpd[17237]: proto: precision = 0.060 usec (-24) 2024-05-09T05:49:23.926 INFO:teuthology.orchestra.run.smithi110.stdout: 9 May 05:49:23 ntpd[17237]: basedate set to 2022-02-04 2024-05-09T05:49:23.926 INFO:teuthology.orchestra.run.smithi110.stdout: 9 May 05:49:23 ntpd[17237]: gps base set to 2022-02-06 (week 2196) 2024-05-09T05:49:23.927 INFO:teuthology.orchestra.run.smithi110.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-09T05:49:23.927 INFO:teuthology.orchestra.run.smithi110.stdout: 9 May 05:49:23 ntpd[17237]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-09T05:49:23.927 INFO:teuthology.orchestra.run.smithi110.stderr:restrict ::: KOD does nothing without LIMITED. 2024-05-09T05:49:23.928 INFO:teuthology.orchestra.run.smithi110.stdout: 9 May 05:49:23 ntpd[17237]: restrict ::: KOD does nothing without LIMITED. 2024-05-09T05:49:23.928 INFO:teuthology.orchestra.run.smithi110.stdout: 9 May 05:49:23 ntpd[17237]: Listen and drop on 0 v6wildcard [::]:123 2024-05-09T05:49:23.928 INFO:teuthology.orchestra.run.smithi110.stdout: 9 May 05:49:23 ntpd[17237]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-05-09T05:49:23.929 INFO:teuthology.orchestra.run.smithi110.stdout: 9 May 05:49:23 ntpd[17237]: Listen normally on 2 lo 127.0.0.1:123 2024-05-09T05:49:23.929 INFO:teuthology.orchestra.run.smithi110.stdout: 9 May 05:49:23 ntpd[17237]: Listen normally on 3 enp3s0f1 172.21.15.110:123 2024-05-09T05:49:23.929 INFO:teuthology.orchestra.run.smithi110.stdout: 9 May 05:49:23 ntpd[17237]: Listen normally on 4 lo [::1]:123 2024-05-09T05:49:23.929 INFO:teuthology.orchestra.run.smithi110.stdout: 9 May 05:49:23 ntpd[17237]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:cc35%5]:123 2024-05-09T05:49:23.929 INFO:teuthology.orchestra.run.smithi110.stdout: 9 May 05:49:23 ntpd[17237]: Listening on routing socket on fd #22 for interface updates 2024-05-09T05:49:24.900 INFO:teuthology.orchestra.run.smithi072.stderr: 9 May 05:49:24 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T05:49:24.900 INFO:teuthology.orchestra.run.smithi072.stderr: 9 May 05:49:24 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T05:49:24.900 INFO:teuthology.orchestra.run.smithi072.stderr: 9 May 05:49:24 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T05:49:24.900 INFO:teuthology.orchestra.run.smithi072.stderr: 9 May 05:49:24 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T05:49:24.900 INFO:teuthology.orchestra.run.smithi072.stderr: 9 May 05:49:24 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T05:49:24.900 INFO:teuthology.orchestra.run.smithi072.stderr: 9 May 05:49:24 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T05:49:24.900 INFO:teuthology.orchestra.run.smithi072.stderr: 9 May 05:49:24 ntpd[17263]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-09T05:49:24.900 INFO:teuthology.orchestra.run.smithi072.stderr: 9 May 05:49:24 ntpd[17263]: can't open /var/log/ntpstats/peerstats.20240509: Permission denied 2024-05-09T05:49:24.926 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 05:49:24 ntpd[17237]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T05:49:24.926 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 05:49:24 ntpd[17237]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T05:49:24.926 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 05:49:24 ntpd[17237]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T05:49:24.926 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 05:49:24 ntpd[17237]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T05:49:24.926 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 05:49:24 ntpd[17237]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T05:49:24.926 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 05:49:24 ntpd[17237]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T05:49:24.927 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 05:49:24 ntpd[17237]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-09T05:49:24.927 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 05:49:24 ntpd[17237]: can't open /var/log/ntpstats/peerstats.20240509: Permission denied 2024-05-09T05:49:24.927 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 05:49:24 ntpd[17237]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T05:49:24.927 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 05:49:24 ntpd[17237]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T05:49:24.927 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 05:49:24 ntpd[17237]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-09T05:49:24.927 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 05:49:24 ntpd[17237]: can't open /var/log/ntpstats/peerstats.20240509: Permission denied 2024-05-09T05:49:26.900 INFO:teuthology.orchestra.run.smithi072.stderr: 9 May 05:49:26 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T05:49:26.900 INFO:teuthology.orchestra.run.smithi072.stderr: 9 May 05:49:26 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T05:49:26.900 INFO:teuthology.orchestra.run.smithi072.stderr: 9 May 05:49:26 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T05:49:26.900 INFO:teuthology.orchestra.run.smithi072.stderr: 9 May 05:49:26 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T05:49:26.901 INFO:teuthology.orchestra.run.smithi072.stderr: 9 May 05:49:26 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T05:49:26.901 INFO:teuthology.orchestra.run.smithi072.stderr: 9 May 05:49:26 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T05:49:26.901 INFO:teuthology.orchestra.run.smithi072.stderr: 9 May 05:49:26 ntpd[17263]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-09T05:49:26.901 INFO:teuthology.orchestra.run.smithi072.stderr: 9 May 05:49:26 ntpd[17263]: can't open /var/log/ntpstats/peerstats.20240509: Permission denied 2024-05-09T05:49:26.901 INFO:teuthology.orchestra.run.smithi072.stderr: 9 May 05:49:26 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T05:49:26.901 INFO:teuthology.orchestra.run.smithi072.stderr: 9 May 05:49:26 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T05:49:26.901 INFO:teuthology.orchestra.run.smithi072.stderr: 9 May 05:49:26 ntpd[17263]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-09T05:49:26.901 INFO:teuthology.orchestra.run.smithi072.stderr: 9 May 05:49:26 ntpd[17263]: can't open /var/log/ntpstats/peerstats.20240509: Permission denied 2024-05-09T05:49:26.926 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 05:49:26 ntpd[17237]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T05:49:26.926 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 05:49:26 ntpd[17237]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T05:49:26.926 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 05:49:26 ntpd[17237]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T05:49:26.926 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 05:49:26 ntpd[17237]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T05:49:26.926 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 05:49:26 ntpd[17237]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T05:49:26.926 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 05:49:26 ntpd[17237]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T05:49:26.926 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 05:49:26 ntpd[17237]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-09T05:49:26.926 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 05:49:26 ntpd[17237]: can't open /var/log/ntpstats/peerstats.20240509: Permission denied 2024-05-09T05:49:26.927 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 05:49:26 ntpd[17237]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T05:49:26.927 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 05:49:26 ntpd[17237]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T05:49:26.927 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 05:49:26 ntpd[17237]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-09T05:49:26.927 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 05:49:26 ntpd[17237]: can't open /var/log/ntpstats/peerstats.20240509: Permission denied 2024-05-09T05:49:27.899 INFO:teuthology.orchestra.run.smithi072.stderr: 9 May 05:49:27 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T05:49:27.900 INFO:teuthology.orchestra.run.smithi072.stderr: 9 May 05:49:27 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T05:49:27.900 INFO:teuthology.orchestra.run.smithi072.stderr: 9 May 05:49:27 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T05:49:27.900 INFO:teuthology.orchestra.run.smithi072.stderr: 9 May 05:49:27 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T05:49:27.900 INFO:teuthology.orchestra.run.smithi072.stderr: 9 May 05:49:27 ntpd[17263]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-09T05:49:27.900 INFO:teuthology.orchestra.run.smithi072.stderr: 9 May 05:49:27 ntpd[17263]: can't open /var/log/ntpstats/peerstats.20240509: Permission denied 2024-05-09T05:49:27.926 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 05:49:27 ntpd[17237]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T05:49:27.926 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 05:49:27 ntpd[17237]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T05:49:27.926 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 05:49:27 ntpd[17237]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T05:49:27.926 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 05:49:27 ntpd[17237]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T05:49:27.926 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 05:49:27 ntpd[17237]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-09T05:49:27.926 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 05:49:27 ntpd[17237]: can't open /var/log/ntpstats/peerstats.20240509: Permission denied 2024-05-09T05:49:28.900 INFO:teuthology.orchestra.run.smithi072.stderr: 9 May 05:49:28 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T05:49:28.900 INFO:teuthology.orchestra.run.smithi072.stderr: 9 May 05:49:28 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T05:49:28.900 INFO:teuthology.orchestra.run.smithi072.stderr: 9 May 05:49:28 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T05:49:28.900 INFO:teuthology.orchestra.run.smithi072.stderr: 9 May 05:49:28 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T05:49:28.900 INFO:teuthology.orchestra.run.smithi072.stderr: 9 May 05:49:28 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T05:49:28.900 INFO:teuthology.orchestra.run.smithi072.stderr: 9 May 05:49:28 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T05:49:28.901 INFO:teuthology.orchestra.run.smithi072.stderr: 9 May 05:49:28 ntpd[17263]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-09T05:49:28.901 INFO:teuthology.orchestra.run.smithi072.stderr: 9 May 05:49:28 ntpd[17263]: can't open /var/log/ntpstats/peerstats.20240509: Permission denied 2024-05-09T05:49:28.901 INFO:teuthology.orchestra.run.smithi072.stderr: 9 May 05:49:28 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T05:49:28.901 INFO:teuthology.orchestra.run.smithi072.stderr: 9 May 05:49:28 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T05:49:28.901 INFO:teuthology.orchestra.run.smithi072.stderr: 9 May 05:49:28 ntpd[17263]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-09T05:49:28.901 INFO:teuthology.orchestra.run.smithi072.stderr: 9 May 05:49:28 ntpd[17263]: can't open /var/log/ntpstats/peerstats.20240509: Permission denied 2024-05-09T05:49:28.926 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 05:49:28 ntpd[17237]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T05:49:28.926 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 05:49:28 ntpd[17237]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T05:49:28.927 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 05:49:28 ntpd[17237]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T05:49:28.927 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 05:49:28 ntpd[17237]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T05:49:28.927 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 05:49:28 ntpd[17237]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T05:49:28.927 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 05:49:28 ntpd[17237]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T05:49:28.927 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 05:49:28 ntpd[17237]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T05:49:28.927 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 05:49:28 ntpd[17237]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T05:49:28.927 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 05:49:28 ntpd[17237]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-09T05:49:28.927 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 05:49:28 ntpd[17237]: can't open /var/log/ntpstats/peerstats.20240509: Permission denied 2024-05-09T05:49:28.927 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 05:49:28 ntpd[17237]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T05:49:28.927 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 05:49:28 ntpd[17237]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T05:49:28.927 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 05:49:28 ntpd[17237]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-09T05:49:28.927 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 05:49:28 ntpd[17237]: can't open /var/log/ntpstats/peerstats.20240509: Permission denied 2024-05-09T05:49:29.899 INFO:teuthology.orchestra.run.smithi072.stderr: 9 May 05:49:29 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T05:49:29.900 INFO:teuthology.orchestra.run.smithi072.stderr: 9 May 05:49:29 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T05:49:29.900 INFO:teuthology.orchestra.run.smithi072.stderr: 9 May 05:49:29 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T05:49:29.900 INFO:teuthology.orchestra.run.smithi072.stderr: 9 May 05:49:29 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T05:49:29.900 INFO:teuthology.orchestra.run.smithi072.stderr: 9 May 05:49:29 ntpd[17263]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-09T05:49:29.900 INFO:teuthology.orchestra.run.smithi072.stderr: 9 May 05:49:29 ntpd[17263]: can't open /var/log/ntpstats/peerstats.20240509: Permission denied 2024-05-09T05:49:29.925 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 05:49:29 ntpd[17237]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T05:49:29.926 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 05:49:29 ntpd[17237]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T05:49:29.926 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 05:49:29 ntpd[17237]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T05:49:29.926 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 05:49:29 ntpd[17237]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T05:49:29.926 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 05:49:29 ntpd[17237]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-09T05:49:29.926 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 05:49:29 ntpd[17237]: can't open /var/log/ntpstats/peerstats.20240509: Permission denied 2024-05-09T05:49:30.900 INFO:teuthology.orchestra.run.smithi072.stderr: 9 May 05:49:30 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T05:49:30.900 INFO:teuthology.orchestra.run.smithi072.stderr: 9 May 05:49:30 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T05:49:30.900 INFO:teuthology.orchestra.run.smithi072.stderr: 9 May 05:49:30 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T05:49:30.901 INFO:teuthology.orchestra.run.smithi072.stderr: 9 May 05:49:30 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T05:49:30.901 INFO:teuthology.orchestra.run.smithi072.stderr: 9 May 05:49:30 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T05:49:30.901 INFO:teuthology.orchestra.run.smithi072.stderr: 9 May 05:49:30 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T05:49:30.901 INFO:teuthology.orchestra.run.smithi072.stderr: 9 May 05:49:30 ntpd[17263]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-09T05:49:30.901 INFO:teuthology.orchestra.run.smithi072.stderr: 9 May 05:49:30 ntpd[17263]: can't open /var/log/ntpstats/peerstats.20240509: Permission denied 2024-05-09T05:49:30.901 INFO:teuthology.orchestra.run.smithi072.stderr: 9 May 05:49:30 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T05:49:30.901 INFO:teuthology.orchestra.run.smithi072.stderr: 9 May 05:49:30 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T05:49:30.901 INFO:teuthology.orchestra.run.smithi072.stderr: 9 May 05:49:30 ntpd[17263]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-09T05:49:30.901 INFO:teuthology.orchestra.run.smithi072.stderr: 9 May 05:49:30 ntpd[17263]: can't open /var/log/ntpstats/peerstats.20240509: Permission denied 2024-05-09T05:49:30.901 INFO:teuthology.orchestra.run.smithi072.stdout: 9 May 05:49:30 ntpd[17263]: ntpd: time slew -0.004272 s 2024-05-09T05:49:30.902 INFO:teuthology.orchestra.run.smithi072.stdout:ntpd: time slew -0.004272s 2024-05-09T05:49:30.902 INFO:teuthology.orchestra.run.smithi072.stderr: 9 May 05:49:30 ntpd[17263]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-05-09T05:49:30.902 INFO:teuthology.orchestra.run.smithi072.stderr: 9 May 05:49:30 ntpd[17263]: can't open /var/log/ntpstats/loopstats.20240509: Permission denied 2024-05-09T05:49:30.926 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 05:49:30 ntpd[17237]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T05:49:30.927 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 05:49:30 ntpd[17237]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T05:49:30.927 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 05:49:30 ntpd[17237]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T05:49:30.927 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 05:49:30 ntpd[17237]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T05:49:30.927 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 05:49:30 ntpd[17237]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T05:49:30.927 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 05:49:30 ntpd[17237]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T05:49:30.927 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 05:49:30 ntpd[17237]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-09T05:49:30.927 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 05:49:30 ntpd[17237]: can't open /var/log/ntpstats/peerstats.20240509: Permission denied 2024-05-09T05:49:30.928 INFO:teuthology.orchestra.run.smithi110.stdout: 9 May 05:49:30 ntpd[17237]: ntpd: time slew +0.002609 s 2024-05-09T05:49:30.928 INFO:teuthology.orchestra.run.smithi110.stdout:ntpd: time slew +0.002609s 2024-05-09T05:49:30.929 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 05:49:30 ntpd[17237]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-05-09T05:49:30.929 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 05:49:30 ntpd[17237]: can't open /var/log/ntpstats/loopstats.20240509: Permission denied 2024-05-09T05:49:30.949 INFO:teuthology.orchestra.run.smithi072.stdout: remote refid st t when poll reach delay offset jitter 2024-05-09T05:49:30.950 INFO:teuthology.orchestra.run.smithi072.stdout:============================================================================== 2024-05-09T05:49:30.950 INFO:teuthology.orchestra.run.smithi072.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-09T05:49:30.950 INFO:teuthology.orchestra.run.smithi072.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-09T05:49:30.950 INFO:teuthology.orchestra.run.smithi072.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-09T05:49:30.950 INFO:teuthology.orchestra.run.smithi072.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-09T05:49:30.987 INFO:teuthology.orchestra.run.smithi110.stdout: remote refid st t when poll reach delay offset jitter 2024-05-09T05:49:30.988 INFO:teuthology.orchestra.run.smithi110.stdout:============================================================================== 2024-05-09T05:49:30.988 INFO:teuthology.orchestra.run.smithi110.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-09T05:49:30.988 INFO:teuthology.orchestra.run.smithi110.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-09T05:49:30.988 INFO:teuthology.orchestra.run.smithi110.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-09T05:49:30.988 INFO:teuthology.orchestra.run.smithi110.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-09T05:49:30.989 INFO:teuthology.run_tasks:Running task install... 2024-05-09T05:49:31.000 DEBUG:teuthology.task.install:project ceph 2024-05-09T05:49:31.000 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'c9da4049f638c0f84bdd9b4e33c42e86046ac554'}} 2024-05-09T05:49:31.000 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'c9da4049f638c0f84bdd9b4e33c42e86046ac554'} 2024-05-09T05:49:31.000 INFO:teuthology.task.install:Using flavor: default 2024-05-09T05:49:31.006 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-09T05:49:31.006 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-05-09T05:49:31.006 DEBUG:teuthology.orchestra.run.smithi072:> sudo apt-key list | grep Ceph 2024-05-09T05:49:31.007 DEBUG:teuthology.orchestra.run.smithi110:> sudo apt-key list | grep Ceph 2024-05-09T05:49:31.064 INFO:teuthology.orchestra.run.smithi072.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-05-09T05:49:31.091 INFO:teuthology.orchestra.run.smithi110.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-05-09T05:49:31.092 INFO:teuthology.orchestra.run.smithi072.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-05-09T05:49:31.092 INFO:teuthology.orchestra.run.smithi072.stdout:uid [ unknown] Ceph.com (release key) 2024-05-09T05:49:31.093 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-05-09T05:49:31.093 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-05-09T05:49:31.094 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=c9da4049f638c0f84bdd9b4e33c42e86046ac554 2024-05-09T05:49:31.145 INFO:teuthology.orchestra.run.smithi110.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-05-09T05:49:31.145 INFO:teuthology.orchestra.run.smithi110.stdout:uid [ unknown] Ceph.com (release key) 2024-05-09T05:49:31.145 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-05-09T05:49:31.145 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-05-09T05:49:31.146 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=c9da4049f638c0f84bdd9b4e33c42e86046ac554 2024-05-09T05:49:31.288 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default/ 2024-05-09T05:49:31.288 INFO:teuthology.task.install.deb:Package version is 19.0.0-3594-gc9da4049-1jammy 2024-05-09T05:49:31.316 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default/ 2024-05-09T05:49:31.316 INFO:teuthology.task.install.deb:Package version is 19.0.0-3594-gc9da4049-1jammy 2024-05-09T05:49:31.645 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-05-09T05:49:31.645 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-05-09T05:49:31.660 DEBUG:teuthology.orchestra.run.smithi110:> sudo apt-get update 2024-05-09T05:49:31.668 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-09T05:49:31.668 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-05-09T05:49:31.682 DEBUG:teuthology.orchestra.run.smithi072:> sudo apt-get update 2024-05-09T05:49:31.857 INFO:teuthology.orchestra.run.smithi110.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-09T05:49:31.858 INFO:teuthology.orchestra.run.smithi072.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-09T05:49:31.949 INFO:teuthology.orchestra.run.smithi110.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-09T05:49:31.966 INFO:teuthology.orchestra.run.smithi072.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-09T05:49:32.033 INFO:teuthology.orchestra.run.smithi110.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-09T05:49:32.050 INFO:teuthology.orchestra.run.smithi072.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-09T05:49:32.065 INFO:teuthology.orchestra.run.smithi110.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy InRelease 2024-05-09T05:49:32.077 INFO:teuthology.orchestra.run.smithi072.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy InRelease 2024-05-09T05:49:32.114 INFO:teuthology.orchestra.run.smithi110.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-09T05:49:32.131 INFO:teuthology.orchestra.run.smithi072.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-09T05:49:32.132 INFO:teuthology.orchestra.run.smithi110.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-05-09T05:49:32.144 INFO:teuthology.orchestra.run.smithi072.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-05-09T05:49:32.200 INFO:teuthology.orchestra.run.smithi110.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy Release.gpg 2024-05-09T05:49:32.215 INFO:teuthology.orchestra.run.smithi072.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy Release.gpg 2024-05-09T05:49:32.266 INFO:teuthology.orchestra.run.smithi110.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,415 B] 2024-05-09T05:49:32.281 INFO:teuthology.orchestra.run.smithi072.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,415 B] 2024-05-09T05:49:32.341 INFO:teuthology.orchestra.run.smithi110.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-05-09T05:49:32.357 INFO:teuthology.orchestra.run.smithi072.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-05-09T05:49:32.503 INFO:teuthology.orchestra.run.smithi110.stdout:Fetched 29.2 kB in 1s (45.3 kB/s) 2024-05-09T05:49:32.515 INFO:teuthology.orchestra.run.smithi072.stdout:Fetched 29.2 kB in 1s (45.5 kB/s) 2024-05-09T05:49:33.484 INFO:teuthology.orchestra.run.smithi110.stdout:Reading package lists... 2024-05-09T05:49:33.499 DEBUG:teuthology.orchestra.run.smithi110:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3594-gc9da4049-1jammy cephadm=19.0.0-3594-gc9da4049-1jammy ceph-mds=19.0.0-3594-gc9da4049-1jammy ceph-mgr=19.0.0-3594-gc9da4049-1jammy ceph-common=19.0.0-3594-gc9da4049-1jammy ceph-fuse=19.0.0-3594-gc9da4049-1jammy ceph-test=19.0.0-3594-gc9da4049-1jammy ceph-volume=19.0.0-3594-gc9da4049-1jammy radosgw=19.0.0-3594-gc9da4049-1jammy python3-rados=19.0.0-3594-gc9da4049-1jammy python3-rgw=19.0.0-3594-gc9da4049-1jammy python3-cephfs=19.0.0-3594-gc9da4049-1jammy python3-rbd=19.0.0-3594-gc9da4049-1jammy libcephfs2=19.0.0-3594-gc9da4049-1jammy libcephfs-dev=19.0.0-3594-gc9da4049-1jammy librados2=19.0.0-3594-gc9da4049-1jammy librbd1=19.0.0-3594-gc9da4049-1jammy rbd-fuse=19.0.0-3594-gc9da4049-1jammy python3-cephfs=19.0.0-3594-gc9da4049-1jammy cephfs-shell=19.0.0-3594-gc9da4049-1jammy cephfs-top=19.0.0-3594-gc9da4049-1jammy cephfs-mirror=19.0.0-3594-gc9da4049-1jammy 2024-05-09T05:49:33.507 INFO:teuthology.orchestra.run.smithi072.stdout:Reading package lists... 2024-05-09T05:49:33.523 DEBUG:teuthology.orchestra.run.smithi072:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3594-gc9da4049-1jammy cephadm=19.0.0-3594-gc9da4049-1jammy ceph-mds=19.0.0-3594-gc9da4049-1jammy ceph-mgr=19.0.0-3594-gc9da4049-1jammy ceph-common=19.0.0-3594-gc9da4049-1jammy ceph-fuse=19.0.0-3594-gc9da4049-1jammy ceph-test=19.0.0-3594-gc9da4049-1jammy ceph-volume=19.0.0-3594-gc9da4049-1jammy radosgw=19.0.0-3594-gc9da4049-1jammy python3-rados=19.0.0-3594-gc9da4049-1jammy python3-rgw=19.0.0-3594-gc9da4049-1jammy python3-cephfs=19.0.0-3594-gc9da4049-1jammy python3-rbd=19.0.0-3594-gc9da4049-1jammy libcephfs2=19.0.0-3594-gc9da4049-1jammy libcephfs-dev=19.0.0-3594-gc9da4049-1jammy librados2=19.0.0-3594-gc9da4049-1jammy librbd1=19.0.0-3594-gc9da4049-1jammy rbd-fuse=19.0.0-3594-gc9da4049-1jammy python3-cephfs=19.0.0-3594-gc9da4049-1jammy cephfs-shell=19.0.0-3594-gc9da4049-1jammy cephfs-top=19.0.0-3594-gc9da4049-1jammy cephfs-mirror=19.0.0-3594-gc9da4049-1jammy 2024-05-09T05:49:33.559 INFO:teuthology.orchestra.run.smithi110.stdout:Reading package lists... 2024-05-09T05:49:33.576 INFO:teuthology.orchestra.run.smithi072.stdout:Reading package lists... 2024-05-09T05:49:33.753 INFO:teuthology.orchestra.run.smithi072.stdout:Building dependency tree... 2024-05-09T05:49:33.753 INFO:teuthology.orchestra.run.smithi072.stdout:Reading state information... 2024-05-09T05:49:33.768 INFO:teuthology.orchestra.run.smithi110.stdout:Building dependency tree... 2024-05-09T05:49:33.768 INFO:teuthology.orchestra.run.smithi110.stdout:Reading state information... 2024-05-09T05:49:33.927 INFO:teuthology.orchestra.run.smithi072.stdout:The following packages were automatically installed and are no longer required: 2024-05-09T05:49:33.928 INFO:teuthology.orchestra.run.smithi072.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-09T05:49:33.928 INFO:teuthology.orchestra.run.smithi072.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-09T05:49:33.928 INFO:teuthology.orchestra.run.smithi072.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-09T05:49:33.928 INFO:teuthology.orchestra.run.smithi072.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-09T05:49:33.929 INFO:teuthology.orchestra.run.smithi072.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-09T05:49:33.929 INFO:teuthology.orchestra.run.smithi072.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-09T05:49:33.930 INFO:teuthology.orchestra.run.smithi072.stdout:The following additional packages will be installed: 2024-05-09T05:49:33.930 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-05-09T05:49:33.930 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-05-09T05:49:33.930 INFO:teuthology.orchestra.run.smithi072.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-05-09T05:49:33.930 INFO:teuthology.orchestra.run.smithi072.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-05-09T05:49:33.931 INFO:teuthology.orchestra.run.smithi072.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-05-09T05:49:33.931 INFO:teuthology.orchestra.run.smithi072.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-05-09T05:49:33.931 INFO:teuthology.orchestra.run.smithi072.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-05-09T05:49:33.931 INFO:teuthology.orchestra.run.smithi072.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-05-09T05:49:33.931 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-05-09T05:49:33.931 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-05-09T05:49:33.931 INFO:teuthology.orchestra.run.smithi072.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-05-09T05:49:33.931 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-05-09T05:49:33.931 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-05-09T05:49:33.931 INFO:teuthology.orchestra.run.smithi072.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-05-09T05:49:33.931 INFO:teuthology.orchestra.run.smithi072.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-05-09T05:49:33.931 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-05-09T05:49:33.931 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-05-09T05:49:33.931 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-05-09T05:49:33.931 INFO:teuthology.orchestra.run.smithi072.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-05-09T05:49:33.932 INFO:teuthology.orchestra.run.smithi072.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-05-09T05:49:33.932 INFO:teuthology.orchestra.run.smithi072.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-05-09T05:49:33.932 INFO:teuthology.orchestra.run.smithi072.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-05-09T05:49:33.932 INFO:teuthology.orchestra.run.smithi072.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-05-09T05:49:33.932 INFO:teuthology.orchestra.run.smithi072.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-05-09T05:49:33.932 INFO:teuthology.orchestra.run.smithi072.stdout:Suggested packages: 2024-05-09T05:49:33.932 INFO:teuthology.orchestra.run.smithi072.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-05-09T05:49:33.932 INFO:teuthology.orchestra.run.smithi072.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-05-09T05:49:33.932 INFO:teuthology.orchestra.run.smithi072.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-05-09T05:49:33.933 INFO:teuthology.orchestra.run.smithi072.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-05-09T05:49:33.933 INFO:teuthology.orchestra.run.smithi072.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-05-09T05:49:33.933 INFO:teuthology.orchestra.run.smithi072.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-05-09T05:49:33.933 INFO:teuthology.orchestra.run.smithi072.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-05-09T05:49:33.933 INFO:teuthology.orchestra.run.smithi072.stdout:Recommended packages: 2024-05-09T05:49:33.933 INFO:teuthology.orchestra.run.smithi072.stdout: btrfs-tools 2024-05-09T05:49:33.959 INFO:teuthology.orchestra.run.smithi110.stdout:The following packages were automatically installed and are no longer required: 2024-05-09T05:49:33.959 INFO:teuthology.orchestra.run.smithi110.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-09T05:49:33.959 INFO:teuthology.orchestra.run.smithi110.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-09T05:49:33.959 INFO:teuthology.orchestra.run.smithi110.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-09T05:49:33.960 INFO:teuthology.orchestra.run.smithi110.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-09T05:49:33.960 INFO:teuthology.orchestra.run.smithi110.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-09T05:49:33.960 INFO:teuthology.orchestra.run.smithi110.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-09T05:49:33.961 INFO:teuthology.orchestra.run.smithi110.stdout:The following additional packages will be installed: 2024-05-09T05:49:33.961 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-05-09T05:49:33.961 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-05-09T05:49:33.961 INFO:teuthology.orchestra.run.smithi110.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-05-09T05:49:33.961 INFO:teuthology.orchestra.run.smithi110.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-05-09T05:49:33.962 INFO:teuthology.orchestra.run.smithi110.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-05-09T05:49:33.962 INFO:teuthology.orchestra.run.smithi110.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-05-09T05:49:33.962 INFO:teuthology.orchestra.run.smithi110.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-05-09T05:49:33.962 INFO:teuthology.orchestra.run.smithi110.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-05-09T05:49:33.962 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-05-09T05:49:33.962 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-05-09T05:49:33.962 INFO:teuthology.orchestra.run.smithi110.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-05-09T05:49:33.962 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-05-09T05:49:33.963 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-05-09T05:49:33.963 INFO:teuthology.orchestra.run.smithi110.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-05-09T05:49:33.963 INFO:teuthology.orchestra.run.smithi110.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-05-09T05:49:33.963 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-05-09T05:49:33.963 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-05-09T05:49:33.963 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-05-09T05:49:33.963 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-05-09T05:49:33.963 INFO:teuthology.orchestra.run.smithi110.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-05-09T05:49:33.963 INFO:teuthology.orchestra.run.smithi110.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-05-09T05:49:33.963 INFO:teuthology.orchestra.run.smithi110.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-05-09T05:49:33.963 INFO:teuthology.orchestra.run.smithi110.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-05-09T05:49:33.963 INFO:teuthology.orchestra.run.smithi110.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-05-09T05:49:33.964 INFO:teuthology.orchestra.run.smithi110.stdout:Suggested packages: 2024-05-09T05:49:33.964 INFO:teuthology.orchestra.run.smithi110.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-05-09T05:49:33.964 INFO:teuthology.orchestra.run.smithi110.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-05-09T05:49:33.964 INFO:teuthology.orchestra.run.smithi110.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-05-09T05:49:33.964 INFO:teuthology.orchestra.run.smithi110.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-05-09T05:49:33.964 INFO:teuthology.orchestra.run.smithi110.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-05-09T05:49:33.964 INFO:teuthology.orchestra.run.smithi110.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-05-09T05:49:33.964 INFO:teuthology.orchestra.run.smithi110.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-05-09T05:49:33.964 INFO:teuthology.orchestra.run.smithi110.stdout:Recommended packages: 2024-05-09T05:49:33.964 INFO:teuthology.orchestra.run.smithi110.stdout: btrfs-tools 2024-05-09T05:49:34.038 INFO:teuthology.orchestra.run.smithi072.stdout:The following NEW packages will be installed: 2024-05-09T05:49:34.038 INFO:teuthology.orchestra.run.smithi072.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-05-09T05:49:34.038 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-05-09T05:49:34.038 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-05-09T05:49:34.038 INFO:teuthology.orchestra.run.smithi072.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-05-09T05:49:34.039 INFO:teuthology.orchestra.run.smithi072.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-05-09T05:49:34.039 INFO:teuthology.orchestra.run.smithi072.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-05-09T05:49:34.039 INFO:teuthology.orchestra.run.smithi072.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-05-09T05:49:34.039 INFO:teuthology.orchestra.run.smithi072.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-05-09T05:49:34.040 INFO:teuthology.orchestra.run.smithi072.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-05-09T05:49:34.040 INFO:teuthology.orchestra.run.smithi072.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-05-09T05:49:34.040 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-05-09T05:49:34.040 INFO:teuthology.orchestra.run.smithi072.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-05-09T05:49:34.040 INFO:teuthology.orchestra.run.smithi072.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-05-09T05:49:34.040 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-05-09T05:49:34.040 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-05-09T05:49:34.040 INFO:teuthology.orchestra.run.smithi072.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-05-09T05:49:34.040 INFO:teuthology.orchestra.run.smithi072.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-05-09T05:49:34.040 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-05-09T05:49:34.041 INFO:teuthology.orchestra.run.smithi072.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-05-09T05:49:34.041 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-05-09T05:49:34.041 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-05-09T05:49:34.041 INFO:teuthology.orchestra.run.smithi072.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-05-09T05:49:34.041 INFO:teuthology.orchestra.run.smithi072.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-05-09T05:49:34.041 INFO:teuthology.orchestra.run.smithi072.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-05-09T05:49:34.041 INFO:teuthology.orchestra.run.smithi072.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-05-09T05:49:34.041 INFO:teuthology.orchestra.run.smithi072.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-05-09T05:49:34.041 INFO:teuthology.orchestra.run.smithi072.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-05-09T05:49:34.041 INFO:teuthology.orchestra.run.smithi072.stdout: socat unzip xmlstarlet zip 2024-05-09T05:49:34.068 INFO:teuthology.orchestra.run.smithi110.stdout:The following NEW packages will be installed: 2024-05-09T05:49:34.068 INFO:teuthology.orchestra.run.smithi110.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-05-09T05:49:34.068 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-05-09T05:49:34.068 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-05-09T05:49:34.068 INFO:teuthology.orchestra.run.smithi110.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-05-09T05:49:34.069 INFO:teuthology.orchestra.run.smithi110.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-05-09T05:49:34.070 INFO:teuthology.orchestra.run.smithi110.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-05-09T05:49:34.070 INFO:teuthology.orchestra.run.smithi110.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-05-09T05:49:34.070 INFO:teuthology.orchestra.run.smithi110.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-05-09T05:49:34.070 INFO:teuthology.orchestra.run.smithi110.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-05-09T05:49:34.070 INFO:teuthology.orchestra.run.smithi110.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-05-09T05:49:34.070 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-05-09T05:49:34.070 INFO:teuthology.orchestra.run.smithi110.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-05-09T05:49:34.070 INFO:teuthology.orchestra.run.smithi110.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-05-09T05:49:34.070 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-05-09T05:49:34.070 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-05-09T05:49:34.070 INFO:teuthology.orchestra.run.smithi110.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-05-09T05:49:34.070 INFO:teuthology.orchestra.run.smithi110.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-05-09T05:49:34.071 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-05-09T05:49:34.071 INFO:teuthology.orchestra.run.smithi110.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-05-09T05:49:34.071 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-05-09T05:49:34.071 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-05-09T05:49:34.071 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-05-09T05:49:34.071 INFO:teuthology.orchestra.run.smithi110.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-05-09T05:49:34.071 INFO:teuthology.orchestra.run.smithi110.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-05-09T05:49:34.071 INFO:teuthology.orchestra.run.smithi110.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-05-09T05:49:34.071 INFO:teuthology.orchestra.run.smithi110.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-05-09T05:49:34.071 INFO:teuthology.orchestra.run.smithi110.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-05-09T05:49:34.071 INFO:teuthology.orchestra.run.smithi110.stdout: socat unzip xmlstarlet zip 2024-05-09T05:49:34.226 INFO:teuthology.orchestra.run.smithi072.stdout:0 upgraded, 124 newly installed, 0 to remove and 303 not upgraded. 2024-05-09T05:49:34.226 INFO:teuthology.orchestra.run.smithi072.stdout:Need to get 175 MB of archives. 2024-05-09T05:49:34.226 INFO:teuthology.orchestra.run.smithi072.stdout:After this operation, 887 MB of additional disk space will be used. 2024-05-09T05:49:34.226 INFO:teuthology.orchestra.run.smithi072.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-05-09T05:49:34.260 INFO:teuthology.orchestra.run.smithi110.stdout:0 upgraded, 124 newly installed, 0 to remove and 303 not upgraded. 2024-05-09T05:49:34.260 INFO:teuthology.orchestra.run.smithi110.stdout:Need to get 175 MB of archives. 2024-05-09T05:49:34.260 INFO:teuthology.orchestra.run.smithi110.stdout:After this operation, 887 MB of additional disk space will be used. 2024-05-09T05:49:34.260 INFO:teuthology.orchestra.run.smithi110.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-05-09T05:49:34.309 INFO:teuthology.orchestra.run.smithi072.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-05-09T05:49:34.342 INFO:teuthology.orchestra.run.smithi110.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-05-09T05:49:34.355 INFO:teuthology.orchestra.run.smithi072.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-05-09T05:49:34.388 INFO:teuthology.orchestra.run.smithi110.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-05-09T05:49:34.418 INFO:teuthology.orchestra.run.smithi110.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3594-gc9da4049-1jammy [3,524 kB] 2024-05-09T05:49:34.499 INFO:teuthology.orchestra.run.smithi072.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3594-gc9da4049-1jammy [3,524 kB] 2024-05-09T05:49:34.559 INFO:teuthology.orchestra.run.smithi072.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-05-09T05:49:34.591 INFO:teuthology.orchestra.run.smithi110.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-05-09T05:49:34.654 INFO:teuthology.orchestra.run.smithi072.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-05-09T05:49:34.667 INFO:teuthology.orchestra.run.smithi072.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-05-09T05:49:34.686 INFO:teuthology.orchestra.run.smithi110.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-05-09T05:49:34.700 INFO:teuthology.orchestra.run.smithi110.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-05-09T05:49:34.720 INFO:teuthology.orchestra.run.smithi072.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-05-09T05:49:34.752 INFO:teuthology.orchestra.run.smithi110.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-05-09T05:49:34.894 INFO:teuthology.orchestra.run.smithi072.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-05-09T05:49:34.903 INFO:teuthology.orchestra.run.smithi072.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-05-09T05:49:34.926 INFO:teuthology.orchestra.run.smithi110.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-05-09T05:49:34.930 INFO:teuthology.orchestra.run.smithi072.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-05-09T05:49:34.935 INFO:teuthology.orchestra.run.smithi110.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-05-09T05:49:34.939 INFO:teuthology.orchestra.run.smithi072.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-05-09T05:49:34.962 INFO:teuthology.orchestra.run.smithi110.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-05-09T05:49:34.970 INFO:teuthology.orchestra.run.smithi110.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-05-09T05:49:35.112 INFO:teuthology.orchestra.run.smithi072.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-05-09T05:49:35.136 INFO:teuthology.orchestra.run.smithi110.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-05-09T05:49:35.688 INFO:teuthology.orchestra.run.smithi072.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-05-09T05:49:35.703 INFO:teuthology.orchestra.run.smithi072.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-05-09T05:49:35.706 INFO:teuthology.orchestra.run.smithi110.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-05-09T05:49:35.719 INFO:teuthology.orchestra.run.smithi072.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-05-09T05:49:35.721 INFO:teuthology.orchestra.run.smithi110.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-05-09T05:49:35.728 INFO:teuthology.orchestra.run.smithi072.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-05-09T05:49:35.729 INFO:teuthology.orchestra.run.smithi072.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-05-09T05:49:35.737 INFO:teuthology.orchestra.run.smithi110.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-05-09T05:49:35.745 INFO:teuthology.orchestra.run.smithi072.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-05-09T05:49:35.746 INFO:teuthology.orchestra.run.smithi110.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-05-09T05:49:35.746 INFO:teuthology.orchestra.run.smithi110.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-05-09T05:49:35.763 INFO:teuthology.orchestra.run.smithi110.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-05-09T05:49:35.783 INFO:teuthology.orchestra.run.smithi072.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-05-09T05:49:35.796 INFO:teuthology.orchestra.run.smithi072.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-05-09T05:49:35.800 INFO:teuthology.orchestra.run.smithi072.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-05-09T05:49:35.801 INFO:teuthology.orchestra.run.smithi072.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-05-09T05:49:35.802 INFO:teuthology.orchestra.run.smithi110.stdout:Get:20 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3594-gc9da4049-1jammy [3,288 kB] 2024-05-09T05:49:35.883 INFO:teuthology.orchestra.run.smithi110.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-05-09T05:49:35.903 INFO:teuthology.orchestra.run.smithi110.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-05-09T05:49:35.905 INFO:teuthology.orchestra.run.smithi110.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-05-09T05:49:35.905 INFO:teuthology.orchestra.run.smithi110.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-05-09T05:49:35.973 INFO:teuthology.orchestra.run.smithi072.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-05-09T05:49:36.057 INFO:teuthology.orchestra.run.smithi072.stdout:Get:25 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3594-gc9da4049-1jammy [3,288 kB] 2024-05-09T05:49:36.063 INFO:teuthology.orchestra.run.smithi072.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-05-09T05:49:36.072 INFO:teuthology.orchestra.run.smithi110.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-05-09T05:49:36.080 INFO:teuthology.orchestra.run.smithi072.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-05-09T05:49:36.145 INFO:teuthology.orchestra.run.smithi072.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-05-09T05:49:36.155 INFO:teuthology.orchestra.run.smithi110.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-05-09T05:49:36.170 INFO:teuthology.orchestra.run.smithi110.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-05-09T05:49:36.182 INFO:teuthology.orchestra.run.smithi072.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-05-09T05:49:36.205 INFO:teuthology.orchestra.run.smithi072.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-05-09T05:49:36.229 INFO:teuthology.orchestra.run.smithi072.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-05-09T05:49:36.237 INFO:teuthology.orchestra.run.smithi110.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-05-09T05:49:36.264 INFO:teuthology.orchestra.run.smithi110.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-05-09T05:49:36.282 INFO:teuthology.orchestra.run.smithi110.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-05-09T05:49:36.305 INFO:teuthology.orchestra.run.smithi110.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-05-09T05:49:36.415 INFO:teuthology.orchestra.run.smithi072.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-05-09T05:49:36.430 INFO:teuthology.orchestra.run.smithi072.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-05-09T05:49:36.437 INFO:teuthology.orchestra.run.smithi072.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-05-09T05:49:36.443 INFO:teuthology.orchestra.run.smithi072.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-05-09T05:49:36.463 INFO:teuthology.orchestra.run.smithi110.stdout:Get:32 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3594-gc9da4049-1jammy [727 kB] 2024-05-09T05:49:36.486 INFO:teuthology.orchestra.run.smithi110.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-05-09T05:49:36.502 INFO:teuthology.orchestra.run.smithi110.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-05-09T05:49:36.509 INFO:teuthology.orchestra.run.smithi110.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-05-09T05:49:36.513 INFO:teuthology.orchestra.run.smithi110.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-05-09T05:49:36.570 INFO:teuthology.orchestra.run.smithi110.stdout:Get:37 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3594-gc9da4049-1jammy [356 kB] 2024-05-09T05:49:36.609 INFO:teuthology.orchestra.run.smithi110.stdout:Get:38 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3594-gc9da4049-1jammy [32.8 kB] 2024-05-09T05:49:36.614 INFO:teuthology.orchestra.run.smithi110.stdout:Get:39 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3594-gc9da4049-1jammy [180 kB] 2024-05-09T05:49:36.627 INFO:teuthology.orchestra.run.smithi072.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-05-09T05:49:36.646 INFO:teuthology.orchestra.run.smithi110.stdout:Get:40 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3594-gc9da4049-1jammy [67.4 kB] 2024-05-09T05:49:36.656 INFO:teuthology.orchestra.run.smithi110.stdout:Get:41 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3594-gc9da4049-1jammy [334 kB] 2024-05-09T05:49:36.699 INFO:teuthology.orchestra.run.smithi110.stdout:Get:42 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3594-gc9da4049-1jammy [7,183 kB] 2024-05-09T05:49:36.699 INFO:teuthology.orchestra.run.smithi110.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-05-09T05:49:36.711 INFO:teuthology.orchestra.run.smithi072.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-05-09T05:49:36.727 INFO:teuthology.orchestra.run.smithi072.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-05-09T05:49:36.787 INFO:teuthology.orchestra.run.smithi110.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-05-09T05:49:36.798 INFO:teuthology.orchestra.run.smithi072.stdout:Get:39 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3594-gc9da4049-1jammy [727 kB] 2024-05-09T05:49:36.804 INFO:teuthology.orchestra.run.smithi110.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-05-09T05:49:36.912 INFO:teuthology.orchestra.run.smithi072.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-05-09T05:49:36.961 INFO:teuthology.orchestra.run.smithi072.stdout:Get:41 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3594-gc9da4049-1jammy [356 kB] 2024-05-09T05:49:36.963 INFO:teuthology.orchestra.run.smithi072.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-05-09T05:49:36.977 INFO:teuthology.orchestra.run.smithi072.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-05-09T05:49:36.979 INFO:teuthology.orchestra.run.smithi072.stdout:Get:44 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3594-gc9da4049-1jammy [32.8 kB] 2024-05-09T05:49:36.981 INFO:teuthology.orchestra.run.smithi072.stdout:Get:45 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3594-gc9da4049-1jammy [180 kB] 2024-05-09T05:49:36.990 INFO:teuthology.orchestra.run.smithi110.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-05-09T05:49:37.041 INFO:teuthology.orchestra.run.smithi110.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-05-09T05:49:37.054 INFO:teuthology.orchestra.run.smithi110.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-05-09T05:49:37.057 INFO:teuthology.orchestra.run.smithi072.stdout:Get:46 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3594-gc9da4049-1jammy [67.4 kB] 2024-05-09T05:49:37.060 INFO:teuthology.orchestra.run.smithi072.stdout:Get:47 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3594-gc9da4049-1jammy [334 kB] 2024-05-09T05:49:37.135 INFO:teuthology.orchestra.run.smithi072.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-05-09T05:49:37.136 INFO:teuthology.orchestra.run.smithi072.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-05-09T05:49:37.141 INFO:teuthology.orchestra.run.smithi072.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-05-09T05:49:37.142 INFO:teuthology.orchestra.run.smithi072.stdout:Get:51 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3594-gc9da4049-1jammy [7,183 kB] 2024-05-09T05:49:37.145 INFO:teuthology.orchestra.run.smithi072.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-05-09T05:49:37.160 INFO:teuthology.orchestra.run.smithi072.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-05-09T05:49:37.212 INFO:teuthology.orchestra.run.smithi110.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-05-09T05:49:37.212 INFO:teuthology.orchestra.run.smithi110.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-05-09T05:49:37.216 INFO:teuthology.orchestra.run.smithi110.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-05-09T05:49:37.222 INFO:teuthology.orchestra.run.smithi110.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-05-09T05:49:37.236 INFO:teuthology.orchestra.run.smithi110.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-05-09T05:49:37.346 INFO:teuthology.orchestra.run.smithi072.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-05-09T05:49:37.420 INFO:teuthology.orchestra.run.smithi110.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-05-09T05:49:37.572 INFO:teuthology.orchestra.run.smithi110.stdout:Get:55 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3594-gc9da4049-1jammy [112 kB] 2024-05-09T05:49:37.589 INFO:teuthology.orchestra.run.smithi110.stdout:Get:56 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3594-gc9da4049-1jammy [471 kB] 2024-05-09T05:49:37.601 INFO:teuthology.orchestra.run.smithi072.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-05-09T05:49:37.644 INFO:teuthology.orchestra.run.smithi110.stdout:Get:57 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3594-gc9da4049-1jammy [25.6 MB] 2024-05-09T05:49:37.699 INFO:teuthology.orchestra.run.smithi110.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-05-09T05:49:37.714 INFO:teuthology.orchestra.run.smithi072.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-05-09T05:49:37.757 INFO:teuthology.orchestra.run.smithi072.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-05-09T05:49:37.820 INFO:teuthology.orchestra.run.smithi110.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-05-09T05:49:37.839 INFO:teuthology.orchestra.run.smithi072.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-05-09T05:49:37.852 INFO:teuthology.orchestra.run.smithi072.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-05-09T05:49:37.865 INFO:teuthology.orchestra.run.smithi110.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-05-09T05:49:37.866 INFO:teuthology.orchestra.run.smithi072.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-05-09T05:49:37.905 INFO:teuthology.orchestra.run.smithi072.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-05-09T05:49:37.946 INFO:teuthology.orchestra.run.smithi110.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-05-09T05:49:37.958 INFO:teuthology.orchestra.run.smithi110.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-05-09T05:49:37.971 INFO:teuthology.orchestra.run.smithi110.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-05-09T05:49:37.992 INFO:teuthology.orchestra.run.smithi072.stdout:Get:62 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3594-gc9da4049-1jammy [112 kB] 2024-05-09T05:49:37.995 INFO:teuthology.orchestra.run.smithi072.stdout:Get:63 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3594-gc9da4049-1jammy [471 kB] 2024-05-09T05:49:38.011 INFO:teuthology.orchestra.run.smithi110.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-05-09T05:49:38.065 INFO:teuthology.orchestra.run.smithi072.stdout:Get:64 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3594-gc9da4049-1jammy [25.6 MB] 2024-05-09T05:49:38.166 INFO:teuthology.orchestra.run.smithi072.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-05-09T05:49:38.168 INFO:teuthology.orchestra.run.smithi072.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-05-09T05:49:38.171 INFO:teuthology.orchestra.run.smithi072.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-05-09T05:49:38.276 INFO:teuthology.orchestra.run.smithi110.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-05-09T05:49:38.278 INFO:teuthology.orchestra.run.smithi110.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-05-09T05:49:38.281 INFO:teuthology.orchestra.run.smithi110.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-05-09T05:49:38.336 INFO:teuthology.orchestra.run.smithi072.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-05-09T05:49:38.448 INFO:teuthology.orchestra.run.smithi110.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-05-09T05:49:38.674 INFO:teuthology.orchestra.run.smithi072.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-05-09T05:49:38.784 INFO:teuthology.orchestra.run.smithi110.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-05-09T05:49:39.070 INFO:teuthology.orchestra.run.smithi072.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-05-09T05:49:39.080 INFO:teuthology.orchestra.run.smithi072.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-05-09T05:49:39.081 INFO:teuthology.orchestra.run.smithi072.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-05-09T05:49:39.150 INFO:teuthology.orchestra.run.smithi072.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-05-09T05:49:39.151 INFO:teuthology.orchestra.run.smithi072.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-05-09T05:49:39.153 INFO:teuthology.orchestra.run.smithi072.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-05-09T05:49:39.154 INFO:teuthology.orchestra.run.smithi072.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-05-09T05:49:39.156 INFO:teuthology.orchestra.run.smithi072.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-05-09T05:49:39.202 INFO:teuthology.orchestra.run.smithi110.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-05-09T05:49:39.214 INFO:teuthology.orchestra.run.smithi110.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-05-09T05:49:39.215 INFO:teuthology.orchestra.run.smithi110.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-05-09T05:49:39.284 INFO:teuthology.orchestra.run.smithi110.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-05-09T05:49:39.285 INFO:teuthology.orchestra.run.smithi110.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-05-09T05:49:39.286 INFO:teuthology.orchestra.run.smithi110.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-05-09T05:49:39.287 INFO:teuthology.orchestra.run.smithi110.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-05-09T05:49:39.289 INFO:teuthology.orchestra.run.smithi110.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-05-09T05:49:39.290 INFO:teuthology.orchestra.run.smithi110.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-05-09T05:49:39.323 INFO:teuthology.orchestra.run.smithi072.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-05-09T05:49:39.409 INFO:teuthology.orchestra.run.smithi072.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-05-09T05:49:39.456 INFO:teuthology.orchestra.run.smithi110.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-05-09T05:49:39.506 INFO:teuthology.orchestra.run.smithi072.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-05-09T05:49:39.670 INFO:teuthology.orchestra.run.smithi110.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-05-09T05:49:39.752 INFO:teuthology.orchestra.run.smithi072.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-05-09T05:49:39.794 INFO:teuthology.orchestra.run.smithi072.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-05-09T05:49:39.819 INFO:teuthology.orchestra.run.smithi072.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-05-09T05:49:39.828 INFO:teuthology.orchestra.run.smithi072.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-05-09T05:49:39.872 INFO:teuthology.orchestra.run.smithi072.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-05-09T05:49:39.897 INFO:teuthology.orchestra.run.smithi072.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-05-09T05:49:39.899 INFO:teuthology.orchestra.run.smithi072.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-05-09T05:49:39.905 INFO:teuthology.orchestra.run.smithi072.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-05-09T05:49:39.989 INFO:teuthology.orchestra.run.smithi110.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-05-09T05:49:40.034 INFO:teuthology.orchestra.run.smithi110.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-05-09T05:49:40.061 INFO:teuthology.orchestra.run.smithi110.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-05-09T05:49:40.071 INFO:teuthology.orchestra.run.smithi110.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-05-09T05:49:40.072 INFO:teuthology.orchestra.run.smithi072.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-05-09T05:49:40.117 INFO:teuthology.orchestra.run.smithi110.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-05-09T05:49:40.142 INFO:teuthology.orchestra.run.smithi110.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-05-09T05:49:40.144 INFO:teuthology.orchestra.run.smithi110.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-05-09T05:49:40.150 INFO:teuthology.orchestra.run.smithi110.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-05-09T05:49:40.154 INFO:teuthology.orchestra.run.smithi110.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-05-09T05:49:40.352 INFO:teuthology.orchestra.run.smithi110.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-05-09T05:49:40.409 INFO:teuthology.orchestra.run.smithi072.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3594-gc9da4049-1jammy [4,917 kB] 2024-05-09T05:49:40.607 INFO:teuthology.orchestra.run.smithi072.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-05-09T05:49:40.612 INFO:teuthology.orchestra.run.smithi110.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-05-09T05:49:40.613 INFO:teuthology.orchestra.run.smithi072.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-05-09T05:49:40.652 INFO:teuthology.orchestra.run.smithi072.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-05-09T05:49:40.653 INFO:teuthology.orchestra.run.smithi072.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-05-09T05:49:40.659 INFO:teuthology.orchestra.run.smithi072.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-05-09T05:49:40.661 INFO:teuthology.orchestra.run.smithi072.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-05-09T05:49:40.703 INFO:teuthology.orchestra.run.smithi072.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-05-09T05:49:40.712 INFO:teuthology.orchestra.run.smithi072.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-05-09T05:49:40.772 INFO:teuthology.orchestra.run.smithi072.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3594-gc9da4049-1jammy [244 kB] 2024-05-09T05:49:40.786 INFO:teuthology.orchestra.run.smithi072.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3594-gc9da4049-1jammy [125 kB] 2024-05-09T05:49:40.786 INFO:teuthology.orchestra.run.smithi072.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-05-09T05:49:40.786 INFO:teuthology.orchestra.run.smithi072.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-05-09T05:49:40.788 INFO:teuthology.orchestra.run.smithi072.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3594-gc9da4049-1jammy [1,543 kB] 2024-05-09T05:49:40.851 INFO:teuthology.orchestra.run.smithi110.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-05-09T05:49:40.854 INFO:teuthology.orchestra.run.smithi110.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-05-09T05:49:40.888 INFO:teuthology.orchestra.run.smithi110.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-05-09T05:49:40.892 INFO:teuthology.orchestra.run.smithi110.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-05-09T05:49:40.926 INFO:teuthology.orchestra.run.smithi110.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-05-09T05:49:40.937 INFO:teuthology.orchestra.run.smithi072.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3594-gc9da4049-1jammy [6,149 kB] 2024-05-09T05:49:40.942 INFO:teuthology.orchestra.run.smithi110.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-05-09T05:49:40.950 INFO:teuthology.orchestra.run.smithi072.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-05-09T05:49:41.071 INFO:teuthology.orchestra.run.smithi110.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-05-09T05:49:41.071 INFO:teuthology.orchestra.run.smithi110.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-05-09T05:49:41.072 INFO:teuthology.orchestra.run.smithi110.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-05-09T05:49:41.138 INFO:teuthology.orchestra.run.smithi110.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3594-gc9da4049-1jammy [4,917 kB] 2024-05-09T05:49:41.299 INFO:teuthology.orchestra.run.smithi110.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-05-09T05:49:41.393 INFO:teuthology.orchestra.run.smithi072.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-05-09T05:49:41.408 INFO:teuthology.orchestra.run.smithi072.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-05-09T05:49:41.492 INFO:teuthology.orchestra.run.smithi072.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3594-gc9da4049-1jammy [22.5 MB] 2024-05-09T05:49:41.585 INFO:teuthology.orchestra.run.smithi110.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-05-09T05:49:41.663 INFO:teuthology.orchestra.run.smithi110.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3594-gc9da4049-1jammy [244 kB] 2024-05-09T05:49:41.692 INFO:teuthology.orchestra.run.smithi110.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3594-gc9da4049-1jammy [125 kB] 2024-05-09T05:49:41.712 INFO:teuthology.orchestra.run.smithi110.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3594-gc9da4049-1jammy [1,543 kB] 2024-05-09T05:49:41.909 INFO:teuthology.orchestra.run.smithi110.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3594-gc9da4049-1jammy [6,149 kB] 2024-05-09T05:49:42.650 INFO:teuthology.orchestra.run.smithi110.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3594-gc9da4049-1jammy [22.5 MB] 2024-05-09T05:49:43.819 INFO:teuthology.orchestra.run.smithi072.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3594-gc9da4049-1jammy [14.0 kB] 2024-05-09T05:49:43.820 INFO:teuthology.orchestra.run.smithi072.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3594-gc9da4049-1jammy [857 kB] 2024-05-09T05:49:43.837 INFO:teuthology.orchestra.run.smithi072.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3594-gc9da4049-1jammy [2,368 kB] 2024-05-09T05:49:44.041 INFO:teuthology.orchestra.run.smithi072.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3594-gc9da4049-1jammy [792 kB] 2024-05-09T05:49:44.146 INFO:teuthology.orchestra.run.smithi072.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3594-gc9da4049-1jammy [148 kB] 2024-05-09T05:49:44.157 INFO:teuthology.orchestra.run.smithi072.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3594-gc9da4049-1jammy [2,279 kB] 2024-05-09T05:49:44.376 INFO:teuthology.orchestra.run.smithi072.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3594-gc9da4049-1jammy [8,625 kB] 2024-05-09T05:49:45.061 INFO:teuthology.orchestra.run.smithi110.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3594-gc9da4049-1jammy [14.0 kB] 2024-05-09T05:49:45.061 INFO:teuthology.orchestra.run.smithi110.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3594-gc9da4049-1jammy [857 kB] 2024-05-09T05:49:45.078 INFO:teuthology.orchestra.run.smithi110.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3594-gc9da4049-1jammy [2,368 kB] 2024-05-09T05:49:45.213 INFO:teuthology.orchestra.run.smithi072.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3594-gc9da4049-1jammy [14.2 kB] 2024-05-09T05:49:45.213 INFO:teuthology.orchestra.run.smithi072.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3594-gc9da4049-1jammy [44.9 MB] 2024-05-09T05:49:45.287 INFO:teuthology.orchestra.run.smithi110.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3594-gc9da4049-1jammy [792 kB] 2024-05-09T05:49:45.373 INFO:teuthology.orchestra.run.smithi110.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3594-gc9da4049-1jammy [148 kB] 2024-05-09T05:49:45.390 INFO:teuthology.orchestra.run.smithi110.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3594-gc9da4049-1jammy [2,279 kB] 2024-05-09T05:49:45.642 INFO:teuthology.orchestra.run.smithi110.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3594-gc9da4049-1jammy [8,625 kB] 2024-05-09T05:49:46.611 INFO:teuthology.orchestra.run.smithi110.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3594-gc9da4049-1jammy [14.2 kB] 2024-05-09T05:49:46.612 INFO:teuthology.orchestra.run.smithi110.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3594-gc9da4049-1jammy [44.9 MB] 2024-05-09T05:49:49.959 INFO:teuthology.orchestra.run.smithi072.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3594-gc9da4049-1jammy [124 kB] 2024-05-09T05:49:49.961 INFO:teuthology.orchestra.run.smithi072.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-3594-gc9da4049-1jammy [236 kB] 2024-05-09T05:49:49.966 INFO:teuthology.orchestra.run.smithi072.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-3594-gc9da4049-1jammy [33.9 kB] 2024-05-09T05:49:49.967 INFO:teuthology.orchestra.run.smithi072.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-3594-gc9da4049-1jammy [23.4 kB] 2024-05-09T05:49:49.968 INFO:teuthology.orchestra.run.smithi072.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3594-gc9da4049-1jammy [38.9 kB] 2024-05-09T05:49:49.969 INFO:teuthology.orchestra.run.smithi072.stdout:Get:123 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3594-gc9da4049-1jammy [14.1 MB] 2024-05-09T05:49:51.184 INFO:teuthology.orchestra.run.smithi072.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3594-gc9da4049-1jammy [92.7 kB] 2024-05-09T05:49:51.538 INFO:teuthology.orchestra.run.smithi110.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3594-gc9da4049-1jammy [124 kB] 2024-05-09T05:49:51.540 INFO:teuthology.orchestra.run.smithi110.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-3594-gc9da4049-1jammy [236 kB] 2024-05-09T05:49:51.546 INFO:teuthology.orchestra.run.smithi110.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-3594-gc9da4049-1jammy [33.9 kB] 2024-05-09T05:49:51.546 INFO:teuthology.orchestra.run.smithi110.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-3594-gc9da4049-1jammy [23.4 kB] 2024-05-09T05:49:51.547 INFO:teuthology.orchestra.run.smithi110.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3594-gc9da4049-1jammy [38.9 kB] 2024-05-09T05:49:51.548 INFO:teuthology.orchestra.run.smithi110.stdout:Get:123 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3594-gc9da4049-1jammy [14.1 MB] 2024-05-09T05:49:51.793 INFO:teuthology.orchestra.run.smithi072.stdout:Fetched 175 MB in 17s (10.2 MB/s) 2024-05-09T05:49:51.932 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-pyperclip. 2024-05-09T05:49:52.028 INFO:teuthology.orchestra.run.smithi072.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-05-09T05:49:52.033 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-05-09T05:49:52.237 INFO:teuthology.orchestra.run.smithi110.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3594-gc9da4049-1jammy [92.7 kB] 2024-05-09T05:49:52.309 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-05-09T05:49:52.621 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-wcwidth. 2024-05-09T05:49:52.648 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-05-09T05:49:52.688 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-09T05:49:52.929 INFO:teuthology.orchestra.run.smithi110.stdout:Fetched 175 MB in 18s (9,584 kB/s) 2024-05-09T05:49:52.976 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-cmd2. 2024-05-09T05:49:52.991 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-05-09T05:49:53.026 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-05-09T05:49:53.067 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pyperclip. 2024-05-09T05:49:53.165 INFO:teuthology.orchestra.run.smithi110.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-05-09T05:49:53.171 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-05-09T05:49:53.215 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-05-09T05:49:53.350 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-05-09T05:49:53.376 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-05-09T05:49:53.459 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-09T05:49:53.468 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-wcwidth. 2024-05-09T05:49:53.494 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-05-09T05:49:53.527 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-09T05:49:53.808 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-05-09T05:49:53.829 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-cmd2. 2024-05-09T05:49:53.834 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-05-09T05:49:53.856 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-05-09T05:49:53.883 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-09T05:49:53.920 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-05-09T05:49:54.197 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-05-09T05:49:54.223 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-05-09T05:49:54.264 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-09T05:49:54.273 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-05-09T05:49:54.300 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-05-09T05:49:54.382 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-09T05:49:54.705 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-05-09T05:49:54.727 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-05-09T05:49:54.731 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-09T05:49:54.754 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-05-09T05:49:54.780 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-09T05:49:54.827 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-09T05:49:55.155 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-05-09T05:49:55.182 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-05-09T05:49:55.212 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-05-09T05:49:55.222 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-09T05:49:55.238 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-09T05:49:55.279 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-09T05:49:55.628 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-05-09T05:49:55.633 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-05-09T05:49:55.654 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-09T05:49:55.659 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-09T05:49:55.694 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-09T05:49:55.708 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-09T05:49:56.016 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-05-09T05:49:56.043 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-05-09T05:49:56.083 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-09T05:49:56.103 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-05-09T05:49:56.130 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-09T05:49:56.170 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-09T05:49:56.446 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package librados2. 2024-05-09T05:49:56.472 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../010-librados2_19.0.0-3594-gc9da4049-1jammy_amd64.deb ... 2024-05-09T05:49:56.498 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-05-09T05:49:56.515 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking librados2 (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:49:56.524 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-09T05:49:56.564 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-09T05:49:56.876 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-05-09T05:49:56.902 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-05-09T05:49:56.942 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-09T05:49:57.072 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package librbd1. 2024-05-09T05:49:57.098 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../011-librbd1_19.0.0-3594-gc9da4049-1jammy_amd64.deb ... 2024-05-09T05:49:57.138 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking librbd1 (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:49:57.262 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package librados2. 2024-05-09T05:49:57.289 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../010-librados2_19.0.0-3594-gc9da4049-1jammy_amd64.deb ... 2024-05-09T05:49:57.329 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking librados2 (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:49:57.993 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package librbd1. 2024-05-09T05:49:58.017 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../011-librbd1_19.0.0-3594-gc9da4049-1jammy_amd64.deb ... 2024-05-09T05:49:58.057 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking librbd1 (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:49:58.069 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libcephfs2. 2024-05-09T05:49:58.096 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-3594-gc9da4049-1jammy_amd64.deb ... 2024-05-09T05:49:58.135 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libcephfs2 (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:49:58.408 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-rados. 2024-05-09T05:49:58.424 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../013-python3-rados_19.0.0-3594-gc9da4049-1jammy_amd64.deb ... 2024-05-09T05:49:58.458 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-rados (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:49:58.476 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libcephfs2. 2024-05-09T05:49:58.492 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-3594-gc9da4049-1jammy_amd64.deb ... 2024-05-09T05:49:58.534 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libcephfs2 (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:49:58.763 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-05-09T05:49:58.789 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-3594-gc9da4049-1jammy_all.deb ... 2024-05-09T05:49:58.830 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-ceph-argparse (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:49:58.854 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-rados. 2024-05-09T05:49:58.869 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../013-python3-rados_19.0.0-3594-gc9da4049-1jammy_amd64.deb ... 2024-05-09T05:49:58.920 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-rados (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:49:59.069 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-cephfs. 2024-05-09T05:49:59.084 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-3594-gc9da4049-1jammy_amd64.deb ... 2024-05-09T05:49:59.127 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-cephfs (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:49:59.248 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-05-09T05:49:59.275 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-3594-gc9da4049-1jammy_all.deb ... 2024-05-09T05:49:59.315 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-ceph-argparse (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:49:59.424 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-ceph-common. 2024-05-09T05:49:59.451 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-3594-gc9da4049-1jammy_all.deb ... 2024-05-09T05:49:59.492 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-ceph-common (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:49:59.559 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-cephfs. 2024-05-09T05:49:59.575 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-3594-gc9da4049-1jammy_amd64.deb ... 2024-05-09T05:49:59.609 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-cephfs (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:49:59.806 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-prettytable. 2024-05-09T05:49:59.833 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-05-09T05:49:59.861 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-ceph-common. 2024-05-09T05:49:59.877 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-3594-gc9da4049-1jammy_all.deb ... 2024-05-09T05:49:59.881 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-05-09T05:49:59.920 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-ceph-common (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:50:00.137 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-rbd. 2024-05-09T05:50:00.164 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-3594-gc9da4049-1jammy_amd64.deb ... 2024-05-09T05:50:00.204 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-rbd (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:50:00.215 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-prettytable. 2024-05-09T05:50:00.241 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-05-09T05:50:00.281 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-05-09T05:50:00.500 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-rbd. 2024-05-09T05:50:00.513 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-3594-gc9da4049-1jammy_amd64.deb ... 2024-05-09T05:50:00.526 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-05-09T05:50:00.542 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-rbd (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:50:00.553 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-05-09T05:50:00.601 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-09T05:50:00.882 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-05-09T05:50:00.886 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-05-09T05:50:00.908 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-05-09T05:50:00.913 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-05-09T05:50:00.949 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-05-09T05:50:00.953 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-09T05:50:01.239 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-05-09T05:50:01.256 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-05-09T05:50:01.266 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-05-09T05:50:01.283 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-05-09T05:50:01.306 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-05-09T05:50:01.339 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-09T05:50:01.608 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-05-09T05:50:01.624 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-05-09T05:50:01.658 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-09T05:50:01.661 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package lua5.1. 2024-05-09T05:50:01.688 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-05-09T05:50:01.728 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-05-09T05:50:02.004 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package lua5.1. 2024-05-09T05:50:02.030 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-05-09T05:50:02.044 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package lua-any. 2024-05-09T05:50:02.070 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-05-09T05:50:02.070 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-05-09T05:50:02.111 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking lua-any (27ubuntu1) ... 2024-05-09T05:50:02.358 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package zip. 2024-05-09T05:50:02.373 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-05-09T05:50:02.390 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package lua-any. 2024-05-09T05:50:02.417 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking zip (3.0-12build2) ... 2024-05-09T05:50:02.417 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-05-09T05:50:02.478 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking lua-any (27ubuntu1) ... 2024-05-09T05:50:02.731 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package unzip. 2024-05-09T05:50:02.734 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package zip. 2024-05-09T05:50:02.750 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-05-09T05:50:02.757 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-05-09T05:50:02.792 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking zip (3.0-12build2) ... 2024-05-09T05:50:02.798 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-05-09T05:50:03.246 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package unzip. 2024-05-09T05:50:03.248 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package luarocks. 2024-05-09T05:50:03.273 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-05-09T05:50:03.274 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-05-09T05:50:03.312 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-05-09T05:50:03.323 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-05-09T05:50:03.699 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package librgw2. 2024-05-09T05:50:03.708 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package luarocks. 2024-05-09T05:50:03.726 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../027-librgw2_19.0.0-3594-gc9da4049-1jammy_amd64.deb ... 2024-05-09T05:50:03.735 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-05-09T05:50:03.765 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking librgw2 (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:50:03.774 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-05-09T05:50:04.124 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package librgw2. 2024-05-09T05:50:04.151 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../027-librgw2_19.0.0-3594-gc9da4049-1jammy_amd64.deb ... 2024-05-09T05:50:04.190 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking librgw2 (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:50:04.578 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-rgw. 2024-05-09T05:50:04.593 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-3594-gc9da4049-1jammy_amd64.deb ... 2024-05-09T05:50:04.636 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-rgw (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:50:04.818 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-rgw. 2024-05-09T05:50:04.845 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-3594-gc9da4049-1jammy_amd64.deb ... 2024-05-09T05:50:04.885 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-rgw (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:50:04.968 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package liboath0:amd64. 2024-05-09T05:50:04.994 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-05-09T05:50:05.035 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-05-09T05:50:05.238 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package liboath0:amd64. 2024-05-09T05:50:05.265 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-05-09T05:50:05.313 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-05-09T05:50:05.342 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libradosstriper1. 2024-05-09T05:50:05.368 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-3594-gc9da4049-1jammy_amd64.deb ... 2024-05-09T05:50:05.408 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libradosstriper1 (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:50:05.574 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libradosstriper1. 2024-05-09T05:50:05.601 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-3594-gc9da4049-1jammy_amd64.deb ... 2024-05-09T05:50:05.633 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libradosstriper1 (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:50:05.831 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-common. 2024-05-09T05:50:05.857 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../031-ceph-common_19.0.0-3594-gc9da4049-1jammy_amd64.deb ... 2024-05-09T05:50:05.897 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-common (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:50:06.069 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-common. 2024-05-09T05:50:06.096 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../031-ceph-common_19.0.0-3594-gc9da4049-1jammy_amd64.deb ... 2024-05-09T05:50:06.135 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-common (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:50:08.233 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-base. 2024-05-09T05:50:08.260 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../032-ceph-base_19.0.0-3594-gc9da4049-1jammy_amd64.deb ... 2024-05-09T05:50:08.309 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-base (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:50:09.020 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-05-09T05:50:09.047 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-05-09T05:50:09.087 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-05-09T05:50:09.390 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-cheroot. 2024-05-09T05:50:09.402 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-base. 2024-05-09T05:50:09.416 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-05-09T05:50:09.429 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../032-ceph-base_19.0.0-3594-gc9da4049-1jammy_amd64.deb ... 2024-05-09T05:50:09.456 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-09T05:50:09.478 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-base (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:50:09.768 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-05-09T05:50:09.794 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-05-09T05:50:09.834 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-05-09T05:50:10.104 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-jaraco.text. 2024-05-09T05:50:10.130 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-05-09T05:50:10.145 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-05-09T05:50:10.172 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-05-09T05:50:10.187 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-05-09T05:50:10.212 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-05-09T05:50:10.474 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-05-09T05:50:10.500 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-05-09T05:50:10.500 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-cheroot. 2024-05-09T05:50:10.527 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-05-09T05:50:10.540 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-05-09T05:50:10.567 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-09T05:50:10.843 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-tempora. 2024-05-09T05:50:10.870 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-05-09T05:50:10.882 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-05-09T05:50:10.909 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-05-09T05:50:10.910 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-05-09T05:50:10.949 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-05-09T05:50:11.221 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-portend. 2024-05-09T05:50:11.221 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-jaraco.text. 2024-05-09T05:50:11.247 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-05-09T05:50:11.247 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-05-09T05:50:11.287 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-05-09T05:50:11.323 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-05-09T05:50:11.524 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-05-09T05:50:11.536 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-05-09T05:50:11.573 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-05-09T05:50:11.619 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-05-09T05:50:11.646 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-05-09T05:50:11.686 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-05-09T05:50:11.876 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-cherrypy3. 2024-05-09T05:50:11.903 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-05-09T05:50:11.943 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-05-09T05:50:11.985 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-tempora. 2024-05-09T05:50:12.011 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-05-09T05:50:12.051 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-05-09T05:50:12.289 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-natsort. 2024-05-09T05:50:12.315 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-05-09T05:50:12.332 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-portend. 2024-05-09T05:50:12.355 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-05-09T05:50:12.358 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-05-09T05:50:12.398 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-05-09T05:50:12.641 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-logutils. 2024-05-09T05:50:12.668 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-05-09T05:50:12.696 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-05-09T05:50:12.699 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-05-09T05:50:12.723 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-05-09T05:50:12.774 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-05-09T05:50:12.952 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-markupsafe. 2024-05-09T05:50:12.979 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-05-09T05:50:13.019 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-05-09T05:50:13.078 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-cherrypy3. 2024-05-09T05:50:13.105 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-05-09T05:50:13.145 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-05-09T05:50:13.324 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-mako. 2024-05-09T05:50:13.350 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-05-09T05:50:13.390 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-09T05:50:13.485 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-natsort. 2024-05-09T05:50:13.511 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-05-09T05:50:13.551 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-05-09T05:50:13.694 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-simplegeneric. 2024-05-09T05:50:13.720 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-05-09T05:50:13.762 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-05-09T05:50:13.825 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-logutils. 2024-05-09T05:50:13.852 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-05-09T05:50:13.892 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-05-09T05:50:14.030 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-singledispatch. 2024-05-09T05:50:14.056 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-05-09T05:50:14.096 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-05-09T05:50:14.190 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-markupsafe. 2024-05-09T05:50:14.217 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-05-09T05:50:14.257 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-05-09T05:50:14.382 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-webob. 2024-05-09T05:50:14.409 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-05-09T05:50:14.449 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-05-09T05:50:14.554 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-mako. 2024-05-09T05:50:14.580 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-05-09T05:50:14.620 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-09T05:50:14.802 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-waitress. 2024-05-09T05:50:14.829 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-05-09T05:50:14.872 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-09T05:50:14.961 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-simplegeneric. 2024-05-09T05:50:14.988 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-05-09T05:50:15.028 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-05-09T05:50:15.180 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-tempita. 2024-05-09T05:50:15.206 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-05-09T05:50:15.246 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-05-09T05:50:15.334 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-singledispatch. 2024-05-09T05:50:15.361 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-05-09T05:50:15.401 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-05-09T05:50:15.508 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-paste. 2024-05-09T05:50:15.523 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-05-09T05:50:15.558 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-05-09T05:50:15.681 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-webob. 2024-05-09T05:50:15.707 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-05-09T05:50:15.748 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-05-09T05:50:15.886 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-05-09T05:50:15.912 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-05-09T05:50:15.952 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-05-09T05:50:16.071 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-waitress. 2024-05-09T05:50:16.098 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-05-09T05:50:16.175 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-09T05:50:16.197 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pastedeploy. 2024-05-09T05:50:16.220 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-05-09T05:50:16.255 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-05-09T05:50:16.453 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-tempita. 2024-05-09T05:50:16.480 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-05-09T05:50:16.517 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-webtest. 2024-05-09T05:50:16.520 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-05-09T05:50:16.543 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-05-09T05:50:16.583 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-05-09T05:50:16.817 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-paste. 2024-05-09T05:50:16.844 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-05-09T05:50:16.892 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-05-09T05:50:16.894 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pecan. 2024-05-09T05:50:16.921 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-05-09T05:50:16.961 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-05-09T05:50:17.190 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-05-09T05:50:17.206 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-05-09T05:50:17.249 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-05-09T05:50:17.350 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-certifi. 2024-05-09T05:50:17.376 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-05-09T05:50:17.416 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-05-09T05:50:17.521 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-pastedeploy. 2024-05-09T05:50:17.547 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-05-09T05:50:17.589 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-05-09T05:50:17.752 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-idna. 2024-05-09T05:50:17.779 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-05-09T05:50:17.840 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-idna (3.3-1) ... 2024-05-09T05:50:17.886 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-webtest. 2024-05-09T05:50:17.913 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-05-09T05:50:17.953 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-05-09T05:50:18.113 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-urllib3. 2024-05-09T05:50:18.140 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-05-09T05:50:18.171 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-09T05:50:18.243 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-pecan. 2024-05-09T05:50:18.269 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-05-09T05:50:18.309 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-05-09T05:50:18.466 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-requests. 2024-05-09T05:50:18.493 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-05-09T05:50:18.525 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-09T05:50:18.628 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-certifi. 2024-05-09T05:50:18.655 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-05-09T05:50:18.694 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-05-09T05:50:18.828 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-werkzeug. 2024-05-09T05:50:18.854 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-05-09T05:50:18.894 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-09T05:50:19.016 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-idna. 2024-05-09T05:50:19.043 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-05-09T05:50:19.083 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-idna (3.3-1) ... 2024-05-09T05:50:19.372 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-05-09T05:50:19.373 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-urllib3. 2024-05-09T05:50:19.399 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-3594-gc9da4049-1jammy_all.deb ... 2024-05-09T05:50:19.400 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-05-09T05:50:19.439 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:50:19.440 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-09T05:50:19.755 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-requests. 2024-05-09T05:50:19.760 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-05-09T05:50:19.782 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-05-09T05:50:19.787 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-3594-gc9da4049-1jammy_amd64.deb ... 2024-05-09T05:50:19.822 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-09T05:50:19.827 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:50:20.127 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-werkzeug. 2024-05-09T05:50:20.147 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-bcrypt. 2024-05-09T05:50:20.154 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-05-09T05:50:20.173 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-05-09T05:50:20.194 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-09T05:50:20.213 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-05-09T05:50:20.484 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-05-09T05:50:20.500 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-3594-gc9da4049-1jammy_all.deb ... 2024-05-09T05:50:20.516 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-openssl. 2024-05-09T05:50:20.542 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-05-09T05:50:20.543 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:50:20.591 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-05-09T05:50:20.894 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-mgr. 2024-05-09T05:50:20.920 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-05-09T05:50:20.920 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-3594-gc9da4049-1jammy_amd64.deb ... 2024-05-09T05:50:20.946 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-3594-gc9da4049-1jammy_amd64.deb ... 2024-05-09T05:50:20.952 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-mgr (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:50:21.020 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:50:21.310 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-bcrypt. 2024-05-09T05:50:21.336 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-05-09T05:50:21.355 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-mon. 2024-05-09T05:50:21.376 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-05-09T05:50:21.382 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-3594-gc9da4049-1jammy_amd64.deb ... 2024-05-09T05:50:21.421 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-mon (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:50:21.673 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-openssl. 2024-05-09T05:50:21.700 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-05-09T05:50:21.740 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-05-09T05:50:22.051 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-osd. 2024-05-09T05:50:22.072 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-mgr. 2024-05-09T05:50:22.077 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-3594-gc9da4049-1jammy_amd64.deb ... 2024-05-09T05:50:22.098 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-3594-gc9da4049-1jammy_amd64.deb ... 2024-05-09T05:50:22.117 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-osd (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:50:22.138 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-mgr (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:50:22.537 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-mon. 2024-05-09T05:50:22.564 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-3594-gc9da4049-1jammy_amd64.deb ... 2024-05-09T05:50:22.604 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-mon (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:50:23.171 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph. 2024-05-09T05:50:23.197 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../068-ceph_19.0.0-3594-gc9da4049-1jammy_amd64.deb ... 2024-05-09T05:50:23.228 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:50:23.327 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-osd. 2024-05-09T05:50:23.354 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-3594-gc9da4049-1jammy_amd64.deb ... 2024-05-09T05:50:23.395 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-osd (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:50:23.523 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-fuse. 2024-05-09T05:50:23.549 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-3594-gc9da4049-1jammy_amd64.deb ... 2024-05-09T05:50:23.589 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-fuse (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:50:23.968 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-mds. 2024-05-09T05:50:23.994 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-3594-gc9da4049-1jammy_amd64.deb ... 2024-05-09T05:50:24.034 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-mds (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:50:24.462 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package cephadm. 2024-05-09T05:50:24.489 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../071-cephadm_19.0.0-3594-gc9da4049-1jammy_amd64.deb ... 2024-05-09T05:50:24.528 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking cephadm (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:50:24.759 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph. 2024-05-09T05:50:24.776 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../068-ceph_19.0.0-3594-gc9da4049-1jammy_amd64.deb ... 2024-05-09T05:50:24.798 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-asyncssh. 2024-05-09T05:50:24.818 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:50:24.824 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-05-09T05:50:24.856 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-05-09T05:50:25.141 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-fuse. 2024-05-09T05:50:25.168 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python-babel-localedata. 2024-05-09T05:50:25.168 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-3594-gc9da4049-1jammy_amd64.deb ... 2024-05-09T05:50:25.186 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-05-09T05:50:25.207 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-fuse (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:50:25.226 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-09T05:50:25.588 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-mds. 2024-05-09T05:50:25.615 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-3594-gc9da4049-1jammy_amd64.deb ... 2024-05-09T05:50:25.654 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-mds (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:50:26.136 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package cephadm. 2024-05-09T05:50:26.163 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../071-cephadm_19.0.0-3594-gc9da4049-1jammy_amd64.deb ... 2024-05-09T05:50:26.203 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking cephadm (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:50:26.281 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-babel. 2024-05-09T05:50:26.310 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-05-09T05:50:26.347 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-05-09T05:50:26.526 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-asyncssh. 2024-05-09T05:50:26.553 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-05-09T05:50:26.601 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-05-09T05:50:26.650 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-jinja2. 2024-05-09T05:50:26.677 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-05-09T05:50:26.717 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-09T05:50:26.897 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python-babel-localedata. 2024-05-09T05:50:26.913 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-05-09T05:50:26.956 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-09T05:50:27.078 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-05-09T05:50:27.105 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-3594-gc9da4049-1jammy_all.deb ... 2024-05-09T05:50:27.144 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:50:27.456 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-repoze.lru. 2024-05-09T05:50:27.483 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-05-09T05:50:27.522 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-05-09T05:50:27.834 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-routes. 2024-05-09T05:50:27.861 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-05-09T05:50:27.900 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-05-09T05:50:27.925 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-babel. 2024-05-09T05:50:27.952 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-05-09T05:50:27.991 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-05-09T05:50:28.262 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-05-09T05:50:28.289 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-3594-gc9da4049-1jammy_all.deb ... 2024-05-09T05:50:28.437 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:50:28.477 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-jinja2. 2024-05-09T05:50:28.500 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-05-09T05:50:28.540 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-09T05:50:28.897 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-05-09T05:50:28.924 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-3594-gc9da4049-1jammy_all.deb ... 2024-05-09T05:50:29.272 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:50:29.594 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-repoze.lru. 2024-05-09T05:50:29.622 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-05-09T05:50:29.661 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-05-09T05:50:29.959 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-routes. 2024-05-09T05:50:29.967 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-05-09T05:50:29.983 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-05-09T05:50:29.986 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-05-09T05:50:30.017 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-09T05:50:30.026 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-05-09T05:50:30.350 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-05-09T05:50:30.376 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-3594-gc9da4049-1jammy_all.deb ... 2024-05-09T05:50:30.416 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:50:30.496 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-joblib. 2024-05-09T05:50:30.523 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-05-09T05:50:30.563 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-05-09T05:50:30.924 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-05-09T05:50:30.951 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-05-09T05:50:31.084 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-05-09T05:50:31.370 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-sklearn. 2024-05-09T05:50:31.386 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-05-09T05:50:31.423 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-09T05:50:32.068 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-05-09T05:50:32.085 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-05-09T05:50:32.127 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-09T05:50:32.163 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-05-09T05:50:32.191 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-3594-gc9da4049-1jammy_all.deb ... 2024-05-09T05:50:32.229 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:50:32.608 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-joblib. 2024-05-09T05:50:32.636 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-05-09T05:50:32.685 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-05-09T05:50:33.041 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-05-09T05:50:33.068 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-05-09T05:50:33.183 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-cachetools. 2024-05-09T05:50:33.210 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-05-09T05:50:33.213 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-05-09T05:50:33.249 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-05-09T05:50:33.510 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-sklearn. 2024-05-09T05:50:33.537 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-05-09T05:50:33.560 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pyasn1. 2024-05-09T05:50:33.576 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-09T05:50:33.588 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-05-09T05:50:33.627 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-05-09T05:50:33.964 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-05-09T05:50:33.991 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-05-09T05:50:34.030 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-05-09T05:50:34.196 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-05-09T05:50:34.224 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-3594-gc9da4049-1jammy_all.deb ... 2024-05-09T05:50:34.263 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:50:34.342 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-rsa. 2024-05-09T05:50:34.369 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-05-09T05:50:34.408 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-rsa (4.8-1) ... 2024-05-09T05:50:34.729 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-google-auth. 2024-05-09T05:50:34.756 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-05-09T05:50:34.795 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-05-09T05:50:35.107 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-05-09T05:50:35.134 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-05-09T05:50:35.173 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-09T05:50:35.460 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-websocket. 2024-05-09T05:50:35.487 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-05-09T05:50:35.526 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-05-09T05:50:35.570 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-cachetools. 2024-05-09T05:50:35.597 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-05-09T05:50:35.637 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-05-09T05:50:35.855 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-kubernetes. 2024-05-09T05:50:35.882 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-05-09T05:50:35.918 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-pyasn1. 2024-05-09T05:50:35.921 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-09T05:50:35.945 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-05-09T05:50:35.985 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-05-09T05:50:36.291 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-05-09T05:50:36.318 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-05-09T05:50:36.366 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-05-09T05:50:36.527 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-05-09T05:50:36.555 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-3594-gc9da4049-1jammy_all.deb ... 2024-05-09T05:50:36.593 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:50:36.648 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-rsa. 2024-05-09T05:50:36.675 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-05-09T05:50:36.715 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-rsa (4.8-1) ... 2024-05-09T05:50:36.846 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libonig5:amd64. 2024-05-09T05:50:36.862 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-05-09T05:50:36.896 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-09T05:50:37.023 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-google-auth. 2024-05-09T05:50:37.051 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-05-09T05:50:37.090 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-05-09T05:50:37.241 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libjq1:amd64. 2024-05-09T05:50:37.268 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-05-09T05:50:37.332 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-09T05:50:37.397 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-05-09T05:50:37.424 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-05-09T05:50:37.464 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-09T05:50:37.602 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package jq. 2024-05-09T05:50:37.618 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-05-09T05:50:37.660 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-05-09T05:50:37.761 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-websocket. 2024-05-09T05:50:37.788 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-05-09T05:50:37.827 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-05-09T05:50:37.879 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package socat. 2024-05-09T05:50:37.895 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-05-09T05:50:37.929 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-05-09T05:50:38.135 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-kubernetes. 2024-05-09T05:50:38.162 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-05-09T05:50:38.191 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package xmlstarlet. 2024-05-09T05:50:38.210 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-09T05:50:38.218 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-05-09T05:50:38.249 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-05-09T05:50:38.603 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-test. 2024-05-09T05:50:38.619 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../099-ceph-test_19.0.0-3594-gc9da4049-1jammy_amd64.deb ... 2024-05-09T05:50:38.661 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-test (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:50:38.939 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-05-09T05:50:38.966 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-3594-gc9da4049-1jammy_all.deb ... 2024-05-09T05:50:39.005 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:50:39.328 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libonig5:amd64. 2024-05-09T05:50:39.356 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-05-09T05:50:39.403 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-09T05:50:39.742 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libjq1:amd64. 2024-05-09T05:50:39.770 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-05-09T05:50:39.809 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-09T05:50:40.065 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package jq. 2024-05-09T05:50:40.081 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-05-09T05:50:40.123 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-05-09T05:50:40.371 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package socat. 2024-05-09T05:50:40.387 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-05-09T05:50:40.429 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-05-09T05:50:40.744 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package xmlstarlet. 2024-05-09T05:50:40.759 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-05-09T05:50:40.794 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-05-09T05:50:41.108 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-volume. 2024-05-09T05:50:41.135 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-3594-gc9da4049-1jammy_all.deb ... 2024-05-09T05:50:41.136 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-test. 2024-05-09T05:50:41.152 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../099-ceph-test_19.0.0-3594-gc9da4049-1jammy_amd64.deb ... 2024-05-09T05:50:41.174 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-volume (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:50:41.194 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-test (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:50:41.537 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package cephfs-mirror. 2024-05-09T05:50:41.564 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-3594-gc9da4049-1jammy_amd64.deb ... 2024-05-09T05:50:41.603 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking cephfs-mirror (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:50:41.881 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-colorama. 2024-05-09T05:50:41.908 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-05-09T05:50:41.947 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-05-09T05:50:42.158 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package cephfs-shell. 2024-05-09T05:50:42.174 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-3594-gc9da4049-1jammy_all.deb ... 2024-05-09T05:50:42.216 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking cephfs-shell (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:50:42.486 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package cephfs-top. 2024-05-09T05:50:42.502 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-3594-gc9da4049-1jammy_all.deb ... 2024-05-09T05:50:42.544 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking cephfs-top (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:50:42.797 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libcephfs-dev. 2024-05-09T05:50:42.813 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-3594-gc9da4049-1jammy_amd64.deb ... 2024-05-09T05:50:42.855 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libcephfs-dev (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:50:43.174 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package lua-socket:amd64. 2024-05-09T05:50:43.202 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-05-09T05:50:43.241 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-09T05:50:43.529 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package lua-sec:amd64. 2024-05-09T05:50:43.556 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-05-09T05:50:43.587 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-05-09T05:50:43.966 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package nvme-cli. 2024-05-09T05:50:43.993 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-05-09T05:50:44.032 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-05-09T05:50:44.454 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package pkg-config. 2024-05-09T05:50:44.482 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-05-09T05:50:44.521 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-05-09T05:50:44.766 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-05-09T05:50:44.793 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-05-09T05:50:44.832 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-05-09T05:50:44.904 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-volume. 2024-05-09T05:50:44.932 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-3594-gc9da4049-1jammy_all.deb ... 2024-05-09T05:50:44.979 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-volume (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:50:45.285 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-iniconfig. 2024-05-09T05:50:45.313 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-05-09T05:50:45.352 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-05-09T05:50:45.381 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package cephfs-mirror. 2024-05-09T05:50:45.409 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-3594-gc9da4049-1jammy_amd64.deb ... 2024-05-09T05:50:45.455 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking cephfs-mirror (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:50:45.613 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pastescript. 2024-05-09T05:50:45.640 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-05-09T05:50:45.671 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-05-09T05:50:45.770 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-colorama. 2024-05-09T05:50:45.798 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-05-09T05:50:45.837 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-05-09T05:50:45.941 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pluggy. 2024-05-09T05:50:45.969 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-05-09T05:50:46.024 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-05-09T05:50:46.083 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package cephfs-shell. 2024-05-09T05:50:46.099 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-3594-gc9da4049-1jammy_all.deb ... 2024-05-09T05:50:46.133 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking cephfs-shell (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:50:46.344 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-psutil. 2024-05-09T05:50:46.371 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-05-09T05:50:46.389 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package cephfs-top. 2024-05-09T05:50:46.405 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-3594-gc9da4049-1jammy_all.deb ... 2024-05-09T05:50:46.410 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-05-09T05:50:46.447 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking cephfs-top (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:50:46.702 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libcephfs-dev. 2024-05-09T05:50:46.722 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-py. 2024-05-09T05:50:46.730 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-3594-gc9da4049-1jammy_amd64.deb ... 2024-05-09T05:50:46.749 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-05-09T05:50:46.768 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libcephfs-dev (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:50:46.788 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-py (1.10.0-1) ... 2024-05-09T05:50:47.083 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package lua-socket:amd64. 2024-05-09T05:50:47.108 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pygments. 2024-05-09T05:50:47.111 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-05-09T05:50:47.136 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-05-09T05:50:47.158 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-09T05:50:47.174 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-05-09T05:50:47.460 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package lua-sec:amd64. 2024-05-09T05:50:47.487 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-05-09T05:50:47.526 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-05-09T05:50:47.646 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pyinotify. 2024-05-09T05:50:47.673 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-05-09T05:50:47.712 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-05-09T05:50:47.877 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package nvme-cli. 2024-05-09T05:50:47.904 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-05-09T05:50:47.943 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-05-09T05:50:47.998 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-toml. 2024-05-09T05:50:48.026 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-05-09T05:50:48.064 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-05-09T05:50:48.309 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pytest. 2024-05-09T05:50:48.336 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-05-09T05:50:48.354 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package pkg-config. 2024-05-09T05:50:48.367 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-05-09T05:50:48.382 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-05-09T05:50:48.421 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-05-09T05:50:48.684 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-05-09T05:50:48.700 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-05-09T05:50:48.713 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-simplejson. 2024-05-09T05:50:48.740 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-05-09T05:50:48.744 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-05-09T05:50:48.779 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-05-09T05:50:49.082 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-05-09T05:50:49.098 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-05-09T05:50:49.125 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-iniconfig. 2024-05-09T05:50:49.131 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-05-09T05:50:49.152 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-05-09T05:50:49.191 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-05-09T05:50:49.489 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-pastescript. 2024-05-09T05:50:49.517 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-05-09T05:50:49.556 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-05-09T05:50:49.870 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-pluggy. 2024-05-09T05:50:49.898 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-05-09T05:50:49.903 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package radosgw. 2024-05-09T05:50:49.930 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../122-radosgw_19.0.0-3594-gc9da4049-1jammy_amd64.deb ... 2024-05-09T05:50:49.964 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-05-09T05:50:49.969 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking radosgw (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:50:50.286 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-psutil. 2024-05-09T05:50:50.314 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-05-09T05:50:50.353 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-05-09T05:50:50.676 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-py. 2024-05-09T05:50:50.704 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-05-09T05:50:50.743 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-py (1.10.0-1) ... 2024-05-09T05:50:50.980 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package rbd-fuse. 2024-05-09T05:50:50.996 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-3594-gc9da4049-1jammy_amd64.deb ... 2024-05-09T05:50:51.038 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking rbd-fuse (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:50:51.067 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-pygments. 2024-05-09T05:50:51.095 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-05-09T05:50:51.134 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-05-09T05:50:51.335 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-05-09T05:50:51.574 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-pyinotify. 2024-05-09T05:50:51.585 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-09T05:50:51.602 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-05-09T05:50:51.649 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-05-09T05:50:51.712 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-05-09T05:50:51.964 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-toml. 2024-05-09T05:50:51.975 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-05-09T05:50:51.992 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-05-09T05:50:52.030 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-05-09T05:50:52.307 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-05-09T05:50:52.337 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-pytest. 2024-05-09T05:50:52.364 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-05-09T05:50:52.404 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-05-09T05:50:52.735 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-simplejson. 2024-05-09T05:50:52.745 INFO:teuthology.orchestra.run.smithi110.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-05-09T05:50:52.762 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-05-09T05:50:52.801 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-05-09T05:50:52.882 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up cephadm (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:50:53.058 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-05-09T05:50:53.086 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-05-09T05:50:53.125 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-05-09T05:50:53.722 INFO:teuthology.orchestra.run.smithi110.stdout:Adding system user cephadm....done 2024-05-09T05:50:53.774 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package radosgw. 2024-05-09T05:50:53.802 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../122-radosgw_19.0.0-3594-gc9da4049-1jammy_amd64.deb ... 2024-05-09T05:50:53.842 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking radosgw (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:50:54.012 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-09T05:50:54.357 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-05-09T05:50:54.625 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-05-09T05:50:54.726 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-05-09T05:50:54.960 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-05-09T05:50:55.122 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package rbd-fuse. 2024-05-09T05:50:55.147 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-3594-gc9da4049-1jammy_amd64.deb ... 2024-05-09T05:50:55.190 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking rbd-fuse (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:50:55.203 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-05-09T05:50:55.330 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-py (1.10.0-1) ... 2024-05-09T05:50:55.506 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-05-09T05:50:55.631 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-05-09T05:50:55.760 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-09T05:50:55.887 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-05-09T05:50:55.991 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-05-09T05:50:56.128 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-05-09T05:50:56.242 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-05-09T05:50:56.425 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-05-09T05:50:56.510 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-05-09T05:50:56.803 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-05-09T05:50:56.861 INFO:teuthology.orchestra.run.smithi072.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-05-09T05:50:56.924 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up cephadm (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:50:57.055 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-05-09T05:50:57.381 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-05-09T05:50:57.453 INFO:teuthology.orchestra.run.smithi072.stdout:Adding system user cephadm....done 2024-05-09T05:50:57.605 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-09T05:50:57.649 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-05-09T05:50:57.874 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-05-09T05:50:57.899 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-ceph-argparse (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:50:58.135 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-05-09T05:50:58.175 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-09T05:50:58.255 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-05-09T05:50:58.276 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-09T05:50:58.378 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-05-09T05:50:58.516 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-05-09T05:50:58.646 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-05-09T05:50:58.771 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-05-09T05:50:58.784 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-05-09T05:50:58.911 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-py (1.10.0-1) ... 2024-05-09T05:50:59.030 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-05-09T05:50:59.208 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-05-09T05:50:59.415 INFO:teuthology.orchestra.run.smithi110.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-05-09T05:50:59.445 INFO:teuthology.orchestra.run.smithi110.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-05-09T05:50:59.509 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-09T05:50:59.569 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-05-09T05:50:59.610 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-05-09T05:50:59.838 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-05-09T05:50:59.935 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-09T05:51:00.053 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-05-09T05:51:00.133 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-05-09T05:51:00.335 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-05-09T05:51:00.402 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-05-09T05:51:00.605 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-05-09T05:51:00.655 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-05-09T05:51:00.898 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up zip (3.0-12build2) ... 2024-05-09T05:51:00.909 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-05-09T05:51:01.024 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-05-09T05:51:01.169 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-05-09T05:51:01.588 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-ceph-argparse (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:51:01.734 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-05-09T05:51:01.840 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-09T05:51:01.968 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-09T05:51:01.969 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-05-09T05:51:02.087 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-05-09T05:51:02.095 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-05-09T05:51:02.213 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-09T05:51:02.339 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-05-09T05:51:02.466 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-05-09T05:51:02.513 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-05-09T05:51:02.726 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-05-09T05:51:02.890 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-05-09T05:51:03.127 INFO:teuthology.orchestra.run.smithi072.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-05-09T05:51:03.149 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-05-09T05:51:03.154 INFO:teuthology.orchestra.run.smithi072.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-05-09T05:51:03.217 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-09T05:51:03.345 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-05-09T05:51:03.526 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-09T05:51:03.715 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-09T05:51:03.793 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-05-09T05:51:03.842 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-05-09T05:51:04.086 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-09T05:51:04.111 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-05-09T05:51:04.374 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-05-09T05:51:04.454 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-05-09T05:51:04.684 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up zip (3.0-12build2) ... 2024-05-09T05:51:04.714 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-05-09T05:51:04.840 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-ceph-common (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:51:04.844 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-05-09T05:51:05.141 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-idna (3.3-1) ... 2024-05-09T05:51:05.467 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-09T05:51:05.491 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-05-09T05:51:05.743 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-05-09T05:51:05.870 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-05-09T05:51:05.997 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-09T05:51:06.291 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-05-09T05:51:06.648 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-05-09T05:51:06.678 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-05-09T05:51:06.891 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-09T05:51:06.921 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-05-09T05:51:07.017 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-toml (0.10.2-1) ... 2024-05-09T05:51:07.268 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-09T05:51:07.283 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-09T05:51:07.369 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-05-09T05:51:07.487 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-09T05:51:07.570 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-05-09T05:51:07.780 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-05-09T05:51:07.872 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-09T05:51:08.047 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-05-09T05:51:08.217 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-05-09T05:51:08.307 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-09T05:51:08.433 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-05-09T05:51:08.470 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-05-09T05:51:08.597 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-ceph-common (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:51:08.751 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-05-09T05:51:08.900 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-idna (3.3-1) ... 2024-05-09T05:51:08.985 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-05-09T05:51:09.210 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-09T05:51:09.228 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-05-09T05:51:09.495 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-05-09T05:51:09.755 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-05-09T05:51:10.022 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-09T05:51:10.148 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-05-09T05:51:10.341 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-05-09T05:51:10.441 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-09T05:51:10.551 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-09T05:51:10.602 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-09T05:51:10.737 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-toml (0.10.2-1) ... 2024-05-09T05:51:10.852 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-05-09T05:51:11.006 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-09T05:51:11.126 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-05-09T05:51:11.169 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-05-09T05:51:11.253 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-09T05:51:11.429 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-09T05:51:11.547 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-05-09T05:51:11.555 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-05-09T05:51:11.681 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-05-09T05:51:11.769 INFO:teuthology.orchestra.run.smithi110.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-05-09T05:51:11.799 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-05-09T05:51:12.009 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-09T05:51:12.044 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-09T05:51:12.133 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-05-09T05:51:12.172 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-05-09T05:51:12.474 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-05-09T05:51:12.510 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-05-09T05:51:12.719 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-05-09T05:51:12.761 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up lua-any (27ubuntu1) ... 2024-05-09T05:51:12.895 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-portend (3.0.0-1) ... 2024-05-09T05:51:12.980 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-05-09T05:51:13.171 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-09T05:51:13.231 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-05-09T05:51:13.297 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-09T05:51:13.483 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-05-09T05:51:13.615 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-05-09T05:51:13.746 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-09T05:51:13.872 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-05-09T05:51:13.916 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-09T05:51:14.150 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-09T05:51:14.200 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-05-09T05:51:14.277 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-09T05:51:14.395 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-rsa (4.8-1) ... 2024-05-09T05:51:14.563 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-05-09T05:51:14.672 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-05-09T05:51:14.866 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-05-09T05:51:14.948 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-09T05:51:15.126 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-09T05:51:15.216 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-05-09T05:51:15.244 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-05-09T05:51:15.371 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-05-09T05:51:15.454 INFO:teuthology.orchestra.run.smithi072.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-05-09T05:51:15.609 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-05-09T05:51:15.936 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-05-09T05:51:15.951 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-09T05:51:16.078 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-05-09T05:51:16.330 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-09T05:51:16.456 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up librados2 (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:51:16.464 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-05-09T05:51:16.582 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:51:16.708 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-05-09T05:51:16.718 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up lua-any (27ubuntu1) ... 2024-05-09T05:51:16.845 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-portend (3.0.0-1) ... 2024-05-09T05:51:17.061 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libcephfs2 (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:51:17.096 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-09T05:51:17.161 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libradosstriper1 (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:51:17.223 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-09T05:51:17.271 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-05-09T05:51:17.535 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-05-09T05:51:17.547 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up librbd1 (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:51:17.682 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-mgr-modules-core (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:51:17.833 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-fuse (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:51:17.837 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-09T05:51:18.062 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-09T05:51:18.062 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-09T05:51:18.106 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-05-09T05:51:18.305 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-rsa (4.8-1) ... 2024-05-09T05:51:18.559 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libcephfs-dev (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:51:18.583 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-05-09T05:51:18.710 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-rados (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:51:18.843 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-09T05:51:18.844 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up librgw2 (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:51:18.979 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up cephfs-top (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:51:19.097 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-05-09T05:51:19.105 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-09T05:51:19.467 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-05-09T05:51:19.745 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-05-09T05:51:20.085 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-09T05:51:20.212 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up librados2 (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:51:20.250 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-rbd (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:51:20.339 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:51:20.376 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up rbd-fuse (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:51:20.459 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-05-09T05:51:20.502 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-rgw (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:51:20.603 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-cephfs (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:51:20.704 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up cephfs-shell (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:51:20.798 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libcephfs2 (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:51:20.822 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-common (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:51:20.943 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libradosstriper1 (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:51:21.070 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-05-09T05:51:21.356 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up librbd1 (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:51:21.483 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-mgr-modules-core (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:51:21.603 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-fuse (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:51:21.714 INFO:teuthology.orchestra.run.smithi110.stdout:Adding group ceph....done 2024-05-09T05:51:21.819 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-09T05:51:21.819 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-09T05:51:22.097 INFO:teuthology.orchestra.run.smithi110.stdout:Adding system user ceph....done 2024-05-09T05:51:22.254 INFO:teuthology.orchestra.run.smithi110.stdout:Setting system user ceph properties....done 2024-05-09T05:51:22.262 INFO:teuthology.orchestra.run.smithi110.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-05-09T05:51:22.314 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libcephfs-dev (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:51:22.395 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-05-09T05:51:22.441 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-rados (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:51:22.551 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up librgw2 (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:51:22.679 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up cephfs-top (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:51:22.712 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-05-09T05:51:22.806 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-09T05:51:23.556 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up cephfs-mirror (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:51:23.827 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-05-09T05:51:23.827 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-05-09T05:51:23.965 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-rbd (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:51:24.092 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up rbd-fuse (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:51:24.202 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-rgw (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:51:24.300 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-test (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:51:24.370 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-cephfs (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:51:24.442 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up radosgw (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:51:24.499 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up cephfs-shell (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:51:24.626 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-common (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:51:24.904 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-09T05:51:24.904 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-09T05:51:25.149 INFO:teuthology.orchestra.run.smithi072.stdout:Adding group ceph....done 2024-05-09T05:51:25.369 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-base (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:51:25.503 INFO:teuthology.orchestra.run.smithi072.stdout:Adding system user ceph....done 2024-05-09T05:51:25.657 INFO:teuthology.orchestra.run.smithi072.stdout:Setting system user ceph properties....done 2024-05-09T05:51:25.671 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-05-09T05:51:25.674 INFO:teuthology.orchestra.run.smithi072.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-05-09T05:51:25.817 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-05-09T05:51:26.121 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-mds (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:51:26.140 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-05-09T05:51:26.330 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-09T05:51:26.330 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-09T05:51:26.621 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up cephfs-mirror (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:51:26.806 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-mgr (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:51:26.828 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-05-09T05:51:26.828 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-05-09T05:51:27.032 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-09T05:51:27.032 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-09T05:51:27.291 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-test (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:51:27.411 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up radosgw (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:51:27.516 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-osd (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:51:27.818 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-09T05:51:27.818 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-09T05:51:27.876 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-09T05:51:27.876 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-09T05:51:28.301 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:51:28.357 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-base (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:51:28.427 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:51:28.695 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-mon (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:51:28.716 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-05-09T05:51:28.904 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-09T05:51:28.904 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-09T05:51:29.380 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-mgr-cephadm (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:51:29.522 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-mds (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:51:29.531 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:51:29.682 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-mgr-dashboard (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:51:29.719 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-09T05:51:29.720 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-09T05:51:29.858 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-volume (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:51:30.200 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-mgr (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:51:30.235 INFO:teuthology.orchestra.run.smithi110.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-09T05:51:30.328 INFO:teuthology.orchestra.run.smithi110.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-09T05:51:30.419 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-09T05:51:30.420 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-09T05:51:30.472 INFO:teuthology.orchestra.run.smithi110.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-09T05:51:30.877 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-osd (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:51:31.149 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-09T05:51:31.150 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-09T05:51:31.572 INFO:teuthology.orchestra.run.smithi110.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-09T05:51:31.628 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:51:31.754 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:51:31.916 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-mon (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:51:32.121 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-09T05:51:32.121 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-09T05:51:32.234 INFO:teuthology.orchestra.run.smithi110.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-09T05:51:32.237 DEBUG:teuthology.orchestra.run.smithi110:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-05-09T05:51:32.298 INFO:teuthology.orchestra.run.smithi110.stdout:Reading package lists... 2024-05-09T05:51:32.491 INFO:teuthology.orchestra.run.smithi110.stdout:Building dependency tree... 2024-05-09T05:51:32.492 INFO:teuthology.orchestra.run.smithi110.stdout:Reading state information... 2024-05-09T05:51:32.585 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-mgr-cephadm (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:51:32.660 INFO:teuthology.orchestra.run.smithi110.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-05-09T05:51:32.661 INFO:teuthology.orchestra.run.smithi110.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-05-09T05:51:32.661 INFO:teuthology.orchestra.run.smithi110.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-05-09T05:51:32.661 INFO:teuthology.orchestra.run.smithi110.stdout:The following packages were automatically installed and are no longer required: 2024-05-09T05:51:32.661 INFO:teuthology.orchestra.run.smithi110.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-09T05:51:32.661 INFO:teuthology.orchestra.run.smithi110.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-09T05:51:32.661 INFO:teuthology.orchestra.run.smithi110.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-09T05:51:32.661 INFO:teuthology.orchestra.run.smithi110.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-09T05:51:32.662 INFO:teuthology.orchestra.run.smithi110.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-09T05:51:32.662 INFO:teuthology.orchestra.run.smithi110.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-09T05:51:32.662 INFO:teuthology.orchestra.run.smithi110.stdout:The following additional packages will be installed: 2024-05-09T05:51:32.663 INFO:teuthology.orchestra.run.smithi110.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-05-09T05:51:32.663 INFO:teuthology.orchestra.run.smithi110.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-05-09T05:51:32.663 INFO:teuthology.orchestra.run.smithi110.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-05-09T05:51:32.663 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-05-09T05:51:32.663 INFO:teuthology.orchestra.run.smithi110.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-05-09T05:51:32.664 INFO:teuthology.orchestra.run.smithi110.stdout:Suggested packages: 2024-05-09T05:51:32.664 INFO:teuthology.orchestra.run.smithi110.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-05-09T05:51:32.664 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-05-09T05:51:32.664 INFO:teuthology.orchestra.run.smithi110.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-05-09T05:51:32.702 INFO:teuthology.orchestra.run.smithi110.stdout:The following NEW packages will be installed: 2024-05-09T05:51:32.703 INFO:teuthology.orchestra.run.smithi110.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-05-09T05:51:32.703 INFO:teuthology.orchestra.run.smithi110.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-05-09T05:51:32.703 INFO:teuthology.orchestra.run.smithi110.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-05-09T05:51:32.703 INFO:teuthology.orchestra.run.smithi110.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-05-09T05:51:32.704 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-05-09T05:51:32.704 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-05-09T05:51:32.704 INFO:teuthology.orchestra.run.smithi110.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-05-09T05:51:32.705 INFO:teuthology.orchestra.run.smithi110.stdout:The following packages will be upgraded: 2024-05-09T05:51:32.705 INFO:teuthology.orchestra.run.smithi110.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-05-09T05:51:32.737 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:51:32.864 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-mgr-dashboard (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:51:32.887 INFO:teuthology.orchestra.run.smithi110.stdout:4 upgraded, 39 newly installed, 0 to remove and 299 not upgraded. 2024-05-09T05:51:32.887 INFO:teuthology.orchestra.run.smithi110.stdout:Need to get 55.7 MB of archives. 2024-05-09T05:51:32.887 INFO:teuthology.orchestra.run.smithi110.stdout:After this operation, 202 MB of additional disk space will be used. 2024-05-09T05:51:32.887 INFO:teuthology.orchestra.run.smithi110.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-05-09T05:51:33.018 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-volume (19.0.0-3594-gc9da4049-1jammy) ... 2024-05-09T05:51:33.364 INFO:teuthology.orchestra.run.smithi072.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-09T05:51:33.474 INFO:teuthology.orchestra.run.smithi072.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-09T05:51:33.521 INFO:teuthology.orchestra.run.smithi110.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-05-09T05:51:33.537 INFO:teuthology.orchestra.run.smithi110.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-05-09T05:51:33.629 INFO:teuthology.orchestra.run.smithi072.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-09T05:51:33.663 INFO:teuthology.orchestra.run.smithi110.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-05-09T05:51:33.664 INFO:teuthology.orchestra.run.smithi110.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-05-09T05:51:33.665 INFO:teuthology.orchestra.run.smithi110.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-05-09T05:51:33.694 INFO:teuthology.orchestra.run.smithi110.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-05-09T05:51:33.695 INFO:teuthology.orchestra.run.smithi110.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-05-09T05:51:33.699 INFO:teuthology.orchestra.run.smithi110.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-05-09T05:51:33.702 INFO:teuthology.orchestra.run.smithi110.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-05-09T05:51:33.703 INFO:teuthology.orchestra.run.smithi110.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-05-09T05:51:33.869 INFO:teuthology.orchestra.run.smithi110.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-05-09T05:51:34.163 INFO:teuthology.orchestra.run.smithi110.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-05-09T05:51:34.172 INFO:teuthology.orchestra.run.smithi110.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-05-09T05:51:34.177 INFO:teuthology.orchestra.run.smithi110.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-05-09T05:51:34.261 INFO:teuthology.orchestra.run.smithi110.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-05-09T05:51:34.774 INFO:teuthology.orchestra.run.smithi072.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-09T05:51:35.316 INFO:teuthology.orchestra.run.smithi110.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-05-09T05:51:35.321 INFO:teuthology.orchestra.run.smithi110.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-05-09T05:51:35.321 INFO:teuthology.orchestra.run.smithi110.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-05-09T05:51:35.328 INFO:teuthology.orchestra.run.smithi110.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-05-09T05:51:35.328 INFO:teuthology.orchestra.run.smithi110.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-05-09T05:51:35.339 INFO:teuthology.orchestra.run.smithi110.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-05-09T05:51:35.507 INFO:teuthology.orchestra.run.smithi110.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-05-09T05:51:35.581 INFO:teuthology.orchestra.run.smithi072.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-09T05:51:35.583 DEBUG:teuthology.orchestra.run.smithi072:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-05-09T05:51:35.677 INFO:teuthology.orchestra.run.smithi072.stdout:Reading package lists... 2024-05-09T05:51:35.860 INFO:teuthology.orchestra.run.smithi072.stdout:Building dependency tree... 2024-05-09T05:51:35.861 INFO:teuthology.orchestra.run.smithi072.stdout:Reading state information... 2024-05-09T05:51:36.030 INFO:teuthology.orchestra.run.smithi072.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-05-09T05:51:36.030 INFO:teuthology.orchestra.run.smithi072.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-05-09T05:51:36.030 INFO:teuthology.orchestra.run.smithi072.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-05-09T05:51:36.030 INFO:teuthology.orchestra.run.smithi072.stdout:The following packages were automatically installed and are no longer required: 2024-05-09T05:51:36.030 INFO:teuthology.orchestra.run.smithi072.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-09T05:51:36.031 INFO:teuthology.orchestra.run.smithi072.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-09T05:51:36.031 INFO:teuthology.orchestra.run.smithi072.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-09T05:51:36.031 INFO:teuthology.orchestra.run.smithi072.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-09T05:51:36.031 INFO:teuthology.orchestra.run.smithi072.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-09T05:51:36.032 INFO:teuthology.orchestra.run.smithi072.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-09T05:51:36.032 INFO:teuthology.orchestra.run.smithi072.stdout:The following additional packages will be installed: 2024-05-09T05:51:36.032 INFO:teuthology.orchestra.run.smithi072.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-05-09T05:51:36.032 INFO:teuthology.orchestra.run.smithi072.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-05-09T05:51:36.032 INFO:teuthology.orchestra.run.smithi072.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-05-09T05:51:36.033 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-05-09T05:51:36.033 INFO:teuthology.orchestra.run.smithi072.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-05-09T05:51:36.033 INFO:teuthology.orchestra.run.smithi072.stdout:Suggested packages: 2024-05-09T05:51:36.033 INFO:teuthology.orchestra.run.smithi072.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-05-09T05:51:36.033 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-05-09T05:51:36.033 INFO:teuthology.orchestra.run.smithi072.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-05-09T05:51:36.073 INFO:teuthology.orchestra.run.smithi072.stdout:The following NEW packages will be installed: 2024-05-09T05:51:36.074 INFO:teuthology.orchestra.run.smithi072.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-05-09T05:51:36.074 INFO:teuthology.orchestra.run.smithi072.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-05-09T05:51:36.074 INFO:teuthology.orchestra.run.smithi072.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-05-09T05:51:36.074 INFO:teuthology.orchestra.run.smithi072.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-05-09T05:51:36.075 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-05-09T05:51:36.075 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-05-09T05:51:36.075 INFO:teuthology.orchestra.run.smithi072.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-05-09T05:51:36.076 INFO:teuthology.orchestra.run.smithi072.stdout:The following packages will be upgraded: 2024-05-09T05:51:36.076 INFO:teuthology.orchestra.run.smithi072.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-05-09T05:51:36.098 INFO:teuthology.orchestra.run.smithi110.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-05-09T05:51:36.098 INFO:teuthology.orchestra.run.smithi110.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-05-09T05:51:36.134 INFO:teuthology.orchestra.run.smithi072.stdout:4 upgraded, 39 newly installed, 0 to remove and 299 not upgraded. 2024-05-09T05:51:36.134 INFO:teuthology.orchestra.run.smithi072.stdout:Need to get 55.7 MB of archives. 2024-05-09T05:51:36.134 INFO:teuthology.orchestra.run.smithi072.stdout:After this operation, 202 MB of additional disk space will be used. 2024-05-09T05:51:36.135 INFO:teuthology.orchestra.run.smithi072.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-05-09T05:51:36.278 INFO:teuthology.orchestra.run.smithi110.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-05-09T05:51:36.279 INFO:teuthology.orchestra.run.smithi110.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-05-09T05:51:36.317 INFO:teuthology.orchestra.run.smithi110.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-05-09T05:51:36.324 INFO:teuthology.orchestra.run.smithi072.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-05-09T05:51:36.332 INFO:teuthology.orchestra.run.smithi072.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-05-09T05:51:36.375 INFO:teuthology.orchestra.run.smithi110.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-05-09T05:51:36.382 INFO:teuthology.orchestra.run.smithi110.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-05-09T05:51:36.383 INFO:teuthology.orchestra.run.smithi110.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-05-09T05:51:36.384 INFO:teuthology.orchestra.run.smithi110.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-05-09T05:51:36.384 INFO:teuthology.orchestra.run.smithi110.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-05-09T05:51:36.409 INFO:teuthology.orchestra.run.smithi072.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-05-09T05:51:36.440 INFO:teuthology.orchestra.run.smithi072.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-05-09T05:51:36.502 INFO:teuthology.orchestra.run.smithi072.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-05-09T05:51:36.549 INFO:teuthology.orchestra.run.smithi072.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-05-09T05:51:36.569 INFO:teuthology.orchestra.run.smithi072.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-05-09T05:51:36.591 INFO:teuthology.orchestra.run.smithi110.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-05-09T05:51:36.608 INFO:teuthology.orchestra.run.smithi072.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-05-09T05:51:36.614 INFO:teuthology.orchestra.run.smithi072.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-05-09T05:51:36.614 INFO:teuthology.orchestra.run.smithi072.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-05-09T05:51:36.618 INFO:teuthology.orchestra.run.smithi072.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-05-09T05:51:36.639 INFO:teuthology.orchestra.run.smithi072.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-05-09T05:51:36.640 INFO:teuthology.orchestra.run.smithi072.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-05-09T05:51:36.641 INFO:teuthology.orchestra.run.smithi072.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-05-09T05:51:36.773 INFO:teuthology.orchestra.run.smithi072.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-05-09T05:51:37.005 INFO:teuthology.orchestra.run.smithi110.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-05-09T05:51:37.158 INFO:teuthology.orchestra.run.smithi072.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-05-09T05:51:37.161 INFO:teuthology.orchestra.run.smithi072.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-05-09T05:51:37.161 INFO:teuthology.orchestra.run.smithi072.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-05-09T05:51:37.164 INFO:teuthology.orchestra.run.smithi072.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-05-09T05:51:37.164 INFO:teuthology.orchestra.run.smithi072.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-05-09T05:51:37.169 INFO:teuthology.orchestra.run.smithi072.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-05-09T05:51:37.170 INFO:teuthology.orchestra.run.smithi072.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-05-09T05:51:37.229 INFO:teuthology.orchestra.run.smithi072.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-05-09T05:51:37.229 INFO:teuthology.orchestra.run.smithi072.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-05-09T05:51:37.256 INFO:teuthology.orchestra.run.smithi072.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-05-09T05:51:37.256 INFO:teuthology.orchestra.run.smithi072.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-05-09T05:51:37.268 INFO:teuthology.orchestra.run.smithi072.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-05-09T05:51:37.291 INFO:teuthology.orchestra.run.smithi072.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-05-09T05:51:37.294 INFO:teuthology.orchestra.run.smithi072.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-05-09T05:51:37.295 INFO:teuthology.orchestra.run.smithi072.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-05-09T05:51:37.295 INFO:teuthology.orchestra.run.smithi072.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-05-09T05:51:37.296 INFO:teuthology.orchestra.run.smithi072.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-05-09T05:51:37.307 INFO:teuthology.orchestra.run.smithi072.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-05-09T05:51:37.308 INFO:teuthology.orchestra.run.smithi072.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-05-09T05:51:37.531 INFO:teuthology.orchestra.run.smithi072.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-05-09T05:51:37.531 INFO:teuthology.orchestra.run.smithi072.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-05-09T05:51:37.531 INFO:teuthology.orchestra.run.smithi072.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-05-09T05:51:37.531 INFO:teuthology.orchestra.run.smithi072.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-05-09T05:51:37.532 INFO:teuthology.orchestra.run.smithi072.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-05-09T05:51:37.532 INFO:teuthology.orchestra.run.smithi072.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-05-09T05:51:37.543 INFO:teuthology.orchestra.run.smithi072.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-05-09T05:51:37.544 INFO:teuthology.orchestra.run.smithi072.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-05-09T05:51:37.824 INFO:teuthology.orchestra.run.smithi110.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-05-09T05:51:37.824 INFO:teuthology.orchestra.run.smithi110.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-05-09T05:51:37.825 INFO:teuthology.orchestra.run.smithi110.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-05-09T05:51:37.825 INFO:teuthology.orchestra.run.smithi110.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-05-09T05:51:37.825 INFO:teuthology.orchestra.run.smithi110.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-05-09T05:51:37.826 INFO:teuthology.orchestra.run.smithi110.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-05-09T05:51:37.849 INFO:teuthology.orchestra.run.smithi110.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-05-09T05:51:37.849 INFO:teuthology.orchestra.run.smithi110.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-05-09T05:51:37.953 INFO:teuthology.orchestra.run.smithi072.stdout:Preconfiguring packages ... 2024-05-09T05:51:38.137 INFO:teuthology.orchestra.run.smithi072.stdout:Fetched 55.7 MB in 1s (38.2 MB/s) 2024-05-09T05:51:38.242 INFO:teuthology.orchestra.run.smithi110.stdout:Preconfiguring packages ... 2024-05-09T05:51:38.415 INFO:teuthology.orchestra.run.smithi110.stdout:Fetched 55.7 MB in 5s (10.8 MB/s) 2024-05-09T05:51:38.458 INFO:teuthology.orchestra.run.smithi072.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173990 files and directories currently installed.) 2024-05-09T05:51:38.463 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-09T05:51:38.619 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-09T05:51:38.736 INFO:teuthology.orchestra.run.smithi110.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173990 files and directories currently installed.) 2024-05-09T05:51:38.741 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-09T05:51:38.889 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-09T05:51:39.284 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-05-09T05:51:39.483 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-05-09T05:51:40.238 INFO:teuthology.orchestra.run.smithi072.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-05-09T05:51:40.508 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package flex. 2024-05-09T05:51:40.509 INFO:teuthology.orchestra.run.smithi110.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-05-09T05:51:40.611 INFO:teuthology.orchestra.run.smithi072.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173990 files and directories currently installed.) 2024-05-09T05:51:40.617 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-05-09T05:51:40.657 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking flex (2.6.4-8build2) ... 2024-05-09T05:51:40.783 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package flex. 2024-05-09T05:51:40.846 INFO:teuthology.orchestra.run.smithi110.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173990 files and directories currently installed.) 2024-05-09T05:51:40.851 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-05-09T05:51:40.899 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking flex (2.6.4-8build2) ... 2024-05-09T05:51:41.112 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-05-09T05:51:41.286 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-05-09T05:51:41.382 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-05-09T05:51:41.521 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-05-09T05:51:41.718 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-09T05:51:41.924 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-09T05:51:42.253 INFO:teuthology.orchestra.run.smithi072.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174063 files and directories currently installed.) 2024-05-09T05:51:42.259 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-09T05:51:42.378 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-09T05:51:42.450 INFO:teuthology.orchestra.run.smithi110.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174063 files and directories currently installed.) 2024-05-09T05:51:42.456 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-09T05:51:42.662 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-09T05:51:42.893 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-09T05:51:43.025 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-09T05:51:43.071 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-09T05:51:43.302 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-09T05:51:43.390 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-05-09T05:51:43.654 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-05-09T05:51:43.752 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package bison. 2024-05-09T05:51:43.850 INFO:teuthology.orchestra.run.smithi072.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174063 files and directories currently installed.) 2024-05-09T05:51:43.856 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-05-09T05:51:43.905 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-05-09T05:51:44.019 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package bison. 2024-05-09T05:51:44.122 INFO:teuthology.orchestra.run.smithi110.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174063 files and directories currently installed.) 2024-05-09T05:51:44.128 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-05-09T05:51:44.180 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-05-09T05:51:44.302 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-05-09T05:51:44.330 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-05-09T05:51:44.369 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-05-09T05:51:44.581 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-05-09T05:51:44.609 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-05-09T05:51:44.647 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-05-09T05:51:44.666 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package dump. 2024-05-09T05:51:44.693 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-05-09T05:51:44.734 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking dump (0.4b47-3) ... 2024-05-09T05:51:44.984 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package dump. 2024-05-09T05:51:44.999 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package indent. 2024-05-09T05:51:45.011 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-05-09T05:51:45.017 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-05-09T05:51:45.050 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking dump (0.4b47-3) ... 2024-05-09T05:51:45.058 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-05-09T05:51:45.306 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-05-09T05:51:45.322 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-05-09T05:51:45.345 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package indent. 2024-05-09T05:51:45.361 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-05-09T05:51:45.364 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-05-09T05:51:45.412 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-05-09T05:51:45.664 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-05-09T05:51:45.680 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-05-09T05:51:45.698 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-05-09T05:51:45.714 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-05-09T05:51:45.726 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-05-09T05:51:45.765 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-05-09T05:51:46.018 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-05-09T05:51:46.020 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-05-09T05:51:46.037 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-05-09T05:51:46.046 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-05-09T05:51:46.078 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-05-09T05:51:46.084 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-05-09T05:51:46.348 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-05-09T05:51:46.375 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-05-09T05:51:46.411 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libfl2:amd64. 2024-05-09T05:51:46.440 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-05-09T05:51:46.440 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-05-09T05:51:46.478 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-05-09T05:51:46.726 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-05-09T05:51:46.726 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libfl2:amd64. 2024-05-09T05:51:46.742 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-05-09T05:51:46.742 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-05-09T05:51:46.776 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-05-09T05:51:46.785 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-05-09T05:51:47.022 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libjson-perl. 2024-05-09T05:51:47.037 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-05-09T05:51:47.039 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-05-09T05:51:47.053 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-05-09T05:51:47.081 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-05-09T05:51:47.095 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-05-09T05:51:47.340 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libjson-perl. 2024-05-09T05:51:47.356 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-05-09T05:51:47.398 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-05-09T05:51:47.513 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libllvm14:amd64. 2024-05-09T05:51:47.541 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-05-09T05:51:47.580 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-05-09T05:51:47.728 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libllvm14:amd64. 2024-05-09T05:51:47.757 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-05-09T05:51:47.794 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-05-09T05:51:49.423 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-05-09T05:51:49.450 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-05-09T05:51:49.498 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-05-09T05:51:49.775 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libmbim-proxy. 2024-05-09T05:51:49.799 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-05-09T05:51:49.842 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-05-09T05:51:49.970 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-05-09T05:51:50.000 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-05-09T05:51:50.037 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-05-09T05:51:50.137 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-05-09T05:51:50.164 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-05-09T05:51:50.195 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-05-09T05:51:50.300 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libmbim-proxy. 2024-05-09T05:51:50.316 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-05-09T05:51:50.358 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-05-09T05:51:50.590 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libndp0:amd64. 2024-05-09T05:51:50.617 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-05-09T05:51:50.656 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-05-09T05:51:50.674 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-05-09T05:51:50.701 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-05-09T05:51:50.740 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-05-09T05:51:50.984 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libnm0:amd64. 2024-05-09T05:51:51.012 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-05-09T05:51:51.051 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-05-09T05:51:51.097 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libndp0:amd64. 2024-05-09T05:51:51.125 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-05-09T05:51:51.172 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-05-09T05:51:51.362 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libpq5:amd64. 2024-05-09T05:51:51.378 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-09T05:51:51.412 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-05-09T05:51:51.494 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libnm0:amd64. 2024-05-09T05:51:51.522 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-05-09T05:51:51.561 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-05-09T05:51:51.757 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-05-09T05:51:51.785 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-05-09T05:51:51.824 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-05-09T05:51:51.893 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libpq5:amd64. 2024-05-09T05:51:51.921 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-09T05:51:51.959 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-05-09T05:51:52.110 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libqmi-proxy. 2024-05-09T05:51:52.126 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-05-09T05:51:52.168 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-05-09T05:51:52.300 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-05-09T05:51:52.328 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-05-09T05:51:52.366 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-05-09T05:51:52.387 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-05-09T05:51:52.403 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-05-09T05:51:52.437 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-09T05:51:52.680 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libqmi-proxy. 2024-05-09T05:51:52.708 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-05-09T05:51:52.746 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-05-09T05:51:52.994 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-05-09T05:51:53.022 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-05-09T05:51:53.060 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-09T05:51:53.551 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-05-09T05:51:53.580 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-05-09T05:51:53.618 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-05-09T05:51:53.634 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-05-09T05:51:53.662 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-05-09T05:51:53.711 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-05-09T05:51:53.988 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package modemmanager. 2024-05-09T05:51:54.015 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-05-09T05:51:54.054 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-05-09T05:51:54.074 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package modemmanager. 2024-05-09T05:51:54.102 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-05-09T05:51:54.141 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-05-09T05:51:54.695 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package network-manager. 2024-05-09T05:51:54.711 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-05-09T05:51:54.761 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-05-09T05:51:54.807 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package network-manager. 2024-05-09T05:51:54.835 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-05-09T05:51:54.891 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-05-09T05:51:55.375 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ppp. 2024-05-09T05:51:55.403 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-05-09T05:51:55.573 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ppp. 2024-05-09T05:51:55.601 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-05-09T05:51:55.690 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-05-09T05:51:55.876 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-05-09T05:51:55.991 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package pptp-linux. 2024-05-09T05:51:56.019 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-05-09T05:51:56.058 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-05-09T05:51:56.294 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package network-manager-pptp. 2024-05-09T05:51:56.295 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package pptp-linux. 2024-05-09T05:51:56.322 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-05-09T05:51:56.322 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-05-09T05:51:56.352 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-05-09T05:51:56.361 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-05-09T05:51:56.600 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package network-manager-pptp. 2024-05-09T05:51:56.614 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-05-09T05:51:56.639 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package postgresql-client-common. 2024-05-09T05:51:56.658 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-05-09T05:51:56.666 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-05-09T05:51:56.705 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking postgresql-client-common (238) ... 2024-05-09T05:51:57.018 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package postgresql-client-14. 2024-05-09T05:51:57.046 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-09T05:51:57.084 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-09T05:51:57.118 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package postgresql-client-common. 2024-05-09T05:51:57.146 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-05-09T05:51:57.229 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking postgresql-client-common (238) ... 2024-05-09T05:51:57.614 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package postgresql-common. 2024-05-09T05:51:57.642 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-05-09T05:51:57.691 INFO:teuthology.orchestra.run.smithi110.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-05-09T05:51:57.721 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking postgresql-common (238) ... 2024-05-09T05:51:57.752 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package postgresql-client-14. 2024-05-09T05:51:57.779 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-09T05:51:57.871 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-09T05:51:58.180 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package postgresql-14. 2024-05-09T05:51:58.208 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-09T05:51:58.250 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-09T05:51:58.664 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package postgresql-common. 2024-05-09T05:51:58.692 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-05-09T05:51:58.757 INFO:teuthology.orchestra.run.smithi072.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-05-09T05:51:58.834 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking postgresql-common (238) ... 2024-05-09T05:51:59.289 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package postgresql-14. 2024-05-09T05:51:59.317 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-09T05:51:59.359 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-09T05:51:59.492 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package postgresql. 2024-05-09T05:51:59.509 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-05-09T05:51:59.550 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking postgresql (14+238) ... 2024-05-09T05:51:59.769 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package postgresql-client. 2024-05-09T05:51:59.786 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-05-09T05:51:59.828 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking postgresql-client (14+238) ... 2024-05-09T05:52:00.047 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package postgresql-contrib. 2024-05-09T05:52:00.065 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-05-09T05:52:00.105 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking postgresql-contrib (14+238) ... 2024-05-09T05:52:00.425 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package tcl8.6. 2024-05-09T05:52:00.453 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-05-09T05:52:00.491 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-05-09T05:52:00.513 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package postgresql. 2024-05-09T05:52:00.530 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-05-09T05:52:00.572 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking postgresql (14+238) ... 2024-05-09T05:52:00.811 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package postgresql-client. 2024-05-09T05:52:00.827 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-05-09T05:52:00.861 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package tcl. 2024-05-09T05:52:00.869 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking postgresql-client (14+238) ... 2024-05-09T05:52:00.889 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-05-09T05:52:00.932 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-05-09T05:52:01.115 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package postgresql-contrib. 2024-05-09T05:52:01.131 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-05-09T05:52:01.173 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking postgresql-contrib (14+238) ... 2024-05-09T05:52:01.230 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package wpasupplicant. 2024-05-09T05:52:01.246 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-05-09T05:52:01.279 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-05-09T05:52:01.496 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package tcl8.6. 2024-05-09T05:52:01.524 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-05-09T05:52:01.571 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-05-09T05:52:01.634 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-05-09T05:52:01.651 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-05-09T05:52:01.693 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-05-09T05:52:01.867 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package tcl. 2024-05-09T05:52:01.883 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-05-09T05:52:01.932 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-05-09T05:52:02.121 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package usb-modeswitch. 2024-05-09T05:52:02.149 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-05-09T05:52:02.196 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-05-09T05:52:02.257 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package wpasupplicant. 2024-05-09T05:52:02.285 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-05-09T05:52:02.324 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-05-09T05:52:02.491 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up postgresql-client-common (238) ... 2024-05-09T05:52:02.700 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-05-09T05:52:02.702 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up flex (2.6.4-8build2) ... 2024-05-09T05:52:02.716 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-05-09T05:52:02.759 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-05-09T05:52:02.828 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-05-09T05:52:02.955 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-05-09T05:52:03.081 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-05-09T05:52:03.141 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package usb-modeswitch. 2024-05-09T05:52:03.169 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-05-09T05:52:03.198 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-05-09T05:52:03.216 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-05-09T05:52:03.300 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-09T05:52:03.509 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up postgresql-client-common (238) ... 2024-05-09T05:52:03.737 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up flex (2.6.4-8build2) ... 2024-05-09T05:52:03.789 INFO:teuthology.orchestra.run.smithi110.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-05-09T05:52:03.856 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-05-09T05:52:03.984 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-05-09T05:52:03.998 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-05-09T05:52:04.111 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-05-09T05:52:04.213 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-05-09T05:52:04.340 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-09T05:52:04.367 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-05-09T05:52:04.367 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-05-09T05:52:04.837 INFO:teuthology.orchestra.run.smithi072.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-05-09T05:52:04.859 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-05-09T05:52:04.921 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-05-09T05:52:04.968 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-05-09T05:52:05.094 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-09T05:52:05.220 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-05-09T05:52:05.294 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-05-09T05:52:05.294 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-05-09T05:52:05.372 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-05-09T05:52:05.498 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-05-09T05:52:05.640 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-05-09T05:52:05.760 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-05-09T05:52:05.766 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-05-09T05:52:05.880 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-05-09T05:52:05.998 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-09T05:52:06.125 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-05-09T05:52:06.252 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-05-09T05:52:06.363 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-05-09T05:52:06.379 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-05-09T05:52:06.490 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up dump (0.4b47-3) ... 2024-05-09T05:52:06.499 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-05-09T05:52:06.583 INFO:teuthology.orchestra.run.smithi110.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-05-09T05:52:06.626 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-05-09T05:52:06.658 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-05-09T05:52:06.759 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-05-09T05:52:06.860 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up tcl (8.6.11+1build2) ... 2024-05-09T05:52:06.978 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libjson-perl (4.04000-1) ... 2024-05-09T05:52:07.104 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-05-09T05:52:07.194 INFO:teuthology.orchestra.run.smithi110.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-05-09T05:52:07.245 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-05-09T05:52:07.264 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-05-09T05:52:07.364 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up dump (0.4b47-3) ... 2024-05-09T05:52:07.390 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-05-09T05:52:07.458 INFO:teuthology.orchestra.run.smithi072.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-05-09T05:52:07.527 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-05-09T05:52:07.575 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-05-09T05:52:07.646 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-05-09T05:52:07.676 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-05-09T05:52:07.773 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up tcl (8.6.11+1build2) ... 2024-05-09T05:52:07.777 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-05-09T05:52:07.899 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libjson-perl (4.04000-1) ... 2024-05-09T05:52:07.928 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up postgresql-client (14+238) ... 2024-05-09T05:52:08.028 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-05-09T05:52:08.054 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-05-09T05:52:08.110 INFO:teuthology.orchestra.run.smithi072.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-05-09T05:52:08.181 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-05-09T05:52:08.307 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-05-09T05:52:08.485 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-05-09T05:52:08.513 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T05:52:08.513 INFO:teuthology.orchestra.run.smithi110.stdout:The following network interfaces were found in /etc/network/interfaces 2024-05-09T05:52:08.513 INFO:teuthology.orchestra.run.smithi110.stdout:which means they are currently configured by ifupdown: 2024-05-09T05:52:08.513 INFO:teuthology.orchestra.run.smithi110.stdout:- enp3s0f1 2024-05-09T05:52:08.513 INFO:teuthology.orchestra.run.smithi110.stdout:If you want to manage those interfaces with NetworkManager instead 2024-05-09T05:52:08.513 INFO:teuthology.orchestra.run.smithi110.stdout:remove their configuration from /etc/network/interfaces. 2024-05-09T05:52:08.513 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T05:52:08.625 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-05-09T05:52:08.638 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-05-09T05:52:08.749 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-05-09T05:52:08.918 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up postgresql-client (14+238) ... 2024-05-09T05:52:08.959 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-05-09T05:52:09.045 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-05-09T05:52:09.267 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-05-09T05:52:09.487 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:52:09.487 INFO:teuthology.orchestra.run.smithi072.stdout:The following network interfaces were found in /etc/network/interfaces 2024-05-09T05:52:09.487 INFO:teuthology.orchestra.run.smithi072.stdout:which means they are currently configured by ifupdown: 2024-05-09T05:52:09.488 INFO:teuthology.orchestra.run.smithi072.stdout:- enp3s0f1 2024-05-09T05:52:09.488 INFO:teuthology.orchestra.run.smithi072.stdout:If you want to manage those interfaces with NetworkManager instead 2024-05-09T05:52:09.488 INFO:teuthology.orchestra.run.smithi072.stdout:remove their configuration from /etc/network/interfaces. 2024-05-09T05:52:09.488 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:52:09.615 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-05-09T05:52:09.774 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-05-09T05:52:09.917 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-05-09T05:52:09.936 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-05-09T05:52:10.043 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-05-09T05:52:10.169 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up postgresql-common (238) ... 2024-05-09T05:52:10.255 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-05-09T05:52:11.019 INFO:teuthology.orchestra.run.smithi110.stdout:Adding user postgres to group ssl-cert 2024-05-09T05:52:11.172 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-05-09T05:52:11.237 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T05:52:11.237 INFO:teuthology.orchestra.run.smithi110.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-05-09T05:52:11.464 INFO:teuthology.orchestra.run.smithi110.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-05-09T05:52:11.464 INFO:teuthology.orchestra.run.smithi110.stdout:Removing obsolete dictionary files: 2024-05-09T05:52:11.962 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-05-09T05:52:12.033 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-05-09T05:52:12.082 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-05-09T05:52:12.209 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up postgresql-common (238) ... 2024-05-09T05:52:12.430 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-09T05:52:12.775 INFO:teuthology.orchestra.run.smithi110.stdout:Creating new PostgreSQL cluster 14/main ... 2024-05-09T05:52:12.802 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-05-09T05:52:12.852 INFO:teuthology.orchestra.run.smithi110.stdout:The files belonging to this database system will be owned by user "postgres". 2024-05-09T05:52:12.852 INFO:teuthology.orchestra.run.smithi110.stdout:This user must also own the server process. 2024-05-09T05:52:12.853 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T05:52:12.853 INFO:teuthology.orchestra.run.smithi110.stdout:The database cluster will be initialized with locale "en_US". 2024-05-09T05:52:12.853 INFO:teuthology.orchestra.run.smithi110.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-05-09T05:52:12.853 INFO:teuthology.orchestra.run.smithi110.stdout:The default text search configuration will be set to "english". 2024-05-09T05:52:12.853 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T05:52:12.853 INFO:teuthology.orchestra.run.smithi110.stdout:Data page checksums are disabled. 2024-05-09T05:52:12.853 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T05:52:12.853 INFO:teuthology.orchestra.run.smithi110.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-05-09T05:52:12.853 INFO:teuthology.orchestra.run.smithi110.stdout:creating subdirectories ... ok 2024-05-09T05:52:12.853 INFO:teuthology.orchestra.run.smithi110.stdout:selecting dynamic shared memory implementation ... posix 2024-05-09T05:52:12.868 INFO:teuthology.orchestra.run.smithi110.stdout:selecting default max_connections ... 100 2024-05-09T05:52:12.890 INFO:teuthology.orchestra.run.smithi110.stdout:selecting default shared_buffers ... 128MB 2024-05-09T05:52:12.907 INFO:teuthology.orchestra.run.smithi110.stdout:selecting default time zone ... Etc/UTC 2024-05-09T05:52:12.907 INFO:teuthology.orchestra.run.smithi110.stdout:creating configuration files ... ok 2024-05-09T05:52:13.026 INFO:teuthology.orchestra.run.smithi110.stdout:running bootstrap script ... ok 2024-05-09T05:52:13.106 INFO:teuthology.orchestra.run.smithi072.stdout:Adding user postgres to group ssl-cert 2024-05-09T05:52:13.338 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:52:13.339 INFO:teuthology.orchestra.run.smithi072.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-05-09T05:52:13.618 INFO:teuthology.orchestra.run.smithi072.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-05-09T05:52:13.618 INFO:teuthology.orchestra.run.smithi072.stdout:Removing obsolete dictionary files: 2024-05-09T05:52:13.652 INFO:teuthology.orchestra.run.smithi110.stdout:performing post-bootstrap initialization ... ok 2024-05-09T05:52:14.153 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-05-09T05:52:14.293 INFO:teuthology.orchestra.run.smithi110.stdout:syncing data to disk ... ok 2024-05-09T05:52:14.539 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-09T05:52:14.695 INFO:teuthology.orchestra.run.smithi110.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-05-09T05:52:14.850 INFO:teuthology.orchestra.run.smithi072.stdout:Creating new PostgreSQL cluster 14/main ... 2024-05-09T05:52:14.861 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-05-09T05:52:14.923 INFO:teuthology.orchestra.run.smithi072.stdout:The files belonging to this database system will be owned by user "postgres". 2024-05-09T05:52:14.923 INFO:teuthology.orchestra.run.smithi072.stdout:This user must also own the server process. 2024-05-09T05:52:14.923 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:52:14.923 INFO:teuthology.orchestra.run.smithi072.stdout:The database cluster will be initialized with locale "en_US". 2024-05-09T05:52:14.923 INFO:teuthology.orchestra.run.smithi072.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-05-09T05:52:14.923 INFO:teuthology.orchestra.run.smithi072.stdout:The default text search configuration will be set to "english". 2024-05-09T05:52:14.923 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:52:14.923 INFO:teuthology.orchestra.run.smithi072.stdout:Data page checksums are disabled. 2024-05-09T05:52:14.924 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:52:14.924 INFO:teuthology.orchestra.run.smithi072.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-05-09T05:52:14.924 INFO:teuthology.orchestra.run.smithi072.stdout:creating subdirectories ... ok 2024-05-09T05:52:14.924 INFO:teuthology.orchestra.run.smithi072.stdout:selecting dynamic shared memory implementation ... posix 2024-05-09T05:52:14.940 INFO:teuthology.orchestra.run.smithi072.stdout:selecting default max_connections ... 100 2024-05-09T05:52:14.962 INFO:teuthology.orchestra.run.smithi072.stdout:selecting default shared_buffers ... 128MB 2024-05-09T05:52:14.969 INFO:teuthology.orchestra.run.smithi072.stdout:selecting default time zone ... Etc/UTC 2024-05-09T05:52:14.969 INFO:teuthology.orchestra.run.smithi072.stdout:creating configuration files ... ok 2024-05-09T05:52:15.083 INFO:teuthology.orchestra.run.smithi072.stdout:running bootstrap script ... ok 2024-05-09T05:52:15.770 INFO:teuthology.orchestra.run.smithi072.stdout:performing post-bootstrap initialization ... ok 2024-05-09T05:52:16.523 INFO:teuthology.orchestra.run.smithi072.stdout:syncing data to disk ... ok 2024-05-09T05:52:16.890 INFO:teuthology.orchestra.run.smithi072.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-05-09T05:52:17.462 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-05-09T05:52:17.588 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up postgresql-contrib (14+238) ... 2024-05-09T05:52:17.705 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up postgresql (14+238) ... 2024-05-09T05:52:17.806 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-05-09T05:52:17.924 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-05-09T05:52:18.175 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-05-09T05:52:18.176 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-05-09T05:52:18.685 INFO:teuthology.orchestra.run.smithi110.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-09T05:52:18.786 INFO:teuthology.orchestra.run.smithi110.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-05-09T05:52:19.088 INFO:teuthology.orchestra.run.smithi110.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-09T05:52:19.241 INFO:teuthology.orchestra.run.smithi110.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-09T05:52:19.654 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-05-09T05:52:19.773 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up postgresql-contrib (14+238) ... 2024-05-09T05:52:19.883 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up postgresql (14+238) ... 2024-05-09T05:52:20.010 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-05-09T05:52:20.138 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-05-09T05:52:20.385 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-05-09T05:52:20.385 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-05-09T05:52:20.611 INFO:teuthology.orchestra.run.smithi110.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-05-09T05:52:20.702 INFO:teuthology.orchestra.run.smithi110.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-09T05:52:20.951 INFO:teuthology.orchestra.run.smithi072.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-09T05:52:21.061 INFO:teuthology.orchestra.run.smithi072.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-05-09T05:52:21.204 INFO:teuthology.orchestra.run.smithi110.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-09T05:52:21.210 DEBUG:teuthology.parallel:result is None 2024-05-09T05:52:21.425 INFO:teuthology.orchestra.run.smithi072.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-09T05:52:21.578 INFO:teuthology.orchestra.run.smithi072.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-09T05:52:22.784 INFO:teuthology.orchestra.run.smithi072.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-05-09T05:52:22.884 INFO:teuthology.orchestra.run.smithi072.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-09T05:52:23.426 INFO:teuthology.orchestra.run.smithi072.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-09T05:52:23.430 DEBUG:teuthology.parallel:result is None 2024-05-09T05:52:23.431 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=c9da4049f638c0f84bdd9b4e33c42e86046ac554 2024-05-09T05:52:23.571 DEBUG:teuthology.orchestra.run.smithi072:> dpkg-query -W -f '${Version}' ceph 2024-05-09T05:52:23.589 INFO:teuthology.orchestra.run.smithi072.stdout:19.0.0-3594-gc9da4049-1jammy 2024-05-09T05:52:23.590 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3594-gc9da4049-1jammy 2024-05-09T05:52:23.590 INFO:teuthology.task.install:The correct ceph version 19.0.0-3594-gc9da4049-1jammy is installed. 2024-05-09T05:52:23.593 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=c9da4049f638c0f84bdd9b4e33c42e86046ac554 2024-05-09T05:52:23.731 DEBUG:teuthology.orchestra.run.smithi110:> dpkg-query -W -f '${Version}' ceph 2024-05-09T05:52:23.750 INFO:teuthology.orchestra.run.smithi110.stdout:19.0.0-3594-gc9da4049-1jammy 2024-05-09T05:52:23.751 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3594-gc9da4049-1jammy 2024-05-09T05:52:23.751 INFO:teuthology.task.install:The correct ceph version 19.0.0-3594-gc9da4049-1jammy is installed. 2024-05-09T05:52:23.753 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-09T05:52:23.753 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-09T05:52:23.753 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-09T05:52:23.767 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-05-09T05:52:23.767 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-09T05:52:23.806 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-09T05:52:23.807 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-09T05:52:23.807 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/daemon-helper 2024-05-09T05:52:23.823 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-09T05:52:23.879 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-05-09T05:52:23.879 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/daemon-helper 2024-05-09T05:52:23.892 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-09T05:52:23.946 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-09T05:52:23.947 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-09T05:52:23.947 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-09T05:52:23.959 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-09T05:52:24.011 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-05-09T05:52:24.012 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-09T05:52:24.025 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-09T05:52:24.077 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-09T05:52:24.077 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-09T05:52:24.077 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/stdin-killer 2024-05-09T05:52:24.089 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-09T05:52:24.143 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-05-09T05:52:24.143 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/stdin-killer 2024-05-09T05:52:24.156 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-09T05:52:24.209 INFO:teuthology.run_tasks:Running task ceph... 2024-05-09T05:52:24.289 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-05-09T05:52:24.289 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 777 /var/log/ceph 2024-05-09T05:52:24.292 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 777 /var/log/ceph 2024-05-09T05:52:24.305 INFO:tasks.ceph:Disabling ceph logrotate... 2024-05-09T05:52:24.305 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-09T05:52:24.346 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-09T05:52:24.359 INFO:tasks.ceph:Creating extra log directories... 2024-05-09T05:52:24.359 DEBUG:teuthology.orchestra.run.smithi072:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-09T05:52:24.401 DEBUG:teuthology.orchestra.run.smithi110:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-09T05:52:24.421 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-05-09T05:52:24.421 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-05-09T05:52:24.421 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-05-09T05:52:24.421 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-09T05:52:24.421 DEBUG:teuthology.orchestra.run.smithi072:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-09T05:52:24.460 DEBUG:teuthology.orchestra.run.smithi072:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-09T05:52:24.535 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-05-09T05:52:24.535 DEBUG:teuthology.orchestra.run.smithi110:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-09T05:52:24.540 DEBUG:teuthology.orchestra.run.smithi110:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-09T05:52:24.619 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-05-09T05:52:24.619 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'Replacing daemon mds'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-05-09T05:52:24.619 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7699143', 'branch': 'wip-pdonnell-testing-20240508.183908-debug', 'description': 'fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mds 2-workunit/suites/iozone}}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7699143', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20240508.183908-debug'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'Replacing daemon mds'], 'sha1': 'c9da4049f638c0f84bdd9b4e33c42e86046ac554'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'check-counter': {'counters': {'mds': ['mds.exported', 'mds.imported']}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'c9da4049f638c0f84bdd9b4e33c42e86046ac554'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20240508.183908-debug', 'sha1': 'c9da4049f638c0f84bdd9b4e33c42e86046ac554'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 1722, 'sha1': 'c9da4049f638c0f84bdd9b4e33c42e86046ac554', 'sleep_before_teardown': 0, 'subset': '67/512', 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20240508.183908-debug', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_c9da4049f638c0f84bdd9b4e33c42e86046ac554/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'c9da4049f638c0f84bdd9b4e33c42e86046ac554', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi072.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLBOhfkWxGaTPCMHW7ek6Zk+T02DHsBcO/UQ9q0wHS/wA2aT+MRqVaNbi1t3+PMacHBs6OcUqrOft9MtfQ3MJu0=', 'smithi110.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBfOcSg3hESNznkB067uAx9DffDP+Oemodm6GOsRSa7LLK7FYgL9jIxuE3LY1G6kjWjZyVRi0Lyly4ao7F4C96w='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'c9da4049f638c0f84bdd9b4e33c42e86046ac554'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'Replacing daemon mds'], 'sha1': 'c9da4049f638c0f84bdd9b4e33c42e86046ac554', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'mds_thrash': None}, {'workunit': {'clients': {'all': ['suites/iozone.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '1ae7ad82388e92a475afff437d49054826c019a1', 'timestamp': '2024-05-08_22:06:20', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-05-09T05:52:24.620 DEBUG:teuthology.orchestra.run.smithi072:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-09T05:52:24.622 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-09T05:52:24.662 DEBUG:teuthology.orchestra.run.smithi072:> sudo install -d -m0777 -- /var/run/ceph 2024-05-09T05:52:24.669 DEBUG:teuthology.orchestra.run.smithi110:> sudo install -d -m0777 -- /var/run/ceph 2024-05-09T05:52:24.718 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-09T05:52:24.718 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/scratch_devs of=/dev/stdout 2024-05-09T05:52:24.728 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-09T05:52:24.728 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_1 2024-05-09T05:52:24.776 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-09T05:52:24.776 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T05:52:24.776 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 5h/5d Inode: 888 Links: 1 2024-05-09T05:52:24.776 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T05:52:24.777 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2024-05-09 05:46:06.864854565 +0000 2024-05-09T05:52:24.777 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2024-05-09 05:46:06.604856884 +0000 2024-05-09T05:52:24.777 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2024-05-09 05:46:06.604856884 +0000 2024-05-09T05:52:24.777 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: - 2024-05-09T05:52:24.777 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-09T05:52:24.830 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2024-05-09T05:52:24.830 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2024-05-09T05:52:24.831 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000449073 s, 1.1 MB/s 2024-05-09T05:52:24.832 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-09T05:52:24.881 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_2 2024-05-09T05:52:24.928 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-09T05:52:24.928 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T05:52:24.928 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 5h/5d Inode: 905 Links: 1 2024-05-09T05:52:24.928 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T05:52:24.928 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2024-05-09 05:46:07.068852746 +0000 2024-05-09T05:52:24.928 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2024-05-09 05:46:07.064852782 +0000 2024-05-09T05:52:24.928 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2024-05-09 05:46:07.064852782 +0000 2024-05-09T05:52:24.928 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: - 2024-05-09T05:52:24.929 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-09T05:52:24.982 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2024-05-09T05:52:24.982 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2024-05-09T05:52:24.982 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000449203 s, 1.1 MB/s 2024-05-09T05:52:24.983 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-09T05:52:25.033 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_3 2024-05-09T05:52:25.080 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-09T05:52:25.080 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T05:52:25.080 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 5h/5d Inode: 918 Links: 1 2024-05-09T05:52:25.080 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T05:52:25.080 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2024-05-09 05:46:07.808846145 +0000 2024-05-09T05:52:25.080 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2024-05-09 05:46:07.560848357 +0000 2024-05-09T05:52:25.080 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2024-05-09 05:46:07.560848357 +0000 2024-05-09T05:52:25.080 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: - 2024-05-09T05:52:25.081 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-09T05:52:25.134 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2024-05-09T05:52:25.134 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2024-05-09T05:52:25.134 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000433614 s, 1.2 MB/s 2024-05-09T05:52:25.135 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-09T05:52:25.185 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_4 2024-05-09T05:52:25.232 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-09T05:52:25.232 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T05:52:25.232 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 5h/5d Inode: 932 Links: 1 2024-05-09T05:52:25.233 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T05:52:25.233 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2024-05-09 05:46:08.320841577 +0000 2024-05-09T05:52:25.233 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2024-05-09 05:46:08.068843825 +0000 2024-05-09T05:52:25.233 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2024-05-09 05:46:08.068843825 +0000 2024-05-09T05:52:25.233 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: - 2024-05-09T05:52:25.233 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-09T05:52:25.286 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2024-05-09T05:52:25.286 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2024-05-09T05:52:25.286 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000402562 s, 1.3 MB/s 2024-05-09T05:52:25.287 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-09T05:52:25.337 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-09T05:52:25.337 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-05-09T05:52:25.337 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/scratch_devs of=/dev/stdout 2024-05-09T05:52:25.343 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-09T05:52:25.343 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_1 2024-05-09T05:52:25.390 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-09T05:52:25.390 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T05:52:25.391 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 889 Links: 1 2024-05-09T05:52:25.391 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T05:52:25.391 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-05-09 05:46:00.698648543 +0000 2024-05-09T05:52:25.391 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-05-09 05:46:00.434650901 +0000 2024-05-09T05:52:25.391 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-05-09 05:46:00.434650901 +0000 2024-05-09T05:52:25.391 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: - 2024-05-09T05:52:25.391 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-09T05:52:25.445 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-05-09T05:52:25.445 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-05-09T05:52:25.445 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000245377 s, 2.1 MB/s 2024-05-09T05:52:25.446 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-09T05:52:25.496 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_2 2024-05-09T05:52:25.542 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-09T05:52:25.542 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T05:52:25.542 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 900 Links: 1 2024-05-09T05:52:25.542 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T05:52:25.542 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-05-09 05:46:01.182644220 +0000 2024-05-09T05:52:25.543 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-05-09 05:46:00.918646578 +0000 2024-05-09T05:52:25.543 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-05-09 05:46:00.918646578 +0000 2024-05-09T05:52:25.543 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: - 2024-05-09T05:52:25.543 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-09T05:52:25.596 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-05-09T05:52:25.597 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-05-09T05:52:25.597 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000282928 s, 1.8 MB/s 2024-05-09T05:52:25.598 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-09T05:52:25.647 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_3 2024-05-09T05:52:25.694 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-09T05:52:25.694 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T05:52:25.694 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 915 Links: 1 2024-05-09T05:52:25.694 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T05:52:25.694 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-05-09 05:46:01.646640075 +0000 2024-05-09T05:52:25.694 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-05-09 05:46:01.406642218 +0000 2024-05-09T05:52:25.694 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-05-09 05:46:01.406642218 +0000 2024-05-09T05:52:25.694 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: - 2024-05-09T05:52:25.695 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-09T05:52:25.748 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-05-09T05:52:25.749 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-05-09T05:52:25.749 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000280616 s, 1.8 MB/s 2024-05-09T05:52:25.750 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-09T05:52:25.799 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_4 2024-05-09T05:52:25.847 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-09T05:52:25.847 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T05:52:25.847 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 933 Links: 1 2024-05-09T05:52:25.847 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T05:52:25.847 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-05-09 05:46:02.114635895 +0000 2024-05-09T05:52:25.847 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-05-09 05:46:01.878638003 +0000 2024-05-09T05:52:25.847 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-05-09 05:46:01.878638003 +0000 2024-05-09T05:52:25.847 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: - 2024-05-09T05:52:25.847 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-09T05:52:25.901 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-05-09T05:52:25.901 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-05-09T05:52:25.901 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000242907 s, 2.1 MB/s 2024-05-09T05:52:25.902 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-09T05:52:25.952 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-09T05:52:25.952 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi072.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi110.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-09T05:52:25.952 INFO:tasks.ceph:Generating config... 2024-05-09T05:52:25.953 INFO:tasks.ceph:[client] client mount timeout = 600 2024-05-09T05:52:25.953 INFO:tasks.ceph:[client] client_shutdown_timeout = 120 2024-05-09T05:52:25.953 INFO:tasks.ceph:[client] debug client = 20 2024-05-09T05:52:25.953 INFO:tasks.ceph:[client] debug ms = 1 2024-05-09T05:52:25.953 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-05-09T05:52:25.953 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-05-09T05:52:25.953 INFO:tasks.ceph:[mds] debug mds = 20 2024-05-09T05:52:25.953 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-05-09T05:52:25.953 INFO:tasks.ceph:[mds] debug ms = 1 2024-05-09T05:52:25.954 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2024-05-09T05:52:25.954 INFO:tasks.ceph:[mds] mds bal merge size = 5 2024-05-09T05:52:25.954 INFO:tasks.ceph:[mds] mds bal split bits = 3 2024-05-09T05:52:25.954 INFO:tasks.ceph:[mds] mds bal split size = 100 2024-05-09T05:52:25.954 INFO:tasks.ceph:[mds] mds debug frag = True 2024-05-09T05:52:25.954 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-05-09T05:52:25.954 INFO:tasks.ceph:[mds] mds oft prefetch dirfrags = True 2024-05-09T05:52:25.954 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-05-09T05:52:25.954 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-05-09T05:52:25.954 INFO:tasks.ceph:[mds] mds_dir_prefetch = True 2024-05-09T05:52:25.954 INFO:tasks.ceph:[mds] mds_sleep_rank_change = 5000000.0 2024-05-09T05:52:25.954 INFO:tasks.ceph:[mds] mon client directed command retry = 5 2024-05-09T05:52:25.955 INFO:tasks.ceph:[mds] ms inject delay max = 1 2024-05-09T05:52:25.955 INFO:tasks.ceph:[mds] ms inject delay probability = 0.005 2024-05-09T05:52:25.955 INFO:tasks.ceph:[mds] ms inject delay type = client mds osd 2024-05-09T05:52:25.955 INFO:tasks.ceph:[mds] ms inject socket failures = 2500 2024-05-09T05:52:25.955 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-05-09T05:52:25.955 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-05-09T05:52:25.955 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-05-09T05:52:25.955 INFO:tasks.ceph:[mgr] debug client = 20 2024-05-09T05:52:25.955 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-05-09T05:52:25.955 INFO:tasks.ceph:[mgr] debug ms = 1 2024-05-09T05:52:25.955 INFO:tasks.ceph:[mon] debug mon = 20 2024-05-09T05:52:25.955 INFO:tasks.ceph:[mon] debug ms = 1 2024-05-09T05:52:25.955 INFO:tasks.ceph:[mon] debug paxos = 20 2024-05-09T05:52:25.955 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-05-09T05:52:25.955 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-05-09T05:52:25.956 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-05-09T05:52:25.956 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-05-09T05:52:25.956 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-05-09T05:52:25.956 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-05-09T05:52:25.956 INFO:tasks.ceph:[osd] debug ms = 1 2024-05-09T05:52:25.956 INFO:tasks.ceph:[osd] debug osd = 20 2024-05-09T05:52:25.956 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-05-09T05:52:25.956 INFO:tasks.ceph:[osd] mon client directed command retry = 5 2024-05-09T05:52:25.956 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-05-09T05:52:25.956 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-05-09T05:52:25.956 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-05-09T05:52:25.956 INFO:tasks.ceph:[osd] ms inject delay max = 1 2024-05-09T05:52:25.956 INFO:tasks.ceph:[osd] ms inject delay probability = 0.005 2024-05-09T05:52:25.956 INFO:tasks.ceph:[osd] ms inject delay type = client mds 2024-05-09T05:52:25.956 INFO:tasks.ceph:[osd] ms inject socket failures = 2500 2024-05-09T05:52:25.957 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-05-09T05:52:25.957 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-05-09T05:52:25.957 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-05-09T05:52:25.957 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-05-09T05:52:25.957 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-05-09T05:52:25.957 INFO:tasks.ceph:Setting up mon.a... 2024-05-09T05:52:25.957 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-05-09T05:52:26.023 INFO:teuthology.orchestra.run.smithi072.stdout:creating /etc/ceph/ceph.keyring 2024-05-09T05:52:26.041 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-05-09T05:52:26.106 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-09T05:52:26.117 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.72'), ('mon.b', '172.21.15.110'), ('mon.c', '[v2:172.21.15.110:3301,v1:172.21.15.110:6790]')] 2024-05-09T05:52:26.118 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.72,172.21.15.110,[v2:172.21.15.110:3301,v1:172.21.15.110:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-05-09T05:52:26.119 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-09T05:52:26.119 DEBUG:teuthology.orchestra.run.smithi072:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-05-09T05:52:26.164 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.72 --add b 172.21.15.110 --addv c '[v2:172.21.15.110:3301,v1:172.21.15.110:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-05-09T05:52:26.278 INFO:teuthology.orchestra.run.smithi072.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-05-09T05:52:26.278 INFO:teuthology.orchestra.run.smithi072.stdout:monmaptool: generated fsid 44c88cb9-b39b-4787-a871-80ddf0ad6292 2024-05-09T05:52:26.278 INFO:teuthology.orchestra.run.smithi072.stdout:setting min_mon_release = quincy 2024-05-09T05:52:26.278 INFO:teuthology.orchestra.run.smithi072.stdout:epoch 0 2024-05-09T05:52:26.278 INFO:teuthology.orchestra.run.smithi072.stdout:fsid 44c88cb9-b39b-4787-a871-80ddf0ad6292 2024-05-09T05:52:26.278 INFO:teuthology.orchestra.run.smithi072.stdout:last_changed 2024-05-09T05:52:26.289112+0000 2024-05-09T05:52:26.278 INFO:teuthology.orchestra.run.smithi072.stdout:created 2024-05-09T05:52:26.289112+0000 2024-05-09T05:52:26.278 INFO:teuthology.orchestra.run.smithi072.stdout:min_mon_release 17 (quincy) 2024-05-09T05:52:26.278 INFO:teuthology.orchestra.run.smithi072.stdout:election_strategy: 1 2024-05-09T05:52:26.278 INFO:teuthology.orchestra.run.smithi072.stdout:0: [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] mon.a 2024-05-09T05:52:26.279 INFO:teuthology.orchestra.run.smithi072.stdout:1: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.b 2024-05-09T05:52:26.279 INFO:teuthology.orchestra.run.smithi072.stdout:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-05-09T05:52:26.279 INFO:teuthology.orchestra.run.smithi072.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-05-09T05:52:26.284 DEBUG:teuthology.orchestra.run.smithi072:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-05-09T05:52:26.289 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 44c88cb9-b39b-4787-a871-80ddf0ad6292... 2024-05-09T05:52:26.290 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-09T05:52:26.333 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-09T05:52:26.357 INFO:teuthology.orchestra.run.smithi072.stdout:[global] 2024-05-09T05:52:26.357 INFO:teuthology.orchestra.run.smithi072.stdout: chdir = "" 2024-05-09T05:52:26.357 INFO:teuthology.orchestra.run.smithi072.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-09T05:52:26.357 INFO:teuthology.orchestra.run.smithi072.stdout: auth supported = cephx 2024-05-09T05:52:26.357 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:52:26.357 INFO:teuthology.orchestra.run.smithi072.stdout: filestore xattr use omap = true 2024-05-09T05:52:26.357 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:52:26.357 INFO:teuthology.orchestra.run.smithi072.stdout: mon clock drift allowed = 1.000 2024-05-09T05:52:26.357 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:52:26.357 INFO:teuthology.orchestra.run.smithi072.stdout: osd crush chooseleaf type = 0 2024-05-09T05:52:26.357 INFO:teuthology.orchestra.run.smithi072.stdout: auth debug = true 2024-05-09T05:52:26.357 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:52:26.358 INFO:teuthology.orchestra.run.smithi072.stdout: ms die on old message = true 2024-05-09T05:52:26.358 INFO:teuthology.orchestra.run.smithi072.stdout: ms die on bug = true 2024-05-09T05:52:26.358 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:52:26.358 INFO:teuthology.orchestra.run.smithi072.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-09T05:52:26.358 INFO:teuthology.orchestra.run.smithi072.stdout: mon pg warn max object skew = 0 2024-05-09T05:52:26.358 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:52:26.358 INFO:teuthology.orchestra.run.smithi072.stdout: # disable pg_autoscaler by default for new pools 2024-05-09T05:52:26.358 INFO:teuthology.orchestra.run.smithi072.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-09T05:52:26.358 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:52:26.358 INFO:teuthology.orchestra.run.smithi072.stdout: osd pool default size = 2 2024-05-09T05:52:26.358 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:52:26.358 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd allow primary affinity = true 2024-05-09T05:52:26.358 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd allow pg remap = true 2024-05-09T05:52:26.358 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on legacy crush tunables = false 2024-05-09T05:52:26.359 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on crush straw calc version zero = false 2024-05-09T05:52:26.359 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on no sortbitwise = false 2024-05-09T05:52:26.359 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on osd down out interval zero = false 2024-05-09T05:52:26.359 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on too few osds = false 2024-05-09T05:52:26.359 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-09T05:52:26.359 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-09T05:52:26.359 INFO:teuthology.orchestra.run.smithi072.stdout: mon_allow_pool_size_one = true 2024-05-09T05:52:26.359 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:52:26.359 INFO:teuthology.orchestra.run.smithi072.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-09T05:52:26.359 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:52:26.359 INFO:teuthology.orchestra.run.smithi072.stdout: osd default data pool replay window = 5 2024-05-09T05:52:26.359 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:52:26.359 INFO:teuthology.orchestra.run.smithi072.stdout: mon allow pool delete = true 2024-05-09T05:52:26.359 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:52:26.360 INFO:teuthology.orchestra.run.smithi072.stdout: mon cluster log file level = debug 2024-05-09T05:52:26.360 INFO:teuthology.orchestra.run.smithi072.stdout: debug asserts on shutdown = true 2024-05-09T05:52:26.360 INFO:teuthology.orchestra.run.smithi072.stdout: mon health detail to clog = false 2024-05-09T05:52:26.360 INFO:teuthology.orchestra.run.smithi072.stdout: mon host = "172.21.15.72,172.21.15.110,[v2:172.21.15.110:3301,v1:172.21.15.110:6790]" 2024-05-09T05:52:26.360 INFO:teuthology.orchestra.run.smithi072.stdout: fsid = 44c88cb9-b39b-4787-a871-80ddf0ad6292 2024-05-09T05:52:26.360 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:52:26.360 INFO:teuthology.orchestra.run.smithi072.stdout:[osd] 2024-05-09T05:52:26.360 INFO:teuthology.orchestra.run.smithi072.stdout: osd journal size = 100 2024-05-09T05:52:26.360 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:52:26.360 INFO:teuthology.orchestra.run.smithi072.stdout: osd scrub load threshold = 5.0 2024-05-09T05:52:26.360 INFO:teuthology.orchestra.run.smithi072.stdout: osd scrub max interval = 600 2024-05-09T05:52:26.360 INFO:teuthology.orchestra.run.smithi072.stdout: osd mclock profile = high_recovery_ops 2024-05-09T05:52:26.360 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:52:26.360 INFO:teuthology.orchestra.run.smithi072.stdout: osd recover clone overlap = true 2024-05-09T05:52:26.360 INFO:teuthology.orchestra.run.smithi072.stdout: osd recovery max chunk = 1048576 2024-05-09T05:52:26.361 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:52:26.361 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug shutdown = true 2024-05-09T05:52:26.361 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug op order = true 2024-05-09T05:52:26.361 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug verify stray on activate = true 2024-05-09T05:52:26.361 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug trim objects = true 2024-05-09T05:52:26.361 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:52:26.361 INFO:teuthology.orchestra.run.smithi072.stdout: osd open classes on start = true 2024-05-09T05:52:26.361 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug pg log writeout = true 2024-05-09T05:52:26.361 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:52:26.361 INFO:teuthology.orchestra.run.smithi072.stdout: osd deep scrub update digest min age = 30 2024-05-09T05:52:26.361 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:52:26.361 INFO:teuthology.orchestra.run.smithi072.stdout: osd map max advance = 10 2024-05-09T05:52:26.361 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:52:26.361 INFO:teuthology.orchestra.run.smithi072.stdout: journal zero on create = true 2024-05-09T05:52:26.362 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:52:26.362 INFO:teuthology.orchestra.run.smithi072.stdout: filestore ondisk finisher threads = 3 2024-05-09T05:52:26.362 INFO:teuthology.orchestra.run.smithi072.stdout: filestore apply finisher threads = 3 2024-05-09T05:52:26.362 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:52:26.362 INFO:teuthology.orchestra.run.smithi072.stdout: bdev debug aio = true 2024-05-09T05:52:26.362 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug misdirected ops = true 2024-05-09T05:52:26.362 INFO:teuthology.orchestra.run.smithi072.stdout: bluestore block size = 96636764160 2024-05-09T05:52:26.362 INFO:teuthology.orchestra.run.smithi072.stdout: bluestore fsck on mount = True 2024-05-09T05:52:26.362 INFO:teuthology.orchestra.run.smithi072.stdout: debug bluefs = 20 2024-05-09T05:52:26.362 INFO:teuthology.orchestra.run.smithi072.stdout: debug bluestore = 20 2024-05-09T05:52:26.362 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2024-05-09T05:52:26.362 INFO:teuthology.orchestra.run.smithi072.stdout: debug osd = 20 2024-05-09T05:52:26.362 INFO:teuthology.orchestra.run.smithi072.stdout: debug rocksdb = 10 2024-05-09T05:52:26.362 INFO:teuthology.orchestra.run.smithi072.stdout: mon client directed command retry = 5 2024-05-09T05:52:26.363 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd backfillfull_ratio = 0.85 2024-05-09T05:52:26.363 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd full ratio = 0.9 2024-05-09T05:52:26.363 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd nearfull ratio = 0.8 2024-05-09T05:52:26.363 INFO:teuthology.orchestra.run.smithi072.stdout: ms inject delay max = 1 2024-05-09T05:52:26.363 INFO:teuthology.orchestra.run.smithi072.stdout: ms inject delay probability = 0.005 2024-05-09T05:52:26.363 INFO:teuthology.orchestra.run.smithi072.stdout: ms inject delay type = client mds 2024-05-09T05:52:26.363 INFO:teuthology.orchestra.run.smithi072.stdout: ms inject socket failures = 2500 2024-05-09T05:52:26.363 INFO:teuthology.orchestra.run.smithi072.stdout: osd blocked scrub grace period = 3600 2024-05-09T05:52:26.363 INFO:teuthology.orchestra.run.smithi072.stdout: osd failsafe full ratio = 0.95 2024-05-09T05:52:26.363 INFO:teuthology.orchestra.run.smithi072.stdout: osd max markdown count = 1000 2024-05-09T05:52:26.363 INFO:teuthology.orchestra.run.smithi072.stdout: osd objectstore = bluestore 2024-05-09T05:52:26.363 INFO:teuthology.orchestra.run.smithi072.stdout: osd op complaint time = 180 2024-05-09T05:52:26.363 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:52:26.363 INFO:teuthology.orchestra.run.smithi072.stdout:[mgr] 2024-05-09T05:52:26.364 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2024-05-09T05:52:26.364 INFO:teuthology.orchestra.run.smithi072.stdout: debug mgr = 20 2024-05-09T05:52:26.364 INFO:teuthology.orchestra.run.smithi072.stdout: debug mon = 20 2024-05-09T05:52:26.364 INFO:teuthology.orchestra.run.smithi072.stdout: debug auth = 20 2024-05-09T05:52:26.364 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min pgs per osd = 4 2024-05-09T05:52:26.364 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min bytes per osd = 10 2024-05-09T05:52:26.364 INFO:teuthology.orchestra.run.smithi072.stdout: mgr/telemetry/nag = false 2024-05-09T05:52:26.364 INFO:teuthology.orchestra.run.smithi072.stdout: debug client = 20 2024-05-09T05:52:26.364 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:52:26.364 INFO:teuthology.orchestra.run.smithi072.stdout:[mon] 2024-05-09T05:52:26.364 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2024-05-09T05:52:26.364 INFO:teuthology.orchestra.run.smithi072.stdout: debug mon = 20 2024-05-09T05:52:26.364 INFO:teuthology.orchestra.run.smithi072.stdout: debug paxos = 20 2024-05-09T05:52:26.364 INFO:teuthology.orchestra.run.smithi072.stdout: debug auth = 20 2024-05-09T05:52:26.364 INFO:teuthology.orchestra.run.smithi072.stdout: mon data avail warn = 5 2024-05-09T05:52:26.365 INFO:teuthology.orchestra.run.smithi072.stdout: mon mgr mkfs grace = 240 2024-05-09T05:52:26.365 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min pgs per osd = 4 2024-05-09T05:52:26.365 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd reporter subtree level = osd 2024-05-09T05:52:26.365 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd prime pg temp = true 2024-05-09T05:52:26.365 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min bytes per osd = 10 2024-05-09T05:52:26.365 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:52:26.365 INFO:teuthology.orchestra.run.smithi072.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-09T05:52:26.365 INFO:teuthology.orchestra.run.smithi072.stdout: auth mon ticket ttl = 660 # 11m 2024-05-09T05:52:26.365 INFO:teuthology.orchestra.run.smithi072.stdout: auth service ticket ttl = 240 # 4m 2024-05-09T05:52:26.365 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:52:26.365 INFO:teuthology.orchestra.run.smithi072.stdout: # don't complain about insecure global_id in the test suite 2024-05-09T05:52:26.365 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-09T05:52:26.365 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-09T05:52:26.365 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:52:26.366 INFO:teuthology.orchestra.run.smithi072.stdout: # 1m isn't quite enough 2024-05-09T05:52:26.366 INFO:teuthology.orchestra.run.smithi072.stdout: mon_down_mkfs_grace = 2m 2024-05-09T05:52:26.366 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:52:26.366 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_filestore_osds = false 2024-05-09T05:52:26.366 INFO:teuthology.orchestra.run.smithi072.stdout: mon down mkfs grace = 300 2024-05-09T05:52:26.366 INFO:teuthology.orchestra.run.smithi072.stdout: mon op complaint time = 120 2024-05-09T05:52:26.366 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:52:26.366 INFO:teuthology.orchestra.run.smithi072.stdout:[client] 2024-05-09T05:52:26.366 INFO:teuthology.orchestra.run.smithi072.stdout: rgw cache enabled = true 2024-05-09T05:52:26.366 INFO:teuthology.orchestra.run.smithi072.stdout: rgw enable ops log = true 2024-05-09T05:52:26.366 INFO:teuthology.orchestra.run.smithi072.stdout: rgw enable usage log = true 2024-05-09T05:52:26.366 INFO:teuthology.orchestra.run.smithi072.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-09T05:52:26.366 INFO:teuthology.orchestra.run.smithi072.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-09T05:52:26.366 INFO:teuthology.orchestra.run.smithi072.stdout: client mount timeout = 600 2024-05-09T05:52:26.367 INFO:teuthology.orchestra.run.smithi072.stdout: client_shutdown_timeout = 120 2024-05-09T05:52:26.367 INFO:teuthology.orchestra.run.smithi072.stdout: debug client = 20 2024-05-09T05:52:26.367 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2024-05-09T05:52:26.367 INFO:teuthology.orchestra.run.smithi072.stdout: rados mon op timeout = 900 2024-05-09T05:52:26.367 INFO:teuthology.orchestra.run.smithi072.stdout: rados osd op timeout = 900 2024-05-09T05:52:26.367 INFO:teuthology.orchestra.run.smithi072.stdout:[mon.a] 2024-05-09T05:52:26.367 INFO:teuthology.orchestra.run.smithi072.stdout:[mon.b] 2024-05-09T05:52:26.367 INFO:teuthology.orchestra.run.smithi072.stdout:[mon.c] 2024-05-09T05:52:26.367 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.a] 2024-05-09T05:52:26.367 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.c] 2024-05-09T05:52:26.367 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.e] 2024-05-09T05:52:26.367 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.b] 2024-05-09T05:52:26.367 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.d] 2024-05-09T05:52:26.367 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.f] 2024-05-09T05:52:26.367 INFO:teuthology.orchestra.run.smithi072.stdout:[mds] 2024-05-09T05:52:26.368 INFO:teuthology.orchestra.run.smithi072.stdout: debug mds = 20 2024-05-09T05:52:26.368 INFO:teuthology.orchestra.run.smithi072.stdout: debug mds balancer = 20 2024-05-09T05:52:26.368 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2024-05-09T05:52:26.368 INFO:teuthology.orchestra.run.smithi072.stdout: mds bal fragment size max = 10000 2024-05-09T05:52:26.368 INFO:teuthology.orchestra.run.smithi072.stdout: mds bal merge size = 5 2024-05-09T05:52:26.368 INFO:teuthology.orchestra.run.smithi072.stdout: mds bal split bits = 3 2024-05-09T05:52:26.368 INFO:teuthology.orchestra.run.smithi072.stdout: mds bal split size = 100 2024-05-09T05:52:26.368 INFO:teuthology.orchestra.run.smithi072.stdout: mds debug frag = True 2024-05-09T05:52:26.368 INFO:teuthology.orchestra.run.smithi072.stdout: mds debug scatterstat = True 2024-05-09T05:52:26.368 INFO:teuthology.orchestra.run.smithi072.stdout: mds oft prefetch dirfrags = True 2024-05-09T05:52:26.368 INFO:teuthology.orchestra.run.smithi072.stdout: mds op complaint time = 180 2024-05-09T05:52:26.368 INFO:teuthology.orchestra.run.smithi072.stdout: mds verify scatter = True 2024-05-09T05:52:26.368 INFO:teuthology.orchestra.run.smithi072.stdout: mds_dir_prefetch = True 2024-05-09T05:52:26.368 INFO:teuthology.orchestra.run.smithi072.stdout: mds_sleep_rank_change = 5000000.0 2024-05-09T05:52:26.369 INFO:teuthology.orchestra.run.smithi072.stdout: mon client directed command retry = 5 2024-05-09T05:52:26.369 INFO:teuthology.orchestra.run.smithi072.stdout: ms inject delay max = 1 2024-05-09T05:52:26.369 INFO:teuthology.orchestra.run.smithi072.stdout: ms inject delay probability = 0.005 2024-05-09T05:52:26.369 INFO:teuthology.orchestra.run.smithi072.stdout: ms inject delay type = client mds osd 2024-05-09T05:52:26.369 INFO:teuthology.orchestra.run.smithi072.stdout: ms inject socket failures = 2500 2024-05-09T05:52:26.369 INFO:teuthology.orchestra.run.smithi072.stdout: osd op complaint time = 180 2024-05-09T05:52:26.369 INFO:teuthology.orchestra.run.smithi072.stdout: rados mon op timeout = 900 2024-05-09T05:52:26.369 INFO:teuthology.orchestra.run.smithi072.stdout: rados osd op timeout = 900 2024-05-09T05:52:26.369 INFO:teuthology.orchestra.run.smithi110.stdout:[global] 2024-05-09T05:52:26.370 INFO:teuthology.orchestra.run.smithi110.stdout: chdir = "" 2024-05-09T05:52:26.370 INFO:teuthology.orchestra.run.smithi110.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-09T05:52:26.370 INFO:teuthology.orchestra.run.smithi110.stdout: auth supported = cephx 2024-05-09T05:52:26.370 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T05:52:26.370 INFO:teuthology.orchestra.run.smithi110.stdout: filestore xattr use omap = true 2024-05-09T05:52:26.370 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T05:52:26.370 INFO:teuthology.orchestra.run.smithi110.stdout: mon clock drift allowed = 1.000 2024-05-09T05:52:26.370 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T05:52:26.370 INFO:teuthology.orchestra.run.smithi110.stdout: osd crush chooseleaf type = 0 2024-05-09T05:52:26.370 INFO:teuthology.orchestra.run.smithi110.stdout: auth debug = true 2024-05-09T05:52:26.370 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T05:52:26.370 INFO:teuthology.orchestra.run.smithi110.stdout: ms die on old message = true 2024-05-09T05:52:26.371 INFO:teuthology.orchestra.run.smithi110.stdout: ms die on bug = true 2024-05-09T05:52:26.371 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T05:52:26.371 INFO:teuthology.orchestra.run.smithi110.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-09T05:52:26.371 INFO:teuthology.orchestra.run.smithi110.stdout: mon pg warn max object skew = 0 2024-05-09T05:52:26.371 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T05:52:26.371 INFO:teuthology.orchestra.run.smithi110.stdout: # disable pg_autoscaler by default for new pools 2024-05-09T05:52:26.371 INFO:teuthology.orchestra.run.smithi110.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-09T05:52:26.371 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T05:52:26.371 INFO:teuthology.orchestra.run.smithi110.stdout: osd pool default size = 2 2024-05-09T05:52:26.371 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T05:52:26.371 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd allow primary affinity = true 2024-05-09T05:52:26.371 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd allow pg remap = true 2024-05-09T05:52:26.371 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on legacy crush tunables = false 2024-05-09T05:52:26.371 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on crush straw calc version zero = false 2024-05-09T05:52:26.371 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on no sortbitwise = false 2024-05-09T05:52:26.372 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on osd down out interval zero = false 2024-05-09T05:52:26.372 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on too few osds = false 2024-05-09T05:52:26.372 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-09T05:52:26.372 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-09T05:52:26.372 INFO:teuthology.orchestra.run.smithi110.stdout: mon_allow_pool_size_one = true 2024-05-09T05:52:26.372 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T05:52:26.372 INFO:teuthology.orchestra.run.smithi110.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-09T05:52:26.372 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T05:52:26.372 INFO:teuthology.orchestra.run.smithi110.stdout: osd default data pool replay window = 5 2024-05-09T05:52:26.372 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T05:52:26.372 INFO:teuthology.orchestra.run.smithi110.stdout: mon allow pool delete = true 2024-05-09T05:52:26.372 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T05:52:26.372 INFO:teuthology.orchestra.run.smithi110.stdout: mon cluster log file level = debug 2024-05-09T05:52:26.372 INFO:teuthology.orchestra.run.smithi110.stdout: debug asserts on shutdown = true 2024-05-09T05:52:26.373 INFO:teuthology.orchestra.run.smithi110.stdout: mon health detail to clog = false 2024-05-09T05:52:26.373 INFO:teuthology.orchestra.run.smithi110.stdout: mon host = "172.21.15.72,172.21.15.110,[v2:172.21.15.110:3301,v1:172.21.15.110:6790]" 2024-05-09T05:52:26.373 INFO:teuthology.orchestra.run.smithi110.stdout: fsid = 44c88cb9-b39b-4787-a871-80ddf0ad6292 2024-05-09T05:52:26.373 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T05:52:26.373 INFO:teuthology.orchestra.run.smithi110.stdout:[osd] 2024-05-09T05:52:26.373 INFO:teuthology.orchestra.run.smithi110.stdout: osd journal size = 100 2024-05-09T05:52:26.373 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T05:52:26.373 INFO:teuthology.orchestra.run.smithi110.stdout: osd scrub load threshold = 5.0 2024-05-09T05:52:26.373 INFO:teuthology.orchestra.run.smithi110.stdout: osd scrub max interval = 600 2024-05-09T05:52:26.373 INFO:teuthology.orchestra.run.smithi110.stdout: osd mclock profile = high_recovery_ops 2024-05-09T05:52:26.373 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T05:52:26.373 INFO:teuthology.orchestra.run.smithi110.stdout: osd recover clone overlap = true 2024-05-09T05:52:26.373 INFO:teuthology.orchestra.run.smithi110.stdout: osd recovery max chunk = 1048576 2024-05-09T05:52:26.373 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T05:52:26.373 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug shutdown = true 2024-05-09T05:52:26.374 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug op order = true 2024-05-09T05:52:26.374 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug verify stray on activate = true 2024-05-09T05:52:26.374 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug trim objects = true 2024-05-09T05:52:26.374 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T05:52:26.374 INFO:teuthology.orchestra.run.smithi110.stdout: osd open classes on start = true 2024-05-09T05:52:26.374 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug pg log writeout = true 2024-05-09T05:52:26.374 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T05:52:26.374 INFO:teuthology.orchestra.run.smithi110.stdout: osd deep scrub update digest min age = 30 2024-05-09T05:52:26.374 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T05:52:26.374 INFO:teuthology.orchestra.run.smithi110.stdout: osd map max advance = 10 2024-05-09T05:52:26.374 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T05:52:26.374 INFO:teuthology.orchestra.run.smithi110.stdout: journal zero on create = true 2024-05-09T05:52:26.374 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T05:52:26.375 INFO:teuthology.orchestra.run.smithi110.stdout: filestore ondisk finisher threads = 3 2024-05-09T05:52:26.375 INFO:teuthology.orchestra.run.smithi110.stdout: filestore apply finisher threads = 3 2024-05-09T05:52:26.375 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T05:52:26.375 INFO:teuthology.orchestra.run.smithi110.stdout: bdev debug aio = true 2024-05-09T05:52:26.375 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug misdirected ops = true 2024-05-09T05:52:26.375 INFO:teuthology.orchestra.run.smithi110.stdout: bluestore block size = 96636764160 2024-05-09T05:52:26.375 INFO:teuthology.orchestra.run.smithi110.stdout: bluestore fsck on mount = True 2024-05-09T05:52:26.375 INFO:teuthology.orchestra.run.smithi110.stdout: debug bluefs = 20 2024-05-09T05:52:26.375 INFO:teuthology.orchestra.run.smithi110.stdout: debug bluestore = 20 2024-05-09T05:52:26.375 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-05-09T05:52:26.375 INFO:teuthology.orchestra.run.smithi110.stdout: debug osd = 20 2024-05-09T05:52:26.375 INFO:teuthology.orchestra.run.smithi110.stdout: debug rocksdb = 10 2024-05-09T05:52:26.375 INFO:teuthology.orchestra.run.smithi110.stdout: mon client directed command retry = 5 2024-05-09T05:52:26.375 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd backfillfull_ratio = 0.85 2024-05-09T05:52:26.376 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd full ratio = 0.9 2024-05-09T05:52:26.376 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd nearfull ratio = 0.8 2024-05-09T05:52:26.376 INFO:teuthology.orchestra.run.smithi110.stdout: ms inject delay max = 1 2024-05-09T05:52:26.376 INFO:teuthology.orchestra.run.smithi110.stdout: ms inject delay probability = 0.005 2024-05-09T05:52:26.376 INFO:teuthology.orchestra.run.smithi110.stdout: ms inject delay type = client mds 2024-05-09T05:52:26.376 INFO:teuthology.orchestra.run.smithi110.stdout: ms inject socket failures = 2500 2024-05-09T05:52:26.376 INFO:teuthology.orchestra.run.smithi110.stdout: osd blocked scrub grace period = 3600 2024-05-09T05:52:26.376 INFO:teuthology.orchestra.run.smithi110.stdout: osd failsafe full ratio = 0.95 2024-05-09T05:52:26.376 INFO:teuthology.orchestra.run.smithi110.stdout: osd max markdown count = 1000 2024-05-09T05:52:26.376 INFO:teuthology.orchestra.run.smithi110.stdout: osd objectstore = bluestore 2024-05-09T05:52:26.376 INFO:teuthology.orchestra.run.smithi110.stdout: osd op complaint time = 180 2024-05-09T05:52:26.376 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T05:52:26.376 INFO:teuthology.orchestra.run.smithi110.stdout:[mgr] 2024-05-09T05:52:26.376 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-05-09T05:52:26.376 INFO:teuthology.orchestra.run.smithi110.stdout: debug mgr = 20 2024-05-09T05:52:26.377 INFO:teuthology.orchestra.run.smithi110.stdout: debug mon = 20 2024-05-09T05:52:26.377 INFO:teuthology.orchestra.run.smithi110.stdout: debug auth = 20 2024-05-09T05:52:26.377 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min pgs per osd = 4 2024-05-09T05:52:26.377 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min bytes per osd = 10 2024-05-09T05:52:26.377 INFO:teuthology.orchestra.run.smithi110.stdout: mgr/telemetry/nag = false 2024-05-09T05:52:26.377 INFO:teuthology.orchestra.run.smithi110.stdout: debug client = 20 2024-05-09T05:52:26.377 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T05:52:26.377 INFO:teuthology.orchestra.run.smithi110.stdout:[mon] 2024-05-09T05:52:26.377 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-05-09T05:52:26.377 INFO:teuthology.orchestra.run.smithi110.stdout: debug mon = 20 2024-05-09T05:52:26.377 INFO:teuthology.orchestra.run.smithi110.stdout: debug paxos = 20 2024-05-09T05:52:26.377 INFO:teuthology.orchestra.run.smithi110.stdout: debug auth = 20 2024-05-09T05:52:26.377 INFO:teuthology.orchestra.run.smithi110.stdout: mon data avail warn = 5 2024-05-09T05:52:26.377 INFO:teuthology.orchestra.run.smithi110.stdout: mon mgr mkfs grace = 240 2024-05-09T05:52:26.378 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min pgs per osd = 4 2024-05-09T05:52:26.378 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd reporter subtree level = osd 2024-05-09T05:52:26.378 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd prime pg temp = true 2024-05-09T05:52:26.378 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min bytes per osd = 10 2024-05-09T05:52:26.378 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T05:52:26.378 INFO:teuthology.orchestra.run.smithi110.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-09T05:52:26.378 INFO:teuthology.orchestra.run.smithi110.stdout: auth mon ticket ttl = 660 # 11m 2024-05-09T05:52:26.378 INFO:teuthology.orchestra.run.smithi110.stdout: auth service ticket ttl = 240 # 4m 2024-05-09T05:52:26.378 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T05:52:26.378 INFO:teuthology.orchestra.run.smithi110.stdout: # don't complain about insecure global_id in the test suite 2024-05-09T05:52:26.378 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-09T05:52:26.378 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-09T05:52:26.378 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T05:52:26.378 INFO:teuthology.orchestra.run.smithi110.stdout: # 1m isn't quite enough 2024-05-09T05:52:26.378 INFO:teuthology.orchestra.run.smithi110.stdout: mon_down_mkfs_grace = 2m 2024-05-09T05:52:26.379 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T05:52:26.379 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_filestore_osds = false 2024-05-09T05:52:26.379 INFO:teuthology.orchestra.run.smithi110.stdout: mon down mkfs grace = 300 2024-05-09T05:52:26.379 INFO:teuthology.orchestra.run.smithi110.stdout: mon op complaint time = 120 2024-05-09T05:52:26.379 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T05:52:26.379 INFO:teuthology.orchestra.run.smithi110.stdout:[client] 2024-05-09T05:52:26.379 INFO:teuthology.orchestra.run.smithi110.stdout: rgw cache enabled = true 2024-05-09T05:52:26.379 INFO:teuthology.orchestra.run.smithi110.stdout: rgw enable ops log = true 2024-05-09T05:52:26.379 INFO:teuthology.orchestra.run.smithi110.stdout: rgw enable usage log = true 2024-05-09T05:52:26.379 INFO:teuthology.orchestra.run.smithi110.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-09T05:52:26.379 INFO:teuthology.orchestra.run.smithi110.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-09T05:52:26.379 INFO:teuthology.orchestra.run.smithi110.stdout: client mount timeout = 600 2024-05-09T05:52:26.379 INFO:teuthology.orchestra.run.smithi110.stdout: client_shutdown_timeout = 120 2024-05-09T05:52:26.379 INFO:teuthology.orchestra.run.smithi110.stdout: debug client = 20 2024-05-09T05:52:26.380 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-05-09T05:52:26.380 INFO:teuthology.orchestra.run.smithi110.stdout: rados mon op timeout = 900 2024-05-09T05:52:26.380 INFO:teuthology.orchestra.run.smithi110.stdout: rados osd op timeout = 900 2024-05-09T05:52:26.380 INFO:teuthology.orchestra.run.smithi110.stdout:[mon.a] 2024-05-09T05:52:26.380 INFO:teuthology.orchestra.run.smithi110.stdout:[mon.b] 2024-05-09T05:52:26.380 INFO:teuthology.orchestra.run.smithi110.stdout:[mon.c] 2024-05-09T05:52:26.380 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.a] 2024-05-09T05:52:26.380 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.c] 2024-05-09T05:52:26.380 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.e] 2024-05-09T05:52:26.380 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.b] 2024-05-09T05:52:26.380 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.d] 2024-05-09T05:52:26.380 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.f] 2024-05-09T05:52:26.380 INFO:teuthology.orchestra.run.smithi110.stdout:[mds] 2024-05-09T05:52:26.380 INFO:teuthology.orchestra.run.smithi110.stdout: debug mds = 20 2024-05-09T05:52:26.381 INFO:teuthology.orchestra.run.smithi110.stdout: debug mds balancer = 20 2024-05-09T05:52:26.381 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-05-09T05:52:26.381 INFO:teuthology.orchestra.run.smithi110.stdout: mds bal fragment size max = 10000 2024-05-09T05:52:26.381 INFO:teuthology.orchestra.run.smithi110.stdout: mds bal merge size = 5 2024-05-09T05:52:26.381 INFO:teuthology.orchestra.run.smithi110.stdout: mds bal split bits = 3 2024-05-09T05:52:26.381 INFO:teuthology.orchestra.run.smithi110.stdout: mds bal split size = 100 2024-05-09T05:52:26.381 INFO:teuthology.orchestra.run.smithi110.stdout: mds debug frag = True 2024-05-09T05:52:26.381 INFO:teuthology.orchestra.run.smithi110.stdout: mds debug scatterstat = True 2024-05-09T05:52:26.381 INFO:teuthology.orchestra.run.smithi110.stdout: mds oft prefetch dirfrags = True 2024-05-09T05:52:26.381 INFO:teuthology.orchestra.run.smithi110.stdout: mds op complaint time = 180 2024-05-09T05:52:26.381 INFO:teuthology.orchestra.run.smithi110.stdout: mds verify scatter = True 2024-05-09T05:52:26.381 INFO:teuthology.orchestra.run.smithi110.stdout: mds_dir_prefetch = True 2024-05-09T05:52:26.381 INFO:teuthology.orchestra.run.smithi110.stdout: mds_sleep_rank_change = 5000000.0 2024-05-09T05:52:26.381 INFO:teuthology.orchestra.run.smithi110.stdout: mon client directed command retry = 5 2024-05-09T05:52:26.381 INFO:teuthology.orchestra.run.smithi110.stdout: ms inject delay max = 1 2024-05-09T05:52:26.382 INFO:teuthology.orchestra.run.smithi110.stdout: ms inject delay probability = 0.005 2024-05-09T05:52:26.382 INFO:teuthology.orchestra.run.smithi110.stdout: ms inject delay type = client mds osd 2024-05-09T05:52:26.382 INFO:teuthology.orchestra.run.smithi110.stdout: ms inject socket failures = 2500 2024-05-09T05:52:26.382 INFO:teuthology.orchestra.run.smithi110.stdout: osd op complaint time = 180 2024-05-09T05:52:26.382 INFO:teuthology.orchestra.run.smithi110.stdout: rados mon op timeout = 900 2024-05-09T05:52:26.382 INFO:teuthology.orchestra.run.smithi110.stdout: rados osd op timeout = 900 2024-05-09T05:52:26.383 INFO:tasks.ceph:Creating admin key on mon.a... 2024-05-09T05:52:26.383 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-05-09T05:52:26.504 INFO:tasks.ceph:Copying monmap to all nodes... 2024-05-09T05:52:26.504 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-09T05:52:26.504 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-05-09T05:52:26.509 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-09T05:52:26.510 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-05-09T05:52:26.556 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi072.front.sepia.ceph.com 2024-05-09T05:52:26.556 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-09T05:52:26.556 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-09T05:52:26.556 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-09T05:52:26.619 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-09T05:52:26.620 DEBUG:teuthology.orchestra.run.smithi072:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-09T05:52:26.668 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi110.front.sepia.ceph.com 2024-05-09T05:52:26.668 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-05-09T05:52:26.668 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-09T05:52:26.668 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-09T05:52:26.692 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-05-09T05:52:26.692 DEBUG:teuthology.orchestra.run.smithi110:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-09T05:52:26.738 INFO:tasks.ceph:Setting up mon nodes... 2024-05-09T05:52:26.739 INFO:tasks.ceph:Setting up mgr nodes... 2024-05-09T05:52:26.739 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-05-09T05:52:26.811 INFO:teuthology.orchestra.run.smithi072.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-05-09T05:52:26.818 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-05-09T05:52:26.894 INFO:teuthology.orchestra.run.smithi110.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-05-09T05:52:26.911 INFO:tasks.ceph:Setting up mds nodes... 2024-05-09T05:52:26.911 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-05-09T05:52:26.983 INFO:teuthology.orchestra.run.smithi072.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-05-09T05:52:26.989 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-05-09T05:52:27.001 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-05-09T05:52:27.111 INFO:teuthology.orchestra.run.smithi072.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-05-09T05:52:27.118 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-05-09T05:52:27.129 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-05-09T05:52:27.233 INFO:teuthology.orchestra.run.smithi072.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-05-09T05:52:27.239 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-05-09T05:52:27.252 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-05-09T05:52:27.325 INFO:teuthology.orchestra.run.smithi110.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-05-09T05:52:27.332 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-05-09T05:52:27.345 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-05-09T05:52:27.458 INFO:teuthology.orchestra.run.smithi110.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-05-09T05:52:27.464 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-05-09T05:52:27.476 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-05-09T05:52:27.585 INFO:teuthology.orchestra.run.smithi110.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-05-09T05:52:27.591 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-05-09T05:52:27.603 INFO:tasks.ceph_client:Setting up client nodes... 2024-05-09T05:52:27.603 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-09T05:52:27.671 INFO:teuthology.orchestra.run.smithi072.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-05-09T05:52:27.686 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-05-09T05:52:27.686 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi072.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi110.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-09T05:52:27.687 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-05-09T05:52:27.699 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-09T05:52:27.699 INFO:tasks.ceph:role: osd.0 2024-05-09T05:52:27.699 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi072.front.sepia.ceph.com 2024-05-09T05:52:27.699 DEBUG:teuthology.orchestra.run.smithi072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-09T05:52:27.761 INFO:teuthology.orchestra.run.smithi072.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-09T05:52:27.761 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-09T05:52:27.761 INFO:teuthology.orchestra.run.smithi072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-09T05:52:27.761 INFO:teuthology.orchestra.run.smithi072.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-09T05:52:27.761 INFO:teuthology.orchestra.run.smithi072.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-09T05:52:27.761 INFO:teuthology.orchestra.run.smithi072.stdout: = sunit=0 swidth=0 blks 2024-05-09T05:52:27.761 INFO:teuthology.orchestra.run.smithi072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-09T05:52:27.762 INFO:teuthology.orchestra.run.smithi072.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-09T05:52:27.762 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-09T05:52:27.762 INFO:teuthology.orchestra.run.smithi072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-09T05:52:28.236 INFO:teuthology.orchestra.run.smithi072.stdout:Discarding blocks...Done. 2024-05-09T05:52:28.238 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi072.front.sepia.ceph.com -o noatime 2024-05-09T05:52:28.238 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-05-09T05:52:28.396 DEBUG:teuthology.orchestra.run.smithi072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-05-09T05:52:28.408 INFO:teuthology.orchestra.run.smithi072.stderr:sudo: /sbin/restorecon: command not found 2024-05-09T05:52:28.408 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T05:52:28.409 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-05-09T05:52:28.464 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-09T05:52:28.464 INFO:tasks.ceph:role: osd.1 2024-05-09T05:52:28.464 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi072.front.sepia.ceph.com 2024-05-09T05:52:28.464 DEBUG:teuthology.orchestra.run.smithi072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-09T05:52:28.527 INFO:teuthology.orchestra.run.smithi072.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-09T05:52:28.527 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-09T05:52:28.527 INFO:teuthology.orchestra.run.smithi072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-09T05:52:28.527 INFO:teuthology.orchestra.run.smithi072.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-09T05:52:28.527 INFO:teuthology.orchestra.run.smithi072.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-09T05:52:28.528 INFO:teuthology.orchestra.run.smithi072.stdout: = sunit=0 swidth=0 blks 2024-05-09T05:52:28.528 INFO:teuthology.orchestra.run.smithi072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-09T05:52:28.528 INFO:teuthology.orchestra.run.smithi072.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-09T05:52:28.528 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-09T05:52:28.528 INFO:teuthology.orchestra.run.smithi072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-09T05:52:28.978 INFO:teuthology.orchestra.run.smithi072.stdout:Discarding blocks...Done. 2024-05-09T05:52:28.980 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi072.front.sepia.ceph.com -o noatime 2024-05-09T05:52:28.980 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-05-09T05:52:29.071 DEBUG:teuthology.orchestra.run.smithi072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-05-09T05:52:29.126 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T05:52:29.126 INFO:teuthology.orchestra.run.smithi072.stderr:sudo: /sbin/restorecon: command not found 2024-05-09T05:52:29.127 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-05-09T05:52:29.180 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-09T05:52:29.180 INFO:tasks.ceph:role: osd.2 2024-05-09T05:52:29.180 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi072.front.sepia.ceph.com 2024-05-09T05:52:29.180 DEBUG:teuthology.orchestra.run.smithi072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-09T05:52:29.244 INFO:teuthology.orchestra.run.smithi072.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-09T05:52:29.244 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-09T05:52:29.244 INFO:teuthology.orchestra.run.smithi072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-09T05:52:29.244 INFO:teuthology.orchestra.run.smithi072.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-09T05:52:29.244 INFO:teuthology.orchestra.run.smithi072.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-09T05:52:29.244 INFO:teuthology.orchestra.run.smithi072.stdout: = sunit=0 swidth=0 blks 2024-05-09T05:52:29.244 INFO:teuthology.orchestra.run.smithi072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-09T05:52:29.244 INFO:teuthology.orchestra.run.smithi072.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-09T05:52:29.244 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-09T05:52:29.245 INFO:teuthology.orchestra.run.smithi072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-09T05:52:29.701 INFO:teuthology.orchestra.run.smithi072.stdout:Discarding blocks...Done. 2024-05-09T05:52:29.703 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi072.front.sepia.ceph.com -o noatime 2024-05-09T05:52:29.703 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-05-09T05:52:29.832 DEBUG:teuthology.orchestra.run.smithi072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-05-09T05:52:29.842 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T05:52:29.842 INFO:teuthology.orchestra.run.smithi072.stderr:sudo: /sbin/restorecon: command not found 2024-05-09T05:52:29.843 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-05-09T05:52:29.895 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-09T05:52:29.895 INFO:tasks.ceph:role: osd.3 2024-05-09T05:52:29.895 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi072.front.sepia.ceph.com 2024-05-09T05:52:29.895 DEBUG:teuthology.orchestra.run.smithi072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-09T05:52:29.960 INFO:teuthology.orchestra.run.smithi072.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-09T05:52:29.961 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-09T05:52:29.961 INFO:teuthology.orchestra.run.smithi072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-09T05:52:29.961 INFO:teuthology.orchestra.run.smithi072.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-09T05:52:29.961 INFO:teuthology.orchestra.run.smithi072.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-09T05:52:29.961 INFO:teuthology.orchestra.run.smithi072.stdout: = sunit=0 swidth=0 blks 2024-05-09T05:52:29.961 INFO:teuthology.orchestra.run.smithi072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-09T05:52:29.961 INFO:teuthology.orchestra.run.smithi072.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-09T05:52:29.961 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-09T05:52:29.961 INFO:teuthology.orchestra.run.smithi072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-09T05:52:30.465 INFO:teuthology.orchestra.run.smithi072.stdout:Discarding blocks...Done. 2024-05-09T05:52:30.467 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi072.front.sepia.ceph.com -o noatime 2024-05-09T05:52:30.467 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-05-09T05:52:30.621 DEBUG:teuthology.orchestra.run.smithi072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-05-09T05:52:30.632 INFO:teuthology.orchestra.run.smithi072.stderr:sudo: /sbin/restorecon: command not found 2024-05-09T05:52:30.633 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T05:52:30.633 DEBUG:teuthology.orchestra.run.smithi072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-09T05:52:30.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:30.810+0000 7f8cc28fe7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-05-09T05:52:30.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:30.810+0000 7f8cc28fe7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-05-09T05:52:30.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:30.810+0000 7f8cc28fe7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-09T05:52:30.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:30.810+0000 7f8cc28fe7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-09T05:52:30.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:30.810+0000 7f8cc28fe7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-09T05:52:30.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:30.814+0000 7f8cc28fe7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-05-09T05:52:33.795 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-09T05:52:33.809 DEBUG:teuthology.orchestra.run.smithi072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-09T05:52:33.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:33.930+0000 7f9777bad7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-05-09T05:52:33.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:33.934+0000 7f9777bad7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-05-09T05:52:33.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:33.934+0000 7f9777bad7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-09T05:52:33.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:33.934+0000 7f9777bad7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-09T05:52:33.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:33.934+0000 7f9777bad7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-09T05:52:33.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:33.934+0000 7f9777bad7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-05-09T05:52:36.889 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-09T05:52:36.902 DEBUG:teuthology.orchestra.run.smithi072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-09T05:52:37.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:37.022+0000 7f47f44837c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-05-09T05:52:37.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:37.022+0000 7f47f44837c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-05-09T05:52:37.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:37.022+0000 7f47f44837c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-09T05:52:37.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:37.022+0000 7f47f44837c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-09T05:52:37.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:37.022+0000 7f47f44837c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-09T05:52:37.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:37.026+0000 7f47f44837c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-05-09T05:52:39.995 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-09T05:52:40.009 DEBUG:teuthology.orchestra.run.smithi072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-09T05:52:40.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:40.130+0000 7fee5231a7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-05-09T05:52:40.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:40.130+0000 7fee5231a7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-05-09T05:52:40.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:40.130+0000 7fee5231a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-09T05:52:40.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:40.130+0000 7fee5231a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-09T05:52:40.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:40.130+0000 7fee5231a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-09T05:52:40.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:40.130+0000 7fee5231a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-05-09T05:52:43.100 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-09T05:52:43.113 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-05-09T05:52:43.128 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-09T05:52:43.128 INFO:tasks.ceph:role: osd.4 2024-05-09T05:52:43.129 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi110.front.sepia.ceph.com 2024-05-09T05:52:43.129 DEBUG:teuthology.orchestra.run.smithi110:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-09T05:52:43.182 INFO:teuthology.orchestra.run.smithi110.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-09T05:52:43.182 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-09T05:52:43.182 INFO:teuthology.orchestra.run.smithi110.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-09T05:52:43.183 INFO:teuthology.orchestra.run.smithi110.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-09T05:52:43.183 INFO:teuthology.orchestra.run.smithi110.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-09T05:52:43.183 INFO:teuthology.orchestra.run.smithi110.stdout: = sunit=0 swidth=0 blks 2024-05-09T05:52:43.183 INFO:teuthology.orchestra.run.smithi110.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-09T05:52:43.183 INFO:teuthology.orchestra.run.smithi110.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-09T05:52:43.183 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-09T05:52:43.183 INFO:teuthology.orchestra.run.smithi110.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-09T05:52:43.207 INFO:teuthology.orchestra.run.smithi110.stdout:Discarding blocks...Done. 2024-05-09T05:52:43.208 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi110.front.sepia.ceph.com -o noatime 2024-05-09T05:52:43.208 DEBUG:teuthology.orchestra.run.smithi110:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-05-09T05:52:43.269 DEBUG:teuthology.orchestra.run.smithi110:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-05-09T05:52:43.323 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T05:52:43.324 INFO:teuthology.orchestra.run.smithi110.stderr:sudo: /sbin/restorecon: command not found 2024-05-09T05:52:43.324 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-05-09T05:52:43.377 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-09T05:52:43.377 INFO:tasks.ceph:role: osd.5 2024-05-09T05:52:43.377 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi110.front.sepia.ceph.com 2024-05-09T05:52:43.378 DEBUG:teuthology.orchestra.run.smithi110:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-09T05:52:43.438 INFO:teuthology.orchestra.run.smithi110.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-09T05:52:43.438 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-09T05:52:43.438 INFO:teuthology.orchestra.run.smithi110.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-09T05:52:43.439 INFO:teuthology.orchestra.run.smithi110.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-09T05:52:43.439 INFO:teuthology.orchestra.run.smithi110.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-09T05:52:43.439 INFO:teuthology.orchestra.run.smithi110.stdout: = sunit=0 swidth=0 blks 2024-05-09T05:52:43.439 INFO:teuthology.orchestra.run.smithi110.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-09T05:52:43.439 INFO:teuthology.orchestra.run.smithi110.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-09T05:52:43.439 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-09T05:52:43.439 INFO:teuthology.orchestra.run.smithi110.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-09T05:52:43.462 INFO:teuthology.orchestra.run.smithi110.stdout:Discarding blocks...Done. 2024-05-09T05:52:43.463 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi110.front.sepia.ceph.com -o noatime 2024-05-09T05:52:43.464 DEBUG:teuthology.orchestra.run.smithi110:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-05-09T05:52:43.519 DEBUG:teuthology.orchestra.run.smithi110:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-05-09T05:52:43.576 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T05:52:43.577 INFO:teuthology.orchestra.run.smithi110.stderr:sudo: /sbin/restorecon: command not found 2024-05-09T05:52:43.577 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-05-09T05:52:43.632 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-09T05:52:43.632 INFO:tasks.ceph:role: osd.6 2024-05-09T05:52:43.632 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi110.front.sepia.ceph.com 2024-05-09T05:52:43.633 DEBUG:teuthology.orchestra.run.smithi110:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-09T05:52:43.687 INFO:teuthology.orchestra.run.smithi110.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-09T05:52:43.687 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-09T05:52:43.687 INFO:teuthology.orchestra.run.smithi110.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-09T05:52:43.687 INFO:teuthology.orchestra.run.smithi110.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-09T05:52:43.687 INFO:teuthology.orchestra.run.smithi110.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-09T05:52:43.687 INFO:teuthology.orchestra.run.smithi110.stdout: = sunit=0 swidth=0 blks 2024-05-09T05:52:43.687 INFO:teuthology.orchestra.run.smithi110.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-09T05:52:43.687 INFO:teuthology.orchestra.run.smithi110.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-09T05:52:43.687 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-09T05:52:43.687 INFO:teuthology.orchestra.run.smithi110.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-09T05:52:43.710 INFO:teuthology.orchestra.run.smithi110.stdout:Discarding blocks...Done. 2024-05-09T05:52:43.712 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi110.front.sepia.ceph.com -o noatime 2024-05-09T05:52:43.712 DEBUG:teuthology.orchestra.run.smithi110:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-05-09T05:52:43.769 DEBUG:teuthology.orchestra.run.smithi110:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-05-09T05:52:43.824 INFO:teuthology.orchestra.run.smithi110.stderr:sudo: /sbin/restorecon: command not found 2024-05-09T05:52:43.824 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T05:52:43.825 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-05-09T05:52:43.878 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-09T05:52:43.878 INFO:tasks.ceph:role: osd.7 2024-05-09T05:52:43.878 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi110.front.sepia.ceph.com 2024-05-09T05:52:43.878 DEBUG:teuthology.orchestra.run.smithi110:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-09T05:52:43.937 INFO:teuthology.orchestra.run.smithi110.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-09T05:52:43.937 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-09T05:52:43.937 INFO:teuthology.orchestra.run.smithi110.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-09T05:52:43.937 INFO:teuthology.orchestra.run.smithi110.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-09T05:52:43.937 INFO:teuthology.orchestra.run.smithi110.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-09T05:52:43.937 INFO:teuthology.orchestra.run.smithi110.stdout: = sunit=0 swidth=0 blks 2024-05-09T05:52:43.937 INFO:teuthology.orchestra.run.smithi110.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-09T05:52:43.937 INFO:teuthology.orchestra.run.smithi110.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-09T05:52:43.937 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-09T05:52:43.937 INFO:teuthology.orchestra.run.smithi110.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-09T05:52:43.960 INFO:teuthology.orchestra.run.smithi110.stdout:Discarding blocks...Done. 2024-05-09T05:52:43.962 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi110.front.sepia.ceph.com -o noatime 2024-05-09T05:52:43.962 DEBUG:teuthology.orchestra.run.smithi110:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-05-09T05:52:44.022 DEBUG:teuthology.orchestra.run.smithi110:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-05-09T05:52:44.075 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T05:52:44.075 INFO:teuthology.orchestra.run.smithi110.stderr:sudo: /sbin/restorecon: command not found 2024-05-09T05:52:44.076 DEBUG:teuthology.orchestra.run.smithi110:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-09T05:52:44.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:52:44.224+0000 7f7725ad07c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-05-09T05:52:44.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:52:44.224+0000 7f7725ad07c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-05-09T05:52:44.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:52:44.224+0000 7f7725ad07c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-09T05:52:44.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:52:44.224+0000 7f7725ad07c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-09T05:52:44.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:52:44.224+0000 7f7725ad07c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-09T05:52:44.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:52:44.224+0000 7f7725ad07c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-05-09T05:52:47.193 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-09T05:52:47.207 DEBUG:teuthology.orchestra.run.smithi110:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-09T05:52:47.321 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:52:47.328+0000 7fcd7cb9a7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-05-09T05:52:47.321 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:52:47.328+0000 7fcd7cb9a7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-05-09T05:52:47.321 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:52:47.328+0000 7fcd7cb9a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-09T05:52:47.321 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:52:47.328+0000 7fcd7cb9a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-09T05:52:47.321 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:52:47.328+0000 7fcd7cb9a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-09T05:52:47.321 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:52:47.328+0000 7fcd7cb9a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-05-09T05:52:50.285 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-09T05:52:50.299 DEBUG:teuthology.orchestra.run.smithi110:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-09T05:52:50.412 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:52:50.420+0000 7ff2331127c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-05-09T05:52:50.412 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:52:50.420+0000 7ff2331127c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-05-09T05:52:50.412 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:52:50.420+0000 7ff2331127c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-09T05:52:50.412 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:52:50.420+0000 7ff2331127c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-09T05:52:50.413 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:52:50.420+0000 7ff2331127c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-09T05:52:50.413 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:52:50.420+0000 7ff2331127c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-05-09T05:52:53.388 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-05-09T05:52:53.400 DEBUG:teuthology.orchestra.run.smithi110:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-09T05:52:53.511 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:52:53.520+0000 7f66314d57c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-05-09T05:52:53.511 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:52:53.520+0000 7f66314d57c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-05-09T05:52:53.511 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:52:53.520+0000 7f66314d57c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-09T05:52:53.511 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:52:53.520+0000 7f66314d57c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-09T05:52:53.511 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:52:53.520+0000 7f66314d57c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-09T05:52:53.511 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:52:53.520+0000 7f66314d57c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-05-09T05:52:54.620 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T05:52:54.623 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T05:52:56.476 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-05-09T05:52:56.490 INFO:tasks.ceph:Reading keys from all nodes... 2024-05-09T05:52:56.490 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-09T05:52:56.490 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-05-09T05:52:56.507 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-09T05:52:56.507 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-05-09T05:52:56.562 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-09T05:52:56.562 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-05-09T05:52:56.618 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-09T05:52:56.618 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-05-09T05:52:56.674 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-09T05:52:56.674 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-05-09T05:52:56.726 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-09T05:52:56.726 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-05-09T05:52:56.777 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-09T05:52:56.778 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-05-09T05:52:56.831 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-09T05:52:56.831 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-05-09T05:52:56.885 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-05-09T05:52:56.886 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-05-09T05:52:56.899 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-05-09T05:52:56.899 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-05-09T05:52:56.955 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-05-09T05:52:56.955 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-05-09T05:52:57.010 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-05-09T05:52:57.010 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-05-09T05:52:57.065 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-05-09T05:52:57.065 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-05-09T05:52:57.117 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-05-09T05:52:57.117 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-05-09T05:52:57.173 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-05-09T05:52:57.173 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-05-09T05:52:57.225 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-05-09T05:52:57.225 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-05-09T05:52:57.278 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-09T05:52:57.278 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-05-09T05:52:57.285 INFO:tasks.ceph:Adding keys to all mons... 2024-05-09T05:52:57.285 DEBUG:teuthology.orchestra.run.smithi072:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-09T05:52:57.328 DEBUG:teuthology.orchestra.run.smithi110:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-09T05:52:57.337 INFO:teuthology.orchestra.run.smithi072.stdout:[mgr.y] 2024-05-09T05:52:57.338 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQCaZDxmnRsNMRAAHPigmUOqvkwx/kjMPLjNtQ== 2024-05-09T05:52:57.338 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.a] 2024-05-09T05:52:57.338 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQCaZDxmgclDOxAAP3801aqIMEo3muQp3r03Jw== 2024-05-09T05:52:57.338 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.c] 2024-05-09T05:52:57.338 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQCbZDxm8eJSBxAAS5OLHmUlx52DTeKqfrBYgw== 2024-05-09T05:52:57.338 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.e] 2024-05-09T05:52:57.338 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQCbZDxmI6iRDhAANG6fx3s6zvHuRRLS8J0ppw== 2024-05-09T05:52:57.338 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.0] 2024-05-09T05:52:57.338 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQCeZDxmJgJgMBAAHUxtik6TKVJLDwBKr4c5RQ== 2024-05-09T05:52:57.338 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.1] 2024-05-09T05:52:57.338 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQChZDxm9w2wNxAAAbx5GN37kKXWDOiAonl70A== 2024-05-09T05:52:57.338 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.2] 2024-05-09T05:52:57.339 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQClZDxmXZKIARAARWwKJxrpL/qIyRcXJZJgaQ== 2024-05-09T05:52:57.339 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.3] 2024-05-09T05:52:57.339 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQCoZDxmoL3lBxAA+Fmv5aT1LZ0DFhupYOXxGQ== 2024-05-09T05:52:57.339 INFO:teuthology.orchestra.run.smithi072.stdout:[mgr.x] 2024-05-09T05:52:57.339 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQCaZDxmJbAvNhAAKr+ZIHTRje7Vgj4hh7ylYg== 2024-05-09T05:52:57.339 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.b] 2024-05-09T05:52:57.339 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQCbZDxmKTZMFBAAm9PkKmFTRNKDNRAa5ZpYYQ== 2024-05-09T05:52:57.339 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.d] 2024-05-09T05:52:57.339 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQCbZDxmNRYsHBAAjLNTtejrQPDtW9zKqZ2bCw== 2024-05-09T05:52:57.339 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.f] 2024-05-09T05:52:57.340 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQCbZDxmHGK8IxAAUyEZJoGuiUoPPehXHRz3LA== 2024-05-09T05:52:57.340 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.4] 2024-05-09T05:52:57.340 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQCsZDxmzm2vDRAADSeLrYb4qcV0vz41SeQrWw== 2024-05-09T05:52:57.340 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.5] 2024-05-09T05:52:57.340 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQCvZDxmkMEEFBAAwKfAweh93coetUfU2mHHZQ== 2024-05-09T05:52:57.340 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.6] 2024-05-09T05:52:57.340 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQCyZDxmzbJ2GRAA6tJQM6WbYc/I/NnzsAKJ8Q== 2024-05-09T05:52:57.341 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.7] 2024-05-09T05:52:57.341 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQC1ZDxmPPNQHxAAsGViGH0P4F5lHXDiXH94Ug== 2024-05-09T05:52:57.341 INFO:teuthology.orchestra.run.smithi072.stdout:[client.0] 2024-05-09T05:52:57.341 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQCbZDxmy0q0KBAACuOatGRP3GAfcWYoDPbTYQ== 2024-05-09T05:52:57.342 INFO:teuthology.orchestra.run.smithi110.stdout:[mgr.y] 2024-05-09T05:52:57.342 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQCaZDxmnRsNMRAAHPigmUOqvkwx/kjMPLjNtQ== 2024-05-09T05:52:57.343 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.a] 2024-05-09T05:52:57.343 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQCaZDxmgclDOxAAP3801aqIMEo3muQp3r03Jw== 2024-05-09T05:52:57.343 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.c] 2024-05-09T05:52:57.343 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQCbZDxm8eJSBxAAS5OLHmUlx52DTeKqfrBYgw== 2024-05-09T05:52:57.343 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.e] 2024-05-09T05:52:57.343 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQCbZDxmI6iRDhAANG6fx3s6zvHuRRLS8J0ppw== 2024-05-09T05:52:57.343 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.0] 2024-05-09T05:52:57.343 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQCeZDxmJgJgMBAAHUxtik6TKVJLDwBKr4c5RQ== 2024-05-09T05:52:57.343 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.1] 2024-05-09T05:52:57.343 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQChZDxm9w2wNxAAAbx5GN37kKXWDOiAonl70A== 2024-05-09T05:52:57.343 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.2] 2024-05-09T05:52:57.343 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQClZDxmXZKIARAARWwKJxrpL/qIyRcXJZJgaQ== 2024-05-09T05:52:57.343 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.3] 2024-05-09T05:52:57.343 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQCoZDxmoL3lBxAA+Fmv5aT1LZ0DFhupYOXxGQ== 2024-05-09T05:52:57.344 INFO:teuthology.orchestra.run.smithi110.stdout:[mgr.x] 2024-05-09T05:52:57.344 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQCaZDxmJbAvNhAAKr+ZIHTRje7Vgj4hh7ylYg== 2024-05-09T05:52:57.344 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.b] 2024-05-09T05:52:57.344 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQCbZDxmKTZMFBAAm9PkKmFTRNKDNRAa5ZpYYQ== 2024-05-09T05:52:57.344 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.d] 2024-05-09T05:52:57.344 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQCbZDxmNRYsHBAAjLNTtejrQPDtW9zKqZ2bCw== 2024-05-09T05:52:57.344 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.f] 2024-05-09T05:52:57.344 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQCbZDxmHGK8IxAAUyEZJoGuiUoPPehXHRz3LA== 2024-05-09T05:52:57.344 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.4] 2024-05-09T05:52:57.344 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQCsZDxmzm2vDRAADSeLrYb4qcV0vz41SeQrWw== 2024-05-09T05:52:57.344 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.5] 2024-05-09T05:52:57.344 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQCvZDxmkMEEFBAAwKfAweh93coetUfU2mHHZQ== 2024-05-09T05:52:57.344 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.6] 2024-05-09T05:52:57.344 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQCyZDxmzbJ2GRAA6tJQM6WbYc/I/NnzsAKJ8Q== 2024-05-09T05:52:57.345 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.7] 2024-05-09T05:52:57.345 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQC1ZDxmPPNQHxAAsGViGH0P4F5lHXDiXH94Ug== 2024-05-09T05:52:57.345 INFO:teuthology.orchestra.run.smithi110.stdout:[client.0] 2024-05-09T05:52:57.345 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQCbZDxmy0q0KBAACuOatGRP3GAfcWYoDPbTYQ== 2024-05-09T05:52:57.345 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-09T05:52:57.388 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-09T05:52:57.469 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-09T05:52:57.471 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-09T05:52:57.548 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-09T05:52:57.551 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-09T05:52:57.625 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-09T05:52:57.627 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-09T05:52:57.703 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T05:52:57.706 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T05:52:57.773 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T05:52:57.776 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T05:52:57.846 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T05:52:57.848 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T05:52:57.921 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T05:52:57.924 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T05:52:57.996 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-09T05:52:57.998 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-09T05:52:58.071 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-09T05:52:58.073 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-09T05:52:58.149 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-09T05:52:58.151 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-09T05:52:58.226 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-09T05:52:58.229 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-09T05:52:58.304 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T05:52:58.307 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T05:52:58.375 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T05:52:58.378 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T05:52:58.449 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T05:52:58.451 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T05:52:58.518 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T05:52:58.520 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T05:52:58.592 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-09T05:52:58.594 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-09T05:52:58.670 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-05-09T05:52:58.670 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-05-09T05:52:58.680 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-09T05:52:58.803 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-05-09T05:52:58.814 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-05-09T05:52:58.828 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-09T05:52:58.950 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-05-09T05:52:58.960 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-05-09T05:52:59.012 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-09T05:52:59.133 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-05-09T05:52:59.143 DEBUG:teuthology.orchestra.run.smithi072:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-09T05:52:59.145 DEBUG:teuthology.orchestra.run.smithi110:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-09T05:52:59.189 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-05-09T05:52:59.189 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-09T05:52:59.189 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-05-09T05:52:59.192 INFO:tasks.ceph.mon.a:Started 2024-05-09T05:52:59.192 INFO:tasks.ceph.mon.b:Restarting daemon 2024-05-09T05:52:59.192 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-05-09T05:52:59.231 INFO:tasks.ceph.mon.b:Started 2024-05-09T05:52:59.232 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-09T05:52:59.232 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-05-09T05:52:59.234 INFO:tasks.ceph.mon.c:Started 2024-05-09T05:52:59.234 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-05-09T05:52:59.235 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-05-09T05:52:59.235 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-05-09T05:52:59.238 INFO:tasks.ceph.mgr.y:Started 2024-05-09T05:52:59.238 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-05-09T05:52:59.239 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-05-09T05:52:59.241 INFO:tasks.ceph.mgr.x:Started 2024-05-09T05:52:59.241 INFO:tasks.ceph:Setting crush tunables to default 2024-05-09T05:52:59.241 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --cluster ceph osd crush tunables default 2024-05-09T05:52:59.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.390+0000 7f16f3d4a640 1 Processor -- start 2024-05-09T05:52:59.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.390+0000 7f16f3d4a640 1 -- start start 2024-05-09T05:52:59.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.390+0000 7f16f3d4a640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f16ec15ab90 0x7f16ec15afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:52:59.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.390+0000 7f16f3d4a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f16ec0c5420 0x7f16ec0c5830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:52:59.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.390+0000 7f16f3d4a640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16ec0cad30 con 0x7f16ec0c4bf0 2024-05-09T05:52:59.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.390+0000 7f16f3d4a640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f16ec15b4e0 con 0x7f16ec15ab90 2024-05-09T05:52:59.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.390+0000 7f16f3d4a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f16ec0cc4d0 con 0x7f16ec0c5420 2024-05-09T05:52:59.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.390+0000 7f16f1ae6640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f16ec0c4bf0 0x7f16ec0ca620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.72:46208/0 (socket says 172.21.15.72:46208) 2024-05-09T05:52:59.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.390+0000 7f16f22e7640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f16ec0c5420 0x7f16ec0c5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:52:59.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.390+0000 7f16f12e5640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f16ec15ab90 0x7f16ec15afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:52:59.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.390+0000 7f16f1ae6640 1 -- 172.21.15.72:0/2194591118 learned_addr learned my addr 172.21.15.72:0/2194591118 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:52:59.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.390+0000 7f16f22e7640 1 -- 172.21.15.72:0/2194591118 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f16ec0c5420 msgr2=0x7f16ec0c5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-09T05:52:59.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.390+0000 7f16f22e7640 1 -- 172.21.15.72:0/2194591118 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f16ec0c5420 msgr2=0x7f16ec0c5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-09T05:52:59.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.390+0000 7f16f22e7640 1 --2- 172.21.15.72:0/2194591118 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f16ec0c5420 0x7f16ec0c5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-09T05:52:59.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.390+0000 7f16f12e5640 1 -- 172.21.15.72:0/2194591118 >> v2:172.21.15.110:3300/0 conn(0x7f16ec15ab90 msgr2=0x7f16ec15afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-09T05:52:59.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.390+0000 7f16f12e5640 1 -- 172.21.15.72:0/2194591118 >> v2:172.21.15.110:3300/0 conn(0x7f16ec15ab90 msgr2=0x7f16ec15afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-09T05:52:59.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.390+0000 7f16f12e5640 1 --2- 172.21.15.72:0/2194591118 >> v2:172.21.15.110:3300/0 conn(0x7f16ec15ab90 0x7f16ec15afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-09T05:52:59.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.390+0000 7f16f22e7640 1 --2- 172.21.15.72:0/2194591118 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f16ec0c5420 0x7f16ec0c5830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-09T05:52:59.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.390+0000 7f16f12e5640 1 --2- 172.21.15.72:0/2194591118 >> v2:172.21.15.110:3300/0 conn(0x7f16ec15ab90 0x7f16ec15afa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-09T05:52:59.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.594+0000 7f16f22e7640 1 --2- 172.21.15.72:0/2194591118 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f16ec0c5420 0x7f16ec0c5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:52:59.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.594+0000 7f16f12e5640 1 --2- 172.21.15.72:0/2194591118 >> v2:172.21.15.110:3300/0 conn(0x7f16ec15ab90 0x7f16ec15afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:52:59.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.594+0000 7f16f22e7640 1 -- 172.21.15.72:0/2194591118 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f16ec0c5420 msgr2=0x7f16ec0c5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-09T05:52:59.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.594+0000 7f16f22e7640 1 -- 172.21.15.72:0/2194591118 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f16ec0c5420 msgr2=0x7f16ec0c5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-09T05:52:59.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.594+0000 7f16f22e7640 1 --2- 172.21.15.72:0/2194591118 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f16ec0c5420 0x7f16ec0c5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-09T05:52:59.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.594+0000 7f16f22e7640 1 --2- 172.21.15.72:0/2194591118 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f16ec0c5420 0x7f16ec0c5830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-09T05:52:59.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.594+0000 7f16f12e5640 1 -- 172.21.15.72:0/2194591118 >> v2:172.21.15.110:3300/0 conn(0x7f16ec15ab90 msgr2=0x7f16ec15afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-09T05:52:59.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.594+0000 7f16f12e5640 1 -- 172.21.15.72:0/2194591118 >> v2:172.21.15.110:3300/0 conn(0x7f16ec15ab90 msgr2=0x7f16ec15afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-09T05:52:59.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.594+0000 7f16f12e5640 1 --2- 172.21.15.72:0/2194591118 >> v2:172.21.15.110:3300/0 conn(0x7f16ec15ab90 0x7f16ec15afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-09T05:52:59.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.594+0000 7f16f12e5640 1 --2- 172.21.15.72:0/2194591118 >> v2:172.21.15.110:3300/0 conn(0x7f16ec15ab90 0x7f16ec15afa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-09T05:52:59.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.618+0000 7f16f0ae4640 1 -- 172.21.15.72:0/2194591118 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 619688403 0 0) 0x7f16ec0cad30 con 0x7f16ec0c4bf0 2024-05-09T05:52:59.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.618+0000 7f16f0ae4640 1 -- 172.21.15.72:0/2194591118 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16d8003530 con 0x7f16ec0c4bf0 2024-05-09T05:52:59.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.618+0000 7f16f0ae4640 1 -- 172.21.15.72:0/2194591118 <== mon.1 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3003284428 0 0) 0x7f16d8003530 con 0x7f16ec0c4bf0 2024-05-09T05:52:59.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.618+0000 7f16f0ae4640 1 -- 172.21.15.72:0/2194591118 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f16ec0c5420 msgr2=0x7f16ec0c5830 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T05:52:59.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.618+0000 7f16f0ae4640 1 --2- 172.21.15.72:0/2194591118 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f16ec0c5420 0x7f16ec0c5830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:52:59.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.618+0000 7f16f0ae4640 1 -- 172.21.15.72:0/2194591118 >> v2:172.21.15.110:3300/0 conn(0x7f16ec15ab90 msgr2=0x7f16ec15afa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T05:52:59.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.618+0000 7f16f0ae4640 1 --2- 172.21.15.72:0/2194591118 >> v2:172.21.15.110:3300/0 conn(0x7f16ec15ab90 0x7f16ec15afa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:52:59.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.618+0000 7f16f0ae4640 1 -- 172.21.15.72:0/2194591118 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16ec0cb990 con 0x7f16ec0c4bf0 2024-05-09T05:52:59.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.618+0000 7f16f0ae4640 1 -- 172.21.15.72:0/2194591118 <== mon.1 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2749052815 0 0) 0x7f16e8001700 con 0x7f16ec0c4bf0 2024-05-09T05:52:59.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.618+0000 7f16f0ae4640 1 -- 172.21.15.72:0/2194591118 >> v1:172.21.15.110:6789/0 conn(0x7f16ec0c4bf0 legacy=0x7f16ec0ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:52:59.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.618+0000 7f16f0ae4640 1 --2- 172.21.15.72:0/2194591118 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16d8003a10 0x7f16d8003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:52:59.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.618+0000 7f16f0ae4640 1 --2- 172.21.15.72:0/2194591118 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16d8004810 0x7f16d8004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:52:59.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.618+0000 7f16f0ae4640 1 --2- 172.21.15.72:0/2194591118 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f16ec0c5420 0x7f16d80052e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:52:59.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.618+0000 7f16f0ae4640 1 -- 172.21.15.72:0/2194591118 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f16ec0cc4d0 con 0x7f16d8004810 2024-05-09T05:52:59.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.618+0000 7f16f0ae4640 1 -- 172.21.15.72:0/2194591118 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f16d800bbf0 con 0x7f16d8003a10 2024-05-09T05:52:59.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.618+0000 7f16f0ae4640 1 -- 172.21.15.72:0/2194591118 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f16d800bdc0 con 0x7f16ec0c5420 2024-05-09T05:52:59.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.618+0000 7f16f12e5640 1 --2- 172.21.15.72:0/2194591118 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16d8004810 0x7f16d8004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:52:59.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.618+0000 7f16f22e7640 1 --2- 172.21.15.72:0/2194591118 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f16ec0c5420 0x7f16d80052e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:52:59.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.618+0000 7f16f1ae6640 1 --2- 172.21.15.72:0/2194591118 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16d8003a10 0x7f16d8003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:52:59.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.618+0000 7f16f22e7640 1 -- 172.21.15.72:0/2194591118 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16d8003a10 msgr2=0x7f16d8003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:52:59.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.618+0000 7f16f22e7640 1 --2- 172.21.15.72:0/2194591118 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16d8003a10 0x7f16d8003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:52:59.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.618+0000 7f16f22e7640 1 -- 172.21.15.72:0/2194591118 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16d8004810 msgr2=0x7f16d8004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:52:59.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.618+0000 7f16f22e7640 1 --2- 172.21.15.72:0/2194591118 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16d8004810 0x7f16d8004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:52:59.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.618+0000 7f16f22e7640 1 -- 172.21.15.72:0/2194591118 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16d8003530 con 0x7f16ec0c5420 2024-05-09T05:52:59.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.626+0000 7f16f22e7640 1 --2- 172.21.15.72:0/2194591118 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f16ec0c5420 0x7f16d80052e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f16e4009610 tx=0x7f16e401cff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6248ccaaa9c815d8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:52:59.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.626+0000 7f16f0ae4640 1 -- 172.21.15.72:0/2194591118 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e40b2070 con 0x7f16ec0c5420 2024-05-09T05:52:59.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.626+0000 7f16f0ae4640 1 -- 172.21.15.72:0/2194591118 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16e40ad440 con 0x7f16ec0c5420 2024-05-09T05:52:59.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.626+0000 7f16f0ae4640 1 -- 172.21.15.72:0/2194591118 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e4009640 con 0x7f16ec0c5420 2024-05-09T05:52:59.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.626+0000 7f16f3d4a640 1 -- 172.21.15.72:0/2194591118 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f16ec0c5420 msgr2=0x7f16d80052e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:52:59.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.626+0000 7f16f3d4a640 1 --2- 172.21.15.72:0/2194591118 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f16ec0c5420 0x7f16d80052e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f16e4009610 tx=0x7f16e401cff0 comp rx=0 tx=0).stop 2024-05-09T05:52:59.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.626+0000 7f16f22e7640 1 -- 172.21.15.72:0/2194591118 reap_dead start 2024-05-09T05:52:59.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.626+0000 7f16f3d4a640 1 -- 172.21.15.72:0/2194591118 shutdown_connections 2024-05-09T05:52:59.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.626+0000 7f16f3d4a640 1 -- 172.21.15.72:0/2194591118 >> 172.21.15.72:0/2194591118 conn(0x7f16ec072080 msgr2=0x7f16ec072490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:52:59.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.626+0000 7f16f3d4a640 1 -- 172.21.15.72:0/2194591118 shutdown_connections 2024-05-09T05:52:59.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.630+0000 7f16f3d4a640 1 -- 172.21.15.72:0/2194591118 wait complete. 2024-05-09T05:52:59.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.634+0000 7f16f3d4a640 1 Processor -- start 2024-05-09T05:52:59.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.634+0000 7f16f3d4a640 1 -- start start 2024-05-09T05:52:59.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.638+0000 7f16f3d4a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16ec0c5420 0x7f16ec157320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:52:59.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.638+0000 7f16f3d4a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f16ec0c8e80 0x7f16ec154dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:52:59.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.638+0000 7f16f3d4a640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16ec158bd0 0x7f16ec14d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:52:59.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.638+0000 7f16f3d4a640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f16ec0cbf10 con 0x7f16ec158bd0 2024-05-09T05:52:59.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.638+0000 7f16f3d4a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f16ec15a700 con 0x7f16ec0c5420 2024-05-09T05:52:59.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.638+0000 7f16f3d4a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f16ec0cc1f0 con 0x7f16ec0c8e80 2024-05-09T05:52:59.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.638+0000 7f16f1ae6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16ec0c5420 0x7f16ec157320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:52:59.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.638+0000 7f16f12e5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f16ec0c8e80 0x7f16ec154dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:52:59.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.638+0000 7f16f1ae6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16ec0c5420 0x7f16ec157320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.72:57086/0 (socket says 172.21.15.72:57086) 2024-05-09T05:52:59.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.638+0000 7f16f1ae6640 1 -- 172.21.15.72:0/2773555756 learned_addr learned my addr 172.21.15.72:0/2773555756 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:52:59.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.638+0000 7f16f22e7640 1 --2- 172.21.15.72:0/2773555756 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16ec158bd0 0x7f16ec14d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:52:59.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.638+0000 7f16f12e5640 1 -- 172.21.15.72:0/2773555756 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16ec0c5420 msgr2=0x7f16ec157320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:52:59.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.638+0000 7f16f12e5640 1 --2- 172.21.15.72:0/2773555756 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16ec0c5420 0x7f16ec157320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:52:59.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.638+0000 7f16f12e5640 1 -- 172.21.15.72:0/2773555756 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16ec158bd0 msgr2=0x7f16ec14d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:52:59.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.638+0000 7f16f12e5640 1 --2- 172.21.15.72:0/2773555756 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16ec158bd0 0x7f16ec14d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:52:59.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.638+0000 7f16f12e5640 1 -- 172.21.15.72:0/2773555756 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16ec1f47d0 con 0x7f16ec0c8e80 2024-05-09T05:52:59.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.638+0000 7f16f1ae6640 1 --2- 172.21.15.72:0/2773555756 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16ec0c5420 0x7f16ec157320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T05:52:59.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.638+0000 7f16f12e5640 1 --2- 172.21.15.72:0/2773555756 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f16ec0c8e80 0x7f16ec154dc0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f16dc000ee0 tx=0x7f16dc013b10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:52:59.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.638+0000 7f16e27fc640 1 -- 172.21.15.72:0/2773555756 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16dc01a070 con 0x7f16ec0c8e80 2024-05-09T05:52:59.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.638+0000 7f16e27fc640 1 -- 172.21.15.72:0/2773555756 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16dc004230 con 0x7f16ec0c8e80 2024-05-09T05:52:59.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.638+0000 7f16e27fc640 1 -- 172.21.15.72:0/2773555756 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16dc00f040 con 0x7f16ec0c8e80 2024-05-09T05:52:59.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.638+0000 7f16f3d4a640 1 -- 172.21.15.72:0/2773555756 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16ec1f3a10 con 0x7f16ec0c8e80 2024-05-09T05:52:59.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.638+0000 7f16f3d4a640 1 -- 172.21.15.72:0/2773555756 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f16ec1f3fd0 con 0x7f16ec0c8e80 2024-05-09T05:52:59.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.638+0000 7f16e27fc640 1 -- 172.21.15.72:0/2773555756 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f16dc01d070 con 0x7f16ec0c8e80 2024-05-09T05:52:59.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.638+0000 7f16e27fc640 1 -- 172.21.15.72:0/2773555756 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f16dc003bb0 con 0x7f16ec0c8e80 2024-05-09T05:52:59.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.638+0000 7f16f3d4a640 1 -- 172.21.15.72:0/2773555756 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16ec06a520 con 0x7f16ec0c8e80 2024-05-09T05:52:59.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.654+0000 7f16e27fc640 1 -- 172.21.15.72:0/2773555756 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f16dc003db0 con 0x7f16ec0c8e80 2024-05-09T05:52:59.718 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.726+0000 7f16f3d4a640 1 -- 172.21.15.72:0/2773555756 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f16ec0caf00 con 0x7f16ec0c8e80 2024-05-09T05:52:59.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.730+0000 7f16e27fc640 1 -- 172.21.15.72:0/2773555756 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f16dc011b40 con 0x7f16ec0c8e80 2024-05-09T05:52:59.726 INFO:teuthology.orchestra.run.smithi072.stderr:adjusted tunables profile to default 2024-05-09T05:52:59.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.734+0000 7f16f3d4a640 1 -- 172.21.15.72:0/2773555756 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f16ec0c8e80 msgr2=0x7f16ec154dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:52:59.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.734+0000 7f16f3d4a640 1 --2- 172.21.15.72:0/2773555756 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f16ec0c8e80 0x7f16ec154dc0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f16dc000ee0 tx=0x7f16dc013b10 comp rx=0 tx=0).stop 2024-05-09T05:52:59.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.734+0000 7f16f3d4a640 1 -- 172.21.15.72:0/2773555756 shutdown_connections 2024-05-09T05:52:59.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.734+0000 7f16f3d4a640 1 --2- 172.21.15.72:0/2773555756 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16ec158bd0 0x7f16ec14d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:52:59.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.734+0000 7f16f3d4a640 1 --2- 172.21.15.72:0/2773555756 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f16ec0c8e80 0x7f16ec154dc0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:52:59.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.734+0000 7f16f3d4a640 1 --2- 172.21.15.72:0/2773555756 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16ec0c5420 0x7f16ec157320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:52:59.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.734+0000 7f16f3d4a640 1 -- 172.21.15.72:0/2773555756 >> 172.21.15.72:0/2773555756 conn(0x7f16ec072080 msgr2=0x7f16ec152a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:52:59.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.734+0000 7f16f3d4a640 1 -- 172.21.15.72:0/2773555756 shutdown_connections 2024-05-09T05:52:59.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:52:59.734+0000 7f16f3d4a640 1 -- 172.21.15.72:0/2773555756 wait complete. 2024-05-09T05:52:59.747 INFO:tasks.ceph:check_enable_crimson: False 2024-05-09T05:52:59.747 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-05-09T05:52:59.748 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-09T05:52:59.748 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-05-09T05:52:59.760 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-09T05:52:59.760 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-05-09T05:52:59.813 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-09T05:52:59.813 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-05-09T05:52:59.866 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-09T05:52:59.866 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-05-09T05:52:59.921 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-05-09T05:52:59.932+0000 7f15db3dd180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-09T05:52:59.921 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-05-09T05:52:59.922 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-05-09T05:52:59.935 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-05-09T05:52:59.935 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-05-09T05:52:59.989 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-05-09T05:52:59.989 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-05-09T05:53:00.041 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-05-09T05:53:00.042 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-05-09T05:53:00.101 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new e4af2aa1-ba5c-4411-a72a-a0e38e589a74 0 2024-05-09T05:53:00.280 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-05-09T05:53:00.286+0000 7f5b11798180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-09T05:53:00.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.304+0000 7fd6aa275640 1 Processor -- start 2024-05-09T05:53:00.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.304+0000 7fd6aa275640 1 -- start start 2024-05-09T05:53:00.295 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.308+0000 7fd6aa275640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd6a4071fa0 0x7fd6a40c9460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:00.295 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.308+0000 7fd6aa275640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd6a40c99a0 0x7fd6a415a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:00.295 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.308+0000 7fd6aa275640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6a40743e0 con 0x7fd6a40723b0 2024-05-09T05:53:00.295 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.308+0000 7fd6aa275640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fd6a40cc0f0 con 0x7fd6a4071fa0 2024-05-09T05:53:00.295 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.308+0000 7fd6aa275640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fd6a4074680 con 0x7fd6a40c99a0 2024-05-09T05:53:00.295 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.308+0000 7fd6a8812640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd6a40c99a0 0x7fd6a415a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:00.295 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.308+0000 7fd6a8812640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd6a40c99a0 0x7fd6a415a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.110:35444/0 (socket says 172.21.15.110:35444) 2024-05-09T05:53:00.295 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.308+0000 7fd6a8812640 1 -- 172.21.15.110:0/606871458 learned_addr learned my addr 172.21.15.110:0/606871458 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T05:53:00.296 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.308+0000 7fd6a37fe640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fd6a40723b0 0x7fd6a41542e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:44516/0 (socket says 172.21.15.110:44516) 2024-05-09T05:53:00.296 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.308+0000 7fd6a3fff640 1 --2- 172.21.15.110:0/606871458 >> v2:172.21.15.72:3300/0 conn(0x7fd6a4071fa0 0x7fd6a40c9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:00.296 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.308+0000 7fd6a2ffd640 1 -- 172.21.15.110:0/606871458 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 667789378 0 0) 0x7fd6a40743e0 con 0x7fd6a40723b0 2024-05-09T05:53:00.296 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.308+0000 7fd6a8812640 1 -- 172.21.15.110:0/606871458 >> v2:172.21.15.72:3300/0 conn(0x7fd6a4071fa0 msgr2=0x7fd6a40c9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:00.296 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.308+0000 7fd6a8812640 1 --2- 172.21.15.110:0/606871458 >> v2:172.21.15.72:3300/0 conn(0x7fd6a4071fa0 0x7fd6a40c9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:00.296 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.308+0000 7fd6a8812640 1 -- 172.21.15.110:0/606871458 >> v1:172.21.15.110:6789/0 conn(0x7fd6a40723b0 legacy=0x7fd6a41542e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:00.296 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.308+0000 7fd6a8812640 1 -- 172.21.15.110:0/606871458 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6a4074960 con 0x7fd6a40c99a0 2024-05-09T05:53:00.296 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.308+0000 7fd6a3fff640 1 --2- 172.21.15.110:0/606871458 >> v2:172.21.15.72:3300/0 conn(0x7fd6a4071fa0 0x7fd6a40c9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:53:00.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.308+0000 7fd6a8812640 1 --2- 172.21.15.110:0/606871458 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd6a40c99a0 0x7fd6a415a7c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd69c009e50 tx=0x7fd69c01c9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9dcfeeb3854347ce server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:00.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.308+0000 7fd6a2ffd640 1 -- 172.21.15.110:0/606871458 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd69c0a5770 con 0x7fd6a40c99a0 2024-05-09T05:53:00.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.308+0000 7fd6a2ffd640 1 -- 172.21.15.110:0/606871458 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd69c0a5910 con 0x7fd6a40c99a0 2024-05-09T05:53:00.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.308+0000 7fd6a2ffd640 1 -- 172.21.15.110:0/606871458 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd69c0a5ce0 con 0x7fd6a40c99a0 2024-05-09T05:53:00.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.312+0000 7fd6aa275640 1 -- 172.21.15.110:0/606871458 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd6a40c99a0 msgr2=0x7fd6a415a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:00.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.312+0000 7fd6aa275640 1 --2- 172.21.15.110:0/606871458 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd6a40c99a0 0x7fd6a415a7c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd69c009e50 tx=0x7fd69c01c9a0 comp rx=0 tx=0).stop 2024-05-09T05:53:00.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.312+0000 7fd6aa275640 1 -- 172.21.15.110:0/606871458 shutdown_connections 2024-05-09T05:53:00.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.312+0000 7fd6aa275640 1 --2- 172.21.15.110:0/606871458 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd6a40c99a0 0x7fd6a415a7c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:00.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.312+0000 7fd6aa275640 1 --2- 172.21.15.110:0/606871458 >> v2:172.21.15.72:3300/0 conn(0x7fd6a4071fa0 0x7fd6a40c9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:00.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.312+0000 7fd6aa275640 1 -- 172.21.15.110:0/606871458 >> 172.21.15.110:0/606871458 conn(0x7fd6a40cf860 msgr2=0x7fd6a40cfc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:00.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.312+0000 7fd6aa275640 1 -- 172.21.15.110:0/606871458 shutdown_connections 2024-05-09T05:53:00.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.312+0000 7fd6aa275640 1 -- 172.21.15.110:0/606871458 wait complete. 2024-05-09T05:53:00.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.312+0000 7fd6aa275640 1 Processor -- start 2024-05-09T05:53:00.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.312+0000 7fd6aa275640 1 -- start start 2024-05-09T05:53:00.304 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.316+0000 7fd6aa275640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6a4071fa0 0x7fd6a406ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:00.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.316+0000 7fd6aa275640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6a40723b0 0x7fd6a406dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:00.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.316+0000 7fd6aa275640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd6a40c99a0 0x7fd6a414cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:00.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.316+0000 7fd6aa275640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a41549f0 con 0x7fd6a40723b0 2024-05-09T05:53:00.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.316+0000 7fd6aa275640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a415b110 con 0x7fd6a4071fa0 2024-05-09T05:53:00.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.316+0000 7fd6aa275640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fd6a4154b70 con 0x7fd6a40c99a0 2024-05-09T05:53:00.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.316+0000 7fd6a3fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6a4071fa0 0x7fd6a406ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:00.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.316+0000 7fd6a8812640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd6a40c99a0 0x7fd6a414cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:00.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.316+0000 7fd6a3fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6a4071fa0 0x7fd6a406ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:44060/0 (socket says 172.21.15.110:44060) 2024-05-09T05:53:00.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.316+0000 7fd6a3fff640 1 -- 172.21.15.110:0/3035649862 learned_addr learned my addr 172.21.15.110:0/3035649862 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T05:53:00.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.316+0000 7fd6a37fe640 1 --2- 172.21.15.110:0/3035649862 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6a40723b0 0x7fd6a406dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:00.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.316+0000 7fd6a8812640 1 -- 172.21.15.110:0/3035649862 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6a4071fa0 msgr2=0x7fd6a406ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:00.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.316+0000 7fd6a8812640 1 --2- 172.21.15.110:0/3035649862 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6a4071fa0 0x7fd6a406ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:00.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.316+0000 7fd6a8812640 1 -- 172.21.15.110:0/3035649862 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6a40723b0 msgr2=0x7fd6a406dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:00.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.316+0000 7fd6a8812640 1 --2- 172.21.15.110:0/3035649862 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6a40723b0 0x7fd6a406dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:00.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.316+0000 7fd6a8812640 1 -- 172.21.15.110:0/3035649862 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6a41f6ce0 con 0x7fd6a40c99a0 2024-05-09T05:53:00.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.316+0000 7fd6a3fff640 1 --2- 172.21.15.110:0/3035649862 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6a4071fa0 0x7fd6a406ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T05:53:00.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.316+0000 7fd6a8812640 1 --2- 172.21.15.110:0/3035649862 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd6a40c99a0 0x7fd6a414cd30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd69c0ab000 tx=0x7fd69c019740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:00.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.316+0000 7fd6a0ff9640 1 -- 172.21.15.110:0/3035649862 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd69c0bc030 con 0x7fd6a40c99a0 2024-05-09T05:53:00.307 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.316+0000 7fd6a0ff9640 1 -- 172.21.15.110:0/3035649862 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd69c0b8470 con 0x7fd6a40c99a0 2024-05-09T05:53:00.307 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.316+0000 7fd6a0ff9640 1 -- 172.21.15.110:0/3035649862 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd69c0b8860 con 0x7fd6a40c99a0 2024-05-09T05:53:00.307 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.316+0000 7fd6aa275640 1 -- 172.21.15.110:0/3035649862 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6a406e400 con 0x7fd6a40c99a0 2024-05-09T05:53:00.307 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.316+0000 7fd6aa275640 1 -- 172.21.15.110:0/3035649862 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6a406d9e0 con 0x7fd6a40c99a0 2024-05-09T05:53:00.307 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.316+0000 7fd6a0ff9640 1 -- 172.21.15.110:0/3035649862 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd69c0bf070 con 0x7fd6a40c99a0 2024-05-09T05:53:00.307 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.316+0000 7fd6a0ff9640 1 -- 172.21.15.110:0/3035649862 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fd69c0c18d0 con 0x7fd6a40c99a0 2024-05-09T05:53:00.307 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.316+0000 7fd6aa275640 1 -- 172.21.15.110:0/3035649862 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6a406a520 con 0x7fd6a40c99a0 2024-05-09T05:53:00.307 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.320+0000 7fd6a0ff9640 1 -- 172.21.15.110:0/3035649862 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fd69c016620 con 0x7fd6a40c99a0 2024-05-09T05:53:00.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.388+0000 7fd6aa275640 1 -- 172.21.15.110:0/3035649862 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e4af2aa1-ba5c-4411-a72a-a0e38e589a74", "id": 0} v 0) -- 0x7fd6a41f6440 con 0x7fd6a40c99a0 2024-05-09T05:53:00.381 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.392+0000 7fd6a0ff9640 1 -- 172.21.15.110:0/3035649862 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e4af2aa1-ba5c-4411-a72a-a0e38e589a74", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fd69c0b8a00 con 0x7fd6a40c99a0 2024-05-09T05:53:00.381 INFO:teuthology.orchestra.run.smithi110.stdout:0 2024-05-09T05:53:00.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.396+0000 7fd6aa275640 1 -- 172.21.15.110:0/3035649862 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd6a40c99a0 msgr2=0x7fd6a414cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:00.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.396+0000 7fd6aa275640 1 --2- 172.21.15.110:0/3035649862 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd6a40c99a0 0x7fd6a414cd30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd69c0ab000 tx=0x7fd69c019740 comp rx=0 tx=0).stop 2024-05-09T05:53:00.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.396+0000 7fd6aa275640 1 -- 172.21.15.110:0/3035649862 shutdown_connections 2024-05-09T05:53:00.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.396+0000 7fd6aa275640 1 --2- 172.21.15.110:0/3035649862 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd6a40c99a0 0x7fd6a414cd30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:00.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.396+0000 7fd6aa275640 1 --2- 172.21.15.110:0/3035649862 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6a40723b0 0x7fd6a406dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:00.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.396+0000 7fd6aa275640 1 --2- 172.21.15.110:0/3035649862 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6a4071fa0 0x7fd6a406ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:00.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.396+0000 7fd6aa275640 1 -- 172.21.15.110:0/3035649862 >> 172.21.15.110:0/3035649862 conn(0x7fd6a40cf860 msgr2=0x7fd6a40c76d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:00.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.396+0000 7fd6aa275640 1 -- 172.21.15.110:0/3035649862 shutdown_connections 2024-05-09T05:53:00.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.396+0000 7fd6aa275640 1 -- 172.21.15.110:0/3035649862 wait complete. 2024-05-09T05:53:00.402 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new 052504f5-a523-4922-bdc7-ce2890faa5ff 1 2024-05-09T05:53:00.428 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-05-09T05:53:00.440+0000 7f15db3dd180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-09T05:53:00.548 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.560+0000 7f8fe4503640 1 Processor -- start 2024-05-09T05:53:00.549 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.560+0000 7f8fe4503640 1 -- start start 2024-05-09T05:53:00.551 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.564+0000 7f8fe4503640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8fdc1549d0 0x7f8fdc074260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:00.552 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.564+0000 7f8fe4503640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8fdc06d7b0 0x7f8fdc06dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:00.552 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.564+0000 7f8fe4503640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fdc06f7b0 con 0x7f8fdc15aa40 2024-05-09T05:53:00.552 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.564+0000 7f8fe4503640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f8fdc06f580 con 0x7f8fdc1549d0 2024-05-09T05:53:00.552 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.564+0000 7f8fe4503640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f8fdc06fa50 con 0x7f8fdc06d7b0 2024-05-09T05:53:00.552 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.564+0000 7f8fe1a9e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8fdc06d7b0 0x7f8fdc06dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:00.552 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.564+0000 7f8fe1a9e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8fdc06d7b0 0x7f8fdc06dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:44064/0 (socket says 172.21.15.110:44064) 2024-05-09T05:53:00.553 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.564+0000 7f8fe2aa0640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f8fdc15aa40 0x7f8fdc15ae50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:44530/0 (socket says 172.21.15.110:44530) 2024-05-09T05:53:00.553 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.564+0000 7f8fe1a9e640 1 -- 172.21.15.110:0/615738787 learned_addr learned my addr 172.21.15.110:0/615738787 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T05:53:00.553 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.564+0000 7f8fe229f640 1 --2- 172.21.15.110:0/615738787 >> v2:172.21.15.72:3300/0 conn(0x7f8fdc1549d0 0x7f8fdc074260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:00.553 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.564+0000 7f8fe1a9e640 1 -- 172.21.15.110:0/615738787 >> v2:172.21.15.72:3300/0 conn(0x7f8fdc1549d0 msgr2=0x7f8fdc074260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:00.553 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.564+0000 7f8fe1a9e640 1 --2- 172.21.15.110:0/615738787 >> v2:172.21.15.72:3300/0 conn(0x7f8fdc1549d0 0x7f8fdc074260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:00.553 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.564+0000 7f8fe1a9e640 1 -- 172.21.15.110:0/615738787 >> v1:172.21.15.110:6789/0 conn(0x7f8fdc15aa40 legacy=0x7f8fdc15ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:00.554 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.564+0000 7f8fe129d640 1 -- 172.21.15.110:0/615738787 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 638605271 0 0) 0x7f8fdc06f7b0 con 0x7f8fdc15aa40 2024-05-09T05:53:00.554 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.564+0000 7f8fe1a9e640 1 -- 172.21.15.110:0/615738787 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fdc0c9cf0 con 0x7f8fdc06d7b0 2024-05-09T05:53:00.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.564+0000 7f8fe1a9e640 1 --2- 172.21.15.110:0/615738787 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8fdc06d7b0 0x7f8fdc06dbc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc0c5310 tx=0x7f8fd001ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=663337c9c05bedd2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:00.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.564+0000 7f8fe129d640 1 -- 172.21.15.110:0/615738787 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd00b5070 con 0x7f8fdc06d7b0 2024-05-09T05:53:00.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.564+0000 7f8fe129d640 1 -- 172.21.15.110:0/615738787 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fd00a8a10 con 0x7f8fdc06d7b0 2024-05-09T05:53:00.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.564+0000 7f8fe129d640 1 -- 172.21.15.110:0/615738787 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd00a8de0 con 0x7f8fdc06d7b0 2024-05-09T05:53:00.562 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.568+0000 7f8fe4503640 1 -- 172.21.15.110:0/615738787 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8fdc06d7b0 msgr2=0x7f8fdc06dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:00.562 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.568+0000 7f8fe4503640 1 --2- 172.21.15.110:0/615738787 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8fdc06d7b0 0x7f8fdc06dbc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc0c5310 tx=0x7f8fd001ed10 comp rx=0 tx=0).stop 2024-05-09T05:53:00.562 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.568+0000 7f8fe4503640 1 -- 172.21.15.110:0/615738787 shutdown_connections 2024-05-09T05:53:00.562 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.568+0000 7f8fe4503640 1 --2- 172.21.15.110:0/615738787 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8fdc06d7b0 0x7f8fdc06dbc0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:00.562 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.568+0000 7f8fe4503640 1 --2- 172.21.15.110:0/615738787 >> v2:172.21.15.72:3300/0 conn(0x7f8fdc1549d0 0x7f8fdc074260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:00.562 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.568+0000 7f8fe4503640 1 -- 172.21.15.110:0/615738787 >> 172.21.15.110:0/615738787 conn(0x7f8fdc06e9b0 msgr2=0x7f8fdc06edc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:00.563 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.568+0000 7f8fe4503640 1 -- 172.21.15.110:0/615738787 shutdown_connections 2024-05-09T05:53:00.563 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.568+0000 7f8fe4503640 1 -- 172.21.15.110:0/615738787 wait complete. 2024-05-09T05:53:00.563 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.568+0000 7f8fe4503640 1 Processor -- start 2024-05-09T05:53:00.563 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.568+0000 7f8fe4503640 1 -- start start 2024-05-09T05:53:00.563 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.568+0000 7f8fe4503640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8fdc06d7b0 0x7f8fdc0c45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:00.563 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.568+0000 7f8fe4503640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8fdc1549d0 0x7f8fdc1f5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:00.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.568+0000 7f8fe4503640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8fdc15aa40 0x7f8fdc0738b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:00.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.568+0000 7f8fe4503640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f8fdc15a4d0 con 0x7f8fdc06d7b0 2024-05-09T05:53:00.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.568+0000 7f8fe4503640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f8fdc0ca2b0 con 0x7f8fdc15aa40 2024-05-09T05:53:00.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.568+0000 7f8fe4503640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f8fdc06fe90 con 0x7f8fdc1549d0 2024-05-09T05:53:00.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.568+0000 7f8fe1a9e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8fdc1549d0 0x7f8fdc1f5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:00.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.568+0000 7f8fe1a9e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8fdc1549d0 0x7f8fdc1f5e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.110:35472/0 (socket says 172.21.15.110:35472) 2024-05-09T05:53:00.565 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.568+0000 7f8fe2aa0640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8fdc15aa40 0x7f8fdc0738b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:00.565 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.568+0000 7f8fe1a9e640 1 -- 172.21.15.110:0/3118880833 learned_addr learned my addr 172.21.15.110:0/3118880833 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T05:53:00.565 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.568+0000 7f8fe229f640 1 --2- 172.21.15.110:0/3118880833 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8fdc06d7b0 0x7f8fdc0c45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:00.565 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.568+0000 7f8fe1a9e640 1 -- 172.21.15.110:0/3118880833 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8fdc15aa40 msgr2=0x7f8fdc0738b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:00.565 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.568+0000 7f8fe1a9e640 1 --2- 172.21.15.110:0/3118880833 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8fdc15aa40 0x7f8fdc0738b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:00.565 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.568+0000 7f8fe1a9e640 1 -- 172.21.15.110:0/3118880833 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8fdc06d7b0 msgr2=0x7f8fdc0c45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:00.566 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.568+0000 7f8fe1a9e640 1 --2- 172.21.15.110:0/3118880833 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8fdc06d7b0 0x7f8fdc0c45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:00.566 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.568+0000 7f8fe1a9e640 1 -- 172.21.15.110:0/3118880833 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fdc1f6340 con 0x7f8fdc1549d0 2024-05-09T05:53:00.566 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.568+0000 7f8fe2aa0640 1 --2- 172.21.15.110:0/3118880833 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8fdc15aa40 0x7f8fdc0738b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T05:53:00.566 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.572+0000 7f8fe1a9e640 1 --2- 172.21.15.110:0/3118880833 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8fdc1549d0 0x7f8fdc1f5e00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8fd00b3040 tx=0x7f8fd001bab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:00.566 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.572+0000 7f8fceffd640 1 -- 172.21.15.110:0/3118880833 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd00b5070 con 0x7f8fdc1549d0 2024-05-09T05:53:00.566 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.572+0000 7f8fceffd640 1 -- 172.21.15.110:0/3118880833 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fd00b0b30 con 0x7f8fdc1549d0 2024-05-09T05:53:00.567 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.572+0000 7f8fe4503640 1 -- 172.21.15.110:0/3118880833 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fdc0b0940 con 0x7f8fdc1549d0 2024-05-09T05:53:00.567 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.572+0000 7f8fceffd640 1 -- 172.21.15.110:0/3118880833 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd00bb410 con 0x7f8fdc1549d0 2024-05-09T05:53:00.567 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.572+0000 7f8fe4503640 1 -- 172.21.15.110:0/3118880833 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fdc1f2950 con 0x7f8fdc1549d0 2024-05-09T05:53:00.567 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.572+0000 7f8fceffd640 1 -- 172.21.15.110:0/3118880833 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8fd00c2060 con 0x7f8fdc1549d0 2024-05-09T05:53:00.567 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.572+0000 7f8fceffd640 1 -- 172.21.15.110:0/3118880833 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f8fd00c4940 con 0x7f8fdc1549d0 2024-05-09T05:53:00.567 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.572+0000 7f8fe4503640 1 -- 172.21.15.110:0/3118880833 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fdc06a520 con 0x7f8fdc1549d0 2024-05-09T05:53:00.568 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.572+0000 7f8fceffd640 1 -- 172.21.15.110:0/3118880833 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f8fd0018870 con 0x7f8fdc1549d0 2024-05-09T05:53:00.631 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.644+0000 7f8fe4503640 1 -- 172.21.15.110:0/3118880833 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd new", "uuid": "052504f5-a523-4922-bdc7-ce2890faa5ff", "id": 1} v 0) -- 0x7f8fdc0c9ad0 con 0x7f8fdc1549d0 2024-05-09T05:53:00.634 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-05-09T05:53:00.648+0000 7f15db3dd180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-09T05:53:00.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.652+0000 7f8fceffd640 1 -- 172.21.15.110:0/3118880833 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "052504f5-a523-4922-bdc7-ce2890faa5ff", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f8fd00bb9e0 con 0x7f8fdc1549d0 2024-05-09T05:53:00.638 INFO:teuthology.orchestra.run.smithi110.stdout:1 2024-05-09T05:53:00.639 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.652+0000 7f8fe4503640 1 -- 172.21.15.110:0/3118880833 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8fdc1549d0 msgr2=0x7f8fdc1f5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:00.639 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.652+0000 7f8fe4503640 1 --2- 172.21.15.110:0/3118880833 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8fdc1549d0 0x7f8fdc1f5e00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8fd00b3040 tx=0x7f8fd001bab0 comp rx=0 tx=0).stop 2024-05-09T05:53:00.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.652+0000 7f8fe4503640 1 -- 172.21.15.110:0/3118880833 shutdown_connections 2024-05-09T05:53:00.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.652+0000 7f8fe4503640 1 --2- 172.21.15.110:0/3118880833 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8fdc15aa40 0x7f8fdc0738b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:00.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.652+0000 7f8fe4503640 1 --2- 172.21.15.110:0/3118880833 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8fdc1549d0 0x7f8fdc1f5e00 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:00.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.652+0000 7f8fe4503640 1 --2- 172.21.15.110:0/3118880833 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8fdc06d7b0 0x7f8fdc0c45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:00.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.652+0000 7f8fe4503640 1 -- 172.21.15.110:0/3118880833 >> 172.21.15.110:0/3118880833 conn(0x7f8fdc06e9b0 msgr2=0x7f8fdc159b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:00.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.652+0000 7f8fe4503640 1 -- 172.21.15.110:0/3118880833 shutdown_connections 2024-05-09T05:53:00.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.652+0000 7f8fe4503640 1 -- 172.21.15.110:0/3118880833 wait complete. 2024-05-09T05:53:00.657 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new 28bc1c95-6d0d-4263-baad-314d86e6a670 2 2024-05-09T05:53:00.768 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-05-09T05:53:00.774+0000 7f5b11798180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-09T05:53:00.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.852+0000 7f65da866640 1 Processor -- start 2024-05-09T05:53:00.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.852+0000 7f65da866640 1 -- start start 2024-05-09T05:53:00.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.852+0000 7f65da866640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f65d415ab90 0x7f65d415afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:00.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.852+0000 7f65da866640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65d40cad30 con 0x7f65d40c5420 2024-05-09T05:53:00.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.856+0000 7f65da866640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65d40cb990 con 0x7f65d40c4bf0 2024-05-09T05:53:00.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.856+0000 7f65da866640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f65d415b4e0 con 0x7f65d415ab90 2024-05-09T05:53:00.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.856+0000 7f65d3fff640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f65d40c4bf0 0x7f65d40ca620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:44536/0 (socket says 172.21.15.110:44536) 2024-05-09T05:53:00.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.856+0000 7f65d3fff640 1 -- 172.21.15.110:0/695634521 learned_addr learned my addr 172.21.15.110:0/695634521 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-05-09T05:53:00.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.856+0000 7f65d37fe640 1 --2- 172.21.15.110:0/695634521 >> v2:172.21.15.72:3300/0 conn(0x7f65d415ab90 0x7f65d415afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:00.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.856+0000 7f65d2ffd640 1 -- 172.21.15.110:0/695634521 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 136335613 0 0) 0x7f65d40cb990 con 0x7f65d40c4bf0 2024-05-09T05:53:00.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.856+0000 7f65d2ffd640 1 -- 172.21.15.110:0/695634521 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65bc003530 con 0x7f65d40c4bf0 2024-05-09T05:53:00.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.856+0000 7f65d2ffd640 1 -- 172.21.15.110:0/695634521 <== mon.1 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2254898795 0 0) 0x7f65bc003530 con 0x7f65d40c4bf0 2024-05-09T05:53:00.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.856+0000 7f65d2ffd640 1 -- 172.21.15.110:0/695634521 >> v2:172.21.15.72:3300/0 conn(0x7f65d415ab90 msgr2=0x7f65d415afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:00.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.856+0000 7f65d2ffd640 1 --2- 172.21.15.110:0/695634521 >> v2:172.21.15.72:3300/0 conn(0x7f65d415ab90 0x7f65d415afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:00.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.856+0000 7f65d2ffd640 1 -- 172.21.15.110:0/695634521 >> v1:172.21.15.72:6789/0 conn(0x7f65d40c5420 legacy=0x7f65d4164e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:00.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.856+0000 7f65d2ffd640 1 -- 172.21.15.110:0/695634521 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65d40cbc30 con 0x7f65d40c4bf0 2024-05-09T05:53:00.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.856+0000 7f65d2ffd640 1 -- 172.21.15.110:0/695634521 <== mon.1 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2749052815 0 0) 0x7f65c8001700 con 0x7f65d40c4bf0 2024-05-09T05:53:00.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.856+0000 7f65d2ffd640 1 -- 172.21.15.110:0/695634521 >> v1:172.21.15.110:6789/0 conn(0x7f65d40c4bf0 legacy=0x7f65d40ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:00.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.856+0000 7f65d2ffd640 1 --2- 172.21.15.110:0/695634521 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65bc003a60 0x7f65bc003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:00.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.856+0000 7f65d2ffd640 1 --2- 172.21.15.110:0/695634521 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65bc004810 0x7f65bc004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:00.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.856+0000 7f65d2ffd640 1 --2- 172.21.15.110:0/695634521 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f65bc005260 0x7f65bc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:00.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.856+0000 7f65d2ffd640 1 -- 172.21.15.110:0/695634521 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f65bc00c1b0 con 0x7f65bc004810 2024-05-09T05:53:00.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.856+0000 7f65d2ffd640 1 -- 172.21.15.110:0/695634521 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f65bc00c360 con 0x7f65bc003a60 2024-05-09T05:53:00.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.856+0000 7f65d2ffd640 1 -- 172.21.15.110:0/695634521 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f65bc00c560 con 0x7f65bc005260 2024-05-09T05:53:00.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.856+0000 7f65d3fff640 1 --2- 172.21.15.110:0/695634521 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65bc003a60 0x7f65bc003ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:00.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.856+0000 7f65d8e03640 1 --2- 172.21.15.110:0/695634521 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f65bc005260 0x7f65bc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:00.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.856+0000 7f65d37fe640 1 --2- 172.21.15.110:0/695634521 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65bc004810 0x7f65bc004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:00.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.856+0000 7f65d3fff640 1 -- 172.21.15.110:0/695634521 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f65bc005260 msgr2=0x7f65bc00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:00.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.856+0000 7f65d3fff640 1 --2- 172.21.15.110:0/695634521 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f65bc005260 0x7f65bc00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:00.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.856+0000 7f65d3fff640 1 -- 172.21.15.110:0/695634521 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65bc004810 msgr2=0x7f65bc004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:00.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.856+0000 7f65d3fff640 1 --2- 172.21.15.110:0/695634521 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65bc004810 0x7f65bc004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:00.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.856+0000 7f65d3fff640 1 -- 172.21.15.110:0/695634521 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65bc003530 con 0x7f65bc003a60 2024-05-09T05:53:00.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.856+0000 7f65d8e03640 1 --2- 172.21.15.110:0/695634521 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f65bc005260 0x7f65bc00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T05:53:00.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.856+0000 7f65d8e03640 1 -- 172.21.15.110:0/695634521 reap_dead start 2024-05-09T05:53:00.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.856+0000 7f65d3fff640 1 --2- 172.21.15.110:0/695634521 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65bc003a60 0x7f65bc003ed0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f65c8001060 tx=0x7f65c801cba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b0acf1299185af3 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:00.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.856+0000 7f65d2ffd640 1 -- 172.21.15.110:0/695634521 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c8007d20 con 0x7f65bc003a60 2024-05-09T05:53:00.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.856+0000 7f65d2ffd640 1 -- 172.21.15.110:0/695634521 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65c80a9020 con 0x7f65bc003a60 2024-05-09T05:53:00.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.856+0000 7f65d2ffd640 1 -- 172.21.15.110:0/695634521 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c80a5b40 con 0x7f65bc003a60 2024-05-09T05:53:00.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.860+0000 7f65da866640 1 -- 172.21.15.110:0/695634521 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65bc003a60 msgr2=0x7f65bc003ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:00.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.860+0000 7f65da866640 1 --2- 172.21.15.110:0/695634521 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65bc003a60 0x7f65bc003ed0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f65c8001060 tx=0x7f65c801cba0 comp rx=0 tx=0).stop 2024-05-09T05:53:00.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.860+0000 7f65da866640 1 -- 172.21.15.110:0/695634521 shutdown_connections 2024-05-09T05:53:00.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.860+0000 7f65da866640 1 --2- 172.21.15.110:0/695634521 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65bc003a60 0x7f65bc003ed0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:00.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.860+0000 7f65da866640 1 -- 172.21.15.110:0/695634521 >> 172.21.15.110:0/695634521 conn(0x7f65d4072080 msgr2=0x7f65d4072490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:00.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.860+0000 7f65da866640 1 -- 172.21.15.110:0/695634521 shutdown_connections 2024-05-09T05:53:00.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.860+0000 7f65da866640 1 -- 172.21.15.110:0/695634521 wait complete. 2024-05-09T05:53:00.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.860+0000 7f65da866640 1 Processor -- start 2024-05-09T05:53:00.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.860+0000 7f65da866640 1 -- start start 2024-05-09T05:53:00.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.860+0000 7f65da866640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65bc003a60 0x7f65d4156420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:00.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.860+0000 7f65da866640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65d4154dc0 0x7f65d4075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:00.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.860+0000 7f65da866640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f65d4157700 0x7f65d4152690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:00.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.860+0000 7f65da866640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f65d415a700 con 0x7f65d4154dc0 2024-05-09T05:53:00.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.860+0000 7f65da866640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f65d40cc4d0 con 0x7f65bc003a60 2024-05-09T05:53:00.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.860+0000 7f65da866640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f65d40cc1f0 con 0x7f65d4157700 2024-05-09T05:53:00.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.860+0000 7f65d3fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65bc003a60 0x7f65d4156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:00.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.860+0000 7f65d3fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65bc003a60 0x7f65d4156420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:44078/0 (socket says 172.21.15.110:44078) 2024-05-09T05:53:00.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.860+0000 7f65d3fff640 1 -- 172.21.15.110:0/3322851747 learned_addr learned my addr 172.21.15.110:0/3322851747 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T05:53:00.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.860+0000 7f65d8e03640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f65d4157700 0x7f65d4152690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:00.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.864+0000 7f65d37fe640 1 --2- 172.21.15.110:0/3322851747 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65d4154dc0 0x7f65d4075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:00.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.864+0000 7f65d3fff640 1 -- 172.21.15.110:0/3322851747 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f65d4157700 msgr2=0x7f65d4152690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:00.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.864+0000 7f65d3fff640 1 --2- 172.21.15.110:0/3322851747 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f65d4157700 0x7f65d4152690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:00.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.864+0000 7f65d3fff640 1 -- 172.21.15.110:0/3322851747 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65d4154dc0 msgr2=0x7f65d4075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:00.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.864+0000 7f65d3fff640 1 --2- 172.21.15.110:0/3322851747 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65d4154dc0 0x7f65d4075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:00.853 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.864+0000 7f65d3fff640 1 -- 172.21.15.110:0/3322851747 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65d41f0620 con 0x7f65bc003a60 2024-05-09T05:53:00.853 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.864+0000 7f65d8e03640 1 --2- 172.21.15.110:0/3322851747 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f65d4157700 0x7f65d4152690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T05:53:00.853 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.864+0000 7f65d3fff640 1 --2- 172.21.15.110:0/3322851747 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65bc003a60 0x7f65d4156420 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f65c8000c10 tx=0x7f65bc005840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:00.853 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.864+0000 7f65d0ff9640 1 -- 172.21.15.110:0/3322851747 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c80a5d10 con 0x7f65bc003a60 2024-05-09T05:53:00.853 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.864+0000 7f65d0ff9640 1 -- 172.21.15.110:0/3322851747 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65c80b2070 con 0x7f65bc003a60 2024-05-09T05:53:00.853 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.864+0000 7f65da866640 1 -- 172.21.15.110:0/3322851747 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65d4155570 con 0x7f65bc003a60 2024-05-09T05:53:00.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.864+0000 7f65d0ff9640 1 -- 172.21.15.110:0/3322851747 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c8004a30 con 0x7f65bc003a60 2024-05-09T05:53:00.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.864+0000 7f65da866640 1 -- 172.21.15.110:0/3322851747 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65d41f0bc0 con 0x7f65bc003a60 2024-05-09T05:53:00.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.864+0000 7f65d0ff9640 1 -- 172.21.15.110:0/3322851747 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f65c80070d0 con 0x7f65bc003a60 2024-05-09T05:53:00.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.864+0000 7f65d0ff9640 1 -- 172.21.15.110:0/3322851747 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f65c80b9da0 con 0x7f65bc003a60 2024-05-09T05:53:00.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.864+0000 7f65da866640 1 -- 172.21.15.110:0/3322851747 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65d406a520 con 0x7f65bc003a60 2024-05-09T05:53:00.855 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.864+0000 7f65d0ff9640 1 -- 172.21.15.110:0/3322851747 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f65c8016950 con 0x7f65bc003a60 2024-05-09T05:53:00.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.936+0000 7f65da866640 1 -- 172.21.15.110:0/3322851747 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd new", "uuid": "28bc1c95-6d0d-4263-baad-314d86e6a670", "id": 2} v 0) -- 0x7f65d40caf00 con 0x7f65bc003a60 2024-05-09T05:53:00.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.940+0000 7f65d0ff9640 1 -- 172.21.15.110:0/3322851747 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "28bc1c95-6d0d-4263-baad-314d86e6a670", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f65c80b9430 con 0x7f65bc003a60 2024-05-09T05:53:00.930 INFO:teuthology.orchestra.run.smithi110.stdout:2 2024-05-09T05:53:00.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.944+0000 7f65da866640 1 -- 172.21.15.110:0/3322851747 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65bc003a60 msgr2=0x7f65d4156420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:00.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.944+0000 7f65da866640 1 --2- 172.21.15.110:0/3322851747 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65bc003a60 0x7f65d4156420 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f65c8000c10 tx=0x7f65bc005840 comp rx=0 tx=0).stop 2024-05-09T05:53:00.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.944+0000 7f65da866640 1 -- 172.21.15.110:0/3322851747 shutdown_connections 2024-05-09T05:53:00.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.944+0000 7f65da866640 1 --2- 172.21.15.110:0/3322851747 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f65d4157700 0x7f65d4152690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:00.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.944+0000 7f65da866640 1 --2- 172.21.15.110:0/3322851747 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65d4154dc0 0x7f65d4075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:00.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.944+0000 7f65da866640 1 --2- 172.21.15.110:0/3322851747 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65bc003a60 0x7f65d4156420 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:00.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.944+0000 7f65da866640 1 -- 172.21.15.110:0/3322851747 >> 172.21.15.110:0/3322851747 conn(0x7f65d4072080 msgr2=0x7f65d414f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:00.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.944+0000 7f65da866640 1 -- 172.21.15.110:0/3322851747 shutdown_connections 2024-05-09T05:53:00.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:00.944+0000 7f65da866640 1 -- 172.21.15.110:0/3322851747 wait complete. 2024-05-09T05:53:00.947 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new edcc86cb-f178-4533-8069-de9d781531ea 3 2024-05-09T05:53:00.957 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-05-09T05:53:00.962+0000 7f5b11798180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-09T05:53:01.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.104+0000 7f19ed25b640 1 Processor -- start 2024-05-09T05:53:01.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.104+0000 7f19ed25b640 1 -- start start 2024-05-09T05:53:01.093 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.104+0000 7f19ed25b640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f19e8074040 0x7f19e80c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:01.093 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.104+0000 7f19ed25b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19e80c8510 0x7f19e8164dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:01.093 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.104+0000 7f19ed25b640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19e806e920 con 0x7f19e806c7a0 2024-05-09T05:53:01.093 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.104+0000 7f19ed25b640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f19e8073b70 con 0x7f19e8074040 2024-05-09T05:53:01.093 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.104+0000 7f19ed25b640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f19e8073890 con 0x7f19e80c8510 2024-05-09T05:53:01.093 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.104+0000 7f19e759e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19e80c8510 0x7f19e8164dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:01.093 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.104+0000 7f19e759e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19e80c8510 0x7f19e8164dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.110:35504/0 (socket says 172.21.15.110:35504) 2024-05-09T05:53:01.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.104+0000 7f19e759e640 1 -- 172.21.15.110:0/650034299 learned_addr learned my addr 172.21.15.110:0/650034299 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T05:53:01.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.104+0000 7f19e659c640 1 --2- 172.21.15.110:0/650034299 >> v2:172.21.15.72:3300/0 conn(0x7f19e8074040 0x7f19e80c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:01.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.104+0000 7f19e759e640 1 -- 172.21.15.110:0/650034299 >> v2:172.21.15.72:3300/0 conn(0x7f19e8074040 msgr2=0x7f19e80c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:01.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.104+0000 7f19e759e640 1 --2- 172.21.15.110:0/650034299 >> v2:172.21.15.72:3300/0 conn(0x7f19e8074040 0x7f19e80c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:01.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.104+0000 7f19e759e640 1 -- 172.21.15.110:0/650034299 >> v1:172.21.15.72:6789/0 conn(0x7f19e806c7a0 legacy=0x7f19e8074ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:01.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.104+0000 7f19e759e640 1 -- 172.21.15.110:0/650034299 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19e806e360 con 0x7f19e80c8510 2024-05-09T05:53:01.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.108+0000 7f19e759e640 1 --2- 172.21.15.110:0/650034299 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19e80c8510 0x7f19e8164dd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f19e0009e50 tx=0x7f19e001f210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23df394618d60854 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:01.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.108+0000 7f19e5d9b640 1 -- 172.21.15.110:0/650034299 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e00b4070 con 0x7f19e80c8510 2024-05-09T05:53:01.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.108+0000 7f19e5d9b640 1 -- 172.21.15.110:0/650034299 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19e00af400 con 0x7f19e80c8510 2024-05-09T05:53:01.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.108+0000 7f19e5d9b640 1 -- 172.21.15.110:0/650034299 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e00af7d0 con 0x7f19e80c8510 2024-05-09T05:53:01.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.108+0000 7f19ed25b640 1 -- 172.21.15.110:0/650034299 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19e80c8510 msgr2=0x7f19e8164dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:01.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.108+0000 7f19ed25b640 1 --2- 172.21.15.110:0/650034299 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19e80c8510 0x7f19e8164dd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f19e0009e50 tx=0x7f19e001f210 comp rx=0 tx=0).stop 2024-05-09T05:53:01.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.108+0000 7f19ed25b640 1 -- 172.21.15.110:0/650034299 shutdown_connections 2024-05-09T05:53:01.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.108+0000 7f19ed25b640 1 --2- 172.21.15.110:0/650034299 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19e80c8510 0x7f19e8164dd0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:01.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.108+0000 7f19ed25b640 1 --2- 172.21.15.110:0/650034299 >> v2:172.21.15.72:3300/0 conn(0x7f19e8074040 0x7f19e80c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:01.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.108+0000 7f19ed25b640 1 -- 172.21.15.110:0/650034299 >> 172.21.15.110:0/650034299 conn(0x7f19e80cb3c0 msgr2=0x7f19e80cb7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:01.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.108+0000 7f19ed25b640 1 -- 172.21.15.110:0/650034299 shutdown_connections 2024-05-09T05:53:01.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.108+0000 7f19ed25b640 1 -- 172.21.15.110:0/650034299 wait complete. 2024-05-09T05:53:01.098 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.112+0000 7f19ed25b640 1 Processor -- start 2024-05-09T05:53:01.098 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.112+0000 7f19ed25b640 1 -- start start 2024-05-09T05:53:01.101 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.112+0000 7f19ed25b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19e806c7a0 0x7f19e81e5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:01.101 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.112+0000 7f19ed25b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19e8074040 0x7f19e80c7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:01.101 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.112+0000 7f19ed25b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19e80c8510 0x7f19e814a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:01.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.112+0000 7f19ed25b640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f19e8074450 con 0x7f19e8074040 2024-05-09T05:53:01.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.112+0000 7f19ed25b640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f19e80747c0 con 0x7f19e80c8510 2024-05-09T05:53:01.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.112+0000 7f19ed25b640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f19e815a450 con 0x7f19e806c7a0 2024-05-09T05:53:01.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.112+0000 7f19e6d9d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19e806c7a0 0x7f19e81e5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:01.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.112+0000 7f19e759e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19e80c8510 0x7f19e814a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:01.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.112+0000 7f19e6d9d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19e806c7a0 0x7f19e81e5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.110:35520/0 (socket says 172.21.15.110:35520) 2024-05-09T05:53:01.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.112+0000 7f19e6d9d640 1 -- 172.21.15.110:0/3054810361 learned_addr learned my addr 172.21.15.110:0/3054810361 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T05:53:01.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.112+0000 7f19e659c640 1 --2- 172.21.15.110:0/3054810361 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19e8074040 0x7f19e80c7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:01.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.112+0000 7f19e6d9d640 1 -- 172.21.15.110:0/3054810361 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19e80c8510 msgr2=0x7f19e814a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:01.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.112+0000 7f19e6d9d640 1 --2- 172.21.15.110:0/3054810361 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19e80c8510 0x7f19e814a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:01.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.112+0000 7f19e6d9d640 1 -- 172.21.15.110:0/3054810361 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19e8074040 msgr2=0x7f19e80c7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:01.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.112+0000 7f19e6d9d640 1 --2- 172.21.15.110:0/3054810361 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19e8074040 0x7f19e80c7830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:01.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.112+0000 7f19e6d9d640 1 -- 172.21.15.110:0/3054810361 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19e81e6350 con 0x7f19e806c7a0 2024-05-09T05:53:01.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.112+0000 7f19e759e640 1 --2- 172.21.15.110:0/3054810361 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19e80c8510 0x7f19e814a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T05:53:01.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.112+0000 7f19e6d9d640 1 --2- 172.21.15.110:0/3054810361 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19e806c7a0 0x7f19e81e5e10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f19d800c3f0 tx=0x7f19d800c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:01.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.112+0000 7f19cf7fe640 1 -- 172.21.15.110:0/3054810361 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d8017070 con 0x7f19e806c7a0 2024-05-09T05:53:01.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.112+0000 7f19cf7fe640 1 -- 172.21.15.110:0/3054810361 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19d80052d0 con 0x7f19e806c7a0 2024-05-09T05:53:01.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.112+0000 7f19ed25b640 1 -- 172.21.15.110:0/3054810361 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19e80c7d70 con 0x7f19e806c7a0 2024-05-09T05:53:01.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.112+0000 7f19ed25b640 1 -- 172.21.15.110:0/3054810361 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f19e80ce210 con 0x7f19e806c7a0 2024-05-09T05:53:01.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.112+0000 7f19cf7fe640 1 -- 172.21.15.110:0/3054810361 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d8003820 con 0x7f19e806c7a0 2024-05-09T05:53:01.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.112+0000 7f19cf7fe640 1 -- 172.21.15.110:0/3054810361 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f19d801a070 con 0x7f19e806c7a0 2024-05-09T05:53:01.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.112+0000 7f19cf7fe640 1 -- 172.21.15.110:0/3054810361 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f19d8012420 con 0x7f19e806c7a0 2024-05-09T05:53:01.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.116+0000 7f19ed25b640 1 -- 172.21.15.110:0/3054810361 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19e806a520 con 0x7f19e806c7a0 2024-05-09T05:53:01.104 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.116+0000 7f19cf7fe640 1 -- 172.21.15.110:0/3054810361 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f19d8021020 con 0x7f19e806c7a0 2024-05-09T05:53:01.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.184+0000 7f19ed25b640 1 -- 172.21.15.110:0/3054810361 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd new", "uuid": "edcc86cb-f178-4533-8069-de9d781531ea", "id": 3} v 0) -- 0x7f19e806ce40 con 0x7f19e806c7a0 2024-05-09T05:53:01.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.192+0000 7f19cf7fe640 1 -- 172.21.15.110:0/3054810361 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "edcc86cb-f178-4533-8069-de9d781531ea", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f19d8011a40 con 0x7f19e806c7a0 2024-05-09T05:53:01.179 INFO:teuthology.orchestra.run.smithi110.stdout:3 2024-05-09T05:53:01.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.192+0000 7f19ed25b640 1 -- 172.21.15.110:0/3054810361 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19e806c7a0 msgr2=0x7f19e81e5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:01.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.192+0000 7f19ed25b640 1 --2- 172.21.15.110:0/3054810361 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19e806c7a0 0x7f19e81e5e10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f19d800c3f0 tx=0x7f19d800c8b0 comp rx=0 tx=0).stop 2024-05-09T05:53:01.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.192+0000 7f19ed25b640 1 -- 172.21.15.110:0/3054810361 shutdown_connections 2024-05-09T05:53:01.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.192+0000 7f19ed25b640 1 --2- 172.21.15.110:0/3054810361 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19e80c8510 0x7f19e814a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:01.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.192+0000 7f19ed25b640 1 --2- 172.21.15.110:0/3054810361 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19e8074040 0x7f19e80c7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:01.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.192+0000 7f19ed25b640 1 --2- 172.21.15.110:0/3054810361 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19e806c7a0 0x7f19e81e5e10 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:01.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.192+0000 7f19ed25b640 1 -- 172.21.15.110:0/3054810361 >> 172.21.15.110:0/3054810361 conn(0x7f19e80cb3c0 msgr2=0x7f19e8158660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:01.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.192+0000 7f19ed25b640 1 -- 172.21.15.110:0/3054810361 shutdown_connections 2024-05-09T05:53:01.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.192+0000 7f19ed25b640 1 -- 172.21.15.110:0/3054810361 wait complete. 2024-05-09T05:53:01.197 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new 8d138128-4829-4109-87a1-25f339f3e953 4 2024-05-09T05:53:01.204 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-05-09T05:53:01.216+0000 7f15db3dd180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-09T05:53:01.260 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-05-09T05:53:01.272+0000 7f15db3dd180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-09T05:53:01.315 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-05-09T05:53:01.328+0000 7f15db3dd180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-09T05:53:01.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.344+0000 7f96d30a7640 1 Processor -- start 2024-05-09T05:53:01.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.344+0000 7f96d30a7640 1 -- start start 2024-05-09T05:53:01.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.348+0000 7f96d30a7640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f96cc075020 0x7f96cc074090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:01.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.348+0000 7f96d30a7640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f96cc161f80 0x7f96cc1643a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:01.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.348+0000 7f96d30a7640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96cc06e960 con 0x7f96cc0745d0 2024-05-09T05:53:01.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.348+0000 7f96d30a7640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f96cc072b20 con 0x7f96cc161f80 2024-05-09T05:53:01.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.348+0000 7f96d30a7640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f96cc072840 con 0x7f96cc075020 2024-05-09T05:53:01.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.348+0000 7f96cbfff640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f96cc0745d0 0x7f96cc0c7480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:44540/0 (socket says 172.21.15.110:44540) 2024-05-09T05:53:01.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.348+0000 7f96d0e43640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f96cc075020 0x7f96cc074090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:01.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.348+0000 7f96cbfff640 1 -- 172.21.15.110:0/3275386424 learned_addr learned my addr 172.21.15.110:0/3275386424 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-05-09T05:53:01.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.348+0000 7f96d0e43640 1 -- 172.21.15.110:0/3275386424 >> v2:172.21.15.72:3300/0 conn(0x7f96cc161f80 msgr2=0x7f96cc1643a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:01.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.348+0000 7f96cb7fe640 1 -- 172.21.15.110:0/3275386424 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3705042977 0 0) 0x7f96cc06e960 con 0x7f96cc0745d0 2024-05-09T05:53:01.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.348+0000 7f96d1644640 1 --2- 172.21.15.110:0/3275386424 >> v2:172.21.15.72:3300/0 conn(0x7f96cc161f80 0x7f96cc1643a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:01.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.348+0000 7f96d0e43640 1 --2- 172.21.15.110:0/3275386424 >> v2:172.21.15.72:3300/0 conn(0x7f96cc161f80 0x7f96cc1643a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:01.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.348+0000 7f96d0e43640 1 -- 172.21.15.110:0/3275386424 >> v1:172.21.15.110:6789/0 conn(0x7f96cc0745d0 legacy=0x7f96cc0c7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:01.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.348+0000 7f96d0e43640 1 -- 172.21.15.110:0/3275386424 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96cc06ec20 con 0x7f96cc075020 2024-05-09T05:53:01.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.348+0000 7f96d0e43640 1 --2- 172.21.15.110:0/3275386424 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f96cc075020 0x7f96cc074090 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f96b80097c0 tx=0x7f96b801ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14ea9616969d3d1c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:01.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.348+0000 7f96cb7fe640 1 -- 172.21.15.110:0/3275386424 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b80b5070 con 0x7f96cc075020 2024-05-09T05:53:01.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.348+0000 7f96cb7fe640 1 -- 172.21.15.110:0/3275386424 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96b80a8990 con 0x7f96cc075020 2024-05-09T05:53:01.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.348+0000 7f96cb7fe640 1 -- 172.21.15.110:0/3275386424 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b80a8d60 con 0x7f96cc075020 2024-05-09T05:53:01.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.348+0000 7f96d30a7640 1 -- 172.21.15.110:0/3275386424 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f96cc075020 msgr2=0x7f96cc074090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:01.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.348+0000 7f96d30a7640 1 --2- 172.21.15.110:0/3275386424 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f96cc075020 0x7f96cc074090 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f96b80097c0 tx=0x7f96b801ec90 comp rx=0 tx=0).stop 2024-05-09T05:53:01.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.352+0000 7f96d30a7640 1 -- 172.21.15.110:0/3275386424 shutdown_connections 2024-05-09T05:53:01.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.352+0000 7f96d30a7640 1 --2- 172.21.15.110:0/3275386424 >> v2:172.21.15.72:3300/0 conn(0x7f96cc161f80 0x7f96cc1643a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:01.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.352+0000 7f96d30a7640 1 --2- 172.21.15.110:0/3275386424 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f96cc075020 0x7f96cc074090 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:01.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.352+0000 7f96d30a7640 1 -- 172.21.15.110:0/3275386424 >> 172.21.15.110:0/3275386424 conn(0x7f96cc0cb350 msgr2=0x7f96cc0cb760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:01.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.352+0000 7f96d30a7640 1 -- 172.21.15.110:0/3275386424 shutdown_connections 2024-05-09T05:53:01.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.352+0000 7f96d30a7640 1 -- 172.21.15.110:0/3275386424 wait complete. 2024-05-09T05:53:01.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.352+0000 7f96d30a7640 1 Processor -- start 2024-05-09T05:53:01.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.352+0000 7f96d30a7640 1 -- start start 2024-05-09T05:53:01.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.352+0000 7f96d30a7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96cc0745d0 0x7f96cc1f4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:01.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.352+0000 7f96d30a7640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f96cc075020 0x7f96cc0cc650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:01.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.352+0000 7f96d30a7640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96cc161f80 0x7f96cc14ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:01.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.352+0000 7f96d30a7640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f96cc159dc0 con 0x7f96cc161f80 2024-05-09T05:53:01.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.352+0000 7f96d30a7640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f96cc159ae0 con 0x7f96cc0745d0 2024-05-09T05:53:01.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.352+0000 7f96d30a7640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f96cc15a0a0 con 0x7f96cc075020 2024-05-09T05:53:01.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.352+0000 7f96d0e43640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96cc0745d0 0x7f96cc1f4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:01.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.352+0000 7f96cbfff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f96cc075020 0x7f96cc0cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:01.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.352+0000 7f96d0e43640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96cc0745d0 0x7f96cc1f4b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:44102/0 (socket says 172.21.15.110:44102) 2024-05-09T05:53:01.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.352+0000 7f96d0e43640 1 -- 172.21.15.110:0/3524628842 learned_addr learned my addr 172.21.15.110:0/3524628842 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T05:53:01.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.352+0000 7f96d1644640 1 --2- 172.21.15.110:0/3524628842 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96cc161f80 0x7f96cc14ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:01.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.352+0000 7f96cbfff640 1 -- 172.21.15.110:0/3524628842 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96cc0745d0 msgr2=0x7f96cc1f4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:01.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.352+0000 7f96cbfff640 1 --2- 172.21.15.110:0/3524628842 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96cc0745d0 0x7f96cc1f4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:01.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.352+0000 7f96cbfff640 1 -- 172.21.15.110:0/3524628842 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96cc161f80 msgr2=0x7f96cc14ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:01.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.352+0000 7f96cbfff640 1 --2- 172.21.15.110:0/3524628842 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96cc161f80 0x7f96cc14ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:01.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.352+0000 7f96cbfff640 1 -- 172.21.15.110:0/3524628842 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96cc1f5090 con 0x7f96cc075020 2024-05-09T05:53:01.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.352+0000 7f96d0e43640 1 --2- 172.21.15.110:0/3524628842 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96cc0745d0 0x7f96cc1f4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T05:53:01.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.352+0000 7f96d1644640 1 --2- 172.21.15.110:0/3524628842 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96cc161f80 0x7f96cc14ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:53:01.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.352+0000 7f96cbfff640 1 --2- 172.21.15.110:0/3524628842 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f96cc075020 0x7f96cc0cc650 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f96c000c3f0 tx=0x7f96c000c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:01.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.356+0000 7f96c97fa640 1 -- 172.21.15.110:0/3524628842 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c00074e0 con 0x7f96cc075020 2024-05-09T05:53:01.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.356+0000 7f96c97fa640 1 -- 172.21.15.110:0/3524628842 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96c00047f0 con 0x7f96cc075020 2024-05-09T05:53:01.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.356+0000 7f96d30a7640 1 -- 172.21.15.110:0/3524628842 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96cc149720 con 0x7f96cc075020 2024-05-09T05:53:01.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.356+0000 7f96c97fa640 1 -- 172.21.15.110:0/3524628842 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c0004be0 con 0x7f96cc075020 2024-05-09T05:53:01.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.356+0000 7f96d30a7640 1 -- 172.21.15.110:0/3524628842 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f96cc149950 con 0x7f96cc075020 2024-05-09T05:53:01.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.356+0000 7f96c97fa640 1 -- 172.21.15.110:0/3524628842 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f96c0011070 con 0x7f96cc075020 2024-05-09T05:53:01.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.356+0000 7f96c97fa640 1 -- 172.21.15.110:0/3524628842 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f96c00138d0 con 0x7f96cc075020 2024-05-09T05:53:01.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.356+0000 7f96d30a7640 1 -- 172.21.15.110:0/3524628842 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96cc06a520 con 0x7f96cc075020 2024-05-09T05:53:01.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.356+0000 7f96c97fa640 1 -- 172.21.15.110:0/3524628842 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f96cc1f5090 con 0x7f96cc075020 2024-05-09T05:53:01.396 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-05-09T05:53:01.408+0000 7f15db3dd180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-09T05:53:01.410 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.424+0000 7f96d30a7640 1 -- 172.21.15.110:0/3524628842 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8d138128-4829-4109-87a1-25f339f3e953", "id": 4} v 0) -- 0x7f96cc075f00 con 0x7f96cc075020 2024-05-09T05:53:01.417 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.428+0000 7f96c97fa640 1 -- 172.21.15.110:0/3524628842 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8d138128-4829-4109-87a1-25f339f3e953", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f96c0013bb0 con 0x7f96cc075020 2024-05-09T05:53:01.417 INFO:teuthology.orchestra.run.smithi110.stdout:4 2024-05-09T05:53:01.419 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.432+0000 7f96d30a7640 1 -- 172.21.15.110:0/3524628842 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f96cc075020 msgr2=0x7f96cc0cc650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:01.419 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.432+0000 7f96d30a7640 1 --2- 172.21.15.110:0/3524628842 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f96cc075020 0x7f96cc0cc650 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f96c000c3f0 tx=0x7f96c000c8b0 comp rx=0 tx=0).stop 2024-05-09T05:53:01.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.432+0000 7f96d30a7640 1 -- 172.21.15.110:0/3524628842 shutdown_connections 2024-05-09T05:53:01.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.432+0000 7f96d30a7640 1 --2- 172.21.15.110:0/3524628842 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96cc161f80 0x7f96cc14ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:01.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.432+0000 7f96d30a7640 1 --2- 172.21.15.110:0/3524628842 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f96cc075020 0x7f96cc0cc650 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:01.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.432+0000 7f96d30a7640 1 --2- 172.21.15.110:0/3524628842 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96cc0745d0 0x7f96cc1f4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:01.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.432+0000 7f96d30a7640 1 -- 172.21.15.110:0/3524628842 >> 172.21.15.110:0/3524628842 conn(0x7f96cc0cb350 msgr2=0x7f96cc0c73a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:01.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.432+0000 7f96d30a7640 1 -- 172.21.15.110:0/3524628842 shutdown_connections 2024-05-09T05:53:01.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.432+0000 7f96d30a7640 1 -- 172.21.15.110:0/3524628842 wait complete. 2024-05-09T05:53:01.436 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new 99a4a914-0a0e-4d25-94ae-3e86b8b1aa4b 5 2024-05-09T05:53:01.451 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-05-09T05:53:01.464+0000 7f15db3dd180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-09T05:53:01.499 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-05-09T05:53:01.506+0000 7f5b11798180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-09T05:53:01.532 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-05-09T05:53:01.544+0000 7f15db3dd180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-09T05:53:01.552 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-05-09T05:53:01.558+0000 7f5b11798180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-09T05:53:01.585 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.596+0000 7fa97958f640 1 Processor -- start 2024-05-09T05:53:01.585 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.596+0000 7fa97958f640 1 -- start start 2024-05-09T05:53:01.589 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.600+0000 7fa97958f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa9740cc150 0x7fa9740ca620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:01.589 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.600+0000 7fa97958f640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa974156b50 0x7fa974160420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:01.589 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.600+0000 7fa97958f640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9740cc6b0 con 0x7fa974160960 2024-05-09T05:53:01.589 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.600+0000 7fa97958f640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fa974074570 con 0x7fa974156b50 2024-05-09T05:53:01.589 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.600+0000 7fa97958f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fa974156f60 con 0x7fa9740cc150 2024-05-09T05:53:01.590 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.600+0000 7fa96bfff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa974156b50 0x7fa974160420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:01.590 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.600+0000 7fa9737fe640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fa974160960 0x7fa97406e1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:44552/0 (socket says 172.21.15.110:44552) 2024-05-09T05:53:01.590 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.600+0000 7fa9737fe640 1 -- 172.21.15.110:0/3574926162 learned_addr learned my addr 172.21.15.110:0/3574926162 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-05-09T05:53:01.590 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.600+0000 7fa972ffd640 1 --2- 172.21.15.110:0/3574926162 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa9740cc150 0x7fa9740ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:01.590 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.600+0000 7fa96bfff640 1 -- 172.21.15.110:0/3574926162 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa9740cc150 msgr2=0x7fa9740ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:01.590 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.600+0000 7fa96bfff640 1 --2- 172.21.15.110:0/3574926162 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa9740cc150 0x7fa9740ca620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:01.590 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.600+0000 7fa96bfff640 1 -- 172.21.15.110:0/3574926162 >> v1:172.21.15.110:6789/0 conn(0x7fa974160960 legacy=0x7fa97406e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:01.590 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.600+0000 7fa9727fc640 1 -- 172.21.15.110:0/3574926162 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3684437278 0 0) 0x7fa9740cc6b0 con 0x7fa974160960 2024-05-09T05:53:01.591 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.600+0000 7fa96bfff640 1 -- 172.21.15.110:0/3574926162 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9740cc990 con 0x7fa974156b50 2024-05-09T05:53:01.591 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-05-09T05:53:01.600+0000 7f15db3dd180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-09T05:53:01.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.600+0000 7fa96bfff640 1 --2- 172.21.15.110:0/3574926162 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa974156b50 0x7fa974160420 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa95c0097c0 tx=0x7fa95c01ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1261ee086d1d7c77 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:01.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.604+0000 7fa9727fc640 1 -- 172.21.15.110:0/3574926162 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa95c0b5070 con 0x7fa974156b50 2024-05-09T05:53:01.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.604+0000 7fa9727fc640 1 -- 172.21.15.110:0/3574926162 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa95c0a8990 con 0x7fa974156b50 2024-05-09T05:53:01.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.604+0000 7fa9727fc640 1 -- 172.21.15.110:0/3574926162 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa95c0a8d60 con 0x7fa974156b50 2024-05-09T05:53:01.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.604+0000 7fa97958f640 1 -- 172.21.15.110:0/3574926162 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa974156b50 msgr2=0x7fa974160420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:01.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.604+0000 7fa97958f640 1 --2- 172.21.15.110:0/3574926162 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa974156b50 0x7fa974160420 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa95c0097c0 tx=0x7fa95c01ec90 comp rx=0 tx=0).stop 2024-05-09T05:53:01.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.604+0000 7fa97958f640 1 -- 172.21.15.110:0/3574926162 shutdown_connections 2024-05-09T05:53:01.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.604+0000 7fa97958f640 1 --2- 172.21.15.110:0/3574926162 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa974156b50 0x7fa974160420 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:01.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.604+0000 7fa97958f640 1 --2- 172.21.15.110:0/3574926162 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa9740cc150 0x7fa9740ca620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:01.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.604+0000 7fa97958f640 1 -- 172.21.15.110:0/3574926162 >> 172.21.15.110:0/3574926162 conn(0x7fa974072080 msgr2=0x7fa974072490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:01.593 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.604+0000 7fa97958f640 1 -- 172.21.15.110:0/3574926162 shutdown_connections 2024-05-09T05:53:01.593 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.604+0000 7fa97958f640 1 -- 172.21.15.110:0/3574926162 wait complete. 2024-05-09T05:53:01.593 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.604+0000 7fa97958f640 1 Processor -- start 2024-05-09T05:53:01.593 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.604+0000 7fa97958f640 1 -- start start 2024-05-09T05:53:01.595 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.608+0000 7fa97958f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9740cc150 0x7fa9741f3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:01.595 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.608+0000 7fa97958f640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa974156b50 0x7fa9740cf080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:01.596 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.608+0000 7fa97958f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa974160960 0x7fa97414dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:01.596 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.608+0000 7fa97958f640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fa9740ccf50 con 0x7fa974156b50 2024-05-09T05:53:01.596 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.608+0000 7fa97958f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fa97415fca0 con 0x7fa9740cc150 2024-05-09T05:53:01.596 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.608+0000 7fa97958f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fa97406e8b0 con 0x7fa974160960 2024-05-09T05:53:01.596 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.608+0000 7fa972ffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9740cc150 0x7fa9741f3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:01.596 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.608+0000 7fa9737fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa974160960 0x7fa97414dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:01.596 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.608+0000 7fa972ffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9740cc150 0x7fa9741f3330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:44112/0 (socket says 172.21.15.110:44112) 2024-05-09T05:53:01.596 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.608+0000 7fa972ffd640 1 -- 172.21.15.110:0/2565486161 learned_addr learned my addr 172.21.15.110:0/2565486161 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T05:53:01.596 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.608+0000 7fa96bfff640 1 --2- 172.21.15.110:0/2565486161 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa974156b50 0x7fa9740cf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:01.596 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.608+0000 7fa9737fe640 1 -- 172.21.15.110:0/2565486161 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9740cc150 msgr2=0x7fa9741f3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:01.596 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.608+0000 7fa9737fe640 1 --2- 172.21.15.110:0/2565486161 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9740cc150 0x7fa9741f3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:01.596 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.608+0000 7fa9737fe640 1 -- 172.21.15.110:0/2565486161 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa974156b50 msgr2=0x7fa9740cf080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:01.596 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.608+0000 7fa9737fe640 1 --2- 172.21.15.110:0/2565486161 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa974156b50 0x7fa9740cf080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:01.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.608+0000 7fa9737fe640 1 -- 172.21.15.110:0/2565486161 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9741f3870 con 0x7fa974160960 2024-05-09T05:53:01.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.608+0000 7fa972ffd640 1 --2- 172.21.15.110:0/2565486161 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9740cc150 0x7fa9741f3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T05:53:01.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.608+0000 7fa96bfff640 1 --2- 172.21.15.110:0/2565486161 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa974156b50 0x7fa9740cf080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:53:01.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.608+0000 7fa9737fe640 1 --2- 172.21.15.110:0/2565486161 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa974160960 0x7fa97414dff0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa9740c4c30 tx=0x7fa96c00cb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:01.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.608+0000 7fa96b7fe640 1 -- 172.21.15.110:0/2565486161 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa96c018070 con 0x7fa974160960 2024-05-09T05:53:01.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.608+0000 7fa96b7fe640 1 -- 172.21.15.110:0/2565486161 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa96c004d70 con 0x7fa974160960 2024-05-09T05:53:01.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.608+0000 7fa96b7fe640 1 -- 172.21.15.110:0/2565486161 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa96c00a850 con 0x7fa974160960 2024-05-09T05:53:01.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.608+0000 7fa97958f640 1 -- 172.21.15.110:0/2565486161 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9740b5e70 con 0x7fa974160960 2024-05-09T05:53:01.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.608+0000 7fa97958f640 1 -- 172.21.15.110:0/2565486161 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9741f6820 con 0x7fa974160960 2024-05-09T05:53:01.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.608+0000 7fa96b7fe640 1 -- 172.21.15.110:0/2565486161 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa96c00a9f0 con 0x7fa974160960 2024-05-09T05:53:01.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.608+0000 7fa96b7fe640 1 -- 172.21.15.110:0/2565486161 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fa96c007940 con 0x7fa974160960 2024-05-09T05:53:01.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.608+0000 7fa97958f640 1 -- 172.21.15.110:0/2565486161 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa97406a520 con 0x7fa974160960 2024-05-09T05:53:01.598 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.612+0000 7fa96b7fe640 1 -- 172.21.15.110:0/2565486161 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fa96c021020 con 0x7fa974160960 2024-05-09T05:53:01.605 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-05-09T05:53:01.610+0000 7f5b11798180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-09T05:53:01.662 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.676+0000 7fa97958f640 1 -- 172.21.15.110:0/2565486161 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd new", "uuid": "99a4a914-0a0e-4d25-94ae-3e86b8b1aa4b", "id": 5} v 0) -- 0x7fa9741e8930 con 0x7fa974160960 2024-05-09T05:53:01.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.684+0000 7fa96b7fe640 1 -- 172.21.15.110:0/2565486161 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "99a4a914-0a0e-4d25-94ae-3e86b8b1aa4b", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fa96c00ace0 con 0x7fa974160960 2024-05-09T05:53:01.671 INFO:teuthology.orchestra.run.smithi110.stdout:5 2024-05-09T05:53:01.672 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.684+0000 7fa97958f640 1 -- 172.21.15.110:0/2565486161 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa974160960 msgr2=0x7fa97414dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:01.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.684+0000 7fa97958f640 1 --2- 172.21.15.110:0/2565486161 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa974160960 0x7fa97414dff0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa9740c4c30 tx=0x7fa96c00cb90 comp rx=0 tx=0).stop 2024-05-09T05:53:01.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.684+0000 7fa97958f640 1 -- 172.21.15.110:0/2565486161 shutdown_connections 2024-05-09T05:53:01.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.684+0000 7fa97958f640 1 --2- 172.21.15.110:0/2565486161 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa974160960 0x7fa97414dff0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:01.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.684+0000 7fa97958f640 1 --2- 172.21.15.110:0/2565486161 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa974156b50 0x7fa9740cf080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:01.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.684+0000 7fa97958f640 1 --2- 172.21.15.110:0/2565486161 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9740cc150 0x7fa9741f3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:01.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.684+0000 7fa97958f640 1 -- 172.21.15.110:0/2565486161 >> 172.21.15.110:0/2565486161 conn(0x7fa974072080 msgr2=0x7fa9740ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:01.674 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.684+0000 7fa97958f640 1 -- 172.21.15.110:0/2565486161 shutdown_connections 2024-05-09T05:53:01.674 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.684+0000 7fa97958f640 1 -- 172.21.15.110:0/2565486161 wait complete. 2024-05-09T05:53:01.684 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-05-09T05:53:01.690+0000 7f5b11798180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-09T05:53:01.689 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new 6e04b295-afc9-4f80-80f7-3df1f5168608 6 2024-05-09T05:53:01.735 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-05-09T05:53:01.742+0000 7f5b11798180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-09T05:53:01.746 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-05-09T05:53:01.760+0000 7f15db3dd180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-09T05:53:01.809 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-05-09T05:53:01.820+0000 7f15db3dd180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-09T05:53:01.812 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-05-09T05:53:01.818+0000 7f5b11798180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-09T05:53:01.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.836+0000 7fe3b462b640 1 Processor -- start 2024-05-09T05:53:01.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.836+0000 7fe3b462b640 1 -- start start 2024-05-09T05:53:01.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.840+0000 7fe3b462b640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe3ac0c9150 0x7fe3ac0ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:01.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.840+0000 7fe3b462b640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3ac15c800 con 0x7fe3ac0cf000 2024-05-09T05:53:01.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.840+0000 7fe3b462b640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3ac15cae0 con 0x7fe3ac0cd150 2024-05-09T05:53:01.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.840+0000 7fe3b462b640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fe3ac15c5b0 con 0x7fe3ac0c9150 2024-05-09T05:53:01.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.840+0000 7fe3b23c7640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe3ac0c9150 0x7fe3ac0ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:01.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.840+0000 7fe3b2bc8640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fe3ac0cd150 0x7fe3ac166f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:44566/0 (socket says 172.21.15.110:44566) 2024-05-09T05:53:01.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.840+0000 7fe3b23c7640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe3ac0c9150 0x7fe3ac0ceac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:44118/0 (socket says 172.21.15.110:44118) 2024-05-09T05:53:01.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.840+0000 7fe3b2bc8640 1 -- 172.21.15.110:0/711049787 learned_addr learned my addr 172.21.15.110:0/711049787 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-05-09T05:53:01.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.840+0000 7fe3b23c7640 1 -- 172.21.15.110:0/711049787 >> v1:172.21.15.110:6789/0 conn(0x7fe3ac0cd150 legacy=0x7fe3ac166f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:01.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.840+0000 7fe3b23c7640 1 -- 172.21.15.110:0/711049787 >> v1:172.21.15.72:6789/0 conn(0x7fe3ac0cf000 legacy=0x7fe3ac0cca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:01.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.840+0000 7fe3b23c7640 1 -- 172.21.15.110:0/711049787 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3ac15cdc0 con 0x7fe3ac0c9150 2024-05-09T05:53:01.829 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.840+0000 7fe3b23c7640 1 --2- 172.21.15.110:0/711049787 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3ac0c9150 0x7fe3ac0ceac0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe39c0097c0 tx=0x7fe39c01c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b930697ccdfc4048 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:01.829 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.840+0000 7fe3b13c5640 1 -- 172.21.15.110:0/711049787 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe39c0b0070 con 0x7fe3ac0c9150 2024-05-09T05:53:01.829 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.840+0000 7fe3b13c5640 1 -- 172.21.15.110:0/711049787 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe39c0ab600 con 0x7fe3ac0c9150 2024-05-09T05:53:01.829 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.840+0000 7fe3b13c5640 1 -- 172.21.15.110:0/711049787 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe39c0ab9d0 con 0x7fe3ac0c9150 2024-05-09T05:53:01.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.844+0000 7fe3b462b640 1 -- 172.21.15.110:0/711049787 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3ac0c9150 msgr2=0x7fe3ac0ceac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:01.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.844+0000 7fe3b462b640 1 --2- 172.21.15.110:0/711049787 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3ac0c9150 0x7fe3ac0ceac0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe39c0097c0 tx=0x7fe39c01c410 comp rx=0 tx=0).stop 2024-05-09T05:53:01.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.844+0000 7fe3b462b640 1 -- 172.21.15.110:0/711049787 shutdown_connections 2024-05-09T05:53:01.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.844+0000 7fe3b462b640 1 --2- 172.21.15.110:0/711049787 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3ac0c9150 0x7fe3ac0ceac0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:01.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.844+0000 7fe3b462b640 1 -- 172.21.15.110:0/711049787 >> 172.21.15.110:0/711049787 conn(0x7fe3ac071200 msgr2=0x7fe3ac071610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:01.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.844+0000 7fe3b462b640 1 -- 172.21.15.110:0/711049787 shutdown_connections 2024-05-09T05:53:01.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.844+0000 7fe3b462b640 1 -- 172.21.15.110:0/711049787 wait complete. 2024-05-09T05:53:01.832 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.844+0000 7fe3b462b640 1 Processor -- start 2024-05-09T05:53:01.832 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.844+0000 7fe3b462b640 1 -- start start 2024-05-09T05:53:01.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.844+0000 7fe3b462b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3ac0c9150 0x7fe3ac1f6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:01.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.844+0000 7fe3b462b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3ac0cd150 0x7fe3ac0c6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:01.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.844+0000 7fe3b462b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3ac0cf000 0x7fe3ac14e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:01.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.844+0000 7fe3b462b640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe3ac0ce3b0 con 0x7fe3ac0cf000 2024-05-09T05:53:01.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.844+0000 7fe3b462b640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fe3ac0cc5b0 con 0x7fe3ac0cd150 2024-05-09T05:53:01.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.844+0000 7fe3b462b640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fe3ac0ce530 con 0x7fe3ac0c9150 2024-05-09T05:53:01.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.844+0000 7fe3b23c7640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3ac0c9150 0x7fe3ac1f6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:01.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.844+0000 7fe3b23c7640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3ac0c9150 0x7fe3ac1f6630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.110:35560/0 (socket says 172.21.15.110:35560) 2024-05-09T05:53:01.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.844+0000 7fe3b23c7640 1 -- 172.21.15.110:0/2391453887 learned_addr learned my addr 172.21.15.110:0/2391453887 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T05:53:01.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.844+0000 7fe3b1bc6640 1 --2- 172.21.15.110:0/2391453887 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3ac0cd150 0x7fe3ac0c6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:01.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.844+0000 7fe3b2bc8640 1 --2- 172.21.15.110:0/2391453887 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3ac0cf000 0x7fe3ac14e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:01.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.844+0000 7fe3b23c7640 1 -- 172.21.15.110:0/2391453887 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3ac0cd150 msgr2=0x7fe3ac0c6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:01.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.844+0000 7fe3b23c7640 1 --2- 172.21.15.110:0/2391453887 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3ac0cd150 0x7fe3ac0c6850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:01.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.844+0000 7fe3b23c7640 1 -- 172.21.15.110:0/2391453887 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3ac0cf000 msgr2=0x7fe3ac14e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:01.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.844+0000 7fe3b23c7640 1 --2- 172.21.15.110:0/2391453887 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3ac0cf000 0x7fe3ac14e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:01.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.844+0000 7fe3b23c7640 1 -- 172.21.15.110:0/2391453887 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3ac0c6d90 con 0x7fe3ac0c9150 2024-05-09T05:53:01.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.848+0000 7fe3b23c7640 1 --2- 172.21.15.110:0/2391453887 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3ac0c9150 0x7fe3ac1f6630 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe39c0ae040 tx=0x7fe39c01ac50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:01.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.848+0000 7fe3a2ffd640 1 -- 172.21.15.110:0/2391453887 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe39c0b0050 con 0x7fe3ac0c9150 2024-05-09T05:53:01.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.848+0000 7fe3a2ffd640 1 -- 172.21.15.110:0/2391453887 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe39c0bc070 con 0x7fe3ac0c9150 2024-05-09T05:53:01.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.848+0000 7fe3a2ffd640 1 -- 172.21.15.110:0/2391453887 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe39c0b5a70 con 0x7fe3ac0c9150 2024-05-09T05:53:01.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.848+0000 7fe3b462b640 1 -- 172.21.15.110:0/2391453887 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3ac0c7d00 con 0x7fe3ac0c9150 2024-05-09T05:53:01.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.848+0000 7fe3b462b640 1 -- 172.21.15.110:0/2391453887 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3ac0c82c0 con 0x7fe3ac0c9150 2024-05-09T05:53:01.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.848+0000 7fe3a2ffd640 1 -- 172.21.15.110:0/2391453887 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe39c0ab4c0 con 0x7fe3ac0c9150 2024-05-09T05:53:01.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.848+0000 7fe3a2ffd640 1 -- 172.21.15.110:0/2391453887 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fe39c0c1b40 con 0x7fe3ac0c9150 2024-05-09T05:53:01.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.848+0000 7fe3b462b640 1 -- 172.21.15.110:0/2391453887 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3ac06a520 con 0x7fe3ac0c9150 2024-05-09T05:53:01.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.848+0000 7fe3a2ffd640 1 -- 172.21.15.110:0/2391453887 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fe39c016090 con 0x7fe3ac0c9150 2024-05-09T05:53:01.865 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-05-09T05:53:01.870+0000 7f5b11798180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-09T05:53:01.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.912+0000 7fe3b462b640 1 -- 172.21.15.110:0/2391453887 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6e04b295-afc9-4f80-80f7-3df1f5168608", "id": 6} v 0) -- 0x7fe3ac0c9970 con 0x7fe3ac0c9150 2024-05-09T05:53:01.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.920+0000 7fe3a2ffd640 1 -- 172.21.15.110:0/2391453887 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6e04b295-afc9-4f80-80f7-3df1f5168608", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fe39c0b5c10 con 0x7fe3ac0c9150 2024-05-09T05:53:01.907 INFO:teuthology.orchestra.run.smithi110.stdout:6 2024-05-09T05:53:01.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.920+0000 7fe3b462b640 1 -- 172.21.15.110:0/2391453887 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3ac0c9150 msgr2=0x7fe3ac1f6630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:01.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.920+0000 7fe3b462b640 1 --2- 172.21.15.110:0/2391453887 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3ac0c9150 0x7fe3ac1f6630 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe39c0ae040 tx=0x7fe39c01ac50 comp rx=0 tx=0).stop 2024-05-09T05:53:01.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.920+0000 7fe3b462b640 1 -- 172.21.15.110:0/2391453887 shutdown_connections 2024-05-09T05:53:01.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.920+0000 7fe3b462b640 1 --2- 172.21.15.110:0/2391453887 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3ac0cf000 0x7fe3ac14e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:01.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.920+0000 7fe3b462b640 1 --2- 172.21.15.110:0/2391453887 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3ac0cd150 0x7fe3ac0c6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:01.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.920+0000 7fe3b462b640 1 --2- 172.21.15.110:0/2391453887 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3ac0c9150 0x7fe3ac1f6630 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:01.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.920+0000 7fe3b462b640 1 -- 172.21.15.110:0/2391453887 >> 172.21.15.110:0/2391453887 conn(0x7fe3ac071200 msgr2=0x7fe3ac06d240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:01.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.920+0000 7fe3b462b640 1 -- 172.21.15.110:0/2391453887 shutdown_connections 2024-05-09T05:53:01.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:01.920+0000 7fe3b462b640 1 -- 172.21.15.110:0/2391453887 wait complete. 2024-05-09T05:53:01.926 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new 835de5c9-1e2c-41d8-bd28-d7ffe5ad8fdc 7 2024-05-09T05:53:02.015 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-05-09T05:53:02.023+0000 7f5b11798180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-09T05:53:02.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:02.076+0000 7ffa07b7d640 1 Processor -- start 2024-05-09T05:53:02.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:02.076+0000 7ffa07b7d640 1 -- start start 2024-05-09T05:53:02.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:02.076+0000 7ffa07b7d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa000c92c0 0x7ffa000c96d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:02.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:02.076+0000 7ffa07b7d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ffa00074ac0 0x7ffa00074ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:02.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:02.076+0000 7ffa07b7d640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa0006d9f0 con 0x7ffa0006d140 2024-05-09T05:53:02.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:02.076+0000 7ffa07b7d640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7ffa001616d0 con 0x7ffa00074ac0 2024-05-09T05:53:02.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:02.076+0000 7ffa07b7d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7ffa00160da0 con 0x7ffa000c92c0 2024-05-09T05:53:02.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:02.076+0000 7ffa05118640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa000c92c0 0x7ffa000c96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:02.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:02.076+0000 7ffa05919640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7ffa0006d140 0x7ffa0006c810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:44582/0 (socket says 172.21.15.110:44582) 2024-05-09T05:53:02.066 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:02.076+0000 7ffa05919640 1 -- 172.21.15.110:0/424665552 learned_addr learned my addr 172.21.15.110:0/424665552 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-05-09T05:53:02.066 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:02.076+0000 7ffa0611a640 1 --2- 172.21.15.110:0/424665552 >> v2:172.21.15.110:3300/0 conn(0x7ffa00074ac0 0x7ffa00074ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:02.066 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:02.076+0000 7ffa05118640 1 -- 172.21.15.110:0/424665552 >> v2:172.21.15.110:3300/0 conn(0x7ffa00074ac0 msgr2=0x7ffa00074ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:02.066 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:02.076+0000 7ffa05118640 1 --2- 172.21.15.110:0/424665552 >> v2:172.21.15.110:3300/0 conn(0x7ffa00074ac0 0x7ffa00074ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:02.066 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:02.076+0000 7ffa05118640 1 -- 172.21.15.110:0/424665552 >> v1:172.21.15.110:6789/0 conn(0x7ffa0006d140 legacy=0x7ffa0006c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:02.066 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:02.076+0000 7ffa04917640 1 -- 172.21.15.110:0/424665552 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3049182958 0 0) 0x7ffa0006d9f0 con 0x7ffa0006d140 2024-05-09T05:53:02.066 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:02.076+0000 7ffa05118640 1 -- 172.21.15.110:0/424665552 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa00161080 con 0x7ffa000c92c0 2024-05-09T05:53:02.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:02.080+0000 7ffa05118640 1 --2- 172.21.15.110:0/424665552 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa000c92c0 0x7ffa000c96d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc0097c0 tx=0x7ff9fc01ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33ef77700d578ef2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:02.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:02.080+0000 7ffa04917640 1 -- 172.21.15.110:0/424665552 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9fc0b5070 con 0x7ffa000c92c0 2024-05-09T05:53:02.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:02.080+0000 7ffa04917640 1 -- 172.21.15.110:0/424665552 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9fc0a8990 con 0x7ffa000c92c0 2024-05-09T05:53:02.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:02.080+0000 7ffa04917640 1 -- 172.21.15.110:0/424665552 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9fc0a8d60 con 0x7ffa000c92c0 2024-05-09T05:53:02.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:02.080+0000 7ffa07b7d640 1 -- 172.21.15.110:0/424665552 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa000c92c0 msgr2=0x7ffa000c96d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:02.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:02.080+0000 7ffa07b7d640 1 --2- 172.21.15.110:0/424665552 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa000c92c0 0x7ffa000c96d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc0097c0 tx=0x7ff9fc01ec90 comp rx=0 tx=0).stop 2024-05-09T05:53:02.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:02.080+0000 7ffa07b7d640 1 -- 172.21.15.110:0/424665552 shutdown_connections 2024-05-09T05:53:02.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:02.080+0000 7ffa07b7d640 1 --2- 172.21.15.110:0/424665552 >> v2:172.21.15.110:3300/0 conn(0x7ffa00074ac0 0x7ffa00074ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:02.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:02.080+0000 7ffa07b7d640 1 --2- 172.21.15.110:0/424665552 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa000c92c0 0x7ffa000c96d0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:02.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:02.080+0000 7ffa07b7d640 1 -- 172.21.15.110:0/424665552 >> 172.21.15.110:0/424665552 conn(0x7ffa000cb3c0 msgr2=0x7ffa000cb7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:02.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:02.080+0000 7ffa07b7d640 1 -- 172.21.15.110:0/424665552 shutdown_connections 2024-05-09T05:53:02.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:02.080+0000 7ffa07b7d640 1 -- 172.21.15.110:0/424665552 wait complete. 2024-05-09T05:53:02.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:02.084+0000 7ffa07b7d640 1 Processor -- start 2024-05-09T05:53:02.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:02.084+0000 7ffa07b7d640 1 -- start start 2024-05-09T05:53:02.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:02.084+0000 7ffa07b7d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa0006d140 0x7ffa000c88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:02.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:02.084+0000 7ffa07b7d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa00074ac0 0x7ffa00155b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:02.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:02.084+0000 7ffa07b7d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa000c92c0 0x7ffa0014b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:02.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:02.084+0000 7ffa07b7d640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ffa0015b1f0 con 0x7ffa0006d140 2024-05-09T05:53:02.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:02.084+0000 7ffa07b7d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ffa0006d550 con 0x7ffa00074ac0 2024-05-09T05:53:02.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:02.084+0000 7ffa07b7d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7ffa001fa490 con 0x7ffa000c92c0 2024-05-09T05:53:02.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:02.084+0000 7ffa0611a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa000c92c0 0x7ffa0014b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:02.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:02.084+0000 7ffa05118640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa00074ac0 0x7ffa00155b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:02.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:02.084+0000 7ffa0611a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa000c92c0 0x7ffa0014b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.110:35578/0 (socket says 172.21.15.110:35578) 2024-05-09T05:53:02.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:02.084+0000 7ffa0611a640 1 -- 172.21.15.110:0/952717685 learned_addr learned my addr 172.21.15.110:0/952717685 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T05:53:02.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:02.084+0000 7ffa05919640 1 --2- 172.21.15.110:0/952717685 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa0006d140 0x7ffa000c88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:02.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:02.084+0000 7ffa0611a640 1 -- 172.21.15.110:0/952717685 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa00074ac0 msgr2=0x7ffa00155b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:02.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:02.084+0000 7ffa0611a640 1 --2- 172.21.15.110:0/952717685 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa00074ac0 0x7ffa00155b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:02.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:02.084+0000 7ffa0611a640 1 -- 172.21.15.110:0/952717685 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa0006d140 msgr2=0x7ffa000c88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:02.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:02.084+0000 7ffa0611a640 1 --2- 172.21.15.110:0/952717685 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa0006d140 0x7ffa000c88e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:02.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:02.084+0000 7ffa0611a640 1 -- 172.21.15.110:0/952717685 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa001605d0 con 0x7ffa000c92c0 2024-05-09T05:53:02.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:02.084+0000 7ffa0611a640 1 --2- 172.21.15.110:0/952717685 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa000c92c0 0x7ffa0014b8c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff9f800ef90 tx=0x7ff9f800c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:02.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:02.084+0000 7ff9f67fc640 1 -- 172.21.15.110:0/952717685 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9f8018020 con 0x7ffa000c92c0 2024-05-09T05:53:02.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:02.084+0000 7ff9f67fc640 1 -- 172.21.15.110:0/952717685 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9f8014480 con 0x7ffa000c92c0 2024-05-09T05:53:02.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:02.084+0000 7ff9f67fc640 1 -- 172.21.15.110:0/952717685 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9f8009e60 con 0x7ffa000c92c0 2024-05-09T05:53:02.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:02.084+0000 7ffa07b7d640 1 -- 172.21.15.110:0/952717685 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa00160b70 con 0x7ffa000c92c0 2024-05-09T05:53:02.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:02.084+0000 7ffa07b7d640 1 -- 172.21.15.110:0/952717685 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa00160890 con 0x7ffa000c92c0 2024-05-09T05:53:02.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:02.084+0000 7ff9f67fc640 1 -- 172.21.15.110:0/952717685 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff9f801b020 con 0x7ffa000c92c0 2024-05-09T05:53:02.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:02.084+0000 7ff9f67fc640 1 -- 172.21.15.110:0/952717685 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7ff9f801dd60 con 0x7ffa000c92c0 2024-05-09T05:53:02.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:02.084+0000 7ffa07b7d640 1 -- 172.21.15.110:0/952717685 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa0006a520 con 0x7ffa000c92c0 2024-05-09T05:53:02.076 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:02.088+0000 7ff9f67fc640 1 -- 172.21.15.110:0/952717685 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7ff9f8022020 con 0x7ffa000c92c0 2024-05-09T05:53:02.076 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-05-09T05:53:02.083+0000 7f5b11798180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-09T05:53:02.186 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:02.200+0000 7ffa07b7d640 1 -- 172.21.15.110:0/952717685 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd new", "uuid": "835de5c9-1e2c-41d8-bd28-d7ffe5ad8fdc", "id": 7} v 0) -- 0x7ffa00074690 con 0x7ffa000c92c0 2024-05-09T05:53:02.191 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:02.204+0000 7ff9f67fc640 1 -- 172.21.15.110:0/952717685 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "835de5c9-1e2c-41d8-bd28-d7ffe5ad8fdc", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7ff9f8010040 con 0x7ffa000c92c0 2024-05-09T05:53:02.191 INFO:teuthology.orchestra.run.smithi110.stdout:7 2024-05-09T05:53:02.192 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:02.204+0000 7ffa07b7d640 1 -- 172.21.15.110:0/952717685 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa000c92c0 msgr2=0x7ffa0014b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:02.192 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:02.204+0000 7ffa07b7d640 1 --2- 172.21.15.110:0/952717685 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa000c92c0 0x7ffa0014b8c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff9f800ef90 tx=0x7ff9f800c490 comp rx=0 tx=0).stop 2024-05-09T05:53:02.192 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:02.204+0000 7ffa07b7d640 1 -- 172.21.15.110:0/952717685 shutdown_connections 2024-05-09T05:53:02.192 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:02.204+0000 7ffa07b7d640 1 --2- 172.21.15.110:0/952717685 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa000c92c0 0x7ffa0014b8c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:02.192 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:02.204+0000 7ffa07b7d640 1 --2- 172.21.15.110:0/952717685 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa00074ac0 0x7ffa00155b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:02.192 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:02.204+0000 7ffa07b7d640 1 --2- 172.21.15.110:0/952717685 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa0006d140 0x7ffa000c88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:02.192 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:02.204+0000 7ffa07b7d640 1 -- 172.21.15.110:0/952717685 >> 172.21.15.110:0/952717685 conn(0x7ffa000cb3c0 msgr2=0x7ffa000cd240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:02.192 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:02.204+0000 7ffa07b7d640 1 -- 172.21.15.110:0/952717685 shutdown_connections 2024-05-09T05:53:02.193 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T05:53:02.204+0000 7ffa07b7d640 1 -- 172.21.15.110:0/952717685 wait complete. 2024-05-09T05:53:02.208 INFO:tasks.ceph.osd.0:Restarting daemon 2024-05-09T05:53:02.208 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-05-09T05:53:02.211 INFO:tasks.ceph.osd.0:Started 2024-05-09T05:53:02.211 INFO:tasks.ceph.osd.1:Restarting daemon 2024-05-09T05:53:02.211 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-05-09T05:53:02.213 INFO:tasks.ceph.osd.1:Started 2024-05-09T05:53:02.214 INFO:tasks.ceph.osd.2:Restarting daemon 2024-05-09T05:53:02.214 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-05-09T05:53:02.216 INFO:tasks.ceph.osd.2:Started 2024-05-09T05:53:02.216 INFO:tasks.ceph.osd.3:Restarting daemon 2024-05-09T05:53:02.216 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-05-09T05:53:02.218 INFO:tasks.ceph.osd.3:Started 2024-05-09T05:53:02.219 INFO:tasks.ceph.osd.4:Restarting daemon 2024-05-09T05:53:02.219 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-05-09T05:53:02.220 INFO:tasks.ceph.osd.4:Started 2024-05-09T05:53:02.221 INFO:tasks.ceph.osd.5:Restarting daemon 2024-05-09T05:53:02.221 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-05-09T05:53:02.222 INFO:tasks.ceph.osd.5:Started 2024-05-09T05:53:02.223 INFO:tasks.ceph.osd.6:Restarting daemon 2024-05-09T05:53:02.223 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-05-09T05:53:02.225 INFO:tasks.ceph.osd.6:Started 2024-05-09T05:53:02.225 INFO:tasks.ceph.osd.7:Restarting daemon 2024-05-09T05:53:02.225 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-05-09T05:53:02.228 INFO:tasks.ceph.osd.7:Started 2024-05-09T05:53:02.228 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T05:53:02.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:02.383+0000 7f9f09938640 1 Processor -- start 2024-05-09T05:53:02.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:02.383+0000 7f9f09938640 1 -- start start 2024-05-09T05:53:02.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:02.383+0000 7f9f09938640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f04156b50 0x7f9f0415c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:02.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:02.383+0000 7f9f09938640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9f04074fd0 0x7f9f041670c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:02.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:02.383+0000 7f9f09938640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f040c92c0 con 0x7f9f04074bc0 2024-05-09T05:53:02.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:02.383+0000 7f9f09938640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f9f0415d7e0 con 0x7f9f04074fd0 2024-05-09T05:53:02.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:02.383+0000 7f9f09938640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f9f040753e0 con 0x7f9f04156b50 2024-05-09T05:53:02.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:02.383+0000 7f9f037fe640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9f04074fd0 0x7f9f041670c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:02.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:02.383+0000 7f9f027fc640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f9f04074bc0 0x7f9f04073450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48642/0 (socket says 172.21.15.72:48642) 2024-05-09T05:53:02.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:02.383+0000 7f9f027fc640 1 -- 172.21.15.72:0/4130524383 learned_addr learned my addr 172.21.15.72:0/4130524383 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:53:02.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:02.383+0000 7f9f02ffd640 1 --2- 172.21.15.72:0/4130524383 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f04156b50 0x7f9f0415c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:02.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:02.383+0000 7f9f037fe640 1 -- 172.21.15.72:0/4130524383 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f04156b50 msgr2=0x7f9f0415c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:02.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:02.383+0000 7f9f037fe640 1 --2- 172.21.15.72:0/4130524383 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f04156b50 0x7f9f0415c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:02.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:02.383+0000 7f9f037fe640 1 -- 172.21.15.72:0/4130524383 >> v1:172.21.15.72:6789/0 conn(0x7f9f04074bc0 legacy=0x7f9f04073450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:02.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:02.383+0000 7f9f037fe640 1 -- 172.21.15.72:0/4130524383 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f04156f60 con 0x7f9f04074fd0 2024-05-09T05:53:02.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:02.387+0000 7f9f037fe640 1 --2- 172.21.15.72:0/4130524383 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f04074fd0 0x7f9f041670c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9efc009d90 tx=0x7f9efc01f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5d267d3b9f74d92 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:02.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:02.387+0000 7f9f01ffb640 1 -- 172.21.15.72:0/4130524383 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9efc0b4070 con 0x7f9f04074fd0 2024-05-09T05:53:02.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:02.387+0000 7f9f01ffb640 1 -- 172.21.15.72:0/4130524383 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9efc0af600 con 0x7f9f04074fd0 2024-05-09T05:53:02.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:02.387+0000 7f9f01ffb640 1 -- 172.21.15.72:0/4130524383 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9efc0af9d0 con 0x7f9f04074fd0 2024-05-09T05:53:02.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:02.387+0000 7f9f09938640 1 -- 172.21.15.72:0/4130524383 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f04074fd0 msgr2=0x7f9f041670c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:02.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:02.387+0000 7f9f09938640 1 --2- 172.21.15.72:0/4130524383 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f04074fd0 0x7f9f041670c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9efc009d90 tx=0x7f9efc01f150 comp rx=0 tx=0).stop 2024-05-09T05:53:02.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:02.387+0000 7f9f09938640 1 -- 172.21.15.72:0/4130524383 shutdown_connections 2024-05-09T05:53:02.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:02.387+0000 7f9f09938640 1 --2- 172.21.15.72:0/4130524383 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f04074fd0 0x7f9f041670c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:02.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:02.387+0000 7f9f09938640 1 --2- 172.21.15.72:0/4130524383 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f04156b50 0x7f9f0415c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:02.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:02.387+0000 7f9f09938640 1 -- 172.21.15.72:0/4130524383 >> 172.21.15.72:0/4130524383 conn(0x7f9f040cb3c0 msgr2=0x7f9f040cb7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:02.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:02.387+0000 7f9f09938640 1 -- 172.21.15.72:0/4130524383 shutdown_connections 2024-05-09T05:53:02.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:02.387+0000 7f9f09938640 1 -- 172.21.15.72:0/4130524383 wait complete. 2024-05-09T05:53:02.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:02.391+0000 7f9f09938640 1 Processor -- start 2024-05-09T05:53:02.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:02.391+0000 7f9f09938640 1 -- start start 2024-05-09T05:53:02.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:02.391+0000 7f9f09938640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f04074bc0 0x7f9f041f7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:02.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:02.391+0000 7f9f09938640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f04074fd0 0x7f9f041443e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:02.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:02.391+0000 7f9f09938640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f04156b50 0x7f9f04146da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:02.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:02.391+0000 7f9f09938640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f9f0415d500 con 0x7f9f04074fd0 2024-05-09T05:53:02.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:02.391+0000 7f9f09938640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f9f0415d220 con 0x7f9f04156b50 2024-05-09T05:53:02.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:02.391+0000 7f9f09938640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f9f040743c0 con 0x7f9f04074bc0 2024-05-09T05:53:02.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:02.391+0000 7f9f027fc640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f04074fd0 0x7f9f041443e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:02.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:02.391+0000 7f9f027fc640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f04074fd0 0x7f9f041443e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56364/0 (socket says 172.21.15.72:56364) 2024-05-09T05:53:02.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:02.391+0000 7f9f027fc640 1 -- 172.21.15.72:0/2638687328 learned_addr learned my addr 172.21.15.72:0/2638687328 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:02.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:02.391+0000 7f9f02ffd640 1 --2- 172.21.15.72:0/2638687328 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f04074bc0 0x7f9f041f7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:02.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:02.391+0000 7f9f037fe640 1 --2- 172.21.15.72:0/2638687328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f04156b50 0x7f9f04146da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:02.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:02.391+0000 7f9f027fc640 1 -- 172.21.15.72:0/2638687328 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f04074bc0 msgr2=0x7f9f041f7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:02.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:02.391+0000 7f9f027fc640 1 --2- 172.21.15.72:0/2638687328 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f04074bc0 0x7f9f041f7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:02.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:02.391+0000 7f9f027fc640 1 -- 172.21.15.72:0/2638687328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f04156b50 msgr2=0x7f9f04146da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:02.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:02.391+0000 7f9f027fc640 1 --2- 172.21.15.72:0/2638687328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f04156b50 0x7f9f04146da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:02.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:02.391+0000 7f9f027fc640 1 -- 172.21.15.72:0/2638687328 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f041f75d0 con 0x7f9f04074fd0 2024-05-09T05:53:02.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:02.391+0000 7f9f02ffd640 1 --2- 172.21.15.72:0/2638687328 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f04074bc0 0x7f9f041f7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T05:53:02.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:02.391+0000 7f9f027fc640 1 --2- 172.21.15.72:0/2638687328 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f04074fd0 0x7f9f041443e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9ef800c430 tx=0x7f9ef800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:02.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:02.391+0000 7f9eebfff640 1 -- 172.21.15.72:0/2638687328 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef8017070 con 0x7f9f04074fd0 2024-05-09T05:53:02.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:02.391+0000 7f9eebfff640 1 -- 172.21.15.72:0/2638687328 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ef8005d10 con 0x7f9f04074fd0 2024-05-09T05:53:02.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:02.391+0000 7f9f09938640 1 -- 172.21.15.72:0/2638687328 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f041563e0 con 0x7f9f04074fd0 2024-05-09T05:53:02.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:02.391+0000 7f9eebfff640 1 -- 172.21.15.72:0/2638687328 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef8007310 con 0x7f9f04074fd0 2024-05-09T05:53:02.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:02.391+0000 7f9f09938640 1 -- 172.21.15.72:0/2638687328 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f0414ebb0 con 0x7f9f04074fd0 2024-05-09T05:53:02.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:02.391+0000 7f9eebfff640 1 -- 172.21.15.72:0/2638687328 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9ef801a070 con 0x7f9f04074fd0 2024-05-09T05:53:02.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:02.391+0000 7f9eebfff640 1 -- 172.21.15.72:0/2638687328 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f9ef80074b0 con 0x7f9f04074fd0 2024-05-09T05:53:02.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:02.391+0000 7f9f09938640 1 -- 172.21.15.72:0/2638687328 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f0415caf0 con 0x7f9f04074fd0 2024-05-09T05:53:02.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:02.423+0000 7f9eebfff640 1 -- 172.21.15.72:0/2638687328 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f9f0415caf0 con 0x7f9f04074fd0 2024-05-09T05:53:02.477 INFO:tasks.ceph.mgr.x.smithi110.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-05-09T05:53:02.477 INFO:tasks.ceph.mgr.x.smithi110.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-05-09T05:53:02.478 INFO:tasks.ceph.mgr.x.smithi110.stderr: from numpy import show_config as show_numpy_config 2024-05-09T05:53:02.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:02.515+0000 7f9f09938640 1 -- 172.21.15.72:0/2638687328 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9f0406a520 con 0x7f9f04074fd0 2024-05-09T05:53:02.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:02.515+0000 7f9eebfff640 1 -- 172.21.15.72:0/2638687328 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f9ef8021020 con 0x7f9f04074fd0 2024-05-09T05:53:02.510 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:53:02.510 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":10,"fsid":"44c88cb9-b39b-4787-a871-80ddf0ad6292","created":"2024-05-09T05:52:59.591187+0000","modified":"2024-05-09T05:53:02.200254+0000","last_up_change":"0.000000","last_in_change":"2024-05-09T05:53:02.200254+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e4af2aa1-ba5c-4411-a72a-a0e38e589a74","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"052504f5-a523-4922-bdc7-ce2890faa5ff","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"28bc1c95-6d0d-4263-baad-314d86e6a670","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"edcc86cb-f178-4533-8069-de9d781531ea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"8d138128-4829-4109-87a1-25f339f3e953","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"99a4a914-0a0e-4d25-94ae-3e86b8b1aa4b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"6e04b295-afc9-4f80-80f7-3df1f5168608","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"835de5c9-1e2c-41d8-bd28-d7ffe5ad8fdc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T05:53:02.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:02.519+0000 7f9ee9ffb640 1 -- 172.21.15.72:0/2638687328 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f04074fd0 msgr2=0x7f9f041443e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:02.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:02.519+0000 7f9ee9ffb640 1 --2- 172.21.15.72:0/2638687328 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f04074fd0 0x7f9f041443e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9ef800c430 tx=0x7f9ef800c8f0 comp rx=0 tx=0).stop 2024-05-09T05:53:02.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:02.519+0000 7f9ee9ffb640 1 -- 172.21.15.72:0/2638687328 shutdown_connections 2024-05-09T05:53:02.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:02.519+0000 7f9ee9ffb640 1 --2- 172.21.15.72:0/2638687328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f04156b50 0x7f9f04146da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:02.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:02.519+0000 7f9ee9ffb640 1 --2- 172.21.15.72:0/2638687328 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f04074fd0 0x7f9f041443e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:02.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:02.519+0000 7f9ee9ffb640 1 --2- 172.21.15.72:0/2638687328 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f04074bc0 0x7f9f041f7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:02.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:02.519+0000 7f9ee9ffb640 1 -- 172.21.15.72:0/2638687328 >> 172.21.15.72:0/2638687328 conn(0x7f9f040cb3c0 msgr2=0x7f9f04149660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:02.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:02.519+0000 7f9ee9ffb640 1 -- 172.21.15.72:0/2638687328 shutdown_connections 2024-05-09T05:53:02.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:02.519+0000 7f9ee9ffb640 1 -- 172.21.15.72:0/2638687328 wait complete. 2024-05-09T05:53:02.534 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-05-09T05:53:02.534 INFO:tasks.ceph:Waiting for OSDs to come up 2024-05-09T05:53:02.547 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-05-09T05:53:02.560+0000 7f15db3dd180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-09T05:53:02.716 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-05-09T05:53:02.728+0000 7f15db3dd180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-09T05:53:02.871 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-05-09T05:53:02.884+0000 7f1085e287c0 -1 Falling back to public interface 2024-05-09T05:53:02.877 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-05-09T05:53:02.888+0000 7f15db3dd180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-09T05:53:02.880 INFO:tasks.ceph.mgr.y.smithi072.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-05-09T05:53:02.880 INFO:tasks.ceph.mgr.y.smithi072.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-05-09T05:53:02.880 INFO:tasks.ceph.mgr.y.smithi072.stderr: from numpy import show_config as show_numpy_config 2024-05-09T05:53:02.887 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-05-09T05:53:02.900+0000 7f8f6def17c0 -1 Falling back to public interface 2024-05-09T05:53:02.890 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-05-09T05:53:02.904+0000 7f45ca6167c0 -1 Falling back to public interface 2024-05-09T05:53:02.896 INFO:tasks.ceph.osd.1.smithi072.stderr:2024-05-09T05:53:02.903+0000 7ff89946f7c0 -1 Falling back to public interface 2024-05-09T05:53:02.896 INFO:tasks.ceph.osd.3.smithi072.stderr:2024-05-09T05:53:02.903+0000 7f671f6547c0 -1 Falling back to public interface 2024-05-09T05:53:02.907 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-05-09T05:53:02.920+0000 7f8b0c62f7c0 -1 Falling back to public interface 2024-05-09T05:53:02.907 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-05-09T05:53:02.915+0000 7f41f981f7c0 -1 Falling back to public interface 2024-05-09T05:53:02.919 INFO:tasks.ceph.osd.2.smithi072.stderr:2024-05-09T05:53:02.927+0000 7fbebc78a7c0 -1 Falling back to public interface 2024-05-09T05:53:02.948 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-05-09T05:53:02.960+0000 7f15db3dd180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-09T05:53:02.952 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-05-09T05:53:02.959+0000 7f5b11798180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-09T05:53:03.095 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-05-09T05:53:03.108+0000 7f15db3dd180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-09T05:53:03.106 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-05-09T05:53:03.111+0000 7f5b11798180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-09T05:53:03.285 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-05-09T05:53:03.291+0000 7f5b11798180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-09T05:53:03.340 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-09T05:53:03.361 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-05-09T05:53:03.367+0000 7f5b11798180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-09T05:53:03.483 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:03.491+0000 7f6045632640 1 Processor -- start 2024-05-09T05:53:03.483 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:03.491+0000 7f6045632640 1 -- start start 2024-05-09T05:53:03.485 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:03.491+0000 7f6045632640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f60400c5e60 0x7f60400cb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:03.485 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:03.491+0000 7f6045632640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f60400c6270 0x7f60400ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:03.485 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:03.491+0000 7f6045632640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f604015b370 con 0x7f60400cb8f0 2024-05-09T05:53:03.485 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:03.491+0000 7f6045632640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f60400c8bb0 con 0x7f60400c5e60 2024-05-09T05:53:03.485 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:03.491+0000 7f6045632640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f60400c8e50 con 0x7f60400c6270 2024-05-09T05:53:03.485 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:03.491+0000 7f603effd640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f60400c5e60 0x7f60400cb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:03.485 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:03.491+0000 7f603f7fe640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f60400cb8f0 0x7f604015da20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48658/0 (socket says 172.21.15.72:48658) 2024-05-09T05:53:03.485 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:03.491+0000 7f603f7fe640 1 -- 172.21.15.72:0/1405318194 learned_addr learned my addr 172.21.15.72:0/1405318194 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:53:03.485 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:03.491+0000 7f603e7fc640 1 --2- 172.21.15.72:0/1405318194 >> v2:172.21.15.110:3300/0 conn(0x7f60400c6270 0x7f60400ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:03.486 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:03.491+0000 7f603effd640 1 -- 172.21.15.72:0/1405318194 >> v2:172.21.15.110:3300/0 conn(0x7f60400c6270 msgr2=0x7f60400ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:03.486 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:03.491+0000 7f603effd640 1 --2- 172.21.15.72:0/1405318194 >> v2:172.21.15.110:3300/0 conn(0x7f60400c6270 0x7f60400ced60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:03.486 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:03.491+0000 7f603effd640 1 -- 172.21.15.72:0/1405318194 >> v1:172.21.15.72:6789/0 conn(0x7f60400cb8f0 legacy=0x7f604015da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:03.486 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:03.491+0000 7f603effd640 1 -- 172.21.15.72:0/1405318194 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f604015a5b0 con 0x7f60400c5e60 2024-05-09T05:53:03.486 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:03.495+0000 7f603effd640 1 --2- 172.21.15.72:0/1405318194 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60400c5e60 0x7f60400cb3b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f60400704d0 tx=0x7f602801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e608b71af43b7ce6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:03.487 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:03.495+0000 7f603dffb640 1 -- 172.21.15.72:0/1405318194 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60280b0070 con 0x7f60400c5e60 2024-05-09T05:53:03.487 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:03.495+0000 7f603dffb640 1 -- 172.21.15.72:0/1405318194 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60280ab600 con 0x7f60400c5e60 2024-05-09T05:53:03.487 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:03.495+0000 7f603dffb640 1 -- 172.21.15.72:0/1405318194 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60280ab9d0 con 0x7f60400c5e60 2024-05-09T05:53:03.488 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:03.495+0000 7f6045632640 1 -- 172.21.15.72:0/1405318194 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60400c5e60 msgr2=0x7f60400cb3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:03.488 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:03.495+0000 7f6045632640 1 --2- 172.21.15.72:0/1405318194 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60400c5e60 0x7f60400cb3b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f60400704d0 tx=0x7f602801c480 comp rx=0 tx=0).stop 2024-05-09T05:53:03.488 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:03.495+0000 7f6045632640 1 -- 172.21.15.72:0/1405318194 shutdown_connections 2024-05-09T05:53:03.488 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:03.495+0000 7f6045632640 1 --2- 172.21.15.72:0/1405318194 >> v2:172.21.15.110:3300/0 conn(0x7f60400c6270 0x7f60400ced60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:03.488 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:03.495+0000 7f6045632640 1 --2- 172.21.15.72:0/1405318194 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60400c5e60 0x7f60400cb3b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:03.488 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:03.495+0000 7f6045632640 1 -- 172.21.15.72:0/1405318194 >> 172.21.15.72:0/1405318194 conn(0x7f604006dce0 msgr2=0x7f604006e120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:03.488 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:03.495+0000 7f6045632640 1 -- 172.21.15.72:0/1405318194 shutdown_connections 2024-05-09T05:53:03.488 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:03.495+0000 7f6045632640 1 -- 172.21.15.72:0/1405318194 wait complete. 2024-05-09T05:53:03.489 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:03.495+0000 7f6045632640 1 Processor -- start 2024-05-09T05:53:03.489 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:03.495+0000 7f6045632640 1 -- start start 2024-05-09T05:53:03.492 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:03.499+0000 7f6045632640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60400c5e60 0x7f6040155730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:03.492 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:03.499+0000 7f6045632640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60400cb8f0 0x7f6040141630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:03.492 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:03.499+0000 7f6045632640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60401571c0 0x7f60401575d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:03.492 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:03.499+0000 7f6045632640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f60400c5af0 con 0x7f60400cb8f0 2024-05-09T05:53:03.492 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:03.499+0000 7f6045632640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f60400c8300 con 0x7f60401571c0 2024-05-09T05:53:03.492 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:03.499+0000 7f6045632640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f60401549f0 con 0x7f60400c5e60 2024-05-09T05:53:03.492 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:03.499+0000 7f603e7fc640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60400cb8f0 0x7f6040141630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:03.493 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:03.499+0000 7f603e7fc640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60400cb8f0 0x7f6040141630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56376/0 (socket says 172.21.15.72:56376) 2024-05-09T05:53:03.493 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:03.499+0000 7f603e7fc640 1 -- 172.21.15.72:0/2519144827 learned_addr learned my addr 172.21.15.72:0/2519144827 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:03.493 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:03.499+0000 7f603f7fe640 1 --2- 172.21.15.72:0/2519144827 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60401571c0 0x7f60401575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:03.493 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:03.499+0000 7f603effd640 1 --2- 172.21.15.72:0/2519144827 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60400c5e60 0x7f6040155730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:03.493 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:03.499+0000 7f603e7fc640 1 -- 172.21.15.72:0/2519144827 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60400c5e60 msgr2=0x7f6040155730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:03.493 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:03.499+0000 7f603e7fc640 1 --2- 172.21.15.72:0/2519144827 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60400c5e60 0x7f6040155730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:03.493 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:03.499+0000 7f603e7fc640 1 -- 172.21.15.72:0/2519144827 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60401571c0 msgr2=0x7f60401575d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:03.493 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:03.499+0000 7f603e7fc640 1 --2- 172.21.15.72:0/2519144827 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60401571c0 0x7f60401575d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:03.493 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:03.499+0000 7f603e7fc640 1 -- 172.21.15.72:0/2519144827 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6040141b70 con 0x7f60400cb8f0 2024-05-09T05:53:03.493 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:03.499+0000 7f603e7fc640 1 --2- 172.21.15.72:0/2519144827 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60400cb8f0 0x7f6040141630 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f603000d600 tx=0x7f603000dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:03.493 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:03.499+0000 7f60377fe640 1 -- 172.21.15.72:0/2519144827 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60300125f0 con 0x7f60400cb8f0 2024-05-09T05:53:03.493 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:03.499+0000 7f60377fe640 1 -- 172.21.15.72:0/2519144827 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6030019070 con 0x7f60400cb8f0 2024-05-09T05:53:03.493 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:03.499+0000 7f6045632640 1 -- 172.21.15.72:0/2519144827 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60400c9590 con 0x7f60400cb8f0 2024-05-09T05:53:03.493 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:03.499+0000 7f60377fe640 1 -- 172.21.15.72:0/2519144827 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60300129b0 con 0x7f60400cb8f0 2024-05-09T05:53:03.494 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:03.499+0000 7f6045632640 1 -- 172.21.15.72:0/2519144827 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60400c9b50 con 0x7f60400cb8f0 2024-05-09T05:53:03.494 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:03.499+0000 7f60377fe640 1 -- 172.21.15.72:0/2519144827 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6030012b50 con 0x7f60400cb8f0 2024-05-09T05:53:03.494 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:03.499+0000 7f60377fe640 1 -- 172.21.15.72:0/2519144827 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f6030014b00 con 0x7f60400cb8f0 2024-05-09T05:53:03.494 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:03.499+0000 7f6045632640 1 -- 172.21.15.72:0/2519144827 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f604006a520 con 0x7f60400cb8f0 2024-05-09T05:53:03.494 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:03.503+0000 7f60377fe640 1 -- 172.21.15.72:0/2519144827 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f6030014430 con 0x7f60400cb8f0 2024-05-09T05:53:03.513 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-05-09T05:53:03.519+0000 7f5b11798180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-09T05:53:03.550 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:03.555+0000 7f6045632640 1 -- 172.21.15.72:0/2519144827 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f60400764a0 con 0x7f60400cb8f0 2024-05-09T05:53:03.550 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:03.559+0000 7f60377fe640 1 -- 172.21.15.72:0/2519144827 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f6030014df0 con 0x7f60400cb8f0 2024-05-09T05:53:03.550 INFO:teuthology.misc.health.smithi072.stdout: 2024-05-09T05:53:03.551 INFO:teuthology.misc.health.smithi072.stdout:{"epoch":10,"fsid":"44c88cb9-b39b-4787-a871-80ddf0ad6292","created":"2024-05-09T05:52:59.591187+0000","modified":"2024-05-09T05:53:02.200254+0000","last_up_change":"0.000000","last_in_change":"2024-05-09T05:53:02.200254+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e4af2aa1-ba5c-4411-a72a-a0e38e589a74","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"052504f5-a523-4922-bdc7-ce2890faa5ff","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"28bc1c95-6d0d-4263-baad-314d86e6a670","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"edcc86cb-f178-4533-8069-de9d781531ea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"8d138128-4829-4109-87a1-25f339f3e953","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"99a4a914-0a0e-4d25-94ae-3e86b8b1aa4b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"6e04b295-afc9-4f80-80f7-3df1f5168608","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"835de5c9-1e2c-41d8-bd28-d7ffe5ad8fdc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T05:53:03.551 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:03.559+0000 7f6045632640 1 -- 172.21.15.72:0/2519144827 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60400cb8f0 msgr2=0x7f6040141630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:03.551 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:03.559+0000 7f6045632640 1 --2- 172.21.15.72:0/2519144827 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60400cb8f0 0x7f6040141630 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f603000d600 tx=0x7f603000dac0 comp rx=0 tx=0).stop 2024-05-09T05:53:03.551 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:03.559+0000 7f6045632640 1 -- 172.21.15.72:0/2519144827 shutdown_connections 2024-05-09T05:53:03.551 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:03.559+0000 7f6045632640 1 --2- 172.21.15.72:0/2519144827 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60401571c0 0x7f60401575d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:03.551 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:03.559+0000 7f6045632640 1 --2- 172.21.15.72:0/2519144827 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60400cb8f0 0x7f6040141630 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:03.552 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:03.559+0000 7f6045632640 1 --2- 172.21.15.72:0/2519144827 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60400c5e60 0x7f6040155730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:03.552 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:03.559+0000 7f6045632640 1 -- 172.21.15.72:0/2519144827 >> 172.21.15.72:0/2519144827 conn(0x7f604006dce0 msgr2=0x7f60401599a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:03.552 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:03.559+0000 7f6045632640 1 -- 172.21.15.72:0/2519144827 shutdown_connections 2024-05-09T05:53:03.552 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:03.559+0000 7f6045632640 1 -- 172.21.15.72:0/2519144827 wait complete. 2024-05-09T05:53:03.568 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-09T05:53:03.730 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-05-09T05:53:03.744+0000 7f15db3dd180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-09T05:53:03.806 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-05-09T05:53:03.816+0000 7f15db3dd180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-09T05:53:03.986 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-05-09T05:53:04.000+0000 7f15db3dd180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-09T05:53:04.060 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-05-09T05:53:04.072+0000 7f15db3dd180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-09T05:53:04.149 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-05-09T05:53:04.155+0000 7f5b11798180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-09T05:53:04.224 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-05-09T05:53:04.231+0000 7f5b11798180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-09T05:53:04.350 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-05-09T05:53:04.360+0000 7f15db3dd180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-09T05:53:04.406 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-05-09T05:53:04.411+0000 7f5b11798180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-09T05:53:04.412 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-05-09T05:53:04.424+0000 7f15db3dd180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-09T05:53:04.482 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-05-09T05:53:04.491+0000 7f5b11798180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-09T05:53:04.777 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-05-09T05:53:04.783+0000 7f5b11798180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-09T05:53:04.840 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-05-09T05:53:04.847+0000 7f5b11798180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-09T05:53:05.462 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-05-09T05:53:05.476+0000 7f1581d88640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-05-09T05:53:05.463 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-05-09T05:53:05.476+0000 7f1581d88640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-05-09T05:53:06.491 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-05-09T05:53:06.504+0000 7f8b0c62f7c0 -1 osd.5 0 log_to_monitors true 2024-05-09T05:53:06.668 INFO:tasks.ceph.osd.1.smithi072.stderr:2024-05-09T05:53:06.675+0000 7ff89946f7c0 -1 osd.1 0 log_to_monitors true 2024-05-09T05:53:06.682 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-05-09T05:53:06.696+0000 7f45ca6167c0 -1 osd.4 0 log_to_monitors true 2024-05-09T05:53:06.766 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-05-09T05:53:06.780+0000 7f8f6def17c0 -1 osd.6 0 log_to_monitors true 2024-05-09T05:53:06.772 INFO:tasks.ceph.osd.2.smithi072.stderr:2024-05-09T05:53:06.779+0000 7fbebc78a7c0 -1 osd.2 0 log_to_monitors true 2024-05-09T05:53:06.773 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-05-09T05:53:06.784+0000 7f1085e287c0 -1 osd.7 0 log_to_monitors true 2024-05-09T05:53:06.773 INFO:tasks.ceph.osd.3.smithi072.stderr:2024-05-09T05:53:06.779+0000 7f671f6547c0 -1 osd.3 0 log_to_monitors true 2024-05-09T05:53:06.797 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-05-09T05:53:06.803+0000 7f41f981f7c0 -1 osd.0 0 log_to_monitors true 2024-05-09T05:53:08.355 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-05-09T05:53:08.368+0000 7f8b08dea640 -1 osd.5 0 waiting for initial osdmap 2024-05-09T05:53:08.391 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-05-09T05:53:08.404+0000 7f8b003d7640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T05:53:08.503 INFO:tasks.ceph.osd.3.smithi072.stderr:2024-05-09T05:53:08.511+0000 7f671be0f640 -1 osd.3 0 waiting for initial osdmap 2024-05-09T05:53:08.527 INFO:tasks.ceph.osd.3.smithi072.stderr:2024-05-09T05:53:08.535+0000 7f67133fc640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T05:53:09.887 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-05-09T05:53:09.899+0000 7f8f69e98640 -1 osd.6 0 waiting for initial osdmap 2024-05-09T05:53:09.914 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-05-09T05:53:09.927+0000 7f8f61c99640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T05:53:09.983 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-05-09T05:53:09.995+0000 7f1081dcf640 -1 osd.7 0 waiting for initial osdmap 2024-05-09T05:53:09.985 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-05-09T05:53:09.995+0000 7f45c65bd640 -1 osd.4 0 waiting for initial osdmap 2024-05-09T05:53:10.007 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-05-09T05:53:10.019+0000 7f1079bd0640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T05:53:10.022 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-05-09T05:53:10.035+0000 7f45be3be640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T05:53:10.374 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-09T05:53:10.460 INFO:tasks.ceph.osd.1.smithi072.stderr:2024-05-09T05:53:10.467+0000 7ff895416640 -1 osd.1 0 waiting for initial osdmap 2024-05-09T05:53:10.506 INFO:tasks.ceph.osd.1.smithi072.stderr:2024-05-09T05:53:10.515+0000 7ff88d217640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T05:53:10.509 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-05-09T05:53:10.515+0000 7f41f57c6640 -1 osd.0 0 waiting for initial osdmap 2024-05-09T05:53:10.511 INFO:tasks.ceph.osd.2.smithi072.stderr:2024-05-09T05:53:10.519+0000 7fbeb8731640 -1 osd.2 0 waiting for initial osdmap 2024-05-09T05:53:10.538 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-05-09T05:53:10.547+0000 7f41ed5c7640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T05:53:10.543 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.551+0000 7f89ae6ab640 1 Processor -- start 2024-05-09T05:53:10.543 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.551+0000 7f89ae6ab640 1 -- start start 2024-05-09T05:53:10.545 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.551+0000 7f89ae6ab640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89a80cd230 0x7f89a815dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:10.545 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.551+0000 7f89ae6ab640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f89a815d180 0x7f89a8167040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:10.545 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.551+0000 7f89ae6ab640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89a80b75e0 con 0x7f89a8156af0 2024-05-09T05:53:10.546 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.551+0000 7f89ae6ab640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f89a815e0f0 con 0x7f89a815d180 2024-05-09T05:53:10.546 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.551+0000 7f89ae6ab640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f89a81604a0 con 0x7f89a80cd230 2024-05-09T05:53:10.546 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.551+0000 7f89acc48640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f89a815d180 0x7f89a8167040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:10.546 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.551+0000 7f89acc48640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f89a815d180 0x7f89a8167040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56446/0 (socket says 172.21.15.72:56446) 2024-05-09T05:53:10.546 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.551+0000 7f89acc48640 1 -- 172.21.15.72:0/2737791503 learned_addr learned my addr 172.21.15.72:0/2737791503 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:10.546 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.551+0000 7f89acc48640 1 -- 172.21.15.72:0/2737791503 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89a80cd230 msgr2=0x7f89a815dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:10.546 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.551+0000 7f89acc48640 1 --2- 172.21.15.72:0/2737791503 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89a80cd230 0x7f89a815dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:10.546 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.551+0000 7f89acc48640 1 -- 172.21.15.72:0/2737791503 >> v1:172.21.15.110:6789/0 conn(0x7f89a8156af0 legacy=0x7f89a80ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:10.546 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.551+0000 7f89acc48640 1 -- 172.21.15.72:0/2737791503 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89a80b7880 con 0x7f89a815d180 2024-05-09T05:53:10.547 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.555+0000 7f89acc48640 1 --2- 172.21.15.72:0/2737791503 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89a815d180 0x7f89a8167040 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f89a80ce540 tx=0x7f89a001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4db640e739e64e15 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:10.548 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.555+0000 7f89a6ffd640 1 -- 172.21.15.72:0/2737791503 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a00a5630 con 0x7f89a815d180 2024-05-09T05:53:10.548 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.555+0000 7f89a6ffd640 1 -- 172.21.15.72:0/2737791503 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89a00a57d0 con 0x7f89a815d180 2024-05-09T05:53:10.548 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.555+0000 7f89a6ffd640 1 -- 172.21.15.72:0/2737791503 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a00a5ba0 con 0x7f89a815d180 2024-05-09T05:53:10.549 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.555+0000 7f89ae6ab640 1 -- 172.21.15.72:0/2737791503 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89a815d180 msgr2=0x7f89a8167040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:10.549 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.555+0000 7f89ae6ab640 1 --2- 172.21.15.72:0/2737791503 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89a815d180 0x7f89a8167040 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f89a80ce540 tx=0x7f89a001c9f0 comp rx=0 tx=0).stop 2024-05-09T05:53:10.549 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.555+0000 7f89ae6ab640 1 -- 172.21.15.72:0/2737791503 shutdown_connections 2024-05-09T05:53:10.549 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.555+0000 7f89ae6ab640 1 --2- 172.21.15.72:0/2737791503 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89a815d180 0x7f89a8167040 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:10.549 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.555+0000 7f89ae6ab640 1 --2- 172.21.15.72:0/2737791503 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89a80cd230 0x7f89a815dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:10.549 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.555+0000 7f89ae6ab640 1 -- 172.21.15.72:0/2737791503 >> 172.21.15.72:0/2737791503 conn(0x7f89a806e7e0 msgr2=0x7f89a806ec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:10.549 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.555+0000 7f89ae6ab640 1 -- 172.21.15.72:0/2737791503 shutdown_connections 2024-05-09T05:53:10.549 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.555+0000 7f89ae6ab640 1 -- 172.21.15.72:0/2737791503 wait complete. 2024-05-09T05:53:10.550 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.559+0000 7f89ae6ab640 1 Processor -- start 2024-05-09T05:53:10.550 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.559+0000 7f89ae6ab640 1 -- start start 2024-05-09T05:53:10.553 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.559+0000 7f89ae6ab640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89a80cd230 0x7f89a8161ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:10.553 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.559+0000 7f89ae6ab640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89a8156af0 0x7f89a8166aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:10.553 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.559+0000 7f89ae6ab640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89a815d180 0x7f89a8154be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:10.553 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.559+0000 7f89ae6ab640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f89a80cd880 con 0x7f89a815d180 2024-05-09T05:53:10.553 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.559+0000 7f89ae6ab640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f89a80cd640 con 0x7f89a80cd230 2024-05-09T05:53:10.553 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.559+0000 7f89ae6ab640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f89a80cda00 con 0x7f89a8156af0 2024-05-09T05:53:10.553 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.559+0000 7f89acc48640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89a815d180 0x7f89a8154be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:10.553 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.559+0000 7f89acc48640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89a815d180 0x7f89a8154be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56452/0 (socket says 172.21.15.72:56452) 2024-05-09T05:53:10.553 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.559+0000 7f89acc48640 1 -- 172.21.15.72:0/3612704661 learned_addr learned my addr 172.21.15.72:0/3612704661 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:10.553 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.559+0000 7f89a7fff640 1 --2- 172.21.15.72:0/3612704661 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89a80cd230 0x7f89a8161ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:10.554 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.559+0000 7f89a77fe640 1 --2- 172.21.15.72:0/3612704661 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89a8156af0 0x7f89a8166aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:10.554 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.559+0000 7f89acc48640 1 -- 172.21.15.72:0/3612704661 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89a8156af0 msgr2=0x7f89a8166aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:10.554 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.559+0000 7f89acc48640 1 --2- 172.21.15.72:0/3612704661 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89a8156af0 0x7f89a8166aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:10.554 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.559+0000 7f89acc48640 1 -- 172.21.15.72:0/3612704661 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89a80cd230 msgr2=0x7f89a8161ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:10.554 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.559+0000 7f89acc48640 1 --2- 172.21.15.72:0/3612704661 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89a80cd230 0x7f89a8161ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:10.554 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.559+0000 7f89acc48640 1 -- 172.21.15.72:0/3612704661 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89a815a930 con 0x7f89a815d180 2024-05-09T05:53:10.554 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.559+0000 7f89a77fe640 1 --2- 172.21.15.72:0/3612704661 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89a8156af0 0x7f89a8166aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:53:10.554 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.559+0000 7f89a7fff640 1 --2- 172.21.15.72:0/3612704661 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89a80cd230 0x7f89a8161ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:53:10.554 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.559+0000 7f89acc48640 1 --2- 172.21.15.72:0/3612704661 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89a815d180 0x7f89a8154be0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f89a001d290 tx=0x7f89a0019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:10.554 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.559+0000 7f89a4ff9640 1 -- 172.21.15.72:0/3612704661 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a00b8670 con 0x7f89a815d180 2024-05-09T05:53:10.554 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.559+0000 7f89a4ff9640 1 -- 172.21.15.72:0/3612704661 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89a00be070 con 0x7f89a815d180 2024-05-09T05:53:10.554 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.559+0000 7f89ae6ab640 1 -- 172.21.15.72:0/3612704661 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89a815a620 con 0x7f89a815d180 2024-05-09T05:53:10.555 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.559+0000 7f89a4ff9640 1 -- 172.21.15.72:0/3612704661 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a00b8a50 con 0x7f89a815d180 2024-05-09T05:53:10.555 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.559+0000 7f89ae6ab640 1 -- 172.21.15.72:0/3612704661 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89a81557a0 con 0x7f89a815d180 2024-05-09T05:53:10.555 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.559+0000 7f89ae6ab640 1 -- 172.21.15.72:0/3612704661 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89a806a520 con 0x7f89a815d180 2024-05-09T05:53:10.555 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.563+0000 7f89a4ff9640 1 -- 172.21.15.72:0/3612704661 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) ==== 93151+0+0 (secure 0 0 0) 0x7f89a00b8bf0 con 0x7f89a815d180 2024-05-09T05:53:10.556 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.563+0000 7f89a4ff9640 1 --2- 172.21.15.72:0/3612704661 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f899406f370 0x7f8994071880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:10.556 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.563+0000 7f89a4ff9640 1 -- 172.21.15.72:0/3612704661 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2791+0+0 (secure 0 0 0) 0x7f89a01297f0 con 0x7f89a815d180 2024-05-09T05:53:10.556 INFO:tasks.ceph.osd.2.smithi072.stderr:2024-05-09T05:53:10.563+0000 7fbeb0532640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T05:53:10.556 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.563+0000 7f89a7fff640 1 --2- 172.21.15.72:0/3612704661 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f899406f370 0x7f8994071880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:10.556 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.563+0000 7f89a7fff640 1 --2- 172.21.15.72:0/3612704661 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f899406f370 0x7f8994071880 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f899800a850 tx=0x7f8998008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:10.560 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.567+0000 7f89a4ff9640 1 -- 172.21.15.72:0/3612704661 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f89a815a930 con 0x7f89a815d180 2024-05-09T05:53:10.725 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.731+0000 7f89ae6ab640 1 -- 172.21.15.72:0/3612704661 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f89a80cdc00 con 0x7f89a815d180 2024-05-09T05:53:10.726 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.735+0000 7f89a4ff9640 1 -- 172.21.15.72:0/3612704661 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+8075 (secure 0 0 0) 0x7f89a00165e0 con 0x7f89a815d180 2024-05-09T05:53:10.726 INFO:teuthology.misc.health.smithi072.stdout: 2024-05-09T05:53:10.726 INFO:teuthology.misc.health.smithi072.stdout:{"epoch":14,"fsid":"44c88cb9-b39b-4787-a871-80ddf0ad6292","created":"2024-05-09T05:52:59.591187+0000","modified":"2024-05-09T05:53:09.679714+0000","last_up_change":"2024-05-09T05:53:08.645073+0000","last_in_change":"2024-05-09T05:53:02.200254+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e4af2aa1-ba5c-4411-a72a-a0e38e589a74","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"052504f5-a523-4922-bdc7-ce2890faa5ff","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"28bc1c95-6d0d-4263-baad-314d86e6a670","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"edcc86cb-f178-4533-8069-de9d781531ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2180866263},{"type":"v1","addr":"172.21.15.72:6806","nonce":2180866263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2180866263},{"type":"v1","addr":"172.21.15.72:6810","nonce":2180866263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2180866263},{"type":"v1","addr":"172.21.15.72:6815","nonce":2180866263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2180866263},{"type":"v1","addr":"172.21.15.72:6813","nonce":2180866263}]},"public_addr":"172.21.15.72:6806/2180866263","cluster_addr":"172.21.15.72:6810/2180866263","heartbeat_back_addr":"172.21.15.72:6815/2180866263","heartbeat_front_addr":"172.21.15.72:6813/2180866263","state":["exists","up"]},{"osd":4,"uuid":"8d138128-4829-4109-87a1-25f339f3e953","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"99a4a914-0a0e-4d25-94ae-3e86b8b1aa4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":977576181},{"type":"v1","addr":"172.21.15.110:6825","nonce":977576181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":977576181},{"type":"v1","addr":"172.21.15.110:6827","nonce":977576181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":977576181},{"type":"v1","addr":"172.21.15.110:6831","nonce":977576181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":977576181},{"type":"v1","addr":"172.21.15.110:6829","nonce":977576181}]},"public_addr":"172.21.15.110:6825/977576181","cluster_addr":"172.21.15.110:6827/977576181","heartbeat_back_addr":"172.21.15.110:6831/977576181","heartbeat_front_addr":"172.21.15.110:6829/977576181","state":["exists","up"]},{"osd":6,"uuid":"6e04b295-afc9-4f80-80f7-3df1f5168608","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"835de5c9-1e2c-41d8-bd28-d7ffe5ad8fdc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:08.516367+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.518775+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T05:53:10.729 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.735+0000 7f89ae6ab640 1 -- 172.21.15.72:0/3612704661 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f899406f370 msgr2=0x7f8994071880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:10.729 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.735+0000 7f89ae6ab640 1 --2- 172.21.15.72:0/3612704661 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f899406f370 0x7f8994071880 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f899800a850 tx=0x7f8998008040 comp rx=0 tx=0).stop 2024-05-09T05:53:10.729 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.735+0000 7f89ae6ab640 1 -- 172.21.15.72:0/3612704661 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89a815d180 msgr2=0x7f89a8154be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:10.729 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.735+0000 7f89ae6ab640 1 --2- 172.21.15.72:0/3612704661 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89a815d180 0x7f89a8154be0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f89a001d290 tx=0x7f89a0019790 comp rx=0 tx=0).stop 2024-05-09T05:53:10.729 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.735+0000 7f89ae6ab640 1 -- 172.21.15.72:0/3612704661 shutdown_connections 2024-05-09T05:53:10.730 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.735+0000 7f89ae6ab640 1 --2- 172.21.15.72:0/3612704661 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f899406f370 0x7f8994071880 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:10.730 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.735+0000 7f89ae6ab640 1 --2- 172.21.15.72:0/3612704661 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89a815d180 0x7f89a8154be0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:10.730 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.735+0000 7f89ae6ab640 1 --2- 172.21.15.72:0/3612704661 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89a8156af0 0x7f89a8166aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:10.730 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.735+0000 7f89ae6ab640 1 --2- 172.21.15.72:0/3612704661 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89a80cd230 0x7f89a8161ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:10.730 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.735+0000 7f89ae6ab640 1 -- 172.21.15.72:0/3612704661 >> 172.21.15.72:0/3612704661 conn(0x7f89a806e7e0 msgr2=0x7f89a815f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:10.730 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.735+0000 7f89ae6ab640 1 -- 172.21.15.72:0/3612704661 shutdown_connections 2024-05-09T05:53:10.730 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:10.735+0000 7f89ae6ab640 1 -- 172.21.15.72:0/3612704661 wait complete. 2024-05-09T05:53:10.746 DEBUG:teuthology.misc:2 of 8 OSDs are up 2024-05-09T05:53:17.553 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-09T05:53:17.706 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.715+0000 7f2f9a117640 1 Processor -- start 2024-05-09T05:53:17.706 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.715+0000 7f2f9a117640 1 -- start start 2024-05-09T05:53:17.709 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.715+0000 7f2f9a117640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2f9406f750 0x7f2f941569d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:17.709 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.715+0000 7f2f9a117640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f9415c710 0x7f2f9415cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:17.709 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.715+0000 7f2f9a117640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f940c9500 con 0x7f2f940c3b90 2024-05-09T05:53:17.709 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.715+0000 7f2f9a117640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f2f940c8cb0 con 0x7f2f9406f750 2024-05-09T05:53:17.709 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.715+0000 7f2f9a117640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f2f940c3fa0 con 0x7f2f9415c710 2024-05-09T05:53:17.709 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.715+0000 7f2f92ffd640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2f9406f750 0x7f2f941569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:17.709 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.715+0000 7f2f92ffd640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2f9406f750 0x7f2f941569d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60142/0 (socket says 172.21.15.72:60142) 2024-05-09T05:53:17.709 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.715+0000 7f2f92ffd640 1 -- 172.21.15.72:0/2932142677 learned_addr learned my addr 172.21.15.72:0/2932142677 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:17.709 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.715+0000 7f2f93fff640 1 --2- 172.21.15.72:0/2932142677 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f9415c710 0x7f2f9415cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:17.709 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.715+0000 7f2f92ffd640 1 -- 172.21.15.72:0/2932142677 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f9415c710 msgr2=0x7f2f9415cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:17.710 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.715+0000 7f2f92ffd640 1 --2- 172.21.15.72:0/2932142677 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f9415c710 0x7f2f9415cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:17.710 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.715+0000 7f2f92ffd640 1 -- 172.21.15.72:0/2932142677 >> v1:172.21.15.110:6789/0 conn(0x7f2f940c3b90 legacy=0x7f2f9406f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:17.710 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.715+0000 7f2f92ffd640 1 -- 172.21.15.72:0/2932142677 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f940c97e0 con 0x7f2f9406f750 2024-05-09T05:53:17.711 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.719+0000 7f2f92ffd640 1 --2- 172.21.15.72:0/2932142677 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f9406f750 0x7f2f941569d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2f88009870 tx=0x7f2f8801ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=784341a22e08e414 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:17.711 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.719+0000 7f2f927fc640 1 -- 172.21.15.72:0/2932142677 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f880b5070 con 0x7f2f9406f750 2024-05-09T05:53:17.711 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.719+0000 7f2f927fc640 1 -- 172.21.15.72:0/2932142677 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f880a8a50 con 0x7f2f9406f750 2024-05-09T05:53:17.711 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.719+0000 7f2f927fc640 1 -- 172.21.15.72:0/2932142677 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f880a8e20 con 0x7f2f9406f750 2024-05-09T05:53:17.712 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.719+0000 7f2f9a117640 1 -- 172.21.15.72:0/2932142677 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f9406f750 msgr2=0x7f2f941569d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:17.712 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.719+0000 7f2f9a117640 1 --2- 172.21.15.72:0/2932142677 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f9406f750 0x7f2f941569d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2f88009870 tx=0x7f2f8801ed50 comp rx=0 tx=0).stop 2024-05-09T05:53:17.712 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.719+0000 7f2f9a117640 1 -- 172.21.15.72:0/2932142677 shutdown_connections 2024-05-09T05:53:17.712 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.719+0000 7f2f9a117640 1 --2- 172.21.15.72:0/2932142677 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f9415c710 0x7f2f9415cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:17.712 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.719+0000 7f2f9a117640 1 --2- 172.21.15.72:0/2932142677 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f9406f750 0x7f2f941569d0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:17.712 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.719+0000 7f2f9a117640 1 -- 172.21.15.72:0/2932142677 >> 172.21.15.72:0/2932142677 conn(0x7f2f940cb260 msgr2=0x7f2f9406c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:17.712 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.719+0000 7f2f9a117640 1 -- 172.21.15.72:0/2932142677 shutdown_connections 2024-05-09T05:53:17.713 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.719+0000 7f2f9a117640 1 -- 172.21.15.72:0/2932142677 wait complete. 2024-05-09T05:53:17.714 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.723+0000 7f2f9a117640 1 Processor -- start 2024-05-09T05:53:17.714 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.723+0000 7f2f9a117640 1 -- start start 2024-05-09T05:53:17.716 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.723+0000 7f2f9a117640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f9406f750 0x7f2f941e3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:17.716 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.723+0000 7f2f9a117640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f940c3b90 0x7f2f941556a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:17.716 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.723+0000 7f2f9a117640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f9415c710 0x7f2f940c5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:17.717 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.723+0000 7f2f9a117640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f2f9406e840 con 0x7f2f940c3b90 2024-05-09T05:53:17.717 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.723+0000 7f2f9a117640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f2f9406ebb0 con 0x7f2f9415c710 2024-05-09T05:53:17.717 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.723+0000 7f2f9a117640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f2f9415d060 con 0x7f2f9406f750 2024-05-09T05:53:17.717 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.723+0000 7f2f92ffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f940c3b90 0x7f2f941556a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:17.717 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.723+0000 7f2f92ffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f940c3b90 0x7f2f941556a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60152/0 (socket says 172.21.15.72:60152) 2024-05-09T05:53:17.717 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.723+0000 7f2f92ffd640 1 -- 172.21.15.72:0/4100783841 learned_addr learned my addr 172.21.15.72:0/4100783841 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:17.717 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.723+0000 7f2f937fe640 1 --2- 172.21.15.72:0/4100783841 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f9406f750 0x7f2f941e3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:17.717 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.723+0000 7f2f93fff640 1 --2- 172.21.15.72:0/4100783841 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f9415c710 0x7f2f940c5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:17.717 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.723+0000 7f2f92ffd640 1 -- 172.21.15.72:0/4100783841 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f9406f750 msgr2=0x7f2f941e3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:17.717 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.723+0000 7f2f92ffd640 1 --2- 172.21.15.72:0/4100783841 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f9406f750 0x7f2f941e3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:17.717 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.723+0000 7f2f92ffd640 1 -- 172.21.15.72:0/4100783841 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f9415c710 msgr2=0x7f2f940c5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:17.717 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.723+0000 7f2f92ffd640 1 --2- 172.21.15.72:0/4100783841 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f9415c710 0x7f2f940c5c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:17.717 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.723+0000 7f2f92ffd640 1 -- 172.21.15.72:0/4100783841 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f941e4440 con 0x7f2f940c3b90 2024-05-09T05:53:17.717 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.723+0000 7f2f92ffd640 1 --2- 172.21.15.72:0/4100783841 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f940c3b90 0x7f2f941556a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2f880b3040 tx=0x7f2f8801baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:17.718 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.723+0000 7f2f7bfff640 1 -- 172.21.15.72:0/4100783841 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f880c0070 con 0x7f2f940c3b90 2024-05-09T05:53:17.718 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.723+0000 7f2f7bfff640 1 -- 172.21.15.72:0/4100783841 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f880ae550 con 0x7f2f940c3b90 2024-05-09T05:53:17.718 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.723+0000 7f2f9a117640 1 -- 172.21.15.72:0/4100783841 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f941f3cb0 con 0x7f2f940c3b90 2024-05-09T05:53:17.718 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.723+0000 7f2f7bfff640 1 -- 172.21.15.72:0/4100783841 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f880b5070 con 0x7f2f940c3b90 2024-05-09T05:53:17.718 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.723+0000 7f2f9a117640 1 -- 172.21.15.72:0/4100783841 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f941e5490 con 0x7f2f940c3b90 2024-05-09T05:53:17.718 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.723+0000 7f2f9a117640 1 -- 172.21.15.72:0/4100783841 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f9406a520 con 0x7f2f940c3b90 2024-05-09T05:53:17.718 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.727+0000 7f2f7bfff640 1 -- 172.21.15.72:0/4100783841 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f2f880c3070 con 0x7f2f940c3b90 2024-05-09T05:53:17.719 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.727+0000 7f2f7bfff640 1 --2- 172.21.15.72:0/4100783841 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f2f8006f430 0x7f2f80071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:17.719 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.727+0000 7f2f7bfff640 1 -- 172.21.15.72:0/4100783841 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f2f8812c8b0 con 0x7f2f940c3b90 2024-05-09T05:53:17.719 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.727+0000 7f2f937fe640 1 --2- 172.21.15.72:0/4100783841 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f2f8006f430 0x7f2f80071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:17.720 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.727+0000 7f2f937fe640 1 --2- 172.21.15.72:0/4100783841 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f2f8006f430 0x7f2f80071940 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2f84001650 tx=0x7f2f84009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:17.723 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.731+0000 7f2f7bfff640 1 -- 172.21.15.72:0/4100783841 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f2f880188b0 con 0x7f2f940c3b90 2024-05-09T05:53:17.878 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.887+0000 7f2f9a117640 1 -- 172.21.15.72:0/4100783841 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2f94155ff0 con 0x7f2f940c3b90 2024-05-09T05:53:17.879 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.887+0000 7f2f7bfff640 1 -- 172.21.15.72:0/4100783841 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12860 (secure 0 0 0) 0x7f2f880f9bf0 con 0x7f2f940c3b90 2024-05-09T05:53:17.880 INFO:teuthology.misc.health.smithi072.stdout: 2024-05-09T05:53:17.880 INFO:teuthology.misc.health.smithi072.stdout:{"epoch":17,"fsid":"44c88cb9-b39b-4787-a871-80ddf0ad6292","created":"2024-05-09T05:52:59.591187+0000","modified":"2024-05-09T05:53:12.910964+0000","last_up_change":"2024-05-09T05:53:10.902489+0000","last_in_change":"2024-05-09T05:53:02.200254+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T05:53:10.503537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e4af2aa1-ba5c-4411-a72a-a0e38e589a74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":331913921},{"type":"v1","addr":"172.21.15.72:6817","nonce":331913921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":331913921},{"type":"v1","addr":"172.21.15.72:6819","nonce":331913921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":331913921},{"type":"v1","addr":"172.21.15.72:6823","nonce":331913921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":331913921},{"type":"v1","addr":"172.21.15.72:6821","nonce":331913921}]},"public_addr":"172.21.15.72:6817/331913921","cluster_addr":"172.21.15.72:6819/331913921","heartbeat_back_addr":"172.21.15.72:6823/331913921","heartbeat_front_addr":"172.21.15.72:6821/331913921","state":["exists","up"]},{"osd":1,"uuid":"052504f5-a523-4922-bdc7-ce2890faa5ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2197151836},{"type":"v1","addr":"172.21.15.72:6801","nonce":2197151836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2197151836},{"type":"v1","addr":"172.21.15.72:6803","nonce":2197151836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2197151836},{"type":"v1","addr":"172.21.15.72:6811","nonce":2197151836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2197151836},{"type":"v1","addr":"172.21.15.72:6807","nonce":2197151836}]},"public_addr":"172.21.15.72:6801/2197151836","cluster_addr":"172.21.15.72:6803/2197151836","heartbeat_back_addr":"172.21.15.72:6811/2197151836","heartbeat_front_addr":"172.21.15.72:6807/2197151836","state":["exists","up"]},{"osd":2,"uuid":"28bc1c95-6d0d-4263-baad-314d86e6a670","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1273581990},{"type":"v1","addr":"172.21.15.72:6825","nonce":1273581990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":1273581990},{"type":"v1","addr":"172.21.15.72:6827","nonce":1273581990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1273581990},{"type":"v1","addr":"172.21.15.72:6831","nonce":1273581990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1273581990},{"type":"v1","addr":"172.21.15.72:6829","nonce":1273581990}]},"public_addr":"172.21.15.72:6825/1273581990","cluster_addr":"172.21.15.72:6827/1273581990","heartbeat_back_addr":"172.21.15.72:6831/1273581990","heartbeat_front_addr":"172.21.15.72:6829/1273581990","state":["exists","up"]},{"osd":3,"uuid":"edcc86cb-f178-4533-8069-de9d781531ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2180866263},{"type":"v1","addr":"172.21.15.72:6806","nonce":2180866263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2180866263},{"type":"v1","addr":"172.21.15.72:6810","nonce":2180866263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2180866263},{"type":"v1","addr":"172.21.15.72:6815","nonce":2180866263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2180866263},{"type":"v1","addr":"172.21.15.72:6813","nonce":2180866263}]},"public_addr":"172.21.15.72:6806/2180866263","cluster_addr":"172.21.15.72:6810/2180866263","heartbeat_back_addr":"172.21.15.72:6815/2180866263","heartbeat_front_addr":"172.21.15.72:6813/2180866263","state":["exists","up"]},{"osd":4,"uuid":"8d138128-4829-4109-87a1-25f339f3e953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3437318248},{"type":"v1","addr":"172.21.15.110:6817","nonce":3437318248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3437318248},{"type":"v1","addr":"172.21.15.110:6819","nonce":3437318248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3437318248},{"type":"v1","addr":"172.21.15.110:6823","nonce":3437318248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3437318248},{"type":"v1","addr":"172.21.15.110:6821","nonce":3437318248}]},"public_addr":"172.21.15.110:6817/3437318248","cluster_addr":"172.21.15.110:6819/3437318248","heartbeat_back_addr":"172.21.15.110:6823/3437318248","heartbeat_front_addr":"172.21.15.110:6821/3437318248","state":["exists","up"]},{"osd":5,"uuid":"99a4a914-0a0e-4d25-94ae-3e86b8b1aa4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":977576181},{"type":"v1","addr":"172.21.15.110:6825","nonce":977576181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":977576181},{"type":"v1","addr":"172.21.15.110:6827","nonce":977576181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":977576181},{"type":"v1","addr":"172.21.15.110:6831","nonce":977576181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":977576181},{"type":"v1","addr":"172.21.15.110:6829","nonce":977576181}]},"public_addr":"172.21.15.110:6825/977576181","cluster_addr":"172.21.15.110:6827/977576181","heartbeat_back_addr":"172.21.15.110:6831/977576181","heartbeat_front_addr":"172.21.15.110:6829/977576181","state":["exists","up"]},{"osd":6,"uuid":"6e04b295-afc9-4f80-80f7-3df1f5168608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":1817638786},{"type":"v1","addr":"172.21.15.110:6809","nonce":1817638786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":1817638786},{"type":"v1","addr":"172.21.15.110:6811","nonce":1817638786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":1817638786},{"type":"v1","addr":"172.21.15.110:6815","nonce":1817638786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":1817638786},{"type":"v1","addr":"172.21.15.110:6813","nonce":1817638786}]},"public_addr":"172.21.15.110:6809/1817638786","cluster_addr":"172.21.15.110:6811/1817638786","heartbeat_back_addr":"172.21.15.110:6815/1817638786","heartbeat_front_addr":"172.21.15.110:6813/1817638786","state":["exists","up"]},{"osd":7,"uuid":"835de5c9-1e2c-41d8-bd28-d7ffe5ad8fdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":214675920},{"type":"v1","addr":"172.21.15.110:6801","nonce":214675920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":214675920},{"type":"v1","addr":"172.21.15.110:6803","nonce":214675920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":214675920},{"type":"v1","addr":"172.21.15.110:6807","nonce":214675920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":214675920},{"type":"v1","addr":"172.21.15.110:6805","nonce":214675920}]},"public_addr":"172.21.15.110:6801/214675920","cluster_addr":"172.21.15.110:6803/214675920","heartbeat_back_addr":"172.21.15.110:6807/214675920","heartbeat_front_addr":"172.21.15.110:6805/214675920","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.849761+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.670554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.743789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:08.516367+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.665550+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.518775+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.786468+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.794984+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T05:53:17.882 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.887+0000 7f2f9a117640 1 -- 172.21.15.72:0/4100783841 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f2f8006f430 msgr2=0x7f2f80071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:17.882 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.887+0000 7f2f9a117640 1 --2- 172.21.15.72:0/4100783841 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f2f8006f430 0x7f2f80071940 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2f84001650 tx=0x7f2f84009040 comp rx=0 tx=0).stop 2024-05-09T05:53:17.882 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.887+0000 7f2f9a117640 1 -- 172.21.15.72:0/4100783841 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f940c3b90 msgr2=0x7f2f941556a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:17.882 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.887+0000 7f2f9a117640 1 --2- 172.21.15.72:0/4100783841 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f940c3b90 0x7f2f941556a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2f880b3040 tx=0x7f2f8801baf0 comp rx=0 tx=0).stop 2024-05-09T05:53:17.882 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.891+0000 7f2f9a117640 1 -- 172.21.15.72:0/4100783841 shutdown_connections 2024-05-09T05:53:17.882 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.891+0000 7f2f9a117640 1 --2- 172.21.15.72:0/4100783841 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f2f8006f430 0x7f2f80071940 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:17.882 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.891+0000 7f2f9a117640 1 --2- 172.21.15.72:0/4100783841 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f9415c710 0x7f2f940c5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:17.883 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.891+0000 7f2f9a117640 1 --2- 172.21.15.72:0/4100783841 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f940c3b90 0x7f2f941556a0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:17.883 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.891+0000 7f2f9a117640 1 --2- 172.21.15.72:0/4100783841 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f9406f750 0x7f2f941e3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:17.883 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.891+0000 7f2f9a117640 1 -- 172.21.15.72:0/4100783841 >> 172.21.15.72:0/4100783841 conn(0x7f2f940cb260 msgr2=0x7f2f941527a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:17.883 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.891+0000 7f2f9a117640 1 -- 172.21.15.72:0/4100783841 shutdown_connections 2024-05-09T05:53:17.883 INFO:teuthology.misc.health.smithi072.stderr:2024-05-09T05:53:17.891+0000 7f2f9a117640 1 -- 172.21.15.72:0/4100783841 wait complete. 2024-05-09T05:53:17.898 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-05-09T05:53:17.898 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-05-09T05:53:17.898 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-09T05:53:17.898 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-09T05:53:17.901 INFO:tasks.ceph.mds.a:Started 2024-05-09T05:53:17.901 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-09T05:53:17.901 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-09T05:53:17.903 INFO:tasks.ceph.mds.c:Started 2024-05-09T05:53:17.903 INFO:tasks.ceph.mds.e:Restarting daemon 2024-05-09T05:53:17.904 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2024-05-09T05:53:17.905 INFO:tasks.ceph.mds.e:Started 2024-05-09T05:53:17.905 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-09T05:53:17.905 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-09T05:53:17.908 INFO:tasks.ceph.mds.b:Started 2024-05-09T05:53:17.908 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-09T05:53:17.908 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-09T05:53:17.911 INFO:tasks.ceph.mds.d:Started 2024-05-09T05:53:17.911 INFO:tasks.ceph.mds.f:Restarting daemon 2024-05-09T05:53:17.911 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i f 2024-05-09T05:53:17.913 INFO:tasks.ceph.mds.f:Started 2024-05-09T05:53:17.913 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-05-09T05:53:17.914 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:53:18.003 INFO:tasks.ceph.mds.a.smithi072.stdout:starting mds.a at 2024-05-09T05:53:18.004 INFO:tasks.ceph.mds.e.smithi072.stdout:starting mds.e at 2024-05-09T05:53:18.027 INFO:tasks.ceph.mds.c.smithi072.stdout:starting mds.c at 2024-05-09T05:53:18.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.083+0000 7fd904555640 1 Processor -- start 2024-05-09T05:53:18.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.083+0000 7fd904555640 1 -- start start 2024-05-09T05:53:18.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.083+0000 7fd904555640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd8fc15c820 0x7fd8fc073450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:18.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.083+0000 7fd904555640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd8fc073990 0x7fd8fc1670c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:18.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.083+0000 7fd904555640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8fc0c92c0 con 0x7fd8fc156b50 2024-05-09T05:53:18.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.083+0000 7fd904555640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fd8fc15d7e0 con 0x7fd8fc15c820 2024-05-09T05:53:18.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.083+0000 7fd904555640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fd8fc156f60 con 0x7fd8fc073990 2024-05-09T05:53:18.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.083+0000 7fd9022f1640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fd8fc156b50 0x7fd8fc074bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41546/0 (socket says 172.21.15.72:41546) 2024-05-09T05:53:18.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.083+0000 7fd9022f1640 1 -- 172.21.15.72:0/3465652796 learned_addr learned my addr 172.21.15.72:0/3465652796 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:53:18.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.087+0000 7fd901af0640 1 --2- 172.21.15.72:0/3465652796 >> v2:172.21.15.110:3300/0 conn(0x7fd8fc15c820 0x7fd8fc073450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:18.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.087+0000 7fd902af2640 1 --2- 172.21.15.72:0/3465652796 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd8fc073990 0x7fd8fc1670c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:18.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.087+0000 7fd9012ef640 1 -- 172.21.15.72:0/3465652796 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1676255195 0 0) 0x7fd8fc0c92c0 con 0x7fd8fc156b50 2024-05-09T05:53:18.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.087+0000 7fd9012ef640 1 -- 172.21.15.72:0/3465652796 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd8e8003530 con 0x7fd8fc156b50 2024-05-09T05:53:18.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.087+0000 7fd9012ef640 1 -- 172.21.15.72:0/3465652796 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 540441459 0 0) 0x7fd8e8003530 con 0x7fd8fc156b50 2024-05-09T05:53:18.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.087+0000 7fd9012ef640 1 -- 172.21.15.72:0/3465652796 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd8fc073990 msgr2=0x7fd8fc1670c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:18.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.087+0000 7fd9012ef640 1 --2- 172.21.15.72:0/3465652796 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd8fc073990 0x7fd8fc1670c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:18.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.087+0000 7fd9012ef640 1 -- 172.21.15.72:0/3465652796 >> v2:172.21.15.110:3300/0 conn(0x7fd8fc15c820 msgr2=0x7fd8fc073450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:18.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.087+0000 7fd9012ef640 1 --2- 172.21.15.72:0/3465652796 >> v2:172.21.15.110:3300/0 conn(0x7fd8fc15c820 0x7fd8fc073450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:18.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.087+0000 7fd9012ef640 1 -- 172.21.15.72:0/3465652796 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8fc15cf40 con 0x7fd8fc156b50 2024-05-09T05:53:18.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.087+0000 7fd9012ef640 1 -- 172.21.15.72:0/3465652796 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2749052815 0 0) 0x7fd8f4001700 con 0x7fd8fc156b50 2024-05-09T05:53:18.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.087+0000 7fd9012ef640 1 -- 172.21.15.72:0/3465652796 >> v1:172.21.15.72:6789/0 conn(0x7fd8fc156b50 legacy=0x7fd8fc074bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:18.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.087+0000 7fd9012ef640 1 --2- 172.21.15.72:0/3465652796 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8e8003a10 0x7fd8e8003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:18.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.087+0000 7fd9012ef640 1 --2- 172.21.15.72:0/3465652796 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8e8004810 0x7fd8e8004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:18.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.087+0000 7fd9012ef640 1 --2- 172.21.15.72:0/3465652796 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd8fc073990 0x7fd8e8005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:18.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.087+0000 7fd9012ef640 1 -- 172.21.15.72:0/3465652796 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fd8fc15d7e0 con 0x7fd8e8004810 2024-05-09T05:53:18.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.087+0000 7fd9012ef640 1 -- 172.21.15.72:0/3465652796 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fd8fc156f60 con 0x7fd8e8003a10 2024-05-09T05:53:18.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.087+0000 7fd9012ef640 1 -- 172.21.15.72:0/3465652796 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fd8e800bb00 con 0x7fd8fc073990 2024-05-09T05:53:18.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.087+0000 7fd901af0640 1 --2- 172.21.15.72:0/3465652796 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8e8004810 0x7fd8e8004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:18.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.087+0000 7fd9022f1640 1 --2- 172.21.15.72:0/3465652796 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8e8003a10 0x7fd8e8003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:18.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.087+0000 7fd902af2640 1 --2- 172.21.15.72:0/3465652796 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd8fc073990 0x7fd8e8005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:18.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.087+0000 7fd901af0640 1 -- 172.21.15.72:0/3465652796 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd8fc073990 msgr2=0x7fd8e8005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:18.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.087+0000 7fd901af0640 1 --2- 172.21.15.72:0/3465652796 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd8fc073990 0x7fd8e8005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:18.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.087+0000 7fd901af0640 1 -- 172.21.15.72:0/3465652796 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8e8003a10 msgr2=0x7fd8e8003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:18.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.087+0000 7fd901af0640 1 --2- 172.21.15.72:0/3465652796 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8e8003a10 0x7fd8e8003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:18.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.087+0000 7fd901af0640 1 -- 172.21.15.72:0/3465652796 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8e8003530 con 0x7fd8e8004810 2024-05-09T05:53:18.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.087+0000 7fd901af0640 1 --2- 172.21.15.72:0/3465652796 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8e8004810 0x7fd8e8004c20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec009ab0 tx=0x7fd8ec01cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da7f1639311f49bc server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:18.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.087+0000 7fd9012ef640 1 -- 172.21.15.72:0/3465652796 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec0b2070 con 0x7fd8e8004810 2024-05-09T05:53:18.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.087+0000 7fd9012ef640 1 -- 172.21.15.72:0/3465652796 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8ec0a5720 con 0x7fd8e8004810 2024-05-09T05:53:18.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.087+0000 7fd9012ef640 1 -- 172.21.15.72:0/3465652796 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec0096b0 con 0x7fd8e8004810 2024-05-09T05:53:18.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.091+0000 7fd904555640 1 -- 172.21.15.72:0/3465652796 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8e8004810 msgr2=0x7fd8e8004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:18.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.091+0000 7fd904555640 1 --2- 172.21.15.72:0/3465652796 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8e8004810 0x7fd8e8004c20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec009ab0 tx=0x7fd8ec01cb20 comp rx=0 tx=0).stop 2024-05-09T05:53:18.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.091+0000 7fd902af2640 1 -- 172.21.15.72:0/3465652796 reap_dead start 2024-05-09T05:53:18.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.091+0000 7fd904555640 1 -- 172.21.15.72:0/3465652796 shutdown_connections 2024-05-09T05:53:18.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.091+0000 7fd904555640 1 -- 172.21.15.72:0/3465652796 >> 172.21.15.72:0/3465652796 conn(0x7fd8fc0cb3c0 msgr2=0x7fd8fc0cb7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:18.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.091+0000 7fd904555640 1 -- 172.21.15.72:0/3465652796 shutdown_connections 2024-05-09T05:53:18.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.091+0000 7fd904555640 1 -- 172.21.15.72:0/3465652796 wait complete. 2024-05-09T05:53:18.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.091+0000 7fd904555640 1 Processor -- start 2024-05-09T05:53:18.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.091+0000 7fd904555640 1 -- start start 2024-05-09T05:53:18.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.091+0000 7fd904555640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8e8004810 0x7fd8fc155570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:18.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.091+0000 7fd904555640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd8fc0ca770 0x7fd8fc1473d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:18.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.091+0000 7fd904555640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8fc147910 0x7fd8fc0c7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:18.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.091+0000 7fd904555640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fd8fc0743c0 con 0x7fd8e8004810 2024-05-09T05:53:18.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.091+0000 7fd904555640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fd8fc15d500 con 0x7fd8fc147910 2024-05-09T05:53:18.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.091+0000 7fd904555640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fd8fc0746a0 con 0x7fd8fc0ca770 2024-05-09T05:53:18.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.091+0000 7fd9022f1640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8e8004810 0x7fd8fc155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:18.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.091+0000 7fd9022f1640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8e8004810 0x7fd8fc155570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60206/0 (socket says 172.21.15.72:60206) 2024-05-09T05:53:18.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.091+0000 7fd9022f1640 1 -- 172.21.15.72:0/581714237 learned_addr learned my addr 172.21.15.72:0/581714237 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:18.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.091+0000 7fd901af0640 1 --2- 172.21.15.72:0/581714237 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd8fc0ca770 0x7fd8fc1473d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:18.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.091+0000 7fd902af2640 1 --2- 172.21.15.72:0/581714237 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8fc147910 0x7fd8fc0c7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:18.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.091+0000 7fd9022f1640 1 -- 172.21.15.72:0/581714237 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd8fc0ca770 msgr2=0x7fd8fc1473d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:18.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.091+0000 7fd9022f1640 1 --2- 172.21.15.72:0/581714237 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd8fc0ca770 0x7fd8fc1473d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:18.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.091+0000 7fd9022f1640 1 -- 172.21.15.72:0/581714237 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8fc147910 msgr2=0x7fd8fc0c7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:18.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.091+0000 7fd9022f1640 1 --2- 172.21.15.72:0/581714237 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8fc147910 0x7fd8fc0c7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:18.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.091+0000 7fd9022f1640 1 -- 172.21.15.72:0/581714237 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8fc155ab0 con 0x7fd8e8004810 2024-05-09T05:53:18.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.091+0000 7fd901af0640 1 --2- 172.21.15.72:0/581714237 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd8fc0ca770 0x7fd8fc1473d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:53:18.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.091+0000 7fd902af2640 1 --2- 172.21.15.72:0/581714237 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8fc147910 0x7fd8fc0c7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:53:18.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.091+0000 7fd9022f1640 1 --2- 172.21.15.72:0/581714237 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8e8004810 0x7fd8fc155570 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd8f400e7e0 tx=0x7fd8f400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:18.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.091+0000 7fd8f2ffd640 1 -- 172.21.15.72:0/581714237 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f400c870 con 0x7fd8e8004810 2024-05-09T05:53:18.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.095+0000 7fd8f2ffd640 1 -- 172.21.15.72:0/581714237 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8f4018070 con 0x7fd8e8004810 2024-05-09T05:53:18.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.095+0000 7fd904555640 1 -- 172.21.15.72:0/581714237 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8fc1f2e00 con 0x7fd8e8004810 2024-05-09T05:53:18.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.095+0000 7fd8f2ffd640 1 -- 172.21.15.72:0/581714237 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f400cc70 con 0x7fd8e8004810 2024-05-09T05:53:18.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.095+0000 7fd904555640 1 -- 172.21.15.72:0/581714237 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8fc1f33c0 con 0x7fd8e8004810 2024-05-09T05:53:18.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.095+0000 7fd904555640 1 -- 172.21.15.72:0/581714237 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8fc06a520 con 0x7fd8e8004810 2024-05-09T05:53:18.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.095+0000 7fd8f2ffd640 1 -- 172.21.15.72:0/581714237 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fd8f401d460 con 0x7fd8e8004810 2024-05-09T05:53:18.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.095+0000 7fd8f2ffd640 1 --2- 172.21.15.72:0/581714237 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fd8e006f400 0x7fd8e0071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:18.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.095+0000 7fd8f2ffd640 1 -- 172.21.15.72:0/581714237 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fd8f408edd0 con 0x7fd8e8004810 2024-05-09T05:53:18.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.095+0000 7fd901af0640 1 --2- 172.21.15.72:0/581714237 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fd8e006f400 0x7fd8e0071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:18.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.095+0000 7fd901af0640 1 --2- 172.21.15.72:0/581714237 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fd8e006f400 0x7fd8e0071910 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec009ab0 tx=0x7fd8ec0046d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:18.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.099+0000 7fd8f2ffd640 1 -- 172.21.15.72:0/581714237 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fd8f405c0a0 con 0x7fd8e8004810 2024-05-09T05:53:18.263 INFO:tasks.ceph.mds.f.smithi110.stdout:starting mds.f at 2024-05-09T05:53:18.263 INFO:tasks.ceph.mds.b.smithi110.stdout:starting mds.b at 2024-05-09T05:53:18.263 INFO:tasks.ceph.mds.d.smithi110.stdout:starting mds.d at 2024-05-09T05:53:18.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.287+0000 7fd904555640 1 -- 172.21.15.72:0/581714237 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd8fc1552d0 con 0x7fd8e8004810 2024-05-09T05:53:18.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.287+0000 7fd8f2ffd640 1 -- 172.21.15.72:0/581714237 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1392 (secure 0 0 0) 0x7fd8f4090090 con 0x7fd8e8004810 2024-05-09T05:53:18.280 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:53:18.280 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6834/1142956298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1142956298},{"type":"v1","addr":"172.21.15.72:6834","nonce":1142956298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-05-09T05:53:18.281 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 2 2024-05-09T05:53:18.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.291+0000 7fd904555640 1 -- 172.21.15.72:0/581714237 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fd8e006f400 msgr2=0x7fd8e0071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:18.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.291+0000 7fd904555640 1 --2- 172.21.15.72:0/581714237 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fd8e006f400 0x7fd8e0071910 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec009ab0 tx=0x7fd8ec0046d0 comp rx=0 tx=0).stop 2024-05-09T05:53:18.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.291+0000 7fd904555640 1 -- 172.21.15.72:0/581714237 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8e8004810 msgr2=0x7fd8fc155570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:18.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.291+0000 7fd904555640 1 --2- 172.21.15.72:0/581714237 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8e8004810 0x7fd8fc155570 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd8f400e7e0 tx=0x7fd8f400eca0 comp rx=0 tx=0).stop 2024-05-09T05:53:18.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.291+0000 7fd904555640 1 -- 172.21.15.72:0/581714237 shutdown_connections 2024-05-09T05:53:18.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.291+0000 7fd904555640 1 --2- 172.21.15.72:0/581714237 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fd8e006f400 0x7fd8e0071910 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:18.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.291+0000 7fd904555640 1 --2- 172.21.15.72:0/581714237 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8fc147910 0x7fd8fc0c7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:18.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.291+0000 7fd904555640 1 --2- 172.21.15.72:0/581714237 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd8fc0ca770 0x7fd8fc1473d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:18.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.291+0000 7fd904555640 1 --2- 172.21.15.72:0/581714237 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8e8004810 0x7fd8fc155570 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:18.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.291+0000 7fd904555640 1 -- 172.21.15.72:0/581714237 >> 172.21.15.72:0/581714237 conn(0x7fd8fc0cb3c0 msgr2=0x7fd8fc150290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:18.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.291+0000 7fd904555640 1 -- 172.21.15.72:0/581714237 shutdown_connections 2024-05-09T05:53:18.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:18.291+0000 7fd904555640 1 -- 172.21.15.72:0/581714237 wait complete. 2024-05-09T05:53:20.301 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:53:20.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.467+0000 7f2b652a3640 1 Processor -- start 2024-05-09T05:53:20.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.467+0000 7f2b652a3640 1 -- start start 2024-05-09T05:53:20.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.471+0000 7f2b652a3640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2b600c77a0 0x7f2b601537d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:20.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.471+0000 7f2b652a3640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2b60074740 0x7f2b60072e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:20.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.471+0000 7f2b652a3640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b600c72c0 con 0x7f2b600733b0 2024-05-09T05:53:20.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.471+0000 7f2b652a3640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f2b600c7bb0 con 0x7f2b60074740 2024-05-09T05:53:20.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.471+0000 7f2b652a3640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f2b60074460 con 0x7f2b600c77a0 2024-05-09T05:53:20.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.471+0000 7f2b5f7fe640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f2b600733b0 0x7f2b6015ca10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41552/0 (socket says 172.21.15.72:41552) 2024-05-09T05:53:20.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.471+0000 7f2b5f7fe640 1 -- 172.21.15.72:0/3069389738 learned_addr learned my addr 172.21.15.72:0/3069389738 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:53:20.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.471+0000 7f2b5effd640 1 --2- 172.21.15.72:0/3069389738 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2b600c77a0 0x7f2b601537d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:20.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.471+0000 7f2b5e7fc640 1 --2- 172.21.15.72:0/3069389738 >> v2:172.21.15.110:3300/0 conn(0x7f2b60074740 0x7f2b60072e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:20.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.471+0000 7f2b5dffb640 1 -- 172.21.15.72:0/3069389738 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2334559955 0 0) 0x7f2b600c72c0 con 0x7f2b600733b0 2024-05-09T05:53:20.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.471+0000 7f2b5dffb640 1 -- 172.21.15.72:0/3069389738 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b48003530 con 0x7f2b600733b0 2024-05-09T05:53:20.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.471+0000 7f2b5dffb640 1 -- 172.21.15.72:0/3069389738 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3206615671 0 0) 0x7f2b48003530 con 0x7f2b600733b0 2024-05-09T05:53:20.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.471+0000 7f2b5dffb640 1 -- 172.21.15.72:0/3069389738 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2b600c77a0 msgr2=0x7f2b601537d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:20.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.471+0000 7f2b5dffb640 1 --2- 172.21.15.72:0/3069389738 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2b600c77a0 0x7f2b601537d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:20.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.471+0000 7f2b5dffb640 1 -- 172.21.15.72:0/3069389738 >> v2:172.21.15.110:3300/0 conn(0x7f2b60074740 msgr2=0x7f2b60072e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:20.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.471+0000 7f2b5dffb640 1 --2- 172.21.15.72:0/3069389738 >> v2:172.21.15.110:3300/0 conn(0x7f2b60074740 0x7f2b60072e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:20.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.471+0000 7f2b5dffb640 1 -- 172.21.15.72:0/3069389738 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b60073af0 con 0x7f2b600733b0 2024-05-09T05:53:20.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.471+0000 7f2b5dffb640 1 -- 172.21.15.72:0/3069389738 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2749052815 0 0) 0x7f2b58001aa0 con 0x7f2b600733b0 2024-05-09T05:53:20.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.471+0000 7f2b5dffb640 1 -- 172.21.15.72:0/3069389738 >> v1:172.21.15.72:6789/0 conn(0x7f2b600733b0 legacy=0x7f2b6015ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:20.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.471+0000 7f2b5dffb640 1 --2- 172.21.15.72:0/3069389738 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b48003a10 0x7f2b48003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:20.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.471+0000 7f2b5dffb640 1 --2- 172.21.15.72:0/3069389738 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b48004810 0x7f2b48004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:20.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.471+0000 7f2b5dffb640 1 --2- 172.21.15.72:0/3069389738 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2b600c77a0 0x7f2b48005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:20.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.471+0000 7f2b5dffb640 1 -- 172.21.15.72:0/3069389738 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f2b600c7bb0 con 0x7f2b48004810 2024-05-09T05:53:20.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.471+0000 7f2b5dffb640 1 -- 172.21.15.72:0/3069389738 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f2b60074460 con 0x7f2b48003a10 2024-05-09T05:53:20.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.471+0000 7f2b5dffb640 1 -- 172.21.15.72:0/3069389738 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f2b4800ba80 con 0x7f2b600c77a0 2024-05-09T05:53:20.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.471+0000 7f2b5e7fc640 1 --2- 172.21.15.72:0/3069389738 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b48004810 0x7f2b48004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:20.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.471+0000 7f2b5f7fe640 1 --2- 172.21.15.72:0/3069389738 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2b600c77a0 0x7f2b48005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:20.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.471+0000 7f2b5e7fc640 1 -- 172.21.15.72:0/3069389738 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2b600c77a0 msgr2=0x7f2b48005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:20.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.471+0000 7f2b5e7fc640 1 --2- 172.21.15.72:0/3069389738 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2b600c77a0 0x7f2b48005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:20.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.471+0000 7f2b5e7fc640 1 -- 172.21.15.72:0/3069389738 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b48003a10 msgr2=0x7f2b48003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:20.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.471+0000 7f2b5e7fc640 1 --2- 172.21.15.72:0/3069389738 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b48003a10 0x7f2b48003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:20.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.471+0000 7f2b5e7fc640 1 -- 172.21.15.72:0/3069389738 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b48003530 con 0x7f2b48004810 2024-05-09T05:53:20.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.475+0000 7f2b5e7fc640 1 --2- 172.21.15.72:0/3069389738 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b48004810 0x7f2b48004c20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2b600ce620 tx=0x7f2b5401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9134515fbec8552 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:20.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.475+0000 7f2b5dffb640 1 -- 172.21.15.72:0/3069389738 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b540b2070 con 0x7f2b48004810 2024-05-09T05:53:20.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.475+0000 7f2b5dffb640 1 -- 172.21.15.72:0/3069389738 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b540a5510 con 0x7f2b48004810 2024-05-09T05:53:20.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.475+0000 7f2b5dffb640 1 -- 172.21.15.72:0/3069389738 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b540096b0 con 0x7f2b48004810 2024-05-09T05:53:20.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.475+0000 7f2b652a3640 1 -- 172.21.15.72:0/3069389738 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b48004810 msgr2=0x7f2b48004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:20.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.475+0000 7f2b652a3640 1 --2- 172.21.15.72:0/3069389738 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b48004810 0x7f2b48004c20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2b600ce620 tx=0x7f2b5401ca30 comp rx=0 tx=0).stop 2024-05-09T05:53:20.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.475+0000 7f2b5f7fe640 1 -- 172.21.15.72:0/3069389738 reap_dead start 2024-05-09T05:53:20.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.475+0000 7f2b652a3640 1 -- 172.21.15.72:0/3069389738 shutdown_connections 2024-05-09T05:53:20.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.475+0000 7f2b652a3640 1 -- 172.21.15.72:0/3069389738 >> 172.21.15.72:0/3069389738 conn(0x7f2b600cde90 msgr2=0x7f2b600ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:20.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.475+0000 7f2b652a3640 1 -- 172.21.15.72:0/3069389738 shutdown_connections 2024-05-09T05:53:20.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.475+0000 7f2b652a3640 1 -- 172.21.15.72:0/3069389738 wait complete. 2024-05-09T05:53:20.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.479+0000 7f2b652a3640 1 Processor -- start 2024-05-09T05:53:20.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.479+0000 7f2b652a3640 1 -- start start 2024-05-09T05:53:20.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.479+0000 7f2b652a3640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2b48004810 0x7f2b6013e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:20.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.479+0000 7f2b652a3640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b6013db70 0x7f2b60140920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:20.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.479+0000 7f2b652a3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b601f6490 0x7f2b60148c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:20.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.479+0000 7f2b652a3640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f2b60074b50 con 0x7f2b6013db70 2024-05-09T05:53:20.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.479+0000 7f2b652a3640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f2b600740b0 con 0x7f2b601f6490 2024-05-09T05:53:20.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.479+0000 7f2b652a3640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f2b60072940 con 0x7f2b48004810 2024-05-09T05:53:20.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.479+0000 7f2b5e7fc640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b6013db70 0x7f2b60140920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:20.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.479+0000 7f2b5e7fc640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b6013db70 0x7f2b60140920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60232/0 (socket says 172.21.15.72:60232) 2024-05-09T05:53:20.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.479+0000 7f2b5e7fc640 1 -- 172.21.15.72:0/3557956625 learned_addr learned my addr 172.21.15.72:0/3557956625 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:20.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.479+0000 7f2b5f7fe640 1 --2- 172.21.15.72:0/3557956625 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b601f6490 0x7f2b60148c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:20.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.479+0000 7f2b5effd640 1 --2- 172.21.15.72:0/3557956625 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2b48004810 0x7f2b6013e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:20.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.479+0000 7f2b5e7fc640 1 -- 172.21.15.72:0/3557956625 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2b48004810 msgr2=0x7f2b6013e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:20.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.479+0000 7f2b5e7fc640 1 --2- 172.21.15.72:0/3557956625 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2b48004810 0x7f2b6013e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:20.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.479+0000 7f2b5e7fc640 1 -- 172.21.15.72:0/3557956625 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b601f6490 msgr2=0x7f2b60148c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:20.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.479+0000 7f2b5e7fc640 1 --2- 172.21.15.72:0/3557956625 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b601f6490 0x7f2b60148c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:20.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.479+0000 7f2b5e7fc640 1 -- 172.21.15.72:0/3557956625 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b6013df80 con 0x7f2b6013db70 2024-05-09T05:53:20.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.479+0000 7f2b5f7fe640 1 --2- 172.21.15.72:0/3557956625 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b601f6490 0x7f2b60148c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:53:20.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.479+0000 7f2b5effd640 1 --2- 172.21.15.72:0/3557956625 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2b48004810 0x7f2b6013e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:53:20.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.479+0000 7f2b5e7fc640 1 --2- 172.21.15.72:0/3557956625 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b6013db70 0x7f2b60140920 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2b540b0040 tx=0x7f2b48005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:20.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.479+0000 7f2b477fe640 1 -- 172.21.15.72:0/3557956625 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b540be070 con 0x7f2b6013db70 2024-05-09T05:53:20.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.479+0000 7f2b477fe640 1 -- 172.21.15.72:0/3557956625 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b540ad440 con 0x7f2b6013db70 2024-05-09T05:53:20.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.479+0000 7f2b652a3640 1 -- 172.21.15.72:0/3557956625 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b60144090 con 0x7f2b6013db70 2024-05-09T05:53:20.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.479+0000 7f2b477fe640 1 -- 172.21.15.72:0/3557956625 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b540b2040 con 0x7f2b6013db70 2024-05-09T05:53:20.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.479+0000 7f2b652a3640 1 -- 172.21.15.72:0/3557956625 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b60144350 con 0x7f2b6013db70 2024-05-09T05:53:20.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.479+0000 7f2b652a3640 1 -- 172.21.15.72:0/3557956625 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b6006a520 con 0x7f2b6013db70 2024-05-09T05:53:20.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.479+0000 7f2b477fe640 1 -- 172.21.15.72:0/3557956625 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f2b540c1070 con 0x7f2b6013db70 2024-05-09T05:53:20.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.483+0000 7f2b477fe640 1 --2- 172.21.15.72:0/3557956625 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f2b4c06f430 0x7f2b4c071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:20.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.483+0000 7f2b477fe640 1 -- 172.21.15.72:0/3557956625 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f2b54128c20 con 0x7f2b6013db70 2024-05-09T05:53:20.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.483+0000 7f2b5effd640 1 --2- 172.21.15.72:0/3557956625 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f2b4c06f430 0x7f2b4c071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:20.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.483+0000 7f2b5effd640 1 --2- 172.21.15.72:0/3557956625 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f2b4c06f430 0x7f2b4c071940 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2b50009160 tx=0x7f2b50008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:20.478 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.487+0000 7f2b477fe640 1 -- 172.21.15.72:0/3557956625 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f2b6013df80 con 0x7f2b6013db70 2024-05-09T05:53:20.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.683+0000 7f2b652a3640 1 -- 172.21.15.72:0/3557956625 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2b60072c50 con 0x7f2b6013db70 2024-05-09T05:53:20.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.683+0000 7f2b477fe640 1 -- 172.21.15.72:0/3557956625 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+5515 (secure 0 0 0) 0x7f2b54016740 con 0x7f2b6013db70 2024-05-09T05:53:20.675 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:53:20.675 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6834/1142956298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1142956298},{"type":"v1","addr":"172.21.15.72:6834","nonce":1142956298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/3946563056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":3946563056},{"type":"v1","addr":"172.21.15.72:6835","nonce":3946563056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4259,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6838/840351907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":840351907},{"type":"v1","addr":"172.21.15.110:6838","nonce":840351907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/1048256382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":1048256382},{"type":"v1","addr":"172.21.15.72:6837","nonce":1048256382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4287,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6839/966325499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6837","nonce":966325499},{"type":"v1","addr":"172.21.15.110:6839","nonce":966325499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4297,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/4134424941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":4134424941},{"type":"v1","addr":"172.21.15.110:6836","nonce":4134424941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-05-09T05:53:20.675 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 3 2024-05-09T05:53:20.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.683+0000 7f2b652a3640 1 -- 172.21.15.72:0/3557956625 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f2b4c06f430 msgr2=0x7f2b4c071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:20.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.683+0000 7f2b652a3640 1 --2- 172.21.15.72:0/3557956625 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f2b4c06f430 0x7f2b4c071940 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2b50009160 tx=0x7f2b50008040 comp rx=0 tx=0).stop 2024-05-09T05:53:20.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.683+0000 7f2b652a3640 1 -- 172.21.15.72:0/3557956625 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b6013db70 msgr2=0x7f2b60140920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:20.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.683+0000 7f2b652a3640 1 --2- 172.21.15.72:0/3557956625 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b6013db70 0x7f2b60140920 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2b540b0040 tx=0x7f2b48005840 comp rx=0 tx=0).stop 2024-05-09T05:53:20.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.683+0000 7f2b652a3640 1 -- 172.21.15.72:0/3557956625 shutdown_connections 2024-05-09T05:53:20.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.683+0000 7f2b652a3640 1 --2- 172.21.15.72:0/3557956625 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f2b4c06f430 0x7f2b4c071940 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:20.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.683+0000 7f2b652a3640 1 --2- 172.21.15.72:0/3557956625 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b601f6490 0x7f2b60148c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:20.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.683+0000 7f2b652a3640 1 --2- 172.21.15.72:0/3557956625 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b6013db70 0x7f2b60140920 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:20.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.683+0000 7f2b652a3640 1 --2- 172.21.15.72:0/3557956625 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2b48004810 0x7f2b6013e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:20.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.683+0000 7f2b652a3640 1 -- 172.21.15.72:0/3557956625 >> 172.21.15.72:0/3557956625 conn(0x7f2b600cde90 msgr2=0x7f2b600ca0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:20.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.683+0000 7f2b652a3640 1 -- 172.21.15.72:0/3557956625 shutdown_connections 2024-05-09T05:53:20.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.683+0000 7f2b652a3640 1 -- 172.21.15.72:0/3557956625 wait complete. 2024-05-09T05:53:20.696 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-09T05:53:20.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.839+0000 7f277161b640 1 Processor -- start 2024-05-09T05:53:20.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.839+0000 7f277161b640 1 -- start start 2024-05-09T05:53:20.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.839+0000 7f277161b640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f276c0c7630 0x7f276c15a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:20.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.839+0000 7f277161b640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f276c0c7a40 0x7f276c0745b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:20.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.839+0000 7f277161b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f276c074af0 0x7f276c06fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:20.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.839+0000 7f277161b640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f276c0c9350 con 0x7f276c0c7a40 2024-05-09T05:53:20.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.839+0000 7f277161b640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f276c0c58e0 con 0x7f276c0c7630 2024-05-09T05:53:20.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.839+0000 7f277161b640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f276c0c5bc0 con 0x7f276c074af0 2024-05-09T05:53:20.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.839+0000 7f2763fff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f276c0c7a40 0x7f276c0745b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:20.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.839+0000 7f2763fff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f276c0c7a40 0x7f276c0745b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60242/0 (socket says 172.21.15.72:60242) 2024-05-09T05:53:20.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.839+0000 7f2763fff640 1 -- 172.21.15.72:0/2928810636 learned_addr learned my addr 172.21.15.72:0/2928810636 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:20.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.839+0000 7f276affd640 1 --2- 172.21.15.72:0/2928810636 >> v2:172.21.15.110:3300/0 conn(0x7f276c0c7630 0x7f276c15a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:20.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.839+0000 7f276b7fe640 1 --2- 172.21.15.72:0/2928810636 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f276c074af0 0x7f276c06fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:20.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.839+0000 7f2763fff640 1 -- 172.21.15.72:0/2928810636 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f276c074af0 msgr2=0x7f276c06fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:20.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.839+0000 7f2763fff640 1 --2- 172.21.15.72:0/2928810636 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f276c074af0 0x7f276c06fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:20.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.839+0000 7f2763fff640 1 -- 172.21.15.72:0/2928810636 >> v2:172.21.15.110:3300/0 conn(0x7f276c0c7630 msgr2=0x7f276c15a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:20.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.839+0000 7f2763fff640 1 --2- 172.21.15.72:0/2928810636 >> v2:172.21.15.110:3300/0 conn(0x7f276c0c7630 0x7f276c15a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:20.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.839+0000 7f2763fff640 1 -- 172.21.15.72:0/2928810636 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f276c0c5ea0 con 0x7f276c0c7a40 2024-05-09T05:53:20.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.839+0000 7f276b7fe640 1 --2- 172.21.15.72:0/2928810636 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f276c074af0 0x7f276c06fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:53:20.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.843+0000 7f2763fff640 1 --2- 172.21.15.72:0/2928810636 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f276c0c7a40 0x7f276c0745b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f276c071b70 tx=0x7f275401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77a934baace6b20b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:20.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.843+0000 7f276a7fc640 1 -- 172.21.15.72:0/2928810636 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27540b5070 con 0x7f276c0c7a40 2024-05-09T05:53:20.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.843+0000 7f276a7fc640 1 -- 172.21.15.72:0/2928810636 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27540a89d0 con 0x7f276c0c7a40 2024-05-09T05:53:20.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.843+0000 7f276a7fc640 1 -- 172.21.15.72:0/2928810636 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27540a8da0 con 0x7f276c0c7a40 2024-05-09T05:53:20.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.843+0000 7f277161b640 1 -- 172.21.15.72:0/2928810636 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f276c0c7a40 msgr2=0x7f276c0745b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:20.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.843+0000 7f277161b640 1 --2- 172.21.15.72:0/2928810636 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f276c0c7a40 0x7f276c0745b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f276c071b70 tx=0x7f275401ed10 comp rx=0 tx=0).stop 2024-05-09T05:53:20.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.843+0000 7f277161b640 1 -- 172.21.15.72:0/2928810636 shutdown_connections 2024-05-09T05:53:20.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.843+0000 7f277161b640 1 --2- 172.21.15.72:0/2928810636 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f276c074af0 0x7f276c06fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:20.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.843+0000 7f277161b640 1 --2- 172.21.15.72:0/2928810636 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f276c0c7a40 0x7f276c0745b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:20.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.843+0000 7f277161b640 1 --2- 172.21.15.72:0/2928810636 >> v2:172.21.15.110:3300/0 conn(0x7f276c0c7630 0x7f276c15a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:20.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.843+0000 7f277161b640 1 -- 172.21.15.72:0/2928810636 >> 172.21.15.72:0/2928810636 conn(0x7f276c0cde90 msgr2=0x7f276c0ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:20.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.843+0000 7f277161b640 1 -- 172.21.15.72:0/2928810636 shutdown_connections 2024-05-09T05:53:20.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.843+0000 7f277161b640 1 -- 172.21.15.72:0/2928810636 wait complete. 2024-05-09T05:53:20.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.843+0000 7f277161b640 1 Processor -- start 2024-05-09T05:53:20.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.843+0000 7f277161b640 1 -- start start 2024-05-09T05:53:20.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.847+0000 7f277161b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f276c074af0 0x7f276c1f17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:20.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.847+0000 7f277161b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f276c0c7630 0x7f276c1f4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:20.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.847+0000 7f277161b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f276c0c7a40 0x7f276c147860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:20.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.847+0000 7f277161b640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f276c0c55a0 con 0x7f276c0c7a40 2024-05-09T05:53:20.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.847+0000 7f277161b640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f276c0c98b0 con 0x7f276c0c7630 2024-05-09T05:53:20.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.847+0000 7f277161b640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f276c0c9dd0 con 0x7f276c074af0 2024-05-09T05:53:20.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.847+0000 7f276b7fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f276c0c7a40 0x7f276c147860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:20.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.847+0000 7f276b7fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f276c0c7a40 0x7f276c147860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60244/0 (socket says 172.21.15.72:60244) 2024-05-09T05:53:20.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.847+0000 7f276b7fe640 1 -- 172.21.15.72:0/3617534298 learned_addr learned my addr 172.21.15.72:0/3617534298 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:20.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.847+0000 7f2763fff640 1 --2- 172.21.15.72:0/3617534298 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f276c0c7630 0x7f276c1f4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:20.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.847+0000 7f276affd640 1 --2- 172.21.15.72:0/3617534298 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f276c074af0 0x7f276c1f17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:20.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.847+0000 7f276b7fe640 1 -- 172.21.15.72:0/3617534298 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f276c074af0 msgr2=0x7f276c1f17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:20.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.847+0000 7f276b7fe640 1 --2- 172.21.15.72:0/3617534298 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f276c074af0 0x7f276c1f17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:20.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.847+0000 7f276b7fe640 1 -- 172.21.15.72:0/3617534298 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f276c0c7630 msgr2=0x7f276c1f4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:20.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.847+0000 7f276b7fe640 1 --2- 172.21.15.72:0/3617534298 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f276c0c7630 0x7f276c1f4c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:20.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.847+0000 7f276b7fe640 1 -- 172.21.15.72:0/3617534298 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f276c1f51a0 con 0x7f276c0c7a40 2024-05-09T05:53:20.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.847+0000 7f276affd640 1 --2- 172.21.15.72:0/3617534298 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f276c074af0 0x7f276c1f17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:53:20.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.847+0000 7f276b7fe640 1 --2- 172.21.15.72:0/3617534298 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f276c0c7a40 0x7f276c147860 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f276400ccf0 tx=0x7f276400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:20.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.847+0000 7f27637fe640 1 -- 172.21.15.72:0/3617534298 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f276400f680 con 0x7f276c0c7a40 2024-05-09T05:53:20.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.847+0000 7f27637fe640 1 -- 172.21.15.72:0/3617534298 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f276400f820 con 0x7f276c0c7a40 2024-05-09T05:53:20.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.847+0000 7f277161b640 1 -- 172.21.15.72:0/3617534298 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f276c1f0d10 con 0x7f276c0c7a40 2024-05-09T05:53:20.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.847+0000 7f27637fe640 1 -- 172.21.15.72:0/3617534298 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f276400fc10 con 0x7f276c0c7a40 2024-05-09T05:53:20.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.847+0000 7f277161b640 1 -- 172.21.15.72:0/3617534298 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f276c1e5f00 con 0x7f276c0c7a40 2024-05-09T05:53:20.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.847+0000 7f277161b640 1 -- 172.21.15.72:0/3617534298 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f276c06a520 con 0x7f276c0c7a40 2024-05-09T05:53:20.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.847+0000 7f27637fe640 1 -- 172.21.15.72:0/3617534298 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f27640213f0 con 0x7f276c0c7a40 2024-05-09T05:53:20.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.851+0000 7f27637fe640 1 --2- 172.21.15.72:0/3617534298 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f274c06f400 0x7f274c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:20.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.851+0000 7f27637fe640 1 -- 172.21.15.72:0/3617534298 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f276408fc20 con 0x7f276c0c7a40 2024-05-09T05:53:20.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.851+0000 7f276affd640 1 --2- 172.21.15.72:0/3617534298 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f274c06f400 0x7f274c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:20.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.851+0000 7f276affd640 1 --2- 172.21.15.72:0/3617534298 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f274c06f400 0x7f274c071910 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f275c006fd0 tx=0x7f275c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:20.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:20.855+0000 7f27637fe640 1 -- 172.21.15.72:0/3617534298 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f2764014030 con 0x7f276c0c7a40 2024-05-09T05:53:20.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.003+0000 7f277161b640 1 -- 172.21.15.72:0/3617534298 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f276c14b340 con 0x7f276c0c7a40 2024-05-09T05:53:20.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.003+0000 7f27637fe640 1 -- 172.21.15.72:0/3617534298 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7f276405cef0 con 0x7f276c0c7a40 2024-05-09T05:53:20.997 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:53:20.997 INFO:teuthology.orchestra.run.smithi072.stdout:[ 2024-05-09T05:53:20.998 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-05-09T05:53:20.998 INFO:teuthology.orchestra.run.smithi072.stdout: "poolnum": 1, 2024-05-09T05:53:20.998 INFO:teuthology.orchestra.run.smithi072.stdout: "poolname": ".mgr" 2024-05-09T05:53:20.998 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-05-09T05:53:20.998 INFO:teuthology.orchestra.run.smithi072.stdout:] 2024-05-09T05:53:21.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.007+0000 7f277161b640 1 -- 172.21.15.72:0/3617534298 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f274c06f400 msgr2=0x7f274c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:21.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.007+0000 7f277161b640 1 --2- 172.21.15.72:0/3617534298 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f274c06f400 0x7f274c071910 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f275c006fd0 tx=0x7f275c008040 comp rx=0 tx=0).stop 2024-05-09T05:53:21.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.007+0000 7f277161b640 1 -- 172.21.15.72:0/3617534298 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f276c0c7a40 msgr2=0x7f276c147860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:21.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.007+0000 7f277161b640 1 --2- 172.21.15.72:0/3617534298 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f276c0c7a40 0x7f276c147860 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f276400ccf0 tx=0x7f276400a650 comp rx=0 tx=0).stop 2024-05-09T05:53:21.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.007+0000 7f277161b640 1 -- 172.21.15.72:0/3617534298 shutdown_connections 2024-05-09T05:53:21.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.007+0000 7f277161b640 1 --2- 172.21.15.72:0/3617534298 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f274c06f400 0x7f274c071910 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:21.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.007+0000 7f277161b640 1 --2- 172.21.15.72:0/3617534298 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f276c0c7a40 0x7f276c147860 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:21.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.007+0000 7f277161b640 1 --2- 172.21.15.72:0/3617534298 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f276c0c7630 0x7f276c1f4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:21.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.007+0000 7f277161b640 1 --2- 172.21.15.72:0/3617534298 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f276c074af0 0x7f276c1f17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:21.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.007+0000 7f277161b640 1 -- 172.21.15.72:0/3617534298 >> 172.21.15.72:0/3617534298 conn(0x7f276c0cde90 msgr2=0x7f276c0c7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:21.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.007+0000 7f277161b640 1 -- 172.21.15.72:0/3617534298 shutdown_connections 2024-05-09T05:53:21.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.007+0000 7f277161b640 1 -- 172.21.15.72:0/3617534298 wait complete. 2024-05-09T05:53:21.017 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-09T05:53:21.017 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-09T05:53:21.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.171+0000 7ff7bdcb0640 1 Processor -- start 2024-05-09T05:53:21.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.171+0000 7ff7bdcb0640 1 -- start start 2024-05-09T05:53:21.167 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.175+0000 7ff7bdcb0640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff7b8156b50 0x7ff7b8073ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:21.167 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.175+0000 7ff7bdcb0640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7b8074410 0x7ff7b80cc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:21.167 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.175+0000 7ff7bdcb0640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff7b80cca30 0x7ff7b80cce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:21.167 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.175+0000 7ff7bdcb0640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7ff7b80cc020 con 0x7ff7b80cca30 2024-05-09T05:53:21.167 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.175+0000 7ff7bdcb0640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7ff7b815dfe0 con 0x7ff7b8156b50 2024-05-09T05:53:21.167 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.175+0000 7ff7bdcb0640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7ff7b815d950 con 0x7ff7b8074410 2024-05-09T05:53:21.167 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.175+0000 7ff7b7fff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff7b80cca30 0x7ff7b80cce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:21.167 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.175+0000 7ff7b7fff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff7b80cca30 0x7ff7b80cce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60260/0 (socket says 172.21.15.72:60260) 2024-05-09T05:53:21.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.175+0000 7ff7b7fff640 1 -- 172.21.15.72:0/1289672378 learned_addr learned my addr 172.21.15.72:0/1289672378 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:21.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.175+0000 7ff7b6ffd640 1 --2- 172.21.15.72:0/1289672378 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7b8074410 0x7ff7b80cc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:21.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.175+0000 7ff7b77fe640 1 --2- 172.21.15.72:0/1289672378 >> v2:172.21.15.110:3300/0 conn(0x7ff7b8156b50 0x7ff7b8073ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:21.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.175+0000 7ff7b7fff640 1 -- 172.21.15.72:0/1289672378 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7b8074410 msgr2=0x7ff7b80cc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:21.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.175+0000 7ff7b7fff640 1 --2- 172.21.15.72:0/1289672378 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7b8074410 0x7ff7b80cc4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:21.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.175+0000 7ff7b7fff640 1 -- 172.21.15.72:0/1289672378 >> v2:172.21.15.110:3300/0 conn(0x7ff7b8156b50 msgr2=0x7ff7b8073ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:21.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.175+0000 7ff7b7fff640 1 --2- 172.21.15.72:0/1289672378 >> v2:172.21.15.110:3300/0 conn(0x7ff7b8156b50 0x7ff7b8073ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:21.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.175+0000 7ff7b7fff640 1 -- 172.21.15.72:0/1289672378 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7b80cda30 con 0x7ff7b80cca30 2024-05-09T05:53:21.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.175+0000 7ff7b77fe640 1 --2- 172.21.15.72:0/1289672378 >> v2:172.21.15.110:3300/0 conn(0x7ff7b8156b50 0x7ff7b8073ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:53:21.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.175+0000 7ff7b7fff640 1 --2- 172.21.15.72:0/1289672378 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7b80cca30 0x7ff7b80cce40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff7b806f9a0 tx=0x7ff7a801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f0ef06c3f5976c9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:21.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.175+0000 7ff7b67fc640 1 -- 172.21.15.72:0/1289672378 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a80ab5f0 con 0x7ff7b80cca30 2024-05-09T05:53:21.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.175+0000 7ff7b67fc640 1 -- 172.21.15.72:0/1289672378 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7a80b0070 con 0x7ff7b80cca30 2024-05-09T05:53:21.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.175+0000 7ff7b67fc640 1 -- 172.21.15.72:0/1289672378 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a80ab9b0 con 0x7ff7b80cca30 2024-05-09T05:53:21.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.179+0000 7ff7bdcb0640 1 -- 172.21.15.72:0/1289672378 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7b80cca30 msgr2=0x7ff7b80cce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:21.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.179+0000 7ff7bdcb0640 1 --2- 172.21.15.72:0/1289672378 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7b80cca30 0x7ff7b80cce40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff7b806f9a0 tx=0x7ff7a801c520 comp rx=0 tx=0).stop 2024-05-09T05:53:21.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.179+0000 7ff7bdcb0640 1 -- 172.21.15.72:0/1289672378 shutdown_connections 2024-05-09T05:53:21.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.179+0000 7ff7bdcb0640 1 --2- 172.21.15.72:0/1289672378 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7b8074410 0x7ff7b80cc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:21.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.179+0000 7ff7bdcb0640 1 --2- 172.21.15.72:0/1289672378 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7b80cca30 0x7ff7b80cce40 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:21.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.179+0000 7ff7bdcb0640 1 --2- 172.21.15.72:0/1289672378 >> v2:172.21.15.110:3300/0 conn(0x7ff7b8156b50 0x7ff7b8073ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:21.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.179+0000 7ff7bdcb0640 1 -- 172.21.15.72:0/1289672378 >> 172.21.15.72:0/1289672378 conn(0x7ff7b80d1b70 msgr2=0x7ff7b80d1f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:21.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.179+0000 7ff7bdcb0640 1 -- 172.21.15.72:0/1289672378 shutdown_connections 2024-05-09T05:53:21.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.179+0000 7ff7bdcb0640 1 -- 172.21.15.72:0/1289672378 wait complete. 2024-05-09T05:53:21.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.179+0000 7ff7bdcb0640 1 Processor -- start 2024-05-09T05:53:21.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.179+0000 7ff7bdcb0640 1 -- start start 2024-05-09T05:53:21.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.179+0000 7ff7bdcb0640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7b8074410 0x7ff7b814c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:21.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.179+0000 7ff7bdcb0640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7b80cca30 0x7ff7b81498b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:21.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.179+0000 7ff7bdcb0640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7b8156b50 0x7ff7b8152940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:21.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.179+0000 7ff7bdcb0640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b8074cf0 con 0x7ff7b8156b50 2024-05-09T05:53:21.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.179+0000 7ff7bdcb0640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b815d670 con 0x7ff7b80cca30 2024-05-09T05:53:21.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.179+0000 7ff7bdcb0640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7ff7b815c9b0 con 0x7ff7b8074410 2024-05-09T05:53:21.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.179+0000 7ff7b7fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7b8156b50 0x7ff7b8152940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:21.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.179+0000 7ff7b7fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7b8156b50 0x7ff7b8152940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60276/0 (socket says 172.21.15.72:60276) 2024-05-09T05:53:21.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.179+0000 7ff7b7fff640 1 -- 172.21.15.72:0/2943437406 learned_addr learned my addr 172.21.15.72:0/2943437406 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:21.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.183+0000 7ff7b77fe640 1 --2- 172.21.15.72:0/2943437406 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7b8074410 0x7ff7b814c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:21.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.183+0000 7ff7b7fff640 1 -- 172.21.15.72:0/2943437406 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7b8074410 msgr2=0x7ff7b814c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:21.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.183+0000 7ff7b7fff640 1 --2- 172.21.15.72:0/2943437406 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7b8074410 0x7ff7b814c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:21.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.183+0000 7ff7b6ffd640 1 --2- 172.21.15.72:0/2943437406 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7b80cca30 0x7ff7b81498b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:21.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.183+0000 7ff7b7fff640 1 -- 172.21.15.72:0/2943437406 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7b80cca30 msgr2=0x7ff7b81498b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:21.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.183+0000 7ff7b7fff640 1 --2- 172.21.15.72:0/2943437406 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7b80cca30 0x7ff7b81498b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:21.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.183+0000 7ff7b7fff640 1 -- 172.21.15.72:0/2943437406 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7b80c8900 con 0x7ff7b8156b50 2024-05-09T05:53:21.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.183+0000 7ff7b7fff640 1 --2- 172.21.15.72:0/2943437406 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7b8156b50 0x7ff7b8152940 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff7a801abd0 tx=0x7ff7a801ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:21.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.183+0000 7ff79ffff640 1 -- 172.21.15.72:0/2943437406 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a80be5f0 con 0x7ff7b8156b50 2024-05-09T05:53:21.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.183+0000 7ff79ffff640 1 -- 172.21.15.72:0/2943437406 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7a80be790 con 0x7ff7b8156b50 2024-05-09T05:53:21.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.183+0000 7ff7bdcb0640 1 -- 172.21.15.72:0/2943437406 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7b8156310 con 0x7ff7b8156b50 2024-05-09T05:53:21.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.183+0000 7ff79ffff640 1 -- 172.21.15.72:0/2943437406 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a80beb80 con 0x7ff7b8156b50 2024-05-09T05:53:21.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.183+0000 7ff7bdcb0640 1 -- 172.21.15.72:0/2943437406 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7b814d320 con 0x7ff7b8156b50 2024-05-09T05:53:21.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.183+0000 7ff7bdcb0640 1 -- 172.21.15.72:0/2943437406 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7b806a520 con 0x7ff7b8156b50 2024-05-09T05:53:21.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.183+0000 7ff79ffff640 1 -- 172.21.15.72:0/2943437406 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff7a80b43f0 con 0x7ff7b8156b50 2024-05-09T05:53:21.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.183+0000 7ff79ffff640 1 --2- 172.21.15.72:0/2943437406 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7ff7a406f400 0x7ff7a4071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:21.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.183+0000 7ff79ffff640 1 -- 172.21.15.72:0/2943437406 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7ff7a8129930 con 0x7ff7b8156b50 2024-05-09T05:53:21.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.183+0000 7ff7b77fe640 1 --2- 172.21.15.72:0/2943437406 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7ff7a406f400 0x7ff7a4071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:21.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.187+0000 7ff7b77fe640 1 --2- 172.21.15.72:0/2943437406 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7ff7a406f400 0x7ff7a4071910 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff7b0008ee0 tx=0x7ff7b0008430 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:21.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.187+0000 7ff79ffff640 1 -- 172.21.15.72:0/2943437406 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7ff7a80c4060 con 0x7ff7b8156b50 2024-05-09T05:53:21.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:21.351+0000 7ff7bdcb0640 1 -- 172.21.15.72:0/2943437406 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7ff7b80cb5c0 con 0x7ff7b8156b50 2024-05-09T05:53:22.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.067+0000 7ff79ffff640 1 -- 172.21.15.72:0/2943437406 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) ==== 138+0+0 (secure 0 0 0) 0x7ff7b80cda30 con 0x7ff7b8156b50 2024-05-09T05:53:22.061 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_metadata' created 2024-05-09T05:53:22.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.071+0000 7ff7bdcb0640 1 -- 172.21.15.72:0/2943437406 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7ff7a406f400 msgr2=0x7ff7a4071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:22.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.071+0000 7ff7bdcb0640 1 --2- 172.21.15.72:0/2943437406 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7ff7a406f400 0x7ff7a4071910 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff7b0008ee0 tx=0x7ff7b0008430 comp rx=0 tx=0).stop 2024-05-09T05:53:22.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.071+0000 7ff7bdcb0640 1 -- 172.21.15.72:0/2943437406 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7b8156b50 msgr2=0x7ff7b8152940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:22.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.071+0000 7ff7bdcb0640 1 --2- 172.21.15.72:0/2943437406 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7b8156b50 0x7ff7b8152940 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff7a801abd0 tx=0x7ff7a801ad60 comp rx=0 tx=0).stop 2024-05-09T05:53:22.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.071+0000 7ff7bdcb0640 1 -- 172.21.15.72:0/2943437406 shutdown_connections 2024-05-09T05:53:22.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.071+0000 7ff7bdcb0640 1 --2- 172.21.15.72:0/2943437406 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7ff7a406f400 0x7ff7a4071910 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:22.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.071+0000 7ff7bdcb0640 1 --2- 172.21.15.72:0/2943437406 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7b8156b50 0x7ff7b8152940 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:22.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.071+0000 7ff7bdcb0640 1 --2- 172.21.15.72:0/2943437406 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7b80cca30 0x7ff7b81498b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:22.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.071+0000 7ff7bdcb0640 1 --2- 172.21.15.72:0/2943437406 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7b8074410 0x7ff7b814c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:22.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.071+0000 7ff7bdcb0640 1 -- 172.21.15.72:0/2943437406 >> 172.21.15.72:0/2943437406 conn(0x7ff7b80d1b70 msgr2=0x7ff7b8153a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:22.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.075+0000 7ff7bdcb0640 1 -- 172.21.15.72:0/2943437406 shutdown_connections 2024-05-09T05:53:22.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.075+0000 7ff7bdcb0640 1 -- 172.21.15.72:0/2943437406 wait complete. 2024-05-09T05:53:22.097 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-05-09T05:53:22.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.267+0000 7fa875bb9640 1 Processor -- start 2024-05-09T05:53:22.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.267+0000 7fa875bb9640 1 -- start start 2024-05-09T05:53:22.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.271+0000 7fa875bb9640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa870154430 0x7fa8700c6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:22.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.271+0000 7fa875bb9640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa8700748f0 0x7fa870074d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:22.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.271+0000 7fa875bb9640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8700c7780 con 0x7fa8700ca270 2024-05-09T05:53:22.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.271+0000 7fa875bb9640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fa8700c7fb0 con 0x7fa870154430 2024-05-09T05:53:22.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.271+0000 7fa875bb9640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fa8700c79f0 con 0x7fa8700748f0 2024-05-09T05:53:22.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.271+0000 7fa86effd640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa870154430 0x7fa8700c6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:22.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.271+0000 7fa86effd640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa870154430 0x7fa8700c6cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52836/0 (socket says 172.21.15.72:52836) 2024-05-09T05:53:22.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.271+0000 7fa86effd640 1 -- 172.21.15.72:0/432424995 learned_addr learned my addr 172.21.15.72:0/432424995 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:22.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.271+0000 7fa86ffff640 1 --2- 172.21.15.72:0/432424995 >> v2:172.21.15.110:3300/0 conn(0x7fa8700748f0 0x7fa870074d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:22.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.271+0000 7fa86effd640 1 -- 172.21.15.72:0/432424995 >> v2:172.21.15.110:3300/0 conn(0x7fa8700748f0 msgr2=0x7fa870074d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:22.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.271+0000 7fa86effd640 1 --2- 172.21.15.72:0/432424995 >> v2:172.21.15.110:3300/0 conn(0x7fa8700748f0 0x7fa870074d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:22.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.271+0000 7fa86effd640 1 -- 172.21.15.72:0/432424995 >> v1:172.21.15.110:6789/0 conn(0x7fa8700ca270 legacy=0x7fa87015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:22.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.271+0000 7fa86effd640 1 -- 172.21.15.72:0/432424995 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8700c7cd0 con 0x7fa870154430 2024-05-09T05:53:22.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.271+0000 7fa86ffff640 1 --2- 172.21.15.72:0/432424995 >> v2:172.21.15.110:3300/0 conn(0x7fa8700748f0 0x7fa870074d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:53:22.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.271+0000 7fa86effd640 1 --2- 172.21.15.72:0/432424995 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa870154430 0x7fa8700c6cf0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa870070340 tx=0x7fa86401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8a11317ab584c0c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:22.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.271+0000 7fa86e7fc640 1 -- 172.21.15.72:0/432424995 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8640b0070 con 0x7fa870154430 2024-05-09T05:53:22.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.271+0000 7fa86e7fc640 1 -- 172.21.15.72:0/432424995 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8640ab600 con 0x7fa870154430 2024-05-09T05:53:22.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.271+0000 7fa86e7fc640 1 -- 172.21.15.72:0/432424995 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8640ab9d0 con 0x7fa870154430 2024-05-09T05:53:22.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.275+0000 7fa875bb9640 1 -- 172.21.15.72:0/432424995 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa870154430 msgr2=0x7fa8700c6cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:22.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.275+0000 7fa875bb9640 1 --2- 172.21.15.72:0/432424995 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa870154430 0x7fa8700c6cf0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa870070340 tx=0x7fa86401c520 comp rx=0 tx=0).stop 2024-05-09T05:53:22.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.275+0000 7fa875bb9640 1 -- 172.21.15.72:0/432424995 shutdown_connections 2024-05-09T05:53:22.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.275+0000 7fa875bb9640 1 --2- 172.21.15.72:0/432424995 >> v2:172.21.15.110:3300/0 conn(0x7fa8700748f0 0x7fa870074d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:22.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.275+0000 7fa875bb9640 1 --2- 172.21.15.72:0/432424995 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa870154430 0x7fa8700c6cf0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:22.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.275+0000 7fa875bb9640 1 -- 172.21.15.72:0/432424995 >> 172.21.15.72:0/432424995 conn(0x7fa870072300 msgr2=0x7fa870072710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:22.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.275+0000 7fa875bb9640 1 -- 172.21.15.72:0/432424995 shutdown_connections 2024-05-09T05:53:22.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.275+0000 7fa875bb9640 1 -- 172.21.15.72:0/432424995 wait complete. 2024-05-09T05:53:22.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.275+0000 7fa875bb9640 1 Processor -- start 2024-05-09T05:53:22.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.275+0000 7fa875bb9640 1 -- start start 2024-05-09T05:53:22.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.275+0000 7fa875bb9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8700748f0 0x7fa87014d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:22.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.275+0000 7fa875bb9640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8700ca270 0x7fa87015cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:22.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.275+0000 7fa875bb9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa870154430 0x7fa8700cad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:22.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.275+0000 7fa875bb9640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fa8700c73b0 con 0x7fa8700ca270 2024-05-09T05:53:22.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.275+0000 7fa875bb9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fa8700c7230 con 0x7fa870154430 2024-05-09T05:53:22.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.275+0000 7fa875bb9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fa870154840 con 0x7fa8700748f0 2024-05-09T05:53:22.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.275+0000 7fa86effd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8700ca270 0x7fa87015cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:22.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.275+0000 7fa86effd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8700ca270 0x7fa87015cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52846/0 (socket says 172.21.15.72:52846) 2024-05-09T05:53:22.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.275+0000 7fa86effd640 1 -- 172.21.15.72:0/3254253274 learned_addr learned my addr 172.21.15.72:0/3254253274 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:22.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.275+0000 7fa86ffff640 1 --2- 172.21.15.72:0/3254253274 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa870154430 0x7fa8700cad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:22.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.275+0000 7fa86f7fe640 1 --2- 172.21.15.72:0/3254253274 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8700748f0 0x7fa87014d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:22.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.275+0000 7fa86effd640 1 -- 172.21.15.72:0/3254253274 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8700748f0 msgr2=0x7fa87014d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:22.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.275+0000 7fa86effd640 1 --2- 172.21.15.72:0/3254253274 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8700748f0 0x7fa87014d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:22.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.275+0000 7fa86effd640 1 -- 172.21.15.72:0/3254253274 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa870154430 msgr2=0x7fa8700cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:22.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.275+0000 7fa86effd640 1 --2- 172.21.15.72:0/3254253274 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa870154430 0x7fa8700cad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:22.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.275+0000 7fa86effd640 1 -- 172.21.15.72:0/3254253274 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa870159f10 con 0x7fa8700ca270 2024-05-09T05:53:22.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.275+0000 7fa86ffff640 1 --2- 172.21.15.72:0/3254253274 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa870154430 0x7fa8700cad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:53:22.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.275+0000 7fa86f7fe640 1 --2- 172.21.15.72:0/3254253274 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8700748f0 0x7fa87014d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:53:22.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.279+0000 7fa86effd640 1 --2- 172.21.15.72:0/3254253274 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8700ca270 0x7fa87015cb00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa8640ae040 tx=0x7fa8640192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:22.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.279+0000 7fa857fff640 1 -- 172.21.15.72:0/3254253274 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8640ba070 con 0x7fa8700ca270 2024-05-09T05:53:22.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.279+0000 7fa857fff640 1 -- 172.21.15.72:0/3254253274 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8640b4620 con 0x7fa8700ca270 2024-05-09T05:53:22.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.279+0000 7fa875bb9640 1 -- 172.21.15.72:0/3254253274 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa87015a4b0 con 0x7fa8700ca270 2024-05-09T05:53:22.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.279+0000 7fa857fff640 1 -- 172.21.15.72:0/3254253274 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8640b0040 con 0x7fa8700ca270 2024-05-09T05:53:22.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.279+0000 7fa875bb9640 1 -- 172.21.15.72:0/3254253274 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8701491c0 con 0x7fa8700ca270 2024-05-09T05:53:22.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.279+0000 7fa875bb9640 1 -- 172.21.15.72:0/3254253274 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa87006a520 con 0x7fa8700ca270 2024-05-09T05:53:22.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.279+0000 7fa857fff640 1 -- 172.21.15.72:0/3254253274 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fa8640bd070 con 0x7fa8700ca270 2024-05-09T05:53:22.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.279+0000 7fa857fff640 1 --2- 172.21.15.72:0/3254253274 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fa85c06f400 0x7fa85c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:22.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.279+0000 7fa857fff640 1 -- 172.21.15.72:0/3254253274 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5227+0+0 (secure 0 0 0) 0x7fa864128260 con 0x7fa8700ca270 2024-05-09T05:53:22.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.279+0000 7fa86f7fe640 1 --2- 172.21.15.72:0/3254253274 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fa85c06f400 0x7fa85c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:22.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.279+0000 7fa86f7fe640 1 --2- 172.21.15.72:0/3254253274 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fa85c06f400 0x7fa85c071910 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa86000a850 tx=0x7fa860008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:22.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.283+0000 7fa857fff640 1 -- 172.21.15.72:0/3254253274 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fa864016110 con 0x7fa8700ca270 2024-05-09T05:53:22.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:22.443+0000 7fa875bb9640 1 -- 172.21.15.72:0/3254253274 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7fa8700c5fe0 con 0x7fa8700ca270 2024-05-09T05:53:23.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.071+0000 7fa857fff640 1 -- 172.21.15.72:0/3254253274 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) ==== 171+0+0 (secure 0 0 0) 0x7fa8640f5530 con 0x7fa8700ca270 2024-05-09T05:53:23.066 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_data' created 2024-05-09T05:53:23.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.079+0000 7fa875bb9640 1 -- 172.21.15.72:0/3254253274 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fa85c06f400 msgr2=0x7fa85c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:23.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.079+0000 7fa875bb9640 1 --2- 172.21.15.72:0/3254253274 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fa85c06f400 0x7fa85c071910 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa86000a850 tx=0x7fa860008040 comp rx=0 tx=0).stop 2024-05-09T05:53:23.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.079+0000 7fa875bb9640 1 -- 172.21.15.72:0/3254253274 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8700ca270 msgr2=0x7fa87015cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:23.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.079+0000 7fa875bb9640 1 --2- 172.21.15.72:0/3254253274 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8700ca270 0x7fa87015cb00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa8640ae040 tx=0x7fa8640192c0 comp rx=0 tx=0).stop 2024-05-09T05:53:23.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.079+0000 7fa875bb9640 1 -- 172.21.15.72:0/3254253274 shutdown_connections 2024-05-09T05:53:23.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.079+0000 7fa875bb9640 1 --2- 172.21.15.72:0/3254253274 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fa85c06f400 0x7fa85c071910 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:23.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.079+0000 7fa875bb9640 1 --2- 172.21.15.72:0/3254253274 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa870154430 0x7fa8700cad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:23.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.079+0000 7fa875bb9640 1 --2- 172.21.15.72:0/3254253274 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8700ca270 0x7fa87015cb00 secure :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa8640ae040 tx=0x7fa8640192c0 comp rx=0 tx=0).stop 2024-05-09T05:53:23.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.079+0000 7fa875bb9640 1 --2- 172.21.15.72:0/3254253274 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8700748f0 0x7fa87014d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:23.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.079+0000 7fa875bb9640 1 -- 172.21.15.72:0/3254253274 >> 172.21.15.72:0/3254253274 conn(0x7fa870072300 msgr2=0x7fa870075d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:23.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.083+0000 7fa875bb9640 1 -- 172.21.15.72:0/3254253274 shutdown_connections 2024-05-09T05:53:23.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.083+0000 7fa875bb9640 1 -- 172.21.15.72:0/3254253274 wait complete. 2024-05-09T05:53:23.117 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-09T05:53:23.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.275+0000 7f3fa49ee640 1 Processor -- start 2024-05-09T05:53:23.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.275+0000 7f3fa49ee640 1 -- start start 2024-05-09T05:53:23.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.275+0000 7f3fa49ee640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3fa0153860 0x7f3fa00c6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:23.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.275+0000 7f3fa49ee640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3fa00c7210 0x7f3fa0163d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:23.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.275+0000 7f3fa49ee640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fa0072b00 con 0x7f3fa0159ed0 2024-05-09T05:53:23.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.275+0000 7f3fa49ee640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f3fa0153c70 con 0x7f3fa0153860 2024-05-09T05:53:23.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.275+0000 7f3fa49ee640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f3fa0072540 con 0x7f3fa00c7210 2024-05-09T05:53:23.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.275+0000 7f3f9e59c640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f3fa0159ed0 0x7f3fa0072f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:37044/0 (socket says 172.21.15.72:37044) 2024-05-09T05:53:23.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.275+0000 7f3f9e59c640 1 -- 172.21.15.72:0/1145968928 learned_addr learned my addr 172.21.15.72:0/1145968928 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:53:23.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.275+0000 7f3f9dd9b640 1 --2- 172.21.15.72:0/1145968928 >> v2:172.21.15.110:3300/0 conn(0x7f3fa0153860 0x7f3fa00c6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:23.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.275+0000 7f3f9d59a640 1 -- 172.21.15.72:0/1145968928 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1100139660 0 0) 0x7f3fa0072b00 con 0x7f3fa0159ed0 2024-05-09T05:53:23.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.275+0000 7f3f9ed9d640 1 --2- 172.21.15.72:0/1145968928 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3fa00c7210 0x7f3fa0163d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:23.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.275+0000 7f3f9d59a640 1 -- 172.21.15.72:0/1145968928 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f88003530 con 0x7f3fa0159ed0 2024-05-09T05:53:23.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.275+0000 7f3f9d59a640 1 -- 172.21.15.72:0/1145968928 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 114446582 0 0) 0x7f3f88003530 con 0x7f3fa0159ed0 2024-05-09T05:53:23.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.275+0000 7f3f9d59a640 1 -- 172.21.15.72:0/1145968928 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3fa00c7210 msgr2=0x7f3fa0163d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:23.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.275+0000 7f3f9d59a640 1 --2- 172.21.15.72:0/1145968928 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3fa00c7210 0x7f3fa0163d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:23.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.275+0000 7f3f9d59a640 1 -- 172.21.15.72:0/1145968928 >> v2:172.21.15.110:3300/0 conn(0x7f3fa0153860 msgr2=0x7f3fa00c6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:23.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.275+0000 7f3f9d59a640 1 --2- 172.21.15.72:0/1145968928 >> v2:172.21.15.110:3300/0 conn(0x7f3fa0153860 0x7f3fa00c6cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:23.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.275+0000 7f3f9d59a640 1 -- 172.21.15.72:0/1145968928 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fa0072820 con 0x7f3fa0159ed0 2024-05-09T05:53:23.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.275+0000 7f3f9d59a640 1 -- 172.21.15.72:0/1145968928 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2749052815 0 0) 0x7f3f90001700 con 0x7f3fa0159ed0 2024-05-09T05:53:23.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.275+0000 7f3f9d59a640 1 -- 172.21.15.72:0/1145968928 >> v1:172.21.15.72:6789/0 conn(0x7f3fa0159ed0 legacy=0x7f3fa0072f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:23.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.275+0000 7f3f9d59a640 1 --2- 172.21.15.72:0/1145968928 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f88003a10 0x7f3f88003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:23.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.275+0000 7f3f9d59a640 1 --2- 172.21.15.72:0/1145968928 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f88004810 0x7f3f88004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:23.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.275+0000 7f3f9d59a640 1 --2- 172.21.15.72:0/1145968928 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3fa00c7210 0x7f3f88005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:23.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.275+0000 7f3f9d59a640 1 -- 172.21.15.72:0/1145968928 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa0153c70 con 0x7f3f88004810 2024-05-09T05:53:23.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.275+0000 7f3f9d59a640 1 -- 172.21.15.72:0/1145968928 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa0072540 con 0x7f3f88003a10 2024-05-09T05:53:23.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.275+0000 7f3f9d59a640 1 -- 172.21.15.72:0/1145968928 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f3f8800bb00 con 0x7f3fa00c7210 2024-05-09T05:53:23.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.279+0000 7f3f9dd9b640 1 --2- 172.21.15.72:0/1145968928 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f88004810 0x7f3f88004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:23.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.279+0000 7f3f9e59c640 1 --2- 172.21.15.72:0/1145968928 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f88003a10 0x7f3f88003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:23.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.279+0000 7f3f9ed9d640 1 --2- 172.21.15.72:0/1145968928 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3fa00c7210 0x7f3f88005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:23.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.279+0000 7f3f9dd9b640 1 -- 172.21.15.72:0/1145968928 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3fa00c7210 msgr2=0x7f3f88005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:23.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.279+0000 7f3f9dd9b640 1 --2- 172.21.15.72:0/1145968928 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3fa00c7210 0x7f3f88005160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:23.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.279+0000 7f3f9dd9b640 1 -- 172.21.15.72:0/1145968928 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f88003a10 msgr2=0x7f3f88003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:23.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.279+0000 7f3f9dd9b640 1 --2- 172.21.15.72:0/1145968928 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f88003a10 0x7f3f88003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:23.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.279+0000 7f3f9dd9b640 1 -- 172.21.15.72:0/1145968928 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f88003530 con 0x7f3f88004810 2024-05-09T05:53:23.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.279+0000 7f3f9dd9b640 1 --2- 172.21.15.72:0/1145968928 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f88004810 0x7f3f88004c20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3f94009ab0 tx=0x7f3f9401cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca7a4d5f1cf767e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:23.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.279+0000 7f3f9d59a640 1 -- 172.21.15.72:0/1145968928 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f940b2070 con 0x7f3f88004810 2024-05-09T05:53:23.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.279+0000 7f3f9d59a640 1 -- 172.21.15.72:0/1145968928 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f940a5720 con 0x7f3f88004810 2024-05-09T05:53:23.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.279+0000 7f3f9d59a640 1 -- 172.21.15.72:0/1145968928 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f940096b0 con 0x7f3f88004810 2024-05-09T05:53:23.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.279+0000 7f3fa49ee640 1 -- 172.21.15.72:0/1145968928 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f88004810 msgr2=0x7f3f88004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:23.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.279+0000 7f3fa49ee640 1 --2- 172.21.15.72:0/1145968928 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f88004810 0x7f3f88004c20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3f94009ab0 tx=0x7f3f9401cb20 comp rx=0 tx=0).stop 2024-05-09T05:53:23.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.279+0000 7f3f9ed9d640 1 -- 172.21.15.72:0/1145968928 reap_dead start 2024-05-09T05:53:23.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.279+0000 7f3fa49ee640 1 -- 172.21.15.72:0/1145968928 shutdown_connections 2024-05-09T05:53:23.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.279+0000 7f3fa49ee640 1 -- 172.21.15.72:0/1145968928 >> 172.21.15.72:0/1145968928 conn(0x7f3fa00cde90 msgr2=0x7f3fa00ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:23.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.279+0000 7f3fa49ee640 1 -- 172.21.15.72:0/1145968928 shutdown_connections 2024-05-09T05:53:23.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.279+0000 7f3fa49ee640 1 -- 172.21.15.72:0/1145968928 wait complete. 2024-05-09T05:53:23.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.283+0000 7f3fa49ee640 1 Processor -- start 2024-05-09T05:53:23.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.283+0000 7f3fa49ee640 1 -- start start 2024-05-09T05:53:23.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.283+0000 7f3fa49ee640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f88004810 0x7f3fa0155c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:23.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.283+0000 7f3fa49ee640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fa01e2760 0x7f3fa01e5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:23.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.283+0000 7f3fa49ee640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3fa0152ad0 0x7f3fa014afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:23.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.283+0000 7f3fa49ee640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa00c4920 con 0x7f3f88004810 2024-05-09T05:53:23.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.283+0000 7f3fa49ee640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa00c7620 con 0x7f3fa01e2760 2024-05-09T05:53:23.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.283+0000 7f3fa49ee640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f3fa00c4cb0 con 0x7f3fa0152ad0 2024-05-09T05:53:23.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.283+0000 7f3f9e59c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f88004810 0x7f3fa0155c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:23.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.283+0000 7f3f9e59c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f88004810 0x7f3fa0155c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52860/0 (socket says 172.21.15.72:52860) 2024-05-09T05:53:23.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.283+0000 7f3f9e59c640 1 -- 172.21.15.72:0/1573798440 learned_addr learned my addr 172.21.15.72:0/1573798440 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:23.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.283+0000 7f3f9dd9b640 1 --2- 172.21.15.72:0/1573798440 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fa01e2760 0x7f3fa01e5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:23.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.283+0000 7f3f9ed9d640 1 --2- 172.21.15.72:0/1573798440 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3fa0152ad0 0x7f3fa014afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:23.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.283+0000 7f3f9e59c640 1 -- 172.21.15.72:0/1573798440 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3fa0152ad0 msgr2=0x7f3fa014afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:23.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.283+0000 7f3f9e59c640 1 --2- 172.21.15.72:0/1573798440 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3fa0152ad0 0x7f3fa014afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:23.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.283+0000 7f3f9e59c640 1 -- 172.21.15.72:0/1573798440 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fa01e2760 msgr2=0x7f3fa01e5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:23.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.283+0000 7f3f9e59c640 1 --2- 172.21.15.72:0/1573798440 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fa01e2760 0x7f3fa01e5170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:23.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.283+0000 7f3f9e59c640 1 -- 172.21.15.72:0/1573798440 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fa01561b0 con 0x7f3f88004810 2024-05-09T05:53:23.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.283+0000 7f3f9e59c640 1 --2- 172.21.15.72:0/1573798440 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f88004810 0x7f3fa0155c70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3f90001500 tx=0x7f3f9000ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:23.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.283+0000 7f3f8effd640 1 -- 172.21.15.72:0/1573798440 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f9000c8c0 con 0x7f3f88004810 2024-05-09T05:53:23.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.283+0000 7f3f8effd640 1 -- 172.21.15.72:0/1573798440 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f9000ca60 con 0x7f3f88004810 2024-05-09T05:53:23.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.283+0000 7f3fa49ee640 1 -- 172.21.15.72:0/1573798440 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fa01e4590 con 0x7f3f88004810 2024-05-09T05:53:23.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.283+0000 7f3f8effd640 1 -- 172.21.15.72:0/1573798440 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f9000ce50 con 0x7f3f88004810 2024-05-09T05:53:23.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.283+0000 7f3fa49ee640 1 -- 172.21.15.72:0/1573798440 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fa01e4b50 con 0x7f3f88004810 2024-05-09T05:53:23.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.287+0000 7f3fa49ee640 1 -- 172.21.15.72:0/1573798440 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fa006a520 con 0x7f3f88004810 2024-05-09T05:53:23.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.287+0000 7f3f8effd640 1 -- 172.21.15.72:0/1573798440 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f3f90012450 con 0x7f3f88004810 2024-05-09T05:53:23.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.287+0000 7f3f8effd640 1 --2- 172.21.15.72:0/1573798440 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f3f8006f400 0x7f3f80071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:23.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.287+0000 7f3f8effd640 1 -- 172.21.15.72:0/1573798440 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5609+0+0 (secure 0 0 0) 0x7f3f90091230 con 0x7f3f88004810 2024-05-09T05:53:23.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.287+0000 7f3f9dd9b640 1 --2- 172.21.15.72:0/1573798440 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f3f8006f400 0x7f3f80071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:23.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.287+0000 7f3f9dd9b640 1 --2- 172.21.15.72:0/1573798440 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f3f8006f400 0x7f3f80071910 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3f94009ab0 tx=0x7f3f940046d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:23.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.291+0000 7f3f8effd640 1 -- 172.21.15.72:0/1573798440 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f3f90016030 con 0x7f3f88004810 2024-05-09T05:53:23.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:23.487+0000 7f3fa49ee640 1 -- 172.21.15.72:0/1573798440 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f3fa00c5f30 con 0x7f3f88004810 2024-05-09T05:53:24.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.107+0000 7f3f8effd640 1 -- 172.21.15.72:0/1573798440 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f3f90066020 con 0x7f3f88004810 2024-05-09T05:53:24.099 INFO:teuthology.orchestra.run.smithi072.stderr:new fs with metadata pool 2 and data pool 3 2024-05-09T05:53:24.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.111+0000 7f3fa49ee640 1 -- 172.21.15.72:0/1573798440 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f3f8006f400 msgr2=0x7f3f80071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:24.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.111+0000 7f3fa49ee640 1 --2- 172.21.15.72:0/1573798440 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f3f8006f400 0x7f3f80071910 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3f94009ab0 tx=0x7f3f940046d0 comp rx=0 tx=0).stop 2024-05-09T05:53:24.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.111+0000 7f3fa49ee640 1 -- 172.21.15.72:0/1573798440 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f88004810 msgr2=0x7f3fa0155c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:24.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.111+0000 7f3fa49ee640 1 --2- 172.21.15.72:0/1573798440 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f88004810 0x7f3fa0155c70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3f90001500 tx=0x7f3f9000ebc0 comp rx=0 tx=0).stop 2024-05-09T05:53:24.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.111+0000 7f3fa49ee640 1 -- 172.21.15.72:0/1573798440 shutdown_connections 2024-05-09T05:53:24.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.111+0000 7f3fa49ee640 1 --2- 172.21.15.72:0/1573798440 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f3f8006f400 0x7f3f80071910 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:24.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.111+0000 7f3fa49ee640 1 --2- 172.21.15.72:0/1573798440 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3fa0152ad0 0x7f3fa014afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:24.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.111+0000 7f3fa49ee640 1 --2- 172.21.15.72:0/1573798440 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fa01e2760 0x7f3fa01e5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:24.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.111+0000 7f3fa49ee640 1 --2- 172.21.15.72:0/1573798440 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f88004810 0x7f3fa0155c70 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:24.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.111+0000 7f3fa49ee640 1 -- 172.21.15.72:0/1573798440 >> 172.21.15.72:0/1573798440 conn(0x7f3fa00cde90 msgr2=0x7f3fa01514e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:24.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.115+0000 7f3fa49ee640 1 -- 172.21.15.72:0/1573798440 shutdown_connections 2024-05-09T05:53:24.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.115+0000 7f3fa49ee640 1 -- 172.21.15.72:0/1573798440 wait complete. 2024-05-09T05:53:24.152 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-05-09T05:53:24.152 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-05-09T05:53:24.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.315+0000 7f5186038640 1 Processor -- start 2024-05-09T05:53:24.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.315+0000 7f5186038640 1 -- start start 2024-05-09T05:53:24.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.315+0000 7f5186038640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f518006d2e0 0x7f5180154700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:24.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.315+0000 7f5186038640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51800cb180 con 0x7f51800cad70 2024-05-09T05:53:24.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.315+0000 7f5186038640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51800cc260 con 0x7f51800ca960 2024-05-09T05:53:24.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.315+0000 7f5186038640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f518015a5f0 con 0x7f518006d2e0 2024-05-09T05:53:24.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.315+0000 7f517ffff640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f51800cad70 0x7f5180164f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:37054/0 (socket says 172.21.15.72:37054) 2024-05-09T05:53:24.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.315+0000 7f517ffff640 1 -- 172.21.15.72:0/2623738402 learned_addr learned my addr 172.21.15.72:0/2623738402 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:53:24.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.315+0000 7f517f7fe640 1 --2- 172.21.15.72:0/2623738402 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f518006d2e0 0x7f5180154700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:24.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.315+0000 7f517e7fc640 1 -- 172.21.15.72:0/2623738402 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1319743540 0 0) 0x7f51800cb180 con 0x7f51800cad70 2024-05-09T05:53:24.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.315+0000 7f517e7fc640 1 -- 172.21.15.72:0/2623738402 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5168003530 con 0x7f51800cad70 2024-05-09T05:53:24.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.315+0000 7f517e7fc640 1 -- 172.21.15.72:0/2623738402 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1473195234 0 0) 0x7f5168003530 con 0x7f51800cad70 2024-05-09T05:53:24.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.315+0000 7f517e7fc640 1 -- 172.21.15.72:0/2623738402 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f518006d2e0 msgr2=0x7f5180154700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:24.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.315+0000 7f517e7fc640 1 --2- 172.21.15.72:0/2623738402 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f518006d2e0 0x7f5180154700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:24.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.315+0000 7f517e7fc640 1 -- 172.21.15.72:0/2623738402 >> v1:172.21.15.110:6789/0 conn(0x7f51800ca960 legacy=0x7f518006c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:24.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.315+0000 7f517e7fc640 1 -- 172.21.15.72:0/2623738402 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51800c8660 con 0x7f51800cad70 2024-05-09T05:53:24.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.315+0000 7f517e7fc640 1 -- 172.21.15.72:0/2623738402 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2749052815 0 0) 0x7f5178001a80 con 0x7f51800cad70 2024-05-09T05:53:24.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.315+0000 7f517e7fc640 1 -- 172.21.15.72:0/2623738402 >> v1:172.21.15.72:6789/0 conn(0x7f51800cad70 legacy=0x7f5180164f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:24.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.315+0000 7f517e7fc640 1 --2- 172.21.15.72:0/2623738402 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f518006d2e0 0x7f51680039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:24.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.315+0000 7f517e7fc640 1 --2- 172.21.15.72:0/2623738402 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5168003fa0 0x7f5168004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:24.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.315+0000 7f517e7fc640 1 --2- 172.21.15.72:0/2623738402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5168004d50 0x7f51680051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:24.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.315+0000 7f517e7fc640 1 -- 172.21.15.72:0/2623738402 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f518015a5f0 con 0x7f5168003fa0 2024-05-09T05:53:24.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.315+0000 7f517e7fc640 1 -- 172.21.15.72:0/2623738402 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f516800bb90 con 0x7f5168004d50 2024-05-09T05:53:24.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.315+0000 7f517e7fc640 1 -- 172.21.15.72:0/2623738402 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f516800bd90 con 0x7f518006d2e0 2024-05-09T05:53:24.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.315+0000 7f517effd640 1 --2- 172.21.15.72:0/2623738402 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5168003fa0 0x7f5168004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:24.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.315+0000 7f517f7fe640 1 --2- 172.21.15.72:0/2623738402 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f518006d2e0 0x7f51680039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:24.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.315+0000 7f517ffff640 1 --2- 172.21.15.72:0/2623738402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5168004d50 0x7f51680051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:24.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.315+0000 7f517effd640 1 -- 172.21.15.72:0/2623738402 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f518006d2e0 msgr2=0x7f51680039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:24.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.315+0000 7f517effd640 1 --2- 172.21.15.72:0/2623738402 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f518006d2e0 0x7f51680039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:24.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.315+0000 7f517effd640 1 -- 172.21.15.72:0/2623738402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5168004d50 msgr2=0x7f51680051a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:24.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.315+0000 7f517effd640 1 --2- 172.21.15.72:0/2623738402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5168004d50 0x7f51680051a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:24.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.315+0000 7f517effd640 1 -- 172.21.15.72:0/2623738402 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5168003530 con 0x7f5168003fa0 2024-05-09T05:53:24.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.319+0000 7f517effd640 1 --2- 172.21.15.72:0/2623738402 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5168003fa0 0x7f5168004810 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5170001a10 tx=0x7f517001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb9462b9076dbd4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:24.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.319+0000 7f517e7fc640 1 -- 172.21.15.72:0/2623738402 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51700b0070 con 0x7f5168003fa0 2024-05-09T05:53:24.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.319+0000 7f517e7fc640 1 -- 172.21.15.72:0/2623738402 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51700ab600 con 0x7f5168003fa0 2024-05-09T05:53:24.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.319+0000 7f517e7fc640 1 -- 172.21.15.72:0/2623738402 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5170001630 con 0x7f5168003fa0 2024-05-09T05:53:24.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.319+0000 7f5186038640 1 -- 172.21.15.72:0/2623738402 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5168003fa0 msgr2=0x7f5168004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:24.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.319+0000 7f5186038640 1 --2- 172.21.15.72:0/2623738402 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5168003fa0 0x7f5168004810 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5170001a10 tx=0x7f517001c450 comp rx=0 tx=0).stop 2024-05-09T05:53:24.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.319+0000 7f517ffff640 1 -- 172.21.15.72:0/2623738402 reap_dead start 2024-05-09T05:53:24.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.319+0000 7f5186038640 1 -- 172.21.15.72:0/2623738402 shutdown_connections 2024-05-09T05:53:24.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.319+0000 7f5186038640 1 -- 172.21.15.72:0/2623738402 >> 172.21.15.72:0/2623738402 conn(0x7f51800cb350 msgr2=0x7f51800cb760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:24.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.319+0000 7f5186038640 1 -- 172.21.15.72:0/2623738402 shutdown_connections 2024-05-09T05:53:24.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.319+0000 7f5186038640 1 -- 172.21.15.72:0/2623738402 wait complete. 2024-05-09T05:53:24.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.323+0000 7f5186038640 1 Processor -- start 2024-05-09T05:53:24.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.323+0000 7f5186038640 1 -- start start 2024-05-09T05:53:24.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.323+0000 7f5186038640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5168003fa0 0x7f518015dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:24.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.323+0000 7f5186038640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f518015b7b0 0x7f51800c28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:24.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.323+0000 7f5186038640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f518015bbc0 0x7f5180149580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:24.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.323+0000 7f5186038640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f51800cbeb0 con 0x7f518015b7b0 2024-05-09T05:53:24.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.323+0000 7f5186038640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f51800c2410 con 0x7f5168003fa0 2024-05-09T05:53:24.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.323+0000 7f5186038640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f518015e6b0 con 0x7f518015bbc0 2024-05-09T05:53:24.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.323+0000 7f517effd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f518015b7b0 0x7f51800c28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:24.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.323+0000 7f517effd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f518015b7b0 0x7f51800c28e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52880/0 (socket says 172.21.15.72:52880) 2024-05-09T05:53:24.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.323+0000 7f517effd640 1 -- 172.21.15.72:0/91565260 learned_addr learned my addr 172.21.15.72:0/91565260 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:24.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.323+0000 7f517f7fe640 1 --2- 172.21.15.72:0/91565260 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5168003fa0 0x7f518015dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:24.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.323+0000 7f517ffff640 1 --2- 172.21.15.72:0/91565260 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f518015bbc0 0x7f5180149580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:24.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.323+0000 7f517effd640 1 -- 172.21.15.72:0/91565260 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f518015bbc0 msgr2=0x7f5180149580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:24.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.323+0000 7f517effd640 1 --2- 172.21.15.72:0/91565260 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f518015bbc0 0x7f5180149580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:24.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.323+0000 7f517effd640 1 -- 172.21.15.72:0/91565260 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5168003fa0 msgr2=0x7f518015dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:24.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.323+0000 7f517effd640 1 --2- 172.21.15.72:0/91565260 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5168003fa0 0x7f518015dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:24.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.323+0000 7f517effd640 1 -- 172.21.15.72:0/91565260 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f518015e1e0 con 0x7f518015b7b0 2024-05-09T05:53:24.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.323+0000 7f517effd640 1 --2- 172.21.15.72:0/91565260 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f518015b7b0 0x7f51800c28e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f517001ab50 tx=0x7f5170019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:24.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.323+0000 7f5167fff640 1 -- 172.21.15.72:0/91565260 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51700b0040 con 0x7f518015b7b0 2024-05-09T05:53:24.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.323+0000 7f5167fff640 1 -- 172.21.15.72:0/91565260 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5170001120 con 0x7f518015b7b0 2024-05-09T05:53:24.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.323+0000 7f5186038640 1 -- 172.21.15.72:0/91565260 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5180150c40 con 0x7f518015b7b0 2024-05-09T05:53:24.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.323+0000 7f5167fff640 1 -- 172.21.15.72:0/91565260 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5170007220 con 0x7f518015b7b0 2024-05-09T05:53:24.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.323+0000 7f5186038640 1 -- 172.21.15.72:0/91565260 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51800c46a0 con 0x7f518015b7b0 2024-05-09T05:53:24.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.327+0000 7f5186038640 1 -- 172.21.15.72:0/91565260 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f518006a520 con 0x7f518015b7b0 2024-05-09T05:53:24.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.327+0000 7f5167fff640 1 -- 172.21.15.72:0/91565260 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f51700bb060 con 0x7f518015b7b0 2024-05-09T05:53:24.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.327+0000 7f5167fff640 1 --2- 172.21.15.72:0/91565260 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f516c06f430 0x7f516c071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:24.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.327+0000 7f5167fff640 1 -- 172.21.15.72:0/91565260 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f5170127e20 con 0x7f518015b7b0 2024-05-09T05:53:24.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.327+0000 7f517f7fe640 1 --2- 172.21.15.72:0/91565260 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f516c06f430 0x7f516c071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:24.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.327+0000 7f517f7fe640 1 --2- 172.21.15.72:0/91565260 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f516c06f430 0x7f516c071940 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5174009ae0 tx=0x7f5174008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:24.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.331+0000 7f5167fff640 1 -- 172.21.15.72:0/91565260 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f51800cc260 con 0x7f518015b7b0 2024-05-09T05:53:24.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:24.499+0000 7f5186038640 1 -- 172.21.15.72:0/91565260 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f5180158240 con 0x7f518015b7b0 2024-05-09T05:53:24.815 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T05:53:24.818 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T05:53:25.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.107+0000 7f5167fff640 1 -- 172.21.15.72:0/91565260 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) ==== 157+0+0 (secure 0 0 0) 0x7f51700f47e0 con 0x7f518015b7b0 2024-05-09T05:53:25.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.111+0000 7f5186038640 1 -- 172.21.15.72:0/91565260 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f516c06f430 msgr2=0x7f516c071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:25.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.111+0000 7f5186038640 1 --2- 172.21.15.72:0/91565260 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f516c06f430 0x7f516c071940 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5174009ae0 tx=0x7f5174008040 comp rx=0 tx=0).stop 2024-05-09T05:53:25.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.111+0000 7f5186038640 1 -- 172.21.15.72:0/91565260 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f518015b7b0 msgr2=0x7f51800c28e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:25.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.111+0000 7f5186038640 1 --2- 172.21.15.72:0/91565260 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f518015b7b0 0x7f51800c28e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f517001ab50 tx=0x7f5170019240 comp rx=0 tx=0).stop 2024-05-09T05:53:25.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.111+0000 7f5186038640 1 -- 172.21.15.72:0/91565260 shutdown_connections 2024-05-09T05:53:25.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.111+0000 7f5186038640 1 --2- 172.21.15.72:0/91565260 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f516c06f430 0x7f516c071940 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:25.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.111+0000 7f5186038640 1 --2- 172.21.15.72:0/91565260 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f518015bbc0 0x7f5180149580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:25.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.111+0000 7f5186038640 1 --2- 172.21.15.72:0/91565260 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f518015b7b0 0x7f51800c28e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:25.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.111+0000 7f5186038640 1 --2- 172.21.15.72:0/91565260 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5168003fa0 0x7f518015dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:25.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.111+0000 7f5186038640 1 -- 172.21.15.72:0/91565260 >> 172.21.15.72:0/91565260 conn(0x7f51800cb350 msgr2=0x7f5180152d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:25.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.111+0000 7f5186038640 1 -- 172.21.15.72:0/91565260 shutdown_connections 2024-05-09T05:53:25.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.111+0000 7f5186038640 1 -- 172.21.15.72:0/91565260 wait complete. 2024-05-09T05:53:25.127 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-05-09T05:53:25.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.291+0000 7f2ab073b640 1 Processor -- start 2024-05-09T05:53:25.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.291+0000 7f2ab073b640 1 -- start start 2024-05-09T05:53:25.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.295+0000 7f2ab073b640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2aa806c7a0 0x7f2aa806cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:25.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.295+0000 7f2ab073b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2aa8072b20 0x7f2aa8072f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:25.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.295+0000 7f2ab073b640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2aa815c1b0 con 0x7f2aa81595c0 2024-05-09T05:53:25.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.295+0000 7f2ab073b640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f2aa815d060 con 0x7f2aa806c7a0 2024-05-09T05:53:25.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.295+0000 7f2ab073b640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f2aa815c450 con 0x7f2aa8072b20 2024-05-09T05:53:25.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.295+0000 7f2aaecd8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2aa8072b20 0x7f2aa8072f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:25.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.295+0000 7f2aadcd6640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2aa806c7a0 0x7f2aa806cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:25.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.295+0000 7f2aaecd8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2aa8072b20 0x7f2aa8072f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.72:44212/0 (socket says 172.21.15.72:44212) 2024-05-09T05:53:25.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.295+0000 7f2aaecd8640 1 -- 172.21.15.72:0/1114191718 learned_addr learned my addr 172.21.15.72:0/1114191718 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:25.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.295+0000 7f2aae4d7640 1 --1- 172.21.15.72:0/1114191718 >> v1:172.21.15.110:6789/0 conn(0x7f2aa81595c0 0x7f2aa80c9320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.72:45858/0 (socket says 172.21.15.72:45858) 2024-05-09T05:53:25.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.295+0000 7f2aaecd8640 1 -- 172.21.15.72:0/1114191718 >> v2:172.21.15.110:3300/0 conn(0x7f2aa806c7a0 msgr2=0x7f2aa806cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:25.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.295+0000 7f2aaecd8640 1 --2- 172.21.15.72:0/1114191718 >> v2:172.21.15.110:3300/0 conn(0x7f2aa806c7a0 0x7f2aa806cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:25.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.295+0000 7f2aaecd8640 1 -- 172.21.15.72:0/1114191718 >> v1:172.21.15.110:6789/0 conn(0x7f2aa81595c0 legacy=0x7f2aa80c9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:25.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.295+0000 7f2aaecd8640 1 -- 172.21.15.72:0/1114191718 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2aa815c730 con 0x7f2aa8072b20 2024-05-09T05:53:25.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.295+0000 7f2aadcd6640 1 --2- 172.21.15.72:0/1114191718 >> v2:172.21.15.110:3300/0 conn(0x7f2aa806c7a0 0x7f2aa806cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T05:53:25.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.299+0000 7f2aaecd8640 1 --2- 172.21.15.72:0/1114191718 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2aa8072b20 0x7f2aa8072f30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2aa0009e50 tx=0x7f2aa001f210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a52b7b567eb1a11e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:25.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.299+0000 7f2aad4d5640 1 -- 172.21.15.72:0/1114191718 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa00b4070 con 0x7f2aa8072b20 2024-05-09T05:53:25.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.299+0000 7f2aad4d5640 1 -- 172.21.15.72:0/1114191718 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2aa00af400 con 0x7f2aa8072b20 2024-05-09T05:53:25.292 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.299+0000 7f2aad4d5640 1 -- 172.21.15.72:0/1114191718 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa00af7d0 con 0x7f2aa8072b20 2024-05-09T05:53:25.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.303+0000 7f2ab073b640 1 -- 172.21.15.72:0/1114191718 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2aa8072b20 msgr2=0x7f2aa8072f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:25.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.303+0000 7f2ab073b640 1 --2- 172.21.15.72:0/1114191718 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2aa8072b20 0x7f2aa8072f30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2aa0009e50 tx=0x7f2aa001f210 comp rx=0 tx=0).stop 2024-05-09T05:53:25.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.303+0000 7f2ab073b640 1 -- 172.21.15.72:0/1114191718 shutdown_connections 2024-05-09T05:53:25.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.303+0000 7f2ab073b640 1 --2- 172.21.15.72:0/1114191718 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2aa8072b20 0x7f2aa8072f30 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:25.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.303+0000 7f2ab073b640 1 --2- 172.21.15.72:0/1114191718 >> v2:172.21.15.110:3300/0 conn(0x7f2aa806c7a0 0x7f2aa806cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:25.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.303+0000 7f2ab073b640 1 -- 172.21.15.72:0/1114191718 >> 172.21.15.72:0/1114191718 conn(0x7f2aa80700d0 msgr2=0x7f2aa80704e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:25.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.303+0000 7f2ab073b640 1 -- 172.21.15.72:0/1114191718 shutdown_connections 2024-05-09T05:53:25.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.303+0000 7f2ab073b640 1 -- 172.21.15.72:0/1114191718 wait complete. 2024-05-09T05:53:25.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.303+0000 7f2ab073b640 1 Processor -- start 2024-05-09T05:53:25.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.303+0000 7f2ab073b640 1 -- start start 2024-05-09T05:53:25.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.307+0000 7f2ab073b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2aa806c7a0 0x7f2aa81f06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:25.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.307+0000 7f2ab073b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2aa8072b20 0x7f2aa8144f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:25.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.307+0000 7f2ab073b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2aa81595c0 0x7f2aa81e3250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:25.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.307+0000 7f2ab073b640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f2aa8073470 con 0x7f2aa806c7a0 2024-05-09T05:53:25.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.307+0000 7f2ab073b640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f2aa815ccf0 con 0x7f2aa8072b20 2024-05-09T05:53:25.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.307+0000 7f2ab073b640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f2aa81599d0 con 0x7f2aa81595c0 2024-05-09T05:53:25.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.307+0000 7f2aae4d7640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2aa806c7a0 0x7f2aa81f06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:25.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.307+0000 7f2aae4d7640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2aa806c7a0 0x7f2aa81f06e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52896/0 (socket says 172.21.15.72:52896) 2024-05-09T05:53:25.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.307+0000 7f2aae4d7640 1 -- 172.21.15.72:0/1435764023 learned_addr learned my addr 172.21.15.72:0/1435764023 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:25.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.307+0000 7f2aadcd6640 1 --2- 172.21.15.72:0/1435764023 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2aa8072b20 0x7f2aa8144f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:25.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.307+0000 7f2aaecd8640 1 --2- 172.21.15.72:0/1435764023 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2aa81595c0 0x7f2aa81e3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:25.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.307+0000 7f2aae4d7640 1 -- 172.21.15.72:0/1435764023 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2aa81595c0 msgr2=0x7f2aa81e3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:25.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.307+0000 7f2aae4d7640 1 --2- 172.21.15.72:0/1435764023 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2aa81595c0 0x7f2aa81e3250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:25.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.307+0000 7f2aae4d7640 1 -- 172.21.15.72:0/1435764023 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2aa8072b20 msgr2=0x7f2aa8144f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:25.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.307+0000 7f2aae4d7640 1 --2- 172.21.15.72:0/1435764023 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2aa8072b20 0x7f2aa8144f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:25.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.307+0000 7f2aae4d7640 1 -- 172.21.15.72:0/1435764023 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2aa814edc0 con 0x7f2aa806c7a0 2024-05-09T05:53:25.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.307+0000 7f2aaecd8640 1 --2- 172.21.15.72:0/1435764023 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2aa81595c0 0x7f2aa81e3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:53:25.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.307+0000 7f2aadcd6640 1 --2- 172.21.15.72:0/1435764023 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2aa8072b20 0x7f2aa8144f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:53:25.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.307+0000 7f2aae4d7640 1 --2- 172.21.15.72:0/1435764023 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2aa806c7a0 0x7f2aa81f06e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c00c430 tx=0x7f2a9c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:25.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.307+0000 7f2a9affd640 1 -- 172.21.15.72:0/1435764023 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c0074e0 con 0x7f2aa806c7a0 2024-05-09T05:53:25.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.307+0000 7f2a9affd640 1 -- 172.21.15.72:0/1435764023 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a9c007680 con 0x7f2aa806c7a0 2024-05-09T05:53:25.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.307+0000 7f2ab073b640 1 -- 172.21.15.72:0/1435764023 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2aa814f060 con 0x7f2aa806c7a0 2024-05-09T05:53:25.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.307+0000 7f2a9affd640 1 -- 172.21.15.72:0/1435764023 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c004a10 con 0x7f2aa806c7a0 2024-05-09T05:53:25.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.307+0000 7f2ab073b640 1 -- 172.21.15.72:0/1435764023 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2aa814e920 con 0x7f2aa806c7a0 2024-05-09T05:53:25.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.307+0000 7f2ab073b640 1 -- 172.21.15.72:0/1435764023 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2aa806a520 con 0x7f2aa806c7a0 2024-05-09T05:53:25.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.307+0000 7f2a9affd640 1 -- 172.21.15.72:0/1435764023 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f2a9c01a020 con 0x7f2aa806c7a0 2024-05-09T05:53:25.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.311+0000 7f2a9affd640 1 --2- 172.21.15.72:0/1435764023 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f2a8c06f400 0x7f2a8c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:25.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.311+0000 7f2a9affd640 1 -- 172.21.15.72:0/1435764023 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 6007+0+0 (secure 0 0 0) 0x7f2a9c08eb10 con 0x7f2aa806c7a0 2024-05-09T05:53:25.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.311+0000 7f2aadcd6640 1 --2- 172.21.15.72:0/1435764023 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f2a8c06f400 0x7f2a8c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:25.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.311+0000 7f2aadcd6640 1 --2- 172.21.15.72:0/1435764023 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f2a8c06f400 0x7f2a8c071910 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2aa80c4ed0 tx=0x7f2aa4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:25.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.315+0000 7f2a9affd640 1 -- 172.21.15.72:0/1435764023 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f2a9c05b9f0 con 0x7f2aa806c7a0 2024-05-09T05:53:25.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:25.475+0000 7f2ab073b640 1 -- 172.21.15.72:0/1435764023 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f2aa81e6cc0 con 0x7f2aa806c7a0 2024-05-09T05:53:27.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.151+0000 7f2a9affd640 1 -- 172.21.15.72:0/1435764023 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) ==== 228+0+0 (secure 0 0 0) 0x7f2a9c05b2f0 con 0x7f2aa806c7a0 2024-05-09T05:53:27.145 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_data_ec' created 2024-05-09T05:53:27.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.155+0000 7f2ab073b640 1 -- 172.21.15.72:0/1435764023 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f2a8c06f400 msgr2=0x7f2a8c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:27.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.155+0000 7f2ab073b640 1 --2- 172.21.15.72:0/1435764023 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f2a8c06f400 0x7f2a8c071910 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2aa80c4ed0 tx=0x7f2aa4008040 comp rx=0 tx=0).stop 2024-05-09T05:53:27.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.155+0000 7f2ab073b640 1 -- 172.21.15.72:0/1435764023 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2aa806c7a0 msgr2=0x7f2aa81f06e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:27.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.155+0000 7f2ab073b640 1 --2- 172.21.15.72:0/1435764023 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2aa806c7a0 0x7f2aa81f06e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c00c430 tx=0x7f2a9c00c8f0 comp rx=0 tx=0).stop 2024-05-09T05:53:27.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.155+0000 7f2ab073b640 1 -- 172.21.15.72:0/1435764023 shutdown_connections 2024-05-09T05:53:27.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.155+0000 7f2ab073b640 1 --2- 172.21.15.72:0/1435764023 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f2a8c06f400 0x7f2a8c071910 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:27.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.155+0000 7f2ab073b640 1 --2- 172.21.15.72:0/1435764023 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2aa81595c0 0x7f2aa81e3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:27.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.155+0000 7f2ab073b640 1 --2- 172.21.15.72:0/1435764023 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2aa8072b20 0x7f2aa8144f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:27.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.155+0000 7f2ab073b640 1 --2- 172.21.15.72:0/1435764023 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2aa806c7a0 0x7f2aa81f06e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:27.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.155+0000 7f2ab073b640 1 -- 172.21.15.72:0/1435764023 >> 172.21.15.72:0/1435764023 conn(0x7f2aa80700d0 msgr2=0x7f2aa81e7360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:27.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.159+0000 7f2ab073b640 1 -- 172.21.15.72:0/1435764023 shutdown_connections 2024-05-09T05:53:27.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.159+0000 7f2ab073b640 1 -- 172.21.15.72:0/1435764023 wait complete. 2024-05-09T05:53:27.185 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-05-09T05:53:27.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.347+0000 7faf481b8640 1 Processor -- start 2024-05-09T05:53:27.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.347+0000 7faf481b8640 1 -- start start 2024-05-09T05:53:27.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.351+0000 7faf481b8640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7faf400b3b70 0x7faf40073c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:27.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.351+0000 7faf481b8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf4015cbd0 0x7faf4015cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:27.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.351+0000 7faf481b8640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf40068dc0 con 0x7faf4015d520 2024-05-09T05:53:27.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.351+0000 7faf481b8640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7faf4006efb0 con 0x7faf400b3b70 2024-05-09T05:53:27.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.351+0000 7faf481b8640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7faf40068820 con 0x7faf4015cbd0 2024-05-09T05:53:27.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.351+0000 7faf45f54640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7faf400b3b70 0x7faf40073c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:27.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.351+0000 7faf45f54640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7faf400b3b70 0x7faf40073c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52904/0 (socket says 172.21.15.72:52904) 2024-05-09T05:53:27.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.351+0000 7faf45f54640 1 -- 172.21.15.72:0/2891856813 learned_addr learned my addr 172.21.15.72:0/2891856813 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:27.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.351+0000 7faf46755640 1 --1- 172.21.15.72:0/2891856813 >> v1:172.21.15.72:6789/0 conn(0x7faf4015d520 0x7faf40159640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:37056/0 (socket says 172.21.15.72:37056) 2024-05-09T05:53:27.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.351+0000 7faf45753640 1 --2- 172.21.15.72:0/2891856813 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf4015cbd0 0x7faf4015cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:27.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.351+0000 7faf45f54640 1 -- 172.21.15.72:0/2891856813 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf4015cbd0 msgr2=0x7faf4015cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:27.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.351+0000 7faf45f54640 1 --2- 172.21.15.72:0/2891856813 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf4015cbd0 0x7faf4015cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:27.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.351+0000 7faf45f54640 1 -- 172.21.15.72:0/2891856813 >> v1:172.21.15.72:6789/0 conn(0x7faf4015d520 legacy=0x7faf40159640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:27.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.351+0000 7faf45f54640 1 -- 172.21.15.72:0/2891856813 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf40068ae0 con 0x7faf400b3b70 2024-05-09T05:53:27.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.355+0000 7faf45f54640 1 --2- 172.21.15.72:0/2891856813 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf400b3b70 0x7faf40073c50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7faf3c009870 tx=0x7faf3c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eff2e0d5a546067a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:27.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.355+0000 7faf44f52640 1 -- 172.21.15.72:0/2891856813 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf3c0b1070 con 0x7faf400b3b70 2024-05-09T05:53:27.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.355+0000 7faf44f52640 1 -- 172.21.15.72:0/2891856813 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf3c0a8050 con 0x7faf400b3b70 2024-05-09T05:53:27.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.355+0000 7faf44f52640 1 -- 172.21.15.72:0/2891856813 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf3c0ac860 con 0x7faf400b3b70 2024-05-09T05:53:27.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.355+0000 7faf481b8640 1 -- 172.21.15.72:0/2891856813 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf400b3b70 msgr2=0x7faf40073c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:27.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.355+0000 7faf481b8640 1 --2- 172.21.15.72:0/2891856813 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf400b3b70 0x7faf40073c50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7faf3c009870 tx=0x7faf3c01c480 comp rx=0 tx=0).stop 2024-05-09T05:53:27.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.355+0000 7faf481b8640 1 -- 172.21.15.72:0/2891856813 shutdown_connections 2024-05-09T05:53:27.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.355+0000 7faf481b8640 1 --2- 172.21.15.72:0/2891856813 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf4015cbd0 0x7faf4015cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:27.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.355+0000 7faf481b8640 1 --2- 172.21.15.72:0/2891856813 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf400b3b70 0x7faf40073c50 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:27.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.355+0000 7faf481b8640 1 -- 172.21.15.72:0/2891856813 >> 172.21.15.72:0/2891856813 conn(0x7faf400cbe10 msgr2=0x7faf400cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:27.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.355+0000 7faf481b8640 1 -- 172.21.15.72:0/2891856813 shutdown_connections 2024-05-09T05:53:27.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.355+0000 7faf481b8640 1 -- 172.21.15.72:0/2891856813 wait complete. 2024-05-09T05:53:27.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.355+0000 7faf481b8640 1 Processor -- start 2024-05-09T05:53:27.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.355+0000 7faf481b8640 1 -- start start 2024-05-09T05:53:27.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.359+0000 7faf481b8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf400b3b70 0x7faf400bff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:27.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.359+0000 7faf481b8640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf4015cbd0 0x7faf401535c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:27.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.359+0000 7faf481b8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf4015d520 0x7faf40073bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:27.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.359+0000 7faf481b8640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7faf4006db80 con 0x7faf4015cbd0 2024-05-09T05:53:27.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.359+0000 7faf481b8640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7faf4006cb90 con 0x7faf4015d520 2024-05-09T05:53:27.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.359+0000 7faf481b8640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7faf4015d930 con 0x7faf400b3b70 2024-05-09T05:53:27.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.359+0000 7faf45753640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf4015cbd0 0x7faf401535c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:27.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.359+0000 7faf45753640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf4015cbd0 0x7faf401535c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52916/0 (socket says 172.21.15.72:52916) 2024-05-09T05:53:27.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.359+0000 7faf45753640 1 -- 172.21.15.72:0/2947880297 learned_addr learned my addr 172.21.15.72:0/2947880297 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:27.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.359+0000 7faf45f54640 1 --2- 172.21.15.72:0/2947880297 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf400b3b70 0x7faf400bff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:27.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.359+0000 7faf46755640 1 --2- 172.21.15.72:0/2947880297 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf4015d520 0x7faf40073bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:27.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.359+0000 7faf45753640 1 -- 172.21.15.72:0/2947880297 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf400b3b70 msgr2=0x7faf400bff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:27.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.359+0000 7faf45753640 1 --2- 172.21.15.72:0/2947880297 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf400b3b70 0x7faf400bff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:27.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.359+0000 7faf45753640 1 -- 172.21.15.72:0/2947880297 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf4015d520 msgr2=0x7faf40073bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:27.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.359+0000 7faf45753640 1 --2- 172.21.15.72:0/2947880297 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf4015d520 0x7faf40073bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:27.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.359+0000 7faf45753640 1 -- 172.21.15.72:0/2947880297 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf400c04d0 con 0x7faf4015cbd0 2024-05-09T05:53:27.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.359+0000 7faf46755640 1 --2- 172.21.15.72:0/2947880297 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf4015d520 0x7faf40073bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:53:27.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.359+0000 7faf45753640 1 --2- 172.21.15.72:0/2947880297 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf4015cbd0 0x7faf401535c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7faf3000d5f0 tx=0x7faf3000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:27.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.359+0000 7faf367fc640 1 -- 172.21.15.72:0/2947880297 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf300125f0 con 0x7faf4015cbd0 2024-05-09T05:53:27.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.359+0000 7faf367fc640 1 -- 172.21.15.72:0/2947880297 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf30019070 con 0x7faf4015cbd0 2024-05-09T05:53:27.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.359+0000 7faf481b8640 1 -- 172.21.15.72:0/2947880297 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf400be680 con 0x7faf4015cbd0 2024-05-09T05:53:27.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.359+0000 7faf367fc640 1 -- 172.21.15.72:0/2947880297 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf300129b0 con 0x7faf4015cbd0 2024-05-09T05:53:27.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.359+0000 7faf481b8640 1 -- 172.21.15.72:0/2947880297 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf401eed40 con 0x7faf4015cbd0 2024-05-09T05:53:27.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.359+0000 7faf481b8640 1 -- 172.21.15.72:0/2947880297 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf4006a520 con 0x7faf4015cbd0 2024-05-09T05:53:27.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.359+0000 7faf367fc640 1 -- 172.21.15.72:0/2947880297 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7faf30012b50 con 0x7faf4015cbd0 2024-05-09T05:53:27.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.363+0000 7faf367fc640 1 --2- 172.21.15.72:0/2947880297 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7faf2406f400 0x7faf24071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:27.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.363+0000 7faf367fc640 1 -- 172.21.15.72:0/2947880297 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6500+0+0 (secure 0 0 0) 0x7faf30090430 con 0x7faf4015cbd0 2024-05-09T05:53:27.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.363+0000 7faf45f54640 1 --2- 172.21.15.72:0/2947880297 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7faf2406f400 0x7faf24071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:27.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.363+0000 7faf45f54640 1 --2- 172.21.15.72:0/2947880297 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7faf2406f400 0x7faf24071910 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7faf3c0ae000 tx=0x7faf3c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:27.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.367+0000 7faf367fc640 1 -- 172.21.15.72:0/2947880297 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7faf3005d0e0 con 0x7faf4015cbd0 2024-05-09T05:53:27.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:27.527+0000 7faf481b8640 1 -- 172.21.15.72:0/2947880297 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7faf40074ce0 con 0x7faf4015cbd0 2024-05-09T05:53:28.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.155+0000 7faf367fc640 1 -- 172.21.15.72:0/2947880297 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v24) ==== 169+0+0 (secure 0 0 0) 0x7faf3005c9e0 con 0x7faf4015cbd0 2024-05-09T05:53:28.148 INFO:teuthology.orchestra.run.smithi072.stderr:set pool 4 allow_ec_overwrites to true 2024-05-09T05:53:28.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.159+0000 7faf481b8640 1 -- 172.21.15.72:0/2947880297 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7faf2406f400 msgr2=0x7faf24071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:28.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.159+0000 7faf481b8640 1 --2- 172.21.15.72:0/2947880297 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7faf2406f400 0x7faf24071910 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7faf3c0ae000 tx=0x7faf3c008040 comp rx=0 tx=0).stop 2024-05-09T05:53:28.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.159+0000 7faf481b8640 1 -- 172.21.15.72:0/2947880297 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf4015cbd0 msgr2=0x7faf401535c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:28.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.159+0000 7faf481b8640 1 --2- 172.21.15.72:0/2947880297 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf4015cbd0 0x7faf401535c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7faf3000d5f0 tx=0x7faf3000dab0 comp rx=0 tx=0).stop 2024-05-09T05:53:28.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.163+0000 7faf481b8640 1 -- 172.21.15.72:0/2947880297 shutdown_connections 2024-05-09T05:53:28.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.163+0000 7faf481b8640 1 --2- 172.21.15.72:0/2947880297 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7faf2406f400 0x7faf24071910 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:28.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.163+0000 7faf481b8640 1 --2- 172.21.15.72:0/2947880297 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf4015d520 0x7faf40073bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:28.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.163+0000 7faf481b8640 1 --2- 172.21.15.72:0/2947880297 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf4015cbd0 0x7faf401535c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:28.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.163+0000 7faf481b8640 1 --2- 172.21.15.72:0/2947880297 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf400b3b70 0x7faf400bff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:28.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.163+0000 7faf481b8640 1 -- 172.21.15.72:0/2947880297 >> 172.21.15.72:0/2947880297 conn(0x7faf400cbe10 msgr2=0x7faf400c99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:28.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.163+0000 7faf481b8640 1 -- 172.21.15.72:0/2947880297 shutdown_connections 2024-05-09T05:53:28.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.163+0000 7faf481b8640 1 -- 172.21.15.72:0/2947880297 wait complete. 2024-05-09T05:53:28.195 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-05-09T05:53:28.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.363+0000 7fd1b1a6d640 1 Processor -- start 2024-05-09T05:53:28.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.363+0000 7fd1b1a6d640 1 -- start start 2024-05-09T05:53:28.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.367+0000 7fd1b1a6d640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd1ac15dea0 0x7fd1ac0745b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:28.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.367+0000 7fd1b1a6d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd1ac074af0 0x7fd1ac164e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:28.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.367+0000 7fd1b1a6d640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1ac0c7c80 con 0x7fd1ac15da90 2024-05-09T05:53:28.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.367+0000 7fd1b1a6d640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fd1ac1513f0 con 0x7fd1ac15dea0 2024-05-09T05:53:28.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.367+0000 7fd1b1a6d640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fd1ac15a4f0 con 0x7fd1ac074af0 2024-05-09T05:53:28.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.367+0000 7fd1aaffd640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd1ac15dea0 0x7fd1ac0745b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:28.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.367+0000 7fd1aaffd640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd1ac15dea0 0x7fd1ac0745b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52934/0 (socket says 172.21.15.72:52934) 2024-05-09T05:53:28.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.367+0000 7fd1aaffd640 1 -- 172.21.15.72:0/1738172281 learned_addr learned my addr 172.21.15.72:0/1738172281 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:28.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.367+0000 7fd1abfff640 1 --2- 172.21.15.72:0/1738172281 >> v2:172.21.15.110:3300/0 conn(0x7fd1ac074af0 0x7fd1ac164e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:28.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.367+0000 7fd1aaffd640 1 -- 172.21.15.72:0/1738172281 >> v2:172.21.15.110:3300/0 conn(0x7fd1ac074af0 msgr2=0x7fd1ac164e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:28.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.367+0000 7fd1aaffd640 1 --2- 172.21.15.72:0/1738172281 >> v2:172.21.15.110:3300/0 conn(0x7fd1ac074af0 0x7fd1ac164e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:28.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.367+0000 7fd1aaffd640 1 -- 172.21.15.72:0/1738172281 >> v1:172.21.15.110:6789/0 conn(0x7fd1ac15da90 legacy=0x7fd1ac0c7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:28.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.367+0000 7fd1aaffd640 1 -- 172.21.15.72:0/1738172281 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1ac0c84f0 con 0x7fd1ac15dea0 2024-05-09T05:53:28.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.367+0000 7fd1abfff640 1 --2- 172.21.15.72:0/1738172281 >> v2:172.21.15.110:3300/0 conn(0x7fd1ac074af0 0x7fd1ac164e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:53:28.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.367+0000 7fd1aaffd640 1 --2- 172.21.15.72:0/1738172281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1ac15dea0 0x7fd1ac0745b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac0c7490 tx=0x7fd1a001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cde185f16abeaffb server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:28.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.367+0000 7fd1aa7fc640 1 -- 172.21.15.72:0/1738172281 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1a00b0070 con 0x7fd1ac15dea0 2024-05-09T05:53:28.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.367+0000 7fd1aa7fc640 1 -- 172.21.15.72:0/1738172281 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1a00ab600 con 0x7fd1ac15dea0 2024-05-09T05:53:28.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.367+0000 7fd1aa7fc640 1 -- 172.21.15.72:0/1738172281 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1a00ab9d0 con 0x7fd1ac15dea0 2024-05-09T05:53:28.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.371+0000 7fd1b1a6d640 1 -- 172.21.15.72:0/1738172281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1ac15dea0 msgr2=0x7fd1ac0745b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:28.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.371+0000 7fd1b1a6d640 1 --2- 172.21.15.72:0/1738172281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1ac15dea0 0x7fd1ac0745b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac0c7490 tx=0x7fd1a001c520 comp rx=0 tx=0).stop 2024-05-09T05:53:28.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.371+0000 7fd1b1a6d640 1 -- 172.21.15.72:0/1738172281 shutdown_connections 2024-05-09T05:53:28.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.371+0000 7fd1b1a6d640 1 --2- 172.21.15.72:0/1738172281 >> v2:172.21.15.110:3300/0 conn(0x7fd1ac074af0 0x7fd1ac164e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:28.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.371+0000 7fd1b1a6d640 1 --2- 172.21.15.72:0/1738172281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1ac15dea0 0x7fd1ac0745b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:28.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.371+0000 7fd1b1a6d640 1 -- 172.21.15.72:0/1738172281 >> 172.21.15.72:0/1738172281 conn(0x7fd1ac0cde90 msgr2=0x7fd1ac0ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:28.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.371+0000 7fd1b1a6d640 1 -- 172.21.15.72:0/1738172281 shutdown_connections 2024-05-09T05:53:28.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.371+0000 7fd1b1a6d640 1 -- 172.21.15.72:0/1738172281 wait complete. 2024-05-09T05:53:28.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.371+0000 7fd1b1a6d640 1 Processor -- start 2024-05-09T05:53:28.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.371+0000 7fd1b1a6d640 1 -- start start 2024-05-09T05:53:28.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.371+0000 7fd1b1a6d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1ac074af0 0x7fd1ac1f9b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:28.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.371+0000 7fd1b1a6d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1ac15da90 0x7fd1ac14c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:28.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.371+0000 7fd1b1a6d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1ac15dea0 0x7fd1ac141570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:28.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.371+0000 7fd1b1a6d640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fd1ac0c70e0 con 0x7fd1ac15da90 2024-05-09T05:53:28.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.371+0000 7fd1b1a6d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fd1ac15ad70 con 0x7fd1ac074af0 2024-05-09T05:53:28.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.371+0000 7fd1b1a6d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fd1ac0c81b0 con 0x7fd1ac15dea0 2024-05-09T05:53:28.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.371+0000 7fd1aaffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1ac15da90 0x7fd1ac14c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:28.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.371+0000 7fd1aaffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1ac15da90 0x7fd1ac14c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52948/0 (socket says 172.21.15.72:52948) 2024-05-09T05:53:28.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.371+0000 7fd1aaffd640 1 -- 172.21.15.72:0/1941905441 learned_addr learned my addr 172.21.15.72:0/1941905441 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:28.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.371+0000 7fd1ab7fe640 1 --2- 172.21.15.72:0/1941905441 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1ac074af0 0x7fd1ac1f9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:28.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.371+0000 7fd1aaffd640 1 -- 172.21.15.72:0/1941905441 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1ac15dea0 msgr2=0x7fd1ac141570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:28.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.371+0000 7fd1abfff640 1 --2- 172.21.15.72:0/1941905441 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1ac15dea0 0x7fd1ac141570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:28.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.371+0000 7fd1aaffd640 1 --2- 172.21.15.72:0/1941905441 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1ac15dea0 0x7fd1ac141570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:28.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.371+0000 7fd1aaffd640 1 -- 172.21.15.72:0/1941905441 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1ac074af0 msgr2=0x7fd1ac1f9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:28.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.371+0000 7fd1aaffd640 1 --2- 172.21.15.72:0/1941905441 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1ac074af0 0x7fd1ac1f9b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:28.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.375+0000 7fd1aaffd640 1 -- 172.21.15.72:0/1941905441 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1ac1fa0b0 con 0x7fd1ac15da90 2024-05-09T05:53:28.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.375+0000 7fd1ab7fe640 1 --2- 172.21.15.72:0/1941905441 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1ac074af0 0x7fd1ac1f9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:53:28.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.375+0000 7fd1aaffd640 1 --2- 172.21.15.72:0/1941905441 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1ac15da90 0x7fd1ac14c490 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd1a001cdc0 tx=0x7fd1a001ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:28.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.375+0000 7fd193fff640 1 -- 172.21.15.72:0/1941905441 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1a00b0040 con 0x7fd1ac15da90 2024-05-09T05:53:28.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.375+0000 7fd193fff640 1 -- 172.21.15.72:0/1941905441 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1a00bc070 con 0x7fd1ac15da90 2024-05-09T05:53:28.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.375+0000 7fd1b1a6d640 1 -- 172.21.15.72:0/1941905441 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1ac0cbb70 con 0x7fd1ac15da90 2024-05-09T05:53:28.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.375+0000 7fd193fff640 1 -- 172.21.15.72:0/1941905441 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1a00b6840 con 0x7fd1ac15da90 2024-05-09T05:53:28.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.375+0000 7fd1b1a6d640 1 -- 172.21.15.72:0/1941905441 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1ac0cb890 con 0x7fd1ac15da90 2024-05-09T05:53:28.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.375+0000 7fd1b1a6d640 1 -- 172.21.15.72:0/1941905441 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1ac14d550 con 0x7fd1ac15da90 2024-05-09T05:53:28.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.375+0000 7fd193fff640 1 -- 172.21.15.72:0/1941905441 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fd1a00ab4c0 con 0x7fd1ac15da90 2024-05-09T05:53:28.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.375+0000 7fd193fff640 1 --2- 172.21.15.72:0/1941905441 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fd19806f430 0x7fd198071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:28.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.375+0000 7fd193fff640 1 -- 172.21.15.72:0/1941905441 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6500+0+0 (secure 0 0 0) 0x7fd1a0129a30 con 0x7fd1ac15da90 2024-05-09T05:53:28.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.375+0000 7fd1ab7fe640 1 --2- 172.21.15.72:0/1941905441 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fd19806f430 0x7fd198071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:28.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.379+0000 7fd1ab7fe640 1 --2- 172.21.15.72:0/1941905441 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fd19806f430 0x7fd198071940 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac0754b0 tx=0x7fd19c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:28.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.379+0000 7fd193fff640 1 -- 172.21.15.72:0/1941905441 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fd1a0016110 con 0x7fd1ac15da90 2024-05-09T05:53:28.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:28.579+0000 7fd1b1a6d640 1 -- 172.21.15.72:0/1941905441 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7fd1ac06a520 con 0x7fd1ac15da90 2024-05-09T05:53:29.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.211+0000 7fd193fff640 1 -- 172.21.15.72:0/1941905441 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v5) ==== 137+0+0 (secure 0 0 0) 0x7fd1a00f6690 con 0x7fd1ac15da90 2024-05-09T05:53:29.205 INFO:teuthology.orchestra.run.smithi072.stderr:added data pool 4 to fsmap 2024-05-09T05:53:29.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.215+0000 7fd1b1a6d640 1 -- 172.21.15.72:0/1941905441 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fd19806f430 msgr2=0x7fd198071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:29.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.215+0000 7fd1b1a6d640 1 --2- 172.21.15.72:0/1941905441 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fd19806f430 0x7fd198071940 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac0754b0 tx=0x7fd19c008040 comp rx=0 tx=0).stop 2024-05-09T05:53:29.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.215+0000 7fd1b1a6d640 1 -- 172.21.15.72:0/1941905441 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1ac15da90 msgr2=0x7fd1ac14c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:29.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.215+0000 7fd1b1a6d640 1 --2- 172.21.15.72:0/1941905441 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1ac15da90 0x7fd1ac14c490 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd1a001cdc0 tx=0x7fd1a001ad60 comp rx=0 tx=0).stop 2024-05-09T05:53:29.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.215+0000 7fd1b1a6d640 1 -- 172.21.15.72:0/1941905441 shutdown_connections 2024-05-09T05:53:29.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.215+0000 7fd1b1a6d640 1 --2- 172.21.15.72:0/1941905441 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fd19806f430 0x7fd198071940 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:29.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.215+0000 7fd1b1a6d640 1 --2- 172.21.15.72:0/1941905441 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1ac15dea0 0x7fd1ac141570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:29.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.215+0000 7fd1b1a6d640 1 --2- 172.21.15.72:0/1941905441 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1ac15da90 0x7fd1ac14c490 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:29.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.215+0000 7fd1b1a6d640 1 --2- 172.21.15.72:0/1941905441 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1ac074af0 0x7fd1ac1f9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:29.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.215+0000 7fd1b1a6d640 1 -- 172.21.15.72:0/1941905441 >> 172.21.15.72:0/1941905441 conn(0x7fd1ac0cde90 msgr2=0x7fd1ac06f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:29.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.215+0000 7fd1b1a6d640 1 -- 172.21.15.72:0/1941905441 shutdown_connections 2024-05-09T05:53:29.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.215+0000 7fd1b1a6d640 1 -- 172.21.15.72:0/1941905441 wait complete. 2024-05-09T05:53:29.234 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:53:29.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.395+0000 7f80f4c19640 1 Processor -- start 2024-05-09T05:53:29.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.395+0000 7f80f4c19640 1 -- start start 2024-05-09T05:53:29.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.395+0000 7f80f4c19640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f80f0159ed0 0x7f80f0153860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:29.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.395+0000 7f80f4c19640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80f0072b00 con 0x7f80f00c73e0 2024-05-09T05:53:29.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.395+0000 7f80f4c19640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80f0072540 con 0x7f80f0072f40 2024-05-09T05:53:29.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.395+0000 7f80f4c19640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f80f0072820 con 0x7f80f0159ed0 2024-05-09T05:53:29.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.395+0000 7f80ee59c640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f80f0159ed0 0x7f80f0153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:29.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.395+0000 7f80eed9d640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f80f00c73e0 0x7f80f0163d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:37058/0 (socket says 172.21.15.72:37058) 2024-05-09T05:53:29.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.395+0000 7f80eed9d640 1 -- 172.21.15.72:0/438523902 learned_addr learned my addr 172.21.15.72:0/438523902 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:53:29.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.395+0000 7f80ed59a640 1 -- 172.21.15.72:0/438523902 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1754718892 0 0) 0x7f80f0072b00 con 0x7f80f00c73e0 2024-05-09T05:53:29.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.395+0000 7f80ed59a640 1 -- 172.21.15.72:0/438523902 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f80d8003530 con 0x7f80f00c73e0 2024-05-09T05:53:29.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.395+0000 7f80ee59c640 1 -- 172.21.15.72:0/438523902 >> v1:172.21.15.110:6789/0 conn(0x7f80f0072f40 legacy=0x7f80f00c6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:29.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.395+0000 7f80ee59c640 1 -- 172.21.15.72:0/438523902 >> v1:172.21.15.72:6789/0 conn(0x7f80f00c73e0 legacy=0x7f80f0163d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:29.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.395+0000 7f80ee59c640 1 -- 172.21.15.72:0/438523902 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80f00c64d0 con 0x7f80f0159ed0 2024-05-09T05:53:29.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.399+0000 7f80ee59c640 1 --2- 172.21.15.72:0/438523902 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f80f0159ed0 0x7f80f0153860 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f80e00097c0 tx=0x7f80e001ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea8c48bc15c8fd11 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:29.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.399+0000 7f80ed59a640 1 -- 172.21.15.72:0/438523902 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e00b5070 con 0x7f80f0159ed0 2024-05-09T05:53:29.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.399+0000 7f80ed59a640 1 -- 172.21.15.72:0/438523902 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80e00a8990 con 0x7f80f0159ed0 2024-05-09T05:53:29.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.399+0000 7f80ed59a640 1 -- 172.21.15.72:0/438523902 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e00a8d40 con 0x7f80f0159ed0 2024-05-09T05:53:29.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.399+0000 7f80f4c19640 1 -- 172.21.15.72:0/438523902 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f80f0159ed0 msgr2=0x7f80f0153860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:29.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.399+0000 7f80f4c19640 1 --2- 172.21.15.72:0/438523902 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f80f0159ed0 0x7f80f0153860 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f80e00097c0 tx=0x7f80e001ec90 comp rx=0 tx=0).stop 2024-05-09T05:53:29.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.399+0000 7f80f4c19640 1 -- 172.21.15.72:0/438523902 shutdown_connections 2024-05-09T05:53:29.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.399+0000 7f80f4c19640 1 --2- 172.21.15.72:0/438523902 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f80f0159ed0 0x7f80f0153860 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:29.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.399+0000 7f80f4c19640 1 -- 172.21.15.72:0/438523902 >> 172.21.15.72:0/438523902 conn(0x7f80f00cde90 msgr2=0x7f80f00ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:29.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.399+0000 7f80f4c19640 1 -- 172.21.15.72:0/438523902 shutdown_connections 2024-05-09T05:53:29.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.399+0000 7f80f4c19640 1 -- 172.21.15.72:0/438523902 wait complete. 2024-05-09T05:53:29.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.403+0000 7f80f4c19640 1 Processor -- start 2024-05-09T05:53:29.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.403+0000 7f80f4c19640 1 -- start start 2024-05-09T05:53:29.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.403+0000 7f80f4c19640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80f0072f40 0x7f80f015c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:29.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.403+0000 7f80f4c19640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80f00c73e0 0x7f80f0152450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:29.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.403+0000 7f80f4c19640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f80f0159ed0 0x7f80f015af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:29.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.403+0000 7f80f4c19640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f80f00c4e30 con 0x7f80f0159ed0 2024-05-09T05:53:29.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.403+0000 7f80f4c19640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f80f00c4cb0 con 0x7f80f00c73e0 2024-05-09T05:53:29.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.403+0000 7f80f4c19640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f80f0073350 con 0x7f80f0072f40 2024-05-09T05:53:29.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.403+0000 7f80eed9d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f80f0159ed0 0x7f80f015af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:29.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.403+0000 7f80eed9d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f80f0159ed0 0x7f80f015af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52960/0 (socket says 172.21.15.72:52960) 2024-05-09T05:53:29.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.403+0000 7f80eed9d640 1 -- 172.21.15.72:0/4282334104 learned_addr learned my addr 172.21.15.72:0/4282334104 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:29.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.403+0000 7f80edd9b640 1 --2- 172.21.15.72:0/4282334104 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80f00c73e0 0x7f80f0152450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:29.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.403+0000 7f80ee59c640 1 --2- 172.21.15.72:0/4282334104 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80f0072f40 0x7f80f015c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:29.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.403+0000 7f80eed9d640 1 -- 172.21.15.72:0/4282334104 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80f0072f40 msgr2=0x7f80f015c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:29.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.403+0000 7f80eed9d640 1 --2- 172.21.15.72:0/4282334104 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80f0072f40 0x7f80f015c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:29.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.403+0000 7f80eed9d640 1 -- 172.21.15.72:0/4282334104 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80f00c73e0 msgr2=0x7f80f0152450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:29.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.403+0000 7f80eed9d640 1 --2- 172.21.15.72:0/4282334104 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80f00c73e0 0x7f80f0152450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:29.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.403+0000 7f80eed9d640 1 -- 172.21.15.72:0/4282334104 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80f015c7a0 con 0x7f80f0159ed0 2024-05-09T05:53:29.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.403+0000 7f80eed9d640 1 --2- 172.21.15.72:0/4282334104 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f80f0159ed0 0x7f80f015af30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f80e800ca50 tx=0x7f80e800cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:29.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.403+0000 7f80deffd640 1 -- 172.21.15.72:0/4282334104 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e8017070 con 0x7f80f0159ed0 2024-05-09T05:53:29.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.403+0000 7f80deffd640 1 -- 172.21.15.72:0/4282334104 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80e800ab70 con 0x7f80f0159ed0 2024-05-09T05:53:29.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.403+0000 7f80f4c19640 1 -- 172.21.15.72:0/4282334104 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80f0158f30 con 0x7f80f0159ed0 2024-05-09T05:53:29.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.403+0000 7f80deffd640 1 -- 172.21.15.72:0/4282334104 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e8012400 con 0x7f80f0159ed0 2024-05-09T05:53:29.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.403+0000 7f80f4c19640 1 -- 172.21.15.72:0/4282334104 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80f015c9b0 con 0x7f80f0159ed0 2024-05-09T05:53:29.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.403+0000 7f80f4c19640 1 -- 172.21.15.72:0/4282334104 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80f006a520 con 0x7f80f0159ed0 2024-05-09T05:53:29.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.407+0000 7f80deffd640 1 -- 172.21.15.72:0/4282334104 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f80e801a070 con 0x7f80f0159ed0 2024-05-09T05:53:29.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.407+0000 7f80deffd640 1 --2- 172.21.15.72:0/4282334104 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f80d006f400 0x7f80d0071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:29.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.407+0000 7f80deffd640 1 -- 172.21.15.72:0/4282334104 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f80e808f200 con 0x7f80f0159ed0 2024-05-09T05:53:29.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.407+0000 7f80ee59c640 1 --2- 172.21.15.72:0/4282334104 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f80d006f400 0x7f80d0071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:29.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.407+0000 7f80ee59c640 1 --2- 172.21.15.72:0/4282334104 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f80d006f400 0x7f80d0071910 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f80e00b2000 tx=0x7f80e0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:29.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.411+0000 7f80deffd640 1 -- 172.21.15.72:0/4282334104 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f80e805bed0 con 0x7f80f0159ed0 2024-05-09T05:53:29.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.607+0000 7f80f4c19640 1 -- 172.21.15.72:0/4282334104 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f80f0074290 con 0x7f80f0159ed0 2024-05-09T05:53:29.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.611+0000 7f80deffd640 1 -- 172.21.15.72:0/4282334104 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+6823 (secure 0 0 0) 0x7f80e805b7d0 con 0x7f80f0159ed0 2024-05-09T05:53:29.603 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:53:29.603 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6834/1142956298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1142956298},{"type":"v1","addr":"172.21.15.72:6834","nonce":1142956298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/3946563056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":3946563056},{"type":"v1","addr":"172.21.15.72:6835","nonce":3946563056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4259,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6838/840351907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":840351907},{"type":"v1","addr":"172.21.15.110:6838","nonce":840351907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/1048256382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":1048256382},{"type":"v1","addr":"172.21.15.72:6837","nonce":1048256382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4287,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6839/966325499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6837","nonce":966325499},{"type":"v1","addr":"172.21.15.110:6839","nonce":966325499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:53:23.494975+0000","modified":"2024-05-09T05:53:28.584905+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:creating","state_seq":1,"addr":"172.21.15.110:6836/4134424941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":4134424941},{"type":"v1","addr":"172.21.15.110:6836","nonce":4134424941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-05-09T05:53:29.603 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 5 2024-05-09T05:53:29.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.611+0000 7f80f4c19640 1 -- 172.21.15.72:0/4282334104 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f80d006f400 msgr2=0x7f80d0071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:29.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.611+0000 7f80f4c19640 1 --2- 172.21.15.72:0/4282334104 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f80d006f400 0x7f80d0071910 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f80e00b2000 tx=0x7f80e0008040 comp rx=0 tx=0).stop 2024-05-09T05:53:29.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.611+0000 7f80f4c19640 1 -- 172.21.15.72:0/4282334104 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f80f0159ed0 msgr2=0x7f80f015af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:29.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.611+0000 7f80f4c19640 1 --2- 172.21.15.72:0/4282334104 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f80f0159ed0 0x7f80f015af30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f80e800ca50 tx=0x7f80e800cf10 comp rx=0 tx=0).stop 2024-05-09T05:53:29.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.611+0000 7f80f4c19640 1 -- 172.21.15.72:0/4282334104 shutdown_connections 2024-05-09T05:53:29.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.611+0000 7f80f4c19640 1 --2- 172.21.15.72:0/4282334104 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f80d006f400 0x7f80d0071910 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:29.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.611+0000 7f80f4c19640 1 --2- 172.21.15.72:0/4282334104 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f80f0159ed0 0x7f80f015af30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:29.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.611+0000 7f80f4c19640 1 --2- 172.21.15.72:0/4282334104 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80f00c73e0 0x7f80f0152450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:29.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.611+0000 7f80f4c19640 1 --2- 172.21.15.72:0/4282334104 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80f0072f40 0x7f80f015c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:29.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.611+0000 7f80f4c19640 1 -- 172.21.15.72:0/4282334104 >> 172.21.15.72:0/4282334104 conn(0x7f80f00cde90 msgr2=0x7f80f0073b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:29.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.611+0000 7f80f4c19640 1 -- 172.21.15.72:0/4282334104 shutdown_connections 2024-05-09T05:53:29.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.611+0000 7f80f4c19640 1 -- 172.21.15.72:0/4282334104 wait complete. 2024-05-09T05:53:29.624 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T05:53:29.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.783+0000 7fe0bacf6640 1 Processor -- start 2024-05-09T05:53:29.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.783+0000 7fe0bacf6640 1 -- start start 2024-05-09T05:53:29.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.787+0000 7fe0bacf6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0b40c77a0 0x7fe0b41537d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:29.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.787+0000 7fe0bacf6640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe0b4074740 0x7fe0b4072e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:29.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.787+0000 7fe0bacf6640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe0b40733b0 0x7fe0b415ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:29.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.787+0000 7fe0bacf6640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fe0b40c72c0 con 0x7fe0b4074740 2024-05-09T05:53:29.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.787+0000 7fe0bacf6640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fe0b40c7bb0 con 0x7fe0b40733b0 2024-05-09T05:53:29.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.787+0000 7fe0bacf6640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fe0b4074460 con 0x7fe0b40c77a0 2024-05-09T05:53:29.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.787+0000 7fe0b3fff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe0b4074740 0x7fe0b4072e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:29.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.787+0000 7fe0b3fff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe0b4074740 0x7fe0b4072e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52962/0 (socket says 172.21.15.72:52962) 2024-05-09T05:53:29.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.787+0000 7fe0b3fff640 1 -- 172.21.15.72:0/1943820952 learned_addr learned my addr 172.21.15.72:0/1943820952 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:29.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.787+0000 7fe0b8a92640 1 --2- 172.21.15.72:0/1943820952 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0b40c77a0 0x7fe0b41537d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:29.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.787+0000 7fe0b9293640 1 --2- 172.21.15.72:0/1943820952 >> v2:172.21.15.110:3300/0 conn(0x7fe0b40733b0 0x7fe0b415ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:29.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.787+0000 7fe0b3fff640 1 -- 172.21.15.72:0/1943820952 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0b40c77a0 msgr2=0x7fe0b41537d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:29.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.787+0000 7fe0b3fff640 1 --2- 172.21.15.72:0/1943820952 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0b40c77a0 0x7fe0b41537d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:29.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.787+0000 7fe0b3fff640 1 -- 172.21.15.72:0/1943820952 >> v2:172.21.15.110:3300/0 conn(0x7fe0b40733b0 msgr2=0x7fe0b415ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:29.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.787+0000 7fe0b3fff640 1 --2- 172.21.15.72:0/1943820952 >> v2:172.21.15.110:3300/0 conn(0x7fe0b40733b0 0x7fe0b415ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:29.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.787+0000 7fe0b3fff640 1 -- 172.21.15.72:0/1943820952 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0b4073af0 con 0x7fe0b4074740 2024-05-09T05:53:29.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.787+0000 7fe0b3fff640 1 --2- 172.21.15.72:0/1943820952 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0b4074740 0x7fe0b4072e70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe0b40ca260 tx=0x7fe0a401e470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e46983168498246f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:29.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.787+0000 7fe0b37fe640 1 -- 172.21.15.72:0/1943820952 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a40b2070 con 0x7fe0b4074740 2024-05-09T05:53:29.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.787+0000 7fe0b37fe640 1 -- 172.21.15.72:0/1943820952 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0a40ad600 con 0x7fe0b4074740 2024-05-09T05:53:29.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.787+0000 7fe0b37fe640 1 -- 172.21.15.72:0/1943820952 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a40ad9d0 con 0x7fe0b4074740 2024-05-09T05:53:29.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.787+0000 7fe0bacf6640 1 -- 172.21.15.72:0/1943820952 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0b4074740 msgr2=0x7fe0b4072e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:29.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.787+0000 7fe0bacf6640 1 --2- 172.21.15.72:0/1943820952 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0b4074740 0x7fe0b4072e70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe0b40ca260 tx=0x7fe0a401e470 comp rx=0 tx=0).stop 2024-05-09T05:53:29.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.787+0000 7fe0bacf6640 1 -- 172.21.15.72:0/1943820952 shutdown_connections 2024-05-09T05:53:29.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.787+0000 7fe0bacf6640 1 --2- 172.21.15.72:0/1943820952 >> v2:172.21.15.110:3300/0 conn(0x7fe0b40733b0 0x7fe0b415ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:29.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.787+0000 7fe0bacf6640 1 --2- 172.21.15.72:0/1943820952 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0b4074740 0x7fe0b4072e70 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:29.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.787+0000 7fe0bacf6640 1 --2- 172.21.15.72:0/1943820952 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0b40c77a0 0x7fe0b41537d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:29.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.787+0000 7fe0bacf6640 1 -- 172.21.15.72:0/1943820952 >> 172.21.15.72:0/1943820952 conn(0x7fe0b40cde90 msgr2=0x7fe0b40ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:29.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.791+0000 7fe0bacf6640 1 -- 172.21.15.72:0/1943820952 shutdown_connections 2024-05-09T05:53:29.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.791+0000 7fe0bacf6640 1 -- 172.21.15.72:0/1943820952 wait complete. 2024-05-09T05:53:29.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.791+0000 7fe0bacf6640 1 Processor -- start 2024-05-09T05:53:29.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.791+0000 7fe0bacf6640 1 -- start start 2024-05-09T05:53:29.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.791+0000 7fe0bacf6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0b40733b0 0x7fe0b41f5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:29.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.791+0000 7fe0bacf6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0b4074740 0x7fe0b40cb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:29.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.791+0000 7fe0bacf6640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0b40c77a0 0x7fe0b41431a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:29.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.791+0000 7fe0bacf6640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b40c4cb0 con 0x7fe0b40c77a0 2024-05-09T05:53:29.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.791+0000 7fe0bacf6640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b4072940 con 0x7fe0b4074740 2024-05-09T05:53:29.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.791+0000 7fe0bacf6640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fe0b40c4e30 con 0x7fe0b40733b0 2024-05-09T05:53:29.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.791+0000 7fe0b9293640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0b40c77a0 0x7fe0b41431a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:29.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.791+0000 7fe0b9293640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0b40c77a0 0x7fe0b41431a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52966/0 (socket says 172.21.15.72:52966) 2024-05-09T05:53:29.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.791+0000 7fe0b9293640 1 -- 172.21.15.72:0/315554917 learned_addr learned my addr 172.21.15.72:0/315554917 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:29.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.791+0000 7fe0b3fff640 1 --2- 172.21.15.72:0/315554917 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0b4074740 0x7fe0b40cb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:29.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.791+0000 7fe0b8a92640 1 --2- 172.21.15.72:0/315554917 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0b40733b0 0x7fe0b41f5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:29.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.791+0000 7fe0b9293640 1 -- 172.21.15.72:0/315554917 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0b40733b0 msgr2=0x7fe0b41f5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:29.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.791+0000 7fe0b9293640 1 --2- 172.21.15.72:0/315554917 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0b40733b0 0x7fe0b41f5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:29.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.791+0000 7fe0b9293640 1 -- 172.21.15.72:0/315554917 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0b4074740 msgr2=0x7fe0b40cb6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:29.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.791+0000 7fe0b9293640 1 --2- 172.21.15.72:0/315554917 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0b4074740 0x7fe0b40cb6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:29.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.791+0000 7fe0b9293640 1 -- 172.21.15.72:0/315554917 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0b4148fb0 con 0x7fe0b40c77a0 2024-05-09T05:53:29.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.791+0000 7fe0b8a92640 1 --2- 172.21.15.72:0/315554917 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0b40733b0 0x7fe0b41f5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:53:29.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.791+0000 7fe0b9293640 1 --2- 172.21.15.72:0/315554917 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0b40c77a0 0x7fe0b41431a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac007d40 tx=0x7fe0ac00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:29.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.791+0000 7fe0b17fa640 1 -- 172.21.15.72:0/315554917 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0ac014420 con 0x7fe0b40c77a0 2024-05-09T05:53:29.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.791+0000 7fe0b17fa640 1 -- 172.21.15.72:0/315554917 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0ac019070 con 0x7fe0b40c77a0 2024-05-09T05:53:29.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.795+0000 7fe0bacf6640 1 -- 172.21.15.72:0/315554917 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0b415ca30 con 0x7fe0b40c77a0 2024-05-09T05:53:29.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.795+0000 7fe0b17fa640 1 -- 172.21.15.72:0/315554917 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0ac014800 con 0x7fe0b40c77a0 2024-05-09T05:53:29.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.795+0000 7fe0bacf6640 1 -- 172.21.15.72:0/315554917 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0b41f5540 con 0x7fe0b40c77a0 2024-05-09T05:53:29.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.795+0000 7fe0bacf6640 1 -- 172.21.15.72:0/315554917 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0b406a520 con 0x7fe0b40c77a0 2024-05-09T05:53:29.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.795+0000 7fe0b17fa640 1 -- 172.21.15.72:0/315554917 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe0ac0149a0 con 0x7fe0b40c77a0 2024-05-09T05:53:29.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.795+0000 7fe0b17fa640 1 --2- 172.21.15.72:0/315554917 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fe09406f430 0x7fe094071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:29.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.795+0000 7fe0b17fa640 1 -- 172.21.15.72:0/315554917 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe0ac08fbe0 con 0x7fe0b40c77a0 2024-05-09T05:53:29.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.795+0000 7fe0b8a92640 1 --2- 172.21.15.72:0/315554917 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fe09406f430 0x7fe094071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:29.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.795+0000 7fe0b8a92640 1 --2- 172.21.15.72:0/315554917 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fe09406f430 0x7fe094071940 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe0b40c41c0 tx=0x7fe09c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:29.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.799+0000 7fe0b17fa640 1 -- 172.21.15.72:0/315554917 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fe0ac05c820 con 0x7fe0b40c77a0 2024-05-09T05:53:29.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.963+0000 7fe0bacf6640 1 -- 172.21.15.72:0/315554917 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe0b40c9080 con 0x7fe0b40c77a0 2024-05-09T05:53:29.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.967+0000 7fe0b17fa640 1 -- 172.21.15.72:0/315554917 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18494 (secure 0 0 0) 0x7fe0ac05c120 con 0x7fe0b40c77a0 2024-05-09T05:53:29.959 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:53:29.959 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"fsid":"44c88cb9-b39b-4787-a871-80ddf0ad6292","created":"2024-05-09T05:52:59.591187+0000","modified":"2024-05-09T05:53:28.584684+0000","last_up_change":"2024-05-09T05:53:10.902489+0000","last_in_change":"2024-05-09T05:53:02.200254+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T05:53:10.503537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T05:53:21.364958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T05:53:22.461477+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-09T05:53:26.171144+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e4af2aa1-ba5c-4411-a72a-a0e38e589a74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":331913921},{"type":"v1","addr":"172.21.15.72:6817","nonce":331913921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":331913921},{"type":"v1","addr":"172.21.15.72:6819","nonce":331913921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":331913921},{"type":"v1","addr":"172.21.15.72:6823","nonce":331913921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":331913921},{"type":"v1","addr":"172.21.15.72:6821","nonce":331913921}]},"public_addr":"172.21.15.72:6817/331913921","cluster_addr":"172.21.15.72:6819/331913921","heartbeat_back_addr":"172.21.15.72:6823/331913921","heartbeat_front_addr":"172.21.15.72:6821/331913921","state":["exists","up"]},{"osd":1,"uuid":"052504f5-a523-4922-bdc7-ce2890faa5ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2197151836},{"type":"v1","addr":"172.21.15.72:6801","nonce":2197151836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2197151836},{"type":"v1","addr":"172.21.15.72:6803","nonce":2197151836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2197151836},{"type":"v1","addr":"172.21.15.72:6811","nonce":2197151836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2197151836},{"type":"v1","addr":"172.21.15.72:6807","nonce":2197151836}]},"public_addr":"172.21.15.72:6801/2197151836","cluster_addr":"172.21.15.72:6803/2197151836","heartbeat_back_addr":"172.21.15.72:6811/2197151836","heartbeat_front_addr":"172.21.15.72:6807/2197151836","state":["exists","up"]},{"osd":2,"uuid":"28bc1c95-6d0d-4263-baad-314d86e6a670","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1273581990},{"type":"v1","addr":"172.21.15.72:6825","nonce":1273581990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":1273581990},{"type":"v1","addr":"172.21.15.72:6827","nonce":1273581990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1273581990},{"type":"v1","addr":"172.21.15.72:6831","nonce":1273581990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1273581990},{"type":"v1","addr":"172.21.15.72:6829","nonce":1273581990}]},"public_addr":"172.21.15.72:6825/1273581990","cluster_addr":"172.21.15.72:6827/1273581990","heartbeat_back_addr":"172.21.15.72:6831/1273581990","heartbeat_front_addr":"172.21.15.72:6829/1273581990","state":["exists","up"]},{"osd":3,"uuid":"edcc86cb-f178-4533-8069-de9d781531ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2180866263},{"type":"v1","addr":"172.21.15.72:6806","nonce":2180866263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2180866263},{"type":"v1","addr":"172.21.15.72:6810","nonce":2180866263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2180866263},{"type":"v1","addr":"172.21.15.72:6815","nonce":2180866263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2180866263},{"type":"v1","addr":"172.21.15.72:6813","nonce":2180866263}]},"public_addr":"172.21.15.72:6806/2180866263","cluster_addr":"172.21.15.72:6810/2180866263","heartbeat_back_addr":"172.21.15.72:6815/2180866263","heartbeat_front_addr":"172.21.15.72:6813/2180866263","state":["exists","up"]},{"osd":4,"uuid":"8d138128-4829-4109-87a1-25f339f3e953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3437318248},{"type":"v1","addr":"172.21.15.110:6817","nonce":3437318248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3437318248},{"type":"v1","addr":"172.21.15.110:6819","nonce":3437318248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3437318248},{"type":"v1","addr":"172.21.15.110:6823","nonce":3437318248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3437318248},{"type":"v1","addr":"172.21.15.110:6821","nonce":3437318248}]},"public_addr":"172.21.15.110:6817/3437318248","cluster_addr":"172.21.15.110:6819/3437318248","heartbeat_back_addr":"172.21.15.110:6823/3437318248","heartbeat_front_addr":"172.21.15.110:6821/3437318248","state":["exists","up"]},{"osd":5,"uuid":"99a4a914-0a0e-4d25-94ae-3e86b8b1aa4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":977576181},{"type":"v1","addr":"172.21.15.110:6825","nonce":977576181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":977576181},{"type":"v1","addr":"172.21.15.110:6827","nonce":977576181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":977576181},{"type":"v1","addr":"172.21.15.110:6831","nonce":977576181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":977576181},{"type":"v1","addr":"172.21.15.110:6829","nonce":977576181}]},"public_addr":"172.21.15.110:6825/977576181","cluster_addr":"172.21.15.110:6827/977576181","heartbeat_back_addr":"172.21.15.110:6831/977576181","heartbeat_front_addr":"172.21.15.110:6829/977576181","state":["exists","up"]},{"osd":6,"uuid":"6e04b295-afc9-4f80-80f7-3df1f5168608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":1817638786},{"type":"v1","addr":"172.21.15.110:6809","nonce":1817638786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":1817638786},{"type":"v1","addr":"172.21.15.110:6811","nonce":1817638786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":1817638786},{"type":"v1","addr":"172.21.15.110:6815","nonce":1817638786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":1817638786},{"type":"v1","addr":"172.21.15.110:6813","nonce":1817638786}]},"public_addr":"172.21.15.110:6809/1817638786","cluster_addr":"172.21.15.110:6811/1817638786","heartbeat_back_addr":"172.21.15.110:6815/1817638786","heartbeat_front_addr":"172.21.15.110:6813/1817638786","state":["exists","up"]},{"osd":7,"uuid":"835de5c9-1e2c-41d8-bd28-d7ffe5ad8fdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":214675920},{"type":"v1","addr":"172.21.15.110:6801","nonce":214675920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":214675920},{"type":"v1","addr":"172.21.15.110:6803","nonce":214675920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":214675920},{"type":"v1","addr":"172.21.15.110:6807","nonce":214675920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":214675920},{"type":"v1","addr":"172.21.15.110:6805","nonce":214675920}]},"public_addr":"172.21.15.110:6801/214675920","cluster_addr":"172.21.15.110:6803/214675920","heartbeat_back_addr":"172.21.15.110:6807/214675920","heartbeat_front_addr":"172.21.15.110:6805/214675920","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.849761+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.670554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.743789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:08.516367+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.665550+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.518775+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.786468+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.794984+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T05:53:29.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.967+0000 7fe0bacf6640 1 -- 172.21.15.72:0/315554917 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fe09406f430 msgr2=0x7fe094071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:29.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.967+0000 7fe0bacf6640 1 --2- 172.21.15.72:0/315554917 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fe09406f430 0x7fe094071940 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe0b40c41c0 tx=0x7fe09c008040 comp rx=0 tx=0).stop 2024-05-09T05:53:29.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.967+0000 7fe0bacf6640 1 -- 172.21.15.72:0/315554917 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0b40c77a0 msgr2=0x7fe0b41431a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:29.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.967+0000 7fe0bacf6640 1 --2- 172.21.15.72:0/315554917 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0b40c77a0 0x7fe0b41431a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac007d40 tx=0x7fe0ac00e4b0 comp rx=0 tx=0).stop 2024-05-09T05:53:29.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.967+0000 7fe0bacf6640 1 -- 172.21.15.72:0/315554917 shutdown_connections 2024-05-09T05:53:29.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.967+0000 7fe0bacf6640 1 --2- 172.21.15.72:0/315554917 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fe09406f430 0x7fe094071940 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:29.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.967+0000 7fe0bacf6640 1 --2- 172.21.15.72:0/315554917 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0b40c77a0 0x7fe0b41431a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:29.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.967+0000 7fe0bacf6640 1 --2- 172.21.15.72:0/315554917 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0b4074740 0x7fe0b40cb6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:29.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.967+0000 7fe0bacf6640 1 --2- 172.21.15.72:0/315554917 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0b40733b0 0x7fe0b41f5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:29.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.967+0000 7fe0bacf6640 1 -- 172.21.15.72:0/315554917 >> 172.21.15.72:0/315554917 conn(0x7fe0b40cde90 msgr2=0x7fe0b4145ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:29.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.967+0000 7fe0bacf6640 1 -- 172.21.15.72:0/315554917 shutdown_connections 2024-05-09T05:53:29.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:29.967+0000 7fe0bacf6640 1 -- 172.21.15.72:0/315554917 wait complete. 2024-05-09T05:53:29.980 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T05:53:30.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.127+0000 7fecf77d8640 1 Processor -- start 2024-05-09T05:53:30.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.127+0000 7fecf77d8640 1 -- start start 2024-05-09T05:53:30.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.127+0000 7fecf77d8640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fecf0165f90 0x7fecf01683b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:30.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.127+0000 7fecf77d8640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecf006d9b0 con 0x7fecf00ca670 2024-05-09T05:53:30.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.127+0000 7fecf77d8640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecf0160040 con 0x7fecf00ca260 2024-05-09T05:53:30.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.127+0000 7fecf77d8640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fecf0160bc0 con 0x7fecf0165f90 2024-05-09T05:53:30.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.127+0000 7fecf4d73640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fecf00ca670 0x7fecf0071dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:37066/0 (socket says 172.21.15.72:37066) 2024-05-09T05:53:30.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.127+0000 7fecf4d73640 1 -- 172.21.15.72:0/3062096230 learned_addr learned my addr 172.21.15.72:0/3062096230 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:53:30.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.127+0000 7fecf5d75640 1 --2- 172.21.15.72:0/3062096230 >> v2:172.21.15.110:3300/0 conn(0x7fecf0165f90 0x7fecf01683b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:30.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.127+0000 7fece7fff640 1 -- 172.21.15.72:0/3062096230 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 153985188 0 0) 0x7fecf006d9b0 con 0x7fecf00ca670 2024-05-09T05:53:30.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.127+0000 7fece7fff640 1 -- 172.21.15.72:0/3062096230 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fecdc003530 con 0x7fecf00ca670 2024-05-09T05:53:30.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.127+0000 7fece7fff640 1 -- 172.21.15.72:0/3062096230 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 158182941 0 0) 0x7fecdc003530 con 0x7fecf00ca670 2024-05-09T05:53:30.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.127+0000 7fece7fff640 1 -- 172.21.15.72:0/3062096230 >> v2:172.21.15.110:3300/0 conn(0x7fecf0165f90 msgr2=0x7fecf01683b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:30.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.127+0000 7fece7fff640 1 --2- 172.21.15.72:0/3062096230 >> v2:172.21.15.110:3300/0 conn(0x7fecf0165f90 0x7fecf01683b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:30.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.127+0000 7fece7fff640 1 -- 172.21.15.72:0/3062096230 >> v1:172.21.15.110:6789/0 conn(0x7fecf00ca260 legacy=0x7fecf015cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:30.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.127+0000 7fece7fff640 1 -- 172.21.15.72:0/3062096230 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecf0160320 con 0x7fecf00ca670 2024-05-09T05:53:30.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.127+0000 7fece7fff640 1 -- 172.21.15.72:0/3062096230 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2749052815 0 0) 0x7fecec001700 con 0x7fecf00ca670 2024-05-09T05:53:30.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.127+0000 7fece7fff640 1 -- 172.21.15.72:0/3062096230 >> v1:172.21.15.72:6789/0 conn(0x7fecf00ca670 legacy=0x7fecf0071dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:30.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.127+0000 7fece7fff640 1 --2- 172.21.15.72:0/3062096230 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecdc003ab0 0x7fecdc003f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:30.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.127+0000 7fece7fff640 1 --2- 172.21.15.72:0/3062096230 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fecdc004810 0x7fecdc004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:30.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.127+0000 7fece7fff640 1 --2- 172.21.15.72:0/3062096230 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fecdc0052b0 0x7fecdc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:30.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.127+0000 7fece7fff640 1 -- 172.21.15.72:0/3062096230 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fecdc00c210 con 0x7fecdc003ab0 2024-05-09T05:53:30.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.127+0000 7fece7fff640 1 -- 172.21.15.72:0/3062096230 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fecdc00c3c0 con 0x7fecdc004810 2024-05-09T05:53:30.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.127+0000 7fece7fff640 1 -- 172.21.15.72:0/3062096230 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fecdc00c5c0 con 0x7fecdc0052b0 2024-05-09T05:53:30.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.127+0000 7fecf5574640 1 --2- 172.21.15.72:0/3062096230 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecdc003ab0 0x7fecdc003f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:30.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.127+0000 7fecf5d75640 1 --2- 172.21.15.72:0/3062096230 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fecdc0052b0 0x7fecdc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:30.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.131+0000 7fecf4d73640 1 --2- 172.21.15.72:0/3062096230 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fecdc004810 0x7fecdc004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:30.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.131+0000 7fecf5574640 1 -- 172.21.15.72:0/3062096230 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fecdc0052b0 msgr2=0x7fecdc00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:30.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.131+0000 7fecf5574640 1 --2- 172.21.15.72:0/3062096230 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fecdc0052b0 0x7fecdc00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:30.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.131+0000 7fecf5574640 1 -- 172.21.15.72:0/3062096230 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fecdc004810 msgr2=0x7fecdc004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:30.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.131+0000 7fecf5574640 1 --2- 172.21.15.72:0/3062096230 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fecdc004810 0x7fecdc004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:30.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.131+0000 7fecf5d75640 1 -- 172.21.15.72:0/3062096230 reap_dead start 2024-05-09T05:53:30.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.131+0000 7fecf5574640 1 -- 172.21.15.72:0/3062096230 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecdc003530 con 0x7fecdc003ab0 2024-05-09T05:53:30.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.131+0000 7fecf5574640 1 --2- 172.21.15.72:0/3062096230 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecdc003ab0 0x7fecdc003f20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fece0001790 tx=0x7fece001c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=810142c2ef892397 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:30.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.131+0000 7fece7fff640 1 -- 172.21.15.72:0/3062096230 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece00013e0 con 0x7fecdc003ab0 2024-05-09T05:53:30.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.131+0000 7fece7fff640 1 -- 172.21.15.72:0/3062096230 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fece00050d0 con 0x7fecdc003ab0 2024-05-09T05:53:30.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.131+0000 7fece7fff640 1 -- 172.21.15.72:0/3062096230 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece00054c0 con 0x7fecdc003ab0 2024-05-09T05:53:30.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.131+0000 7fecf77d8640 1 -- 172.21.15.72:0/3062096230 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecdc003ab0 msgr2=0x7fecdc003f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:30.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.131+0000 7fecf77d8640 1 --2- 172.21.15.72:0/3062096230 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecdc003ab0 0x7fecdc003f20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fece0001790 tx=0x7fece001c390 comp rx=0 tx=0).stop 2024-05-09T05:53:30.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.131+0000 7fecf77d8640 1 -- 172.21.15.72:0/3062096230 shutdown_connections 2024-05-09T05:53:30.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.131+0000 7fecf77d8640 1 --2- 172.21.15.72:0/3062096230 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecdc003ab0 0x7fecdc003f20 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:30.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.131+0000 7fecf77d8640 1 -- 172.21.15.72:0/3062096230 >> 172.21.15.72:0/3062096230 conn(0x7fecf00cf860 msgr2=0x7fecf00cfc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:30.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.131+0000 7fecf77d8640 1 -- 172.21.15.72:0/3062096230 shutdown_connections 2024-05-09T05:53:30.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.135+0000 7fecf77d8640 1 -- 172.21.15.72:0/3062096230 wait complete. 2024-05-09T05:53:30.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.135+0000 7fecf77d8640 1 Processor -- start 2024-05-09T05:53:30.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.135+0000 7fecf77d8640 1 -- start start 2024-05-09T05:53:30.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.135+0000 7fecf77d8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fecdc003ab0 0x7fecf014fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:30.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.135+0000 7fecf77d8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fecf01f6480 0x7fecf014f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:30.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.135+0000 7fecf77d8640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecf00ce9b0 0x7fecf014a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:30.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.135+0000 7fecf77d8640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fecf015fc00 con 0x7fecf00ce9b0 2024-05-09T05:53:30.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.135+0000 7fecf77d8640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fecf0072d80 con 0x7fecf01f6480 2024-05-09T05:53:30.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.135+0000 7fecf77d8640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fecf015fd80 con 0x7fecdc003ab0 2024-05-09T05:53:30.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.135+0000 7fecf5d75640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecf00ce9b0 0x7fecf014a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:30.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.135+0000 7fecf5d75640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecf00ce9b0 0x7fecf014a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52976/0 (socket says 172.21.15.72:52976) 2024-05-09T05:53:30.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.135+0000 7fecf5d75640 1 -- 172.21.15.72:0/2482082581 learned_addr learned my addr 172.21.15.72:0/2482082581 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:30.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.135+0000 7fecf4d73640 1 --2- 172.21.15.72:0/2482082581 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fecf01f6480 0x7fecf014f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:30.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.135+0000 7fecf5574640 1 --2- 172.21.15.72:0/2482082581 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fecdc003ab0 0x7fecf014fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:30.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.135+0000 7fecf5d75640 1 -- 172.21.15.72:0/2482082581 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fecdc003ab0 msgr2=0x7fecf014fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:30.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.135+0000 7fecf5d75640 1 --2- 172.21.15.72:0/2482082581 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fecdc003ab0 0x7fecf014fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:30.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.135+0000 7fecf5d75640 1 -- 172.21.15.72:0/2482082581 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fecf01f6480 msgr2=0x7fecf014f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:30.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.135+0000 7fecf5d75640 1 --2- 172.21.15.72:0/2482082581 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fecf01f6480 0x7fecf014f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:30.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.135+0000 7fecf5d75640 1 -- 172.21.15.72:0/2482082581 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecf014f1a0 con 0x7fecf00ce9b0 2024-05-09T05:53:30.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.135+0000 7fecf5d75640 1 --2- 172.21.15.72:0/2482082581 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecf00ce9b0 0x7fecf014a1a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fecf0075480 tx=0x7fece80115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:30.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.135+0000 7fece5ffb640 1 -- 172.21.15.72:0/2482082581 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece8011e10 con 0x7fecf00ce9b0 2024-05-09T05:53:30.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.135+0000 7fece5ffb640 1 -- 172.21.15.72:0/2482082581 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fece801b070 con 0x7fecf00ce9b0 2024-05-09T05:53:30.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.139+0000 7fecf77d8640 1 -- 172.21.15.72:0/2482082581 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecf01f59a0 con 0x7fecf00ce9b0 2024-05-09T05:53:30.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.139+0000 7fece5ffb640 1 -- 172.21.15.72:0/2482082581 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece80039a0 con 0x7fecf00ce9b0 2024-05-09T05:53:30.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.139+0000 7fecf77d8640 1 -- 172.21.15.72:0/2482082581 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecf01f5f60 con 0x7fecf00ce9b0 2024-05-09T05:53:30.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.139+0000 7fecf77d8640 1 -- 172.21.15.72:0/2482082581 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecf014ef00 con 0x7fecf00ce9b0 2024-05-09T05:53:30.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.139+0000 7fece5ffb640 1 -- 172.21.15.72:0/2482082581 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fece8003b60 con 0x7fecf00ce9b0 2024-05-09T05:53:30.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.139+0000 7fece5ffb640 1 --2- 172.21.15.72:0/2482082581 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fecd406f430 0x7fecd4071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:30.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.139+0000 7fece5ffb640 1 -- 172.21.15.72:0/2482082581 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fece8090a60 con 0x7fecf00ce9b0 2024-05-09T05:53:30.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.139+0000 7fecf5574640 1 --2- 172.21.15.72:0/2482082581 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fecd406f430 0x7fecd4071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:30.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.139+0000 7fecf5574640 1 --2- 172.21.15.72:0/2482082581 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fecd406f430 0x7fecd4071940 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fece00ac000 tx=0x7fece0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:30.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.143+0000 7fece5ffb640 1 -- 172.21.15.72:0/2482082581 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fecf014ef00 con 0x7fecf00ce9b0 2024-05-09T05:53:30.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.295+0000 7fecf77d8640 1 -- 172.21.15.72:0/2482082581 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fecf01f5790 con 0x7fecf00ce9b0 2024-05-09T05:53:30.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.299+0000 7fece5ffb640 1 -- 172.21.15.72:0/2482082581 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18494 (secure 0 0 0) 0x7fece805d780 con 0x7fecf00ce9b0 2024-05-09T05:53:30.291 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:53:30.291 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"fsid":"44c88cb9-b39b-4787-a871-80ddf0ad6292","created":"2024-05-09T05:52:59.591187+0000","modified":"2024-05-09T05:53:28.584684+0000","last_up_change":"2024-05-09T05:53:10.902489+0000","last_in_change":"2024-05-09T05:53:02.200254+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T05:53:10.503537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T05:53:21.364958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T05:53:22.461477+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-09T05:53:26.171144+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e4af2aa1-ba5c-4411-a72a-a0e38e589a74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":331913921},{"type":"v1","addr":"172.21.15.72:6817","nonce":331913921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":331913921},{"type":"v1","addr":"172.21.15.72:6819","nonce":331913921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":331913921},{"type":"v1","addr":"172.21.15.72:6823","nonce":331913921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":331913921},{"type":"v1","addr":"172.21.15.72:6821","nonce":331913921}]},"public_addr":"172.21.15.72:6817/331913921","cluster_addr":"172.21.15.72:6819/331913921","heartbeat_back_addr":"172.21.15.72:6823/331913921","heartbeat_front_addr":"172.21.15.72:6821/331913921","state":["exists","up"]},{"osd":1,"uuid":"052504f5-a523-4922-bdc7-ce2890faa5ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2197151836},{"type":"v1","addr":"172.21.15.72:6801","nonce":2197151836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2197151836},{"type":"v1","addr":"172.21.15.72:6803","nonce":2197151836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2197151836},{"type":"v1","addr":"172.21.15.72:6811","nonce":2197151836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2197151836},{"type":"v1","addr":"172.21.15.72:6807","nonce":2197151836}]},"public_addr":"172.21.15.72:6801/2197151836","cluster_addr":"172.21.15.72:6803/2197151836","heartbeat_back_addr":"172.21.15.72:6811/2197151836","heartbeat_front_addr":"172.21.15.72:6807/2197151836","state":["exists","up"]},{"osd":2,"uuid":"28bc1c95-6d0d-4263-baad-314d86e6a670","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1273581990},{"type":"v1","addr":"172.21.15.72:6825","nonce":1273581990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":1273581990},{"type":"v1","addr":"172.21.15.72:6827","nonce":1273581990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1273581990},{"type":"v1","addr":"172.21.15.72:6831","nonce":1273581990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1273581990},{"type":"v1","addr":"172.21.15.72:6829","nonce":1273581990}]},"public_addr":"172.21.15.72:6825/1273581990","cluster_addr":"172.21.15.72:6827/1273581990","heartbeat_back_addr":"172.21.15.72:6831/1273581990","heartbeat_front_addr":"172.21.15.72:6829/1273581990","state":["exists","up"]},{"osd":3,"uuid":"edcc86cb-f178-4533-8069-de9d781531ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2180866263},{"type":"v1","addr":"172.21.15.72:6806","nonce":2180866263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2180866263},{"type":"v1","addr":"172.21.15.72:6810","nonce":2180866263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2180866263},{"type":"v1","addr":"172.21.15.72:6815","nonce":2180866263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2180866263},{"type":"v1","addr":"172.21.15.72:6813","nonce":2180866263}]},"public_addr":"172.21.15.72:6806/2180866263","cluster_addr":"172.21.15.72:6810/2180866263","heartbeat_back_addr":"172.21.15.72:6815/2180866263","heartbeat_front_addr":"172.21.15.72:6813/2180866263","state":["exists","up"]},{"osd":4,"uuid":"8d138128-4829-4109-87a1-25f339f3e953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3437318248},{"type":"v1","addr":"172.21.15.110:6817","nonce":3437318248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3437318248},{"type":"v1","addr":"172.21.15.110:6819","nonce":3437318248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3437318248},{"type":"v1","addr":"172.21.15.110:6823","nonce":3437318248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3437318248},{"type":"v1","addr":"172.21.15.110:6821","nonce":3437318248}]},"public_addr":"172.21.15.110:6817/3437318248","cluster_addr":"172.21.15.110:6819/3437318248","heartbeat_back_addr":"172.21.15.110:6823/3437318248","heartbeat_front_addr":"172.21.15.110:6821/3437318248","state":["exists","up"]},{"osd":5,"uuid":"99a4a914-0a0e-4d25-94ae-3e86b8b1aa4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":977576181},{"type":"v1","addr":"172.21.15.110:6825","nonce":977576181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":977576181},{"type":"v1","addr":"172.21.15.110:6827","nonce":977576181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":977576181},{"type":"v1","addr":"172.21.15.110:6831","nonce":977576181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":977576181},{"type":"v1","addr":"172.21.15.110:6829","nonce":977576181}]},"public_addr":"172.21.15.110:6825/977576181","cluster_addr":"172.21.15.110:6827/977576181","heartbeat_back_addr":"172.21.15.110:6831/977576181","heartbeat_front_addr":"172.21.15.110:6829/977576181","state":["exists","up"]},{"osd":6,"uuid":"6e04b295-afc9-4f80-80f7-3df1f5168608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":1817638786},{"type":"v1","addr":"172.21.15.110:6809","nonce":1817638786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":1817638786},{"type":"v1","addr":"172.21.15.110:6811","nonce":1817638786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":1817638786},{"type":"v1","addr":"172.21.15.110:6815","nonce":1817638786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":1817638786},{"type":"v1","addr":"172.21.15.110:6813","nonce":1817638786}]},"public_addr":"172.21.15.110:6809/1817638786","cluster_addr":"172.21.15.110:6811/1817638786","heartbeat_back_addr":"172.21.15.110:6815/1817638786","heartbeat_front_addr":"172.21.15.110:6813/1817638786","state":["exists","up"]},{"osd":7,"uuid":"835de5c9-1e2c-41d8-bd28-d7ffe5ad8fdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":214675920},{"type":"v1","addr":"172.21.15.110:6801","nonce":214675920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":214675920},{"type":"v1","addr":"172.21.15.110:6803","nonce":214675920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":214675920},{"type":"v1","addr":"172.21.15.110:6807","nonce":214675920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":214675920},{"type":"v1","addr":"172.21.15.110:6805","nonce":214675920}]},"public_addr":"172.21.15.110:6801/214675920","cluster_addr":"172.21.15.110:6803/214675920","heartbeat_back_addr":"172.21.15.110:6807/214675920","heartbeat_front_addr":"172.21.15.110:6805/214675920","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.849761+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.670554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.743789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:08.516367+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.665550+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.518775+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.786468+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.794984+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T05:53:30.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.299+0000 7fecf77d8640 1 -- 172.21.15.72:0/2482082581 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fecd406f430 msgr2=0x7fecd4071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:30.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.299+0000 7fecf77d8640 1 --2- 172.21.15.72:0/2482082581 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fecd406f430 0x7fecd4071940 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fece00ac000 tx=0x7fece0009040 comp rx=0 tx=0).stop 2024-05-09T05:53:30.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.299+0000 7fecf77d8640 1 -- 172.21.15.72:0/2482082581 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecf00ce9b0 msgr2=0x7fecf014a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:30.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.299+0000 7fecf77d8640 1 --2- 172.21.15.72:0/2482082581 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecf00ce9b0 0x7fecf014a1a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fecf0075480 tx=0x7fece80115a0 comp rx=0 tx=0).stop 2024-05-09T05:53:30.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.303+0000 7fecf77d8640 1 -- 172.21.15.72:0/2482082581 shutdown_connections 2024-05-09T05:53:30.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.303+0000 7fecf77d8640 1 --2- 172.21.15.72:0/2482082581 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fecd406f430 0x7fecd4071940 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:30.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.303+0000 7fecf77d8640 1 --2- 172.21.15.72:0/2482082581 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecf00ce9b0 0x7fecf014a1a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:30.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.303+0000 7fecf77d8640 1 --2- 172.21.15.72:0/2482082581 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fecf01f6480 0x7fecf014f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:30.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.303+0000 7fecf77d8640 1 --2- 172.21.15.72:0/2482082581 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fecdc003ab0 0x7fecf014fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:30.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.303+0000 7fecf77d8640 1 -- 172.21.15.72:0/2482082581 >> 172.21.15.72:0/2482082581 conn(0x7fecf00cf860 msgr2=0x7fecf015b030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:30.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.303+0000 7fecf77d8640 1 -- 172.21.15.72:0/2482082581 shutdown_connections 2024-05-09T05:53:30.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.303+0000 7fecf77d8640 1 -- 172.21.15.72:0/2482082581 wait complete. 2024-05-09T05:53:30.324 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:53:30.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.475+0000 7fe6aa3d5640 1 Processor -- start 2024-05-09T05:53:30.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.475+0000 7fe6aa3d5640 1 -- start start 2024-05-09T05:53:30.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.475+0000 7fe6aa3d5640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe6a415da90 0x7fe6a40c7570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:30.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.475+0000 7fe6aa3d5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe6a415dea0 0x7fe6a40745b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:30.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.475+0000 7fe6aa3d5640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6a415a4f0 con 0x7fe6a4074af0 2024-05-09T05:53:30.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.475+0000 7fe6aa3d5640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fe6a41513f0 con 0x7fe6a415da90 2024-05-09T05:53:30.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.475+0000 7fe6aa3d5640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fe6a40c84f0 con 0x7fe6a415dea0 2024-05-09T05:53:30.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.475+0000 7fe6a3fff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe6a415da90 0x7fe6a40c7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:30.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.475+0000 7fe6a3fff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe6a415da90 0x7fe6a40c7570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52988/0 (socket says 172.21.15.72:52988) 2024-05-09T05:53:30.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.475+0000 7fe6a3fff640 1 -- 172.21.15.72:0/1972588474 learned_addr learned my addr 172.21.15.72:0/1972588474 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:30.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.475+0000 7fe6a37fe640 1 --2- 172.21.15.72:0/1972588474 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe6a415dea0 0x7fe6a40745b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:30.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.475+0000 7fe6a3fff640 1 -- 172.21.15.72:0/1972588474 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe6a415dea0 msgr2=0x7fe6a40745b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:30.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.475+0000 7fe6a3fff640 1 --2- 172.21.15.72:0/1972588474 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe6a415dea0 0x7fe6a40745b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:30.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.475+0000 7fe6a3fff640 1 -- 172.21.15.72:0/1972588474 >> v1:172.21.15.110:6789/0 conn(0x7fe6a4074af0 legacy=0x7fe6a406fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:30.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.475+0000 7fe6a3fff640 1 -- 172.21.15.72:0/1972588474 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6a40c87d0 con 0x7fe6a415da90 2024-05-09T05:53:30.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.479+0000 7fe6a3fff640 1 --2- 172.21.15.72:0/1972588474 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6a415da90 0x7fe6a40c7570 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe698009870 tx=0x7fe69801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7b16ab542e63085 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:30.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.479+0000 7fe6a2ffd640 1 -- 172.21.15.72:0/1972588474 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6980b0070 con 0x7fe6a415da90 2024-05-09T05:53:30.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.479+0000 7fe6a2ffd640 1 -- 172.21.15.72:0/1972588474 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6980ab600 con 0x7fe6a415da90 2024-05-09T05:53:30.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.479+0000 7fe6a2ffd640 1 -- 172.21.15.72:0/1972588474 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6980ab9d0 con 0x7fe6a415da90 2024-05-09T05:53:30.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.479+0000 7fe6aa3d5640 1 -- 172.21.15.72:0/1972588474 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6a415da90 msgr2=0x7fe6a40c7570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:30.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.479+0000 7fe6aa3d5640 1 --2- 172.21.15.72:0/1972588474 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6a415da90 0x7fe6a40c7570 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe698009870 tx=0x7fe69801c560 comp rx=0 tx=0).stop 2024-05-09T05:53:30.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.479+0000 7fe6aa3d5640 1 -- 172.21.15.72:0/1972588474 shutdown_connections 2024-05-09T05:53:30.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.479+0000 7fe6aa3d5640 1 --2- 172.21.15.72:0/1972588474 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe6a415dea0 0x7fe6a40745b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:30.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.479+0000 7fe6aa3d5640 1 --2- 172.21.15.72:0/1972588474 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6a415da90 0x7fe6a40c7570 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:30.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.479+0000 7fe6aa3d5640 1 -- 172.21.15.72:0/1972588474 >> 172.21.15.72:0/1972588474 conn(0x7fe6a40cde90 msgr2=0x7fe6a40ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:30.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.479+0000 7fe6aa3d5640 1 -- 172.21.15.72:0/1972588474 shutdown_connections 2024-05-09T05:53:30.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.479+0000 7fe6aa3d5640 1 -- 172.21.15.72:0/1972588474 wait complete. 2024-05-09T05:53:30.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.479+0000 7fe6aa3d5640 1 Processor -- start 2024-05-09T05:53:30.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.479+0000 7fe6aa3d5640 1 -- start start 2024-05-09T05:53:30.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.483+0000 7fe6aa3d5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6a4074af0 0x7fe6a413fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:30.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.483+0000 7fe6aa3d5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe6a415da90 0x7fe6a415b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:30.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.483+0000 7fe6aa3d5640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6a415dea0 0x7fe6a4148430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:30.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.483+0000 7fe6aa3d5640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a40c81b0 con 0x7fe6a415dea0 2024-05-09T05:53:30.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.483+0000 7fe6aa3d5640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a40c70e0 con 0x7fe6a4074af0 2024-05-09T05:53:30.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.483+0000 7fe6aa3d5640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fe6a4154ab0 con 0x7fe6a415da90 2024-05-09T05:53:30.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.483+0000 7fe6a8972640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6a415dea0 0x7fe6a4148430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:30.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.483+0000 7fe6a8972640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6a415dea0 0x7fe6a4148430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52992/0 (socket says 172.21.15.72:52992) 2024-05-09T05:53:30.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.483+0000 7fe6a8972640 1 -- 172.21.15.72:0/4029762544 learned_addr learned my addr 172.21.15.72:0/4029762544 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:30.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.483+0000 7fe6a3fff640 1 --2- 172.21.15.72:0/4029762544 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6a4074af0 0x7fe6a413fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:30.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.483+0000 7fe6a37fe640 1 --2- 172.21.15.72:0/4029762544 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe6a415da90 0x7fe6a415b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:30.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.483+0000 7fe6a8972640 1 -- 172.21.15.72:0/4029762544 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe6a415da90 msgr2=0x7fe6a415b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:30.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.483+0000 7fe6a8972640 1 --2- 172.21.15.72:0/4029762544 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe6a415da90 0x7fe6a415b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:30.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.483+0000 7fe6a8972640 1 -- 172.21.15.72:0/4029762544 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6a4074af0 msgr2=0x7fe6a413fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:30.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.483+0000 7fe6a8972640 1 --2- 172.21.15.72:0/4029762544 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6a4074af0 0x7fe6a413fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:30.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.483+0000 7fe6a8972640 1 -- 172.21.15.72:0/4029762544 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6a4143410 con 0x7fe6a415dea0 2024-05-09T05:53:30.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.483+0000 7fe6a37fe640 1 --2- 172.21.15.72:0/4029762544 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe6a415da90 0x7fe6a415b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:53:30.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.483+0000 7fe6a8972640 1 --2- 172.21.15.72:0/4029762544 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6a415dea0 0x7fe6a4148430 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe69c00c6b0 tx=0x7fe69c00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:30.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.483+0000 7fe6a0ff9640 1 -- 172.21.15.72:0/4029762544 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe69c003b80 con 0x7fe6a415dea0 2024-05-09T05:53:30.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.483+0000 7fe6a0ff9640 1 -- 172.21.15.72:0/4029762544 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe69c003d20 con 0x7fe6a415dea0 2024-05-09T05:53:30.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.483+0000 7fe6a0ff9640 1 -- 172.21.15.72:0/4029762544 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe69c0052f0 con 0x7fe6a415dea0 2024-05-09T05:53:30.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.483+0000 7fe6aa3d5640 1 -- 172.21.15.72:0/4029762544 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6a4143ba0 con 0x7fe6a415dea0 2024-05-09T05:53:30.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.483+0000 7fe6aa3d5640 1 -- 172.21.15.72:0/4029762544 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6a41423f0 con 0x7fe6a415dea0 2024-05-09T05:53:30.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.483+0000 7fe6aa3d5640 1 -- 172.21.15.72:0/4029762544 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6a4143160 con 0x7fe6a415dea0 2024-05-09T05:53:30.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.483+0000 7fe6a0ff9640 1 -- 172.21.15.72:0/4029762544 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe69c005490 con 0x7fe6a415dea0 2024-05-09T05:53:30.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.487+0000 7fe6a0ff9640 1 --2- 172.21.15.72:0/4029762544 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fe69006f400 0x7fe690071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:30.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.487+0000 7fe6a0ff9640 1 -- 172.21.15.72:0/4029762544 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe69c08f360 con 0x7fe6a415dea0 2024-05-09T05:53:30.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.487+0000 7fe6a3fff640 1 --2- 172.21.15.72:0/4029762544 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fe69006f400 0x7fe690071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:30.478 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.487+0000 7fe6a3fff640 1 --2- 172.21.15.72:0/4029762544 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fe69006f400 0x7fe690071910 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe6980ad000 tx=0x7fe6980a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:30.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.491+0000 7fe6a0ff9640 1 -- 172.21.15.72:0/4029762544 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fe69c05bfa0 con 0x7fe6a415dea0 2024-05-09T05:53:30.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.683+0000 7fe6aa3d5640 1 -- 172.21.15.72:0/4029762544 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe6a406a520 con 0x7fe6a415dea0 2024-05-09T05:53:30.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.687+0000 7fe6a0ff9640 1 -- 172.21.15.72:0/4029762544 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+6828 (secure 0 0 0) 0x7fe69c05b8a0 con 0x7fe6a415dea0 2024-05-09T05:53:30.678 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:53:30.679 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6834/1142956298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1142956298},{"type":"v1","addr":"172.21.15.72:6834","nonce":1142956298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/3946563056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":3946563056},{"type":"v1","addr":"172.21.15.72:6835","nonce":3946563056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4259,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6838/840351907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":840351907},{"type":"v1","addr":"172.21.15.110:6838","nonce":840351907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/1048256382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":1048256382},{"type":"v1","addr":"172.21.15.72:6837","nonce":1048256382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4287,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6839/966325499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6837","nonce":966325499},{"type":"v1","addr":"172.21.15.110:6839","nonce":966325499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:53:23.494975+0000","modified":"2024-05-09T05:53:30.217501+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6836/4134424941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":4134424941},{"type":"v1","addr":"172.21.15.110:6836","nonce":4134424941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4297,"qdb_cluster":[4297]},"id":1}]} 2024-05-09T05:53:30.679 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 7 2024-05-09T05:53:30.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.687+0000 7fe6aa3d5640 1 -- 172.21.15.72:0/4029762544 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fe69006f400 msgr2=0x7fe690071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:30.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.687+0000 7fe6aa3d5640 1 --2- 172.21.15.72:0/4029762544 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fe69006f400 0x7fe690071910 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe6980ad000 tx=0x7fe6980a6000 comp rx=0 tx=0).stop 2024-05-09T05:53:30.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.687+0000 7fe6aa3d5640 1 -- 172.21.15.72:0/4029762544 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6a415dea0 msgr2=0x7fe6a4148430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:30.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.687+0000 7fe6aa3d5640 1 --2- 172.21.15.72:0/4029762544 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6a415dea0 0x7fe6a4148430 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe69c00c6b0 tx=0x7fe69c00cb70 comp rx=0 tx=0).stop 2024-05-09T05:53:30.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.687+0000 7fe6aa3d5640 1 -- 172.21.15.72:0/4029762544 shutdown_connections 2024-05-09T05:53:30.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.687+0000 7fe6aa3d5640 1 --2- 172.21.15.72:0/4029762544 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fe69006f400 0x7fe690071910 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:30.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.687+0000 7fe6aa3d5640 1 --2- 172.21.15.72:0/4029762544 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6a415dea0 0x7fe6a4148430 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:30.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.687+0000 7fe6aa3d5640 1 --2- 172.21.15.72:0/4029762544 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe6a415da90 0x7fe6a415b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:30.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.687+0000 7fe6aa3d5640 1 --2- 172.21.15.72:0/4029762544 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6a4074af0 0x7fe6a413fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:30.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.687+0000 7fe6aa3d5640 1 -- 172.21.15.72:0/4029762544 >> 172.21.15.72:0/4029762544 conn(0x7fe6a40cde90 msgr2=0x7fe6a406f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:30.681 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.687+0000 7fe6aa3d5640 1 -- 172.21.15.72:0/4029762544 shutdown_connections 2024-05-09T05:53:30.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.687+0000 7fe6aa3d5640 1 -- 172.21.15.72:0/4029762544 wait complete. 2024-05-09T05:53:30.699 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T05:53:30.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.859+0000 7f1d7801b640 1 Processor -- start 2024-05-09T05:53:30.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.859+0000 7f1d7801b640 1 -- start start 2024-05-09T05:53:30.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.859+0000 7f1d7801b640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1d700ca960 0x7f1d700cad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:30.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.859+0000 7f1d7801b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d7006c7a0 0x7f1d7006cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:30.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.859+0000 7f1d7801b640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d700cc260 con 0x7f1d7006d2e0 2024-05-09T05:53:30.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.859+0000 7f1d7801b640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f1d7015a5f0 con 0x7f1d700ca960 2024-05-09T05:53:30.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.859+0000 7f1d7801b640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f1d700c8660 con 0x7f1d7006c7a0 2024-05-09T05:53:30.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.859+0000 7f1d75db7640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f1d7006d2e0 0x7f1d70154700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:37076/0 (socket says 172.21.15.72:37076) 2024-05-09T05:53:30.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.859+0000 7f1d75db7640 1 -- 172.21.15.72:0/264660749 learned_addr learned my addr 172.21.15.72:0/264660749 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:53:30.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.859+0000 7f1d755b6640 1 --2- 172.21.15.72:0/264660749 >> v2:172.21.15.72:3300/0 conn(0x7f1d700ca960 0x7f1d700cad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:30.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.859+0000 7f1d765b8640 1 --2- 172.21.15.72:0/264660749 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d7006c7a0 0x7f1d7006cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:30.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.859+0000 7f1d755b6640 1 -- 172.21.15.72:0/264660749 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d7006c7a0 msgr2=0x7f1d7006cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:30.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.859+0000 7f1d755b6640 1 --2- 172.21.15.72:0/264660749 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d7006c7a0 0x7f1d7006cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:30.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.859+0000 7f1d755b6640 1 -- 172.21.15.72:0/264660749 >> v1:172.21.15.72:6789/0 conn(0x7f1d7006d2e0 legacy=0x7f1d70154700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:30.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.859+0000 7f1d755b6640 1 -- 172.21.15.72:0/264660749 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d7006e9f0 con 0x7f1d700ca960 2024-05-09T05:53:30.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.859+0000 7f1d74db5640 1 -- 172.21.15.72:0/264660749 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3059700555 0 0) 0x7f1d6c001120 con 0x7f1d7006d2e0 2024-05-09T05:53:30.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.863+0000 7f1d755b6640 1 --2- 172.21.15.72:0/264660749 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d700ca960 0x7f1d700cad70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1d600097c0 tx=0x7f1d6001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a753593084be5258 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:30.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.863+0000 7f1d74db5640 1 -- 172.21.15.72:0/264660749 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d600b1070 con 0x7f1d700ca960 2024-05-09T05:53:30.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.863+0000 7f1d74db5640 1 -- 172.21.15.72:0/264660749 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d600ac410 con 0x7f1d700ca960 2024-05-09T05:53:30.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.863+0000 7f1d74db5640 1 -- 172.21.15.72:0/264660749 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d600ac7e0 con 0x7f1d700ca960 2024-05-09T05:53:30.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.863+0000 7f1d7801b640 1 -- 172.21.15.72:0/264660749 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d700ca960 msgr2=0x7f1d700cad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:30.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.863+0000 7f1d7801b640 1 --2- 172.21.15.72:0/264660749 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d700ca960 0x7f1d700cad70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1d600097c0 tx=0x7f1d6001c4a0 comp rx=0 tx=0).stop 2024-05-09T05:53:30.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.863+0000 7f1d7801b640 1 -- 172.21.15.72:0/264660749 shutdown_connections 2024-05-09T05:53:30.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.863+0000 7f1d7801b640 1 --2- 172.21.15.72:0/264660749 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d7006c7a0 0x7f1d7006cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:30.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.863+0000 7f1d7801b640 1 --2- 172.21.15.72:0/264660749 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d700ca960 0x7f1d700cad70 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:30.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.863+0000 7f1d7801b640 1 -- 172.21.15.72:0/264660749 >> 172.21.15.72:0/264660749 conn(0x7f1d700cb350 msgr2=0x7f1d700cb760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:30.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.863+0000 7f1d7801b640 1 -- 172.21.15.72:0/264660749 shutdown_connections 2024-05-09T05:53:30.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.863+0000 7f1d7801b640 1 -- 172.21.15.72:0/264660749 wait complete. 2024-05-09T05:53:30.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.867+0000 7f1d7801b640 1 Processor -- start 2024-05-09T05:53:30.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.867+0000 7f1d7801b640 1 -- start start 2024-05-09T05:53:30.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.867+0000 7f1d7801b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d7006c7a0 0x7f1d700cd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:30.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.867+0000 7f1d7801b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d7006d2e0 0x7f1d70151490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:30.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.867+0000 7f1d7801b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d700ca960 0x7f1d701f71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:30.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.867+0000 7f1d7801b640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f1d700c2590 con 0x7f1d7006c7a0 2024-05-09T05:53:30.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.867+0000 7f1d7801b640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f1d700c2410 con 0x7f1d7006d2e0 2024-05-09T05:53:30.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.867+0000 7f1d7801b640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f1d70167790 con 0x7f1d700ca960 2024-05-09T05:53:30.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.867+0000 7f1d75db7640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d7006c7a0 0x7f1d700cd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:30.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.867+0000 7f1d75db7640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d7006c7a0 0x7f1d700cd4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:53012/0 (socket says 172.21.15.72:53012) 2024-05-09T05:53:30.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.867+0000 7f1d75db7640 1 -- 172.21.15.72:0/4266817843 learned_addr learned my addr 172.21.15.72:0/4266817843 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:30.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.867+0000 7f1d755b6640 1 --2- 172.21.15.72:0/4266817843 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d7006d2e0 0x7f1d70151490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:30.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.867+0000 7f1d765b8640 1 --2- 172.21.15.72:0/4266817843 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d700ca960 0x7f1d701f71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:30.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.867+0000 7f1d75db7640 1 -- 172.21.15.72:0/4266817843 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d700ca960 msgr2=0x7f1d701f71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:30.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.867+0000 7f1d75db7640 1 --2- 172.21.15.72:0/4266817843 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d700ca960 0x7f1d701f71d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:30.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.867+0000 7f1d75db7640 1 -- 172.21.15.72:0/4266817843 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d7006d2e0 msgr2=0x7f1d70151490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:30.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.867+0000 7f1d75db7640 1 --2- 172.21.15.72:0/4266817843 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d7006d2e0 0x7f1d70151490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:30.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.867+0000 7f1d75db7640 1 -- 172.21.15.72:0/4266817843 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d700cd9e0 con 0x7f1d7006c7a0 2024-05-09T05:53:30.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.867+0000 7f1d755b6640 1 --2- 172.21.15.72:0/4266817843 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d7006d2e0 0x7f1d70151490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:53:30.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.867+0000 7f1d765b8640 1 --2- 172.21.15.72:0/4266817843 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d700ca960 0x7f1d701f71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:53:30.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.867+0000 7f1d75db7640 1 --2- 172.21.15.72:0/4266817843 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d7006c7a0 0x7f1d700cd4a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c00c460 tx=0x7f1d6c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:30.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.867+0000 7f1d667fc640 1 -- 172.21.15.72:0/4266817843 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c018070 con 0x7f1d7006c7a0 2024-05-09T05:53:30.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.867+0000 7f1d667fc640 1 -- 172.21.15.72:0/4266817843 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d6c007500 con 0x7f1d7006c7a0 2024-05-09T05:53:30.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.867+0000 7f1d7801b640 1 -- 172.21.15.72:0/4266817843 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d700c4260 con 0x7f1d7006c7a0 2024-05-09T05:53:30.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.867+0000 7f1d667fc640 1 -- 172.21.15.72:0/4266817843 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c004a30 con 0x7f1d7006c7a0 2024-05-09T05:53:30.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.867+0000 7f1d7801b640 1 -- 172.21.15.72:0/4266817843 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d700c28b0 con 0x7f1d7006c7a0 2024-05-09T05:53:30.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.867+0000 7f1d7801b640 1 -- 172.21.15.72:0/4266817843 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d7006a520 con 0x7f1d7006c7a0 2024-05-09T05:53:30.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.871+0000 7f1d667fc640 1 -- 172.21.15.72:0/4266817843 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f1d6c01b070 con 0x7f1d7006c7a0 2024-05-09T05:53:30.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.871+0000 7f1d667fc640 1 --2- 172.21.15.72:0/4266817843 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f1d5406f400 0x7f1d54071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:30.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.871+0000 7f1d667fc640 1 -- 172.21.15.72:0/4266817843 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1d6c08e7d0 con 0x7f1d7006c7a0 2024-05-09T05:53:30.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.871+0000 7f1d755b6640 1 --2- 172.21.15.72:0/4266817843 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f1d5406f400 0x7f1d54071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:30.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.871+0000 7f1d755b6640 1 --2- 172.21.15.72:0/4266817843 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f1d5406f400 0x7f1d54071910 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1d600ae000 tx=0x7f1d600a6040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:30.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:30.875+0000 7f1d667fc640 1 -- 172.21.15.72:0/4266817843 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f1d700cc260 con 0x7f1d7006c7a0 2024-05-09T05:53:31.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.027+0000 7f1d7801b640 1 -- 172.21.15.72:0/4266817843 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1d70072810 con 0x7f1d7006c7a0 2024-05-09T05:53:31.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.031+0000 7f1d667fc640 1 -- 172.21.15.72:0/4266817843 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18494 (secure 0 0 0) 0x7f1d6c05b410 con 0x7f1d7006c7a0 2024-05-09T05:53:31.022 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:53:31.022 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"fsid":"44c88cb9-b39b-4787-a871-80ddf0ad6292","created":"2024-05-09T05:52:59.591187+0000","modified":"2024-05-09T05:53:28.584684+0000","last_up_change":"2024-05-09T05:53:10.902489+0000","last_in_change":"2024-05-09T05:53:02.200254+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T05:53:10.503537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T05:53:21.364958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T05:53:22.461477+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-09T05:53:26.171144+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e4af2aa1-ba5c-4411-a72a-a0e38e589a74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":331913921},{"type":"v1","addr":"172.21.15.72:6817","nonce":331913921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":331913921},{"type":"v1","addr":"172.21.15.72:6819","nonce":331913921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":331913921},{"type":"v1","addr":"172.21.15.72:6823","nonce":331913921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":331913921},{"type":"v1","addr":"172.21.15.72:6821","nonce":331913921}]},"public_addr":"172.21.15.72:6817/331913921","cluster_addr":"172.21.15.72:6819/331913921","heartbeat_back_addr":"172.21.15.72:6823/331913921","heartbeat_front_addr":"172.21.15.72:6821/331913921","state":["exists","up"]},{"osd":1,"uuid":"052504f5-a523-4922-bdc7-ce2890faa5ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2197151836},{"type":"v1","addr":"172.21.15.72:6801","nonce":2197151836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2197151836},{"type":"v1","addr":"172.21.15.72:6803","nonce":2197151836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2197151836},{"type":"v1","addr":"172.21.15.72:6811","nonce":2197151836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2197151836},{"type":"v1","addr":"172.21.15.72:6807","nonce":2197151836}]},"public_addr":"172.21.15.72:6801/2197151836","cluster_addr":"172.21.15.72:6803/2197151836","heartbeat_back_addr":"172.21.15.72:6811/2197151836","heartbeat_front_addr":"172.21.15.72:6807/2197151836","state":["exists","up"]},{"osd":2,"uuid":"28bc1c95-6d0d-4263-baad-314d86e6a670","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1273581990},{"type":"v1","addr":"172.21.15.72:6825","nonce":1273581990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":1273581990},{"type":"v1","addr":"172.21.15.72:6827","nonce":1273581990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1273581990},{"type":"v1","addr":"172.21.15.72:6831","nonce":1273581990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1273581990},{"type":"v1","addr":"172.21.15.72:6829","nonce":1273581990}]},"public_addr":"172.21.15.72:6825/1273581990","cluster_addr":"172.21.15.72:6827/1273581990","heartbeat_back_addr":"172.21.15.72:6831/1273581990","heartbeat_front_addr":"172.21.15.72:6829/1273581990","state":["exists","up"]},{"osd":3,"uuid":"edcc86cb-f178-4533-8069-de9d781531ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2180866263},{"type":"v1","addr":"172.21.15.72:6806","nonce":2180866263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2180866263},{"type":"v1","addr":"172.21.15.72:6810","nonce":2180866263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2180866263},{"type":"v1","addr":"172.21.15.72:6815","nonce":2180866263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2180866263},{"type":"v1","addr":"172.21.15.72:6813","nonce":2180866263}]},"public_addr":"172.21.15.72:6806/2180866263","cluster_addr":"172.21.15.72:6810/2180866263","heartbeat_back_addr":"172.21.15.72:6815/2180866263","heartbeat_front_addr":"172.21.15.72:6813/2180866263","state":["exists","up"]},{"osd":4,"uuid":"8d138128-4829-4109-87a1-25f339f3e953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3437318248},{"type":"v1","addr":"172.21.15.110:6817","nonce":3437318248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3437318248},{"type":"v1","addr":"172.21.15.110:6819","nonce":3437318248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3437318248},{"type":"v1","addr":"172.21.15.110:6823","nonce":3437318248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3437318248},{"type":"v1","addr":"172.21.15.110:6821","nonce":3437318248}]},"public_addr":"172.21.15.110:6817/3437318248","cluster_addr":"172.21.15.110:6819/3437318248","heartbeat_back_addr":"172.21.15.110:6823/3437318248","heartbeat_front_addr":"172.21.15.110:6821/3437318248","state":["exists","up"]},{"osd":5,"uuid":"99a4a914-0a0e-4d25-94ae-3e86b8b1aa4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":977576181},{"type":"v1","addr":"172.21.15.110:6825","nonce":977576181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":977576181},{"type":"v1","addr":"172.21.15.110:6827","nonce":977576181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":977576181},{"type":"v1","addr":"172.21.15.110:6831","nonce":977576181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":977576181},{"type":"v1","addr":"172.21.15.110:6829","nonce":977576181}]},"public_addr":"172.21.15.110:6825/977576181","cluster_addr":"172.21.15.110:6827/977576181","heartbeat_back_addr":"172.21.15.110:6831/977576181","heartbeat_front_addr":"172.21.15.110:6829/977576181","state":["exists","up"]},{"osd":6,"uuid":"6e04b295-afc9-4f80-80f7-3df1f5168608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":1817638786},{"type":"v1","addr":"172.21.15.110:6809","nonce":1817638786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":1817638786},{"type":"v1","addr":"172.21.15.110:6811","nonce":1817638786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":1817638786},{"type":"v1","addr":"172.21.15.110:6815","nonce":1817638786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":1817638786},{"type":"v1","addr":"172.21.15.110:6813","nonce":1817638786}]},"public_addr":"172.21.15.110:6809/1817638786","cluster_addr":"172.21.15.110:6811/1817638786","heartbeat_back_addr":"172.21.15.110:6815/1817638786","heartbeat_front_addr":"172.21.15.110:6813/1817638786","state":["exists","up"]},{"osd":7,"uuid":"835de5c9-1e2c-41d8-bd28-d7ffe5ad8fdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":214675920},{"type":"v1","addr":"172.21.15.110:6801","nonce":214675920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":214675920},{"type":"v1","addr":"172.21.15.110:6803","nonce":214675920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":214675920},{"type":"v1","addr":"172.21.15.110:6807","nonce":214675920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":214675920},{"type":"v1","addr":"172.21.15.110:6805","nonce":214675920}]},"public_addr":"172.21.15.110:6801/214675920","cluster_addr":"172.21.15.110:6803/214675920","heartbeat_back_addr":"172.21.15.110:6807/214675920","heartbeat_front_addr":"172.21.15.110:6805/214675920","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.849761+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.670554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.743789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:08.516367+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.665550+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.518775+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.786468+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.794984+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T05:53:31.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.031+0000 7f1d7801b640 1 -- 172.21.15.72:0/4266817843 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f1d5406f400 msgr2=0x7f1d54071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:31.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.031+0000 7f1d7801b640 1 --2- 172.21.15.72:0/4266817843 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f1d5406f400 0x7f1d54071910 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1d600ae000 tx=0x7f1d600a6040 comp rx=0 tx=0).stop 2024-05-09T05:53:31.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.031+0000 7f1d7801b640 1 -- 172.21.15.72:0/4266817843 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d7006c7a0 msgr2=0x7f1d700cd4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:31.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.031+0000 7f1d7801b640 1 --2- 172.21.15.72:0/4266817843 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d7006c7a0 0x7f1d700cd4a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c00c460 tx=0x7f1d6c00c920 comp rx=0 tx=0).stop 2024-05-09T05:53:31.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.031+0000 7f1d7801b640 1 -- 172.21.15.72:0/4266817843 shutdown_connections 2024-05-09T05:53:31.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.031+0000 7f1d7801b640 1 --2- 172.21.15.72:0/4266817843 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f1d5406f400 0x7f1d54071910 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:31.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.031+0000 7f1d7801b640 1 --2- 172.21.15.72:0/4266817843 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d700ca960 0x7f1d701f71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:31.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.031+0000 7f1d7801b640 1 --2- 172.21.15.72:0/4266817843 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d7006d2e0 0x7f1d70151490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:31.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.031+0000 7f1d7801b640 1 --2- 172.21.15.72:0/4266817843 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d7006c7a0 0x7f1d700cd4a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:31.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.031+0000 7f1d7801b640 1 -- 172.21.15.72:0/4266817843 >> 172.21.15.72:0/4266817843 conn(0x7f1d700cb350 msgr2=0x7f1d70075d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:31.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.031+0000 7f1d7801b640 1 -- 172.21.15.72:0/4266817843 shutdown_connections 2024-05-09T05:53:31.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.031+0000 7f1d7801b640 1 -- 172.21.15.72:0/4266817843 wait complete. 2024-05-09T05:53:31.646 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-09T05:53:23.494975+0000', 'modified': '2024-05-09T05:53:30.217501+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4297}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4297': {'gid': 4297, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.110:6836/4134424941', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6834', 'nonce': 4134424941}, {'type': 'v1', 'addr': '172.21.15.110:6836', 'nonce': 4134424941}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4297, 'qdb_cluster': [4297]} 2024-05-09T05:53:31.646 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-09T05:53:31.646 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-09T05:53:31.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.811+0000 7f044cee3640 1 Processor -- start 2024-05-09T05:53:31.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.811+0000 7f044cee3640 1 -- start start 2024-05-09T05:53:31.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.811+0000 7f044cee3640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f044815e470 0x7f044815e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:31.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.811+0000 7f044cee3640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f044815edc0 0x7f044815f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:31.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.811+0000 7f044cee3640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04480cda30 con 0x7f0448156b50 2024-05-09T05:53:31.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.811+0000 7f044cee3640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f04480cc020 con 0x7f044815edc0 2024-05-09T05:53:31.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.811+0000 7f044cee3640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f044815dfe0 con 0x7f044815e470 2024-05-09T05:53:31.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.811+0000 7f0446d9d640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f044815edc0 0x7f044815f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:31.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.811+0000 7f0446d9d640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f044815edc0 0x7f044815f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:53022/0 (socket says 172.21.15.72:53022) 2024-05-09T05:53:31.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.811+0000 7f0446d9d640 1 -- 172.21.15.72:0/2828559671 learned_addr learned my addr 172.21.15.72:0/2828559671 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:31.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.811+0000 7f044659c640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f0448156b50 0x7f0448073ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:37092/0 (socket says 172.21.15.72:37092) 2024-05-09T05:53:31.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.811+0000 7f043ffff640 1 --2- 172.21.15.72:0/2828559671 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f044815e470 0x7f044815e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:31.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.815+0000 7f0446d9d640 1 -- 172.21.15.72:0/2828559671 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f044815e470 msgr2=0x7f044815e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:31.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.815+0000 7f0446d9d640 1 --2- 172.21.15.72:0/2828559671 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f044815e470 0x7f044815e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:31.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.815+0000 7f0446d9d640 1 -- 172.21.15.72:0/2828559671 >> v1:172.21.15.72:6789/0 conn(0x7f0448156b50 legacy=0x7f0448073ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:31.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.815+0000 7f0446d9d640 1 -- 172.21.15.72:0/2828559671 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f044815cdd0 con 0x7f044815edc0 2024-05-09T05:53:31.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.815+0000 7f0445d9b640 1 -- 172.21.15.72:0/2828559671 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1378979413 0 0) 0x7f0438001120 con 0x7f0448156b50 2024-05-09T05:53:31.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.815+0000 7f0446d9d640 1 --2- 172.21.15.72:0/2828559671 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f044815edc0 0x7f044815f1d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0440009e50 tx=0x7f044001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25948ba8e068420d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:31.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.815+0000 7f0445d9b640 1 -- 172.21.15.72:0/2828559671 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04400a5700 con 0x7f044815edc0 2024-05-09T05:53:31.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.815+0000 7f0445d9b640 1 -- 172.21.15.72:0/2828559671 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04400a58a0 con 0x7f044815edc0 2024-05-09T05:53:31.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.815+0000 7f0445d9b640 1 -- 172.21.15.72:0/2828559671 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04400a5c70 con 0x7f044815edc0 2024-05-09T05:53:31.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.815+0000 7f044cee3640 1 -- 172.21.15.72:0/2828559671 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f044815edc0 msgr2=0x7f044815f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:31.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.815+0000 7f044cee3640 1 --2- 172.21.15.72:0/2828559671 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f044815edc0 0x7f044815f1d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0440009e50 tx=0x7f044001ca30 comp rx=0 tx=0).stop 2024-05-09T05:53:31.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.815+0000 7f044cee3640 1 -- 172.21.15.72:0/2828559671 shutdown_connections 2024-05-09T05:53:31.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.815+0000 7f044cee3640 1 --2- 172.21.15.72:0/2828559671 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f044815edc0 0x7f044815f1d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:31.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.815+0000 7f044cee3640 1 --2- 172.21.15.72:0/2828559671 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f044815e470 0x7f044815e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:31.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.815+0000 7f044cee3640 1 -- 172.21.15.72:0/2828559671 >> 172.21.15.72:0/2828559671 conn(0x7f04480d1b70 msgr2=0x7f04480d1f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:31.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.815+0000 7f044cee3640 1 -- 172.21.15.72:0/2828559671 shutdown_connections 2024-05-09T05:53:31.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.815+0000 7f044cee3640 1 -- 172.21.15.72:0/2828559671 wait complete. 2024-05-09T05:53:31.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.819+0000 7f044cee3640 1 Processor -- start 2024-05-09T05:53:31.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.819+0000 7f044cee3640 1 -- start start 2024-05-09T05:53:31.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.819+0000 7f044cee3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0448156b50 0x7f044814d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:31.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.819+0000 7f044cee3640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f044815e470 0x7f04481f6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:31.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.819+0000 7f044cee3640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f044815edc0 0x7f04481ef960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:31.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.819+0000 7f044cee3640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f044815c9b0 con 0x7f044815e470 2024-05-09T05:53:31.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.819+0000 7f044cee3640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f0448074cf0 con 0x7f0448156b50 2024-05-09T05:53:31.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.819+0000 7f044cee3640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f044815cb30 con 0x7f044815edc0 2024-05-09T05:53:31.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.819+0000 7f043ffff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f044815e470 0x7f04481f6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:31.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.819+0000 7f043ffff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f044815e470 0x7f04481f6610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:53028/0 (socket says 172.21.15.72:53028) 2024-05-09T05:53:31.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.819+0000 7f043ffff640 1 -- 172.21.15.72:0/3828181032 learned_addr learned my addr 172.21.15.72:0/3828181032 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:31.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.819+0000 7f044659c640 1 --2- 172.21.15.72:0/3828181032 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0448156b50 0x7f044814d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:31.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.819+0000 7f0446d9d640 1 --2- 172.21.15.72:0/3828181032 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f044815edc0 0x7f04481ef960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:31.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.819+0000 7f043ffff640 1 -- 172.21.15.72:0/3828181032 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f044815edc0 msgr2=0x7f04481ef960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:31.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.819+0000 7f043ffff640 1 --2- 172.21.15.72:0/3828181032 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f044815edc0 0x7f04481ef960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:31.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.819+0000 7f043ffff640 1 -- 172.21.15.72:0/3828181032 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0448156b50 msgr2=0x7f044814d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:31.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.819+0000 7f043ffff640 1 --2- 172.21.15.72:0/3828181032 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0448156b50 0x7f044814d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:31.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.819+0000 7f043ffff640 1 -- 172.21.15.72:0/3828181032 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04481f6b50 con 0x7f044815e470 2024-05-09T05:53:31.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.819+0000 7f044659c640 1 --2- 172.21.15.72:0/3828181032 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0448156b50 0x7f044814d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:53:31.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.823+0000 7f043ffff640 1 --2- 172.21.15.72:0/3828181032 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f044815e470 0x7f04481f6610 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f043000d620 tx=0x7f043000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:31.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.823+0000 7f043effd640 1 -- 172.21.15.72:0/3828181032 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f043000b620 con 0x7f044815e470 2024-05-09T05:53:31.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.823+0000 7f043effd640 1 -- 172.21.15.72:0/3828181032 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0430019070 con 0x7f044815e470 2024-05-09T05:53:31.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.823+0000 7f044cee3640 1 -- 172.21.15.72:0/3828181032 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04481f5e30 con 0x7f044815e470 2024-05-09T05:53:31.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.823+0000 7f043effd640 1 -- 172.21.15.72:0/3828181032 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f043000b9e0 con 0x7f044815e470 2024-05-09T05:53:31.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.823+0000 7f044cee3640 1 -- 172.21.15.72:0/3828181032 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f044814fa10 con 0x7f044815e470 2024-05-09T05:53:31.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.823+0000 7f043effd640 1 -- 172.21.15.72:0/3828181032 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f043000bb80 con 0x7f044815e470 2024-05-09T05:53:31.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.823+0000 7f043effd640 1 --2- 172.21.15.72:0/3828181032 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f042806f400 0x7f0428071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:31.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.823+0000 7f043effd640 1 -- 172.21.15.72:0/3828181032 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f043008f990 con 0x7f044815e470 2024-05-09T05:53:31.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.823+0000 7f044659c640 1 --2- 172.21.15.72:0/3828181032 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f042806f400 0x7f0428071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:31.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.823+0000 7f0454241000 1 Processor -- start 2024-05-09T05:53:31.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.823+0000 7f0454241000 1 -- start start 2024-05-09T05:53:31.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.827+0000 7f044659c640 1 --2- 172.21.15.72:0/3828181032 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f042806f400 0x7f0428071910 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0438007fd0 tx=0x7f0438009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:31.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.827+0000 7f0454241000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55681f8c4bd0 0x55681fa05bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:31.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.827+0000 7f0454241000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55681f8bd180 0x55681fa060f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:31.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.827+0000 7f0454241000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55681f8a6d50 0x55681fa06630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:31.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.827+0000 7f0454241000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55681f8abcc0 con 0x55681f8c4bd0 2024-05-09T05:53:31.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.827+0000 7f0454241000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55681f7c6370 con 0x55681f8bd180 2024-05-09T05:53:31.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.827+0000 7f0454241000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x55681f8138c0 con 0x55681f8a6d50 2024-05-09T05:53:31.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.827+0000 7f044659c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55681f8c4bd0 0x55681fa05bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:31.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.827+0000 7f044659c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55681f8c4bd0 0x55681fa05bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:53044/0 (socket says 172.21.15.72:53044) 2024-05-09T05:53:31.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.827+0000 7f044659c640 1 -- 172.21.15.72:0/1215132849 learned_addr learned my addr 172.21.15.72:0/1215132849 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:31.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.827+0000 7f043ffff640 1 --2- 172.21.15.72:0/1215132849 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55681f8bd180 0x55681fa060f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:31.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.827+0000 7f044659c640 1 -- 172.21.15.72:0/1215132849 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55681f8a6d50 msgr2=0x55681fa06630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:31.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.827+0000 7f044659c640 1 --2- 172.21.15.72:0/1215132849 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55681f8a6d50 0x55681fa06630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:31.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.827+0000 7f044659c640 1 -- 172.21.15.72:0/1215132849 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55681f8bd180 msgr2=0x55681fa060f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:31.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.827+0000 7f044659c640 1 --2- 172.21.15.72:0/1215132849 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55681f8bd180 0x55681fa060f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:31.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.827+0000 7f044659c640 1 -- 172.21.15.72:0/1215132849 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55681f7d4ef0 con 0x55681f8c4bd0 2024-05-09T05:53:31.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.827+0000 7f044659c640 1 --2- 172.21.15.72:0/1215132849 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55681f8c4bd0 0x55681fa05bb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0438007360 tx=0x7f0438010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1b52925726f8d59 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:31.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.827+0000 7f0427fff640 1 -- 172.21.15.72:0/1215132849 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f043800d9a0 con 0x55681f8c4bd0 2024-05-09T05:53:31.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.827+0000 7f0427fff640 1 -- 172.21.15.72:0/1215132849 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f043800db40 con 0x55681f8c4bd0 2024-05-09T05:53:31.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.827+0000 7f0427fff640 1 -- 172.21.15.72:0/1215132849 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0438020450 con 0x55681f8c4bd0 2024-05-09T05:53:31.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.827+0000 7f0454241000 1 -- 172.21.15.72:0/1215132849 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55681f8c4bd0 msgr2=0x55681fa05bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:31.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.827+0000 7f0454241000 1 --2- 172.21.15.72:0/1215132849 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55681f8c4bd0 0x55681fa05bb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0438007360 tx=0x7f0438010000 comp rx=0 tx=0).stop 2024-05-09T05:53:31.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.827+0000 7f0454241000 1 -- 172.21.15.72:0/1215132849 shutdown_connections 2024-05-09T05:53:31.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.827+0000 7f0454241000 1 --2- 172.21.15.72:0/1215132849 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55681f8a6d50 0x55681fa06630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:31.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.827+0000 7f0454241000 1 --2- 172.21.15.72:0/1215132849 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55681f8bd180 0x55681fa060f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:31.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.827+0000 7f0454241000 1 --2- 172.21.15.72:0/1215132849 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55681f8c4bd0 0x55681fa05bb0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:31.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.827+0000 7f0454241000 1 -- 172.21.15.72:0/1215132849 >> 172.21.15.72:0/1215132849 conn(0x55681f4d1730 msgr2=0x55681fa03970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:31.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.827+0000 7f0454241000 1 -- 172.21.15.72:0/1215132849 shutdown_connections 2024-05-09T05:53:31.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.827+0000 7f0454241000 1 -- 172.21.15.72:0/1215132849 wait complete. 2024-05-09T05:53:31.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.827+0000 7f0454241000 1 -- start start 2024-05-09T05:53:31.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.827+0000 7f0454241000 1 Processor -- start 2024-05-09T05:53:31.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.831+0000 7f0454241000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55681f8a6d50 0x55681fa10c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:31.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.831+0000 7f0454241000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55681f8bd180 0x55681fa111a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:31.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.831+0000 7f0454241000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55681f8c4bd0 0x55681f9c6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:31.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.831+0000 7f0454241000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55681f80f880 con 0x55681f8bd180 2024-05-09T05:53:31.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.831+0000 7f0454241000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55681f7cca00 con 0x55681f8a6d50 2024-05-09T05:53:31.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.831+0000 7f0454241000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x55681f7b3910 con 0x55681f8c4bd0 2024-05-09T05:53:31.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.831+0000 7f0454241000 10 client.0 _ll_register_callbacks cb 0x55681f9b0100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T05:53:31.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.831+0000 7f043ffff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55681f8bd180 0x55681fa111a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:31.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.831+0000 7f043ffff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55681f8bd180 0x55681fa111a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:53052/0 (socket says 172.21.15.72:53052) 2024-05-09T05:53:31.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.831+0000 7f043ffff640 1 -- 172.21.15.72:0/2839747418 learned_addr learned my addr 172.21.15.72:0/2839747418 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:31.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.831+0000 7f044659c640 1 --2- 172.21.15.72:0/2839747418 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55681f8a6d50 0x55681fa10c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:31.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.831+0000 7f0446d9d640 1 --2- 172.21.15.72:0/2839747418 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55681f8c4bd0 0x55681f9c6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:31.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.831+0000 7f043ffff640 1 -- 172.21.15.72:0/2839747418 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55681f8c4bd0 msgr2=0x55681f9c6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:31.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.831+0000 7f043ffff640 1 --2- 172.21.15.72:0/2839747418 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55681f8c4bd0 0x55681f9c6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:31.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.831+0000 7f043ffff640 1 -- 172.21.15.72:0/2839747418 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55681f8a6d50 msgr2=0x55681fa10c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:31.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.831+0000 7f043ffff640 1 --2- 172.21.15.72:0/2839747418 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55681f8a6d50 0x55681fa10c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:31.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.831+0000 7f043ffff640 1 -- 172.21.15.72:0/2839747418 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55681f7ccc50 con 0x55681f8bd180 2024-05-09T05:53:31.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.831+0000 7f043ffff640 1 --2- 172.21.15.72:0/2839747418 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55681f8bd180 0x55681fa111a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f043005bc60 tx=0x7f043005b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3e5f3fc8c567864 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:31.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.831+0000 7f04257fa640 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-09T05:53:31.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.831+0000 7f04257fa640 1 -- 172.21.15.72:0/2839747418 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f043005bf60 con 0x55681f8bd180 2024-05-09T05:53:31.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.831+0000 7f04257fa640 1 -- 172.21.15.72:0/2839747418 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f043005b1c0 con 0x55681f8bd180 2024-05-09T05:53:31.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.831+0000 7f0454241000 1 -- 172.21.15.72:0/2839747418 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f043800db40 con 0x55681f8bd180 2024-05-09T05:53:31.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.831+0000 7f04257fa640 1 -- 172.21.15.72:0/2839747418 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f0430060310 con 0x55681f8bd180 2024-05-09T05:53:31.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.831+0000 7f0454241000 10 client.4392 fetch_fsmap learned FSMap version 7 2024-05-09T05:53:31.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.831+0000 7f0454241000 1 -- 172.21.15.72:0/2839747418 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55681f7ca650 con 0x55681f8bd180 2024-05-09T05:53:31.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.831+0000 7f04257fa640 1 -- 172.21.15.72:0/2839747418 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f043800db40 con 0x55681f8bd180 2024-05-09T05:53:31.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.831+0000 7f04257fa640 1 -- 172.21.15.72:0/2839747418 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 7) ==== 4712+0+0 (secure 0 0 0) 0x7f043005f070 con 0x55681f8bd180 2024-05-09T05:53:31.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.831+0000 7f0454241000 10 client.4392 fetch_fsmap finished waiting for FSMap version 7 2024-05-09T05:53:31.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.831+0000 7f0454241000 10 client.4392 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-09T05:53:31.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.831+0000 7f0454241000 20 client.4392 populate_metadata read hostname 'smithi072' 2024-05-09T05:53:31.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.831+0000 7f0454241000 1 --2- 172.21.15.72:0/2839747418 >> [v2:172.21.15.110:6834/4134424941,v1:172.21.15.110:6836/4134424941] conn(0x55681f4b77d0 0x55681f9c7330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:31.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.831+0000 7f0454241000 4 client.4392 mds_command: new command op to 4297 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T05:53:31.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.831+0000 7f0454241000 1 -- 172.21.15.72:0/2839747418 --> [v2:172.21.15.110:6834/4134424941,v1:172.21.15.110:6836/4134424941] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55681f7ac620 con 0x55681f4b77d0 2024-05-09T05:53:31.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.831+0000 7f044659c640 1 --2- 172.21.15.72:0/2839747418 >> [v2:172.21.15.110:6834/4134424941,v1:172.21.15.110:6836/4134424941] conn(0x55681f4b77d0 0x55681f9c7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:31.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.831+0000 7f044659c640 1 -- 172.21.15.72:0/2839747418 >> [v2:172.21.15.110:6834/4134424941,v1:172.21.15.110:6836/4134424941] conn(0x55681f4b77d0 msgr2=0x55681f9c7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 17 2024-05-09T05:53:31.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.831+0000 7f044659c640 1 -- 172.21.15.72:0/2839747418 >> [v2:172.21.15.110:6834/4134424941,v1:172.21.15.110:6836/4134424941] conn(0x55681f4b77d0 msgr2=0x55681f9c7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-09T05:53:31.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.831+0000 7f044659c640 1 --2- 172.21.15.72:0/2839747418 >> [v2:172.21.15.110:6834/4134424941,v1:172.21.15.110:6836/4134424941] conn(0x55681f4b77d0 0x55681f9c7330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-09T05:53:31.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:31.831+0000 7f044659c640 1 --2- 172.21.15.72:0/2839747418 >> [v2:172.21.15.110:6834/4134424941,v1:172.21.15.110:6836/4134424941] conn(0x55681f4b77d0 0x55681f9c7330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-09T05:53:32.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:32.031+0000 7f044659c640 1 --2- 172.21.15.72:0/2839747418 >> [v2:172.21.15.110:6834/4134424941,v1:172.21.15.110:6836/4134424941] conn(0x55681f4b77d0 0x55681f9c7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:32.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:32.035+0000 7f044659c640 1 --2- 172.21.15.72:0/2839747418 >> [v2:172.21.15.110:6834/4134424941,v1:172.21.15.110:6836/4134424941] conn(0x55681f4b77d0 0x55681f9c7330 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1ceb1de4ac75b75 server_cookie=e1f6bfc11576eab5 in_seq=0 out_seq=0 2024-05-09T05:53:32.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:32.035+0000 7f04257fa640 10 client.4392 ms_handle_connect on v2:172.21.15.110:6834/4134424941 2024-05-09T05:53:35.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.223+0000 7f04257fa640 1 -- 172.21.15.72:0/2839747418 <== mds.0 v2:172.21.15.110:6834/4134424941 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55681f7ac620 con 0x55681f4b77d0 2024-05-09T05:53:35.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.223+0000 7f04257fa640 10 client.4392 handle_command_reply: tid=0 2024-05-09T05:53:35.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.223+0000 7f0454241000 1 client.4392 shutdown 2024-05-09T05:53:35.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.223+0000 7f0454241000 1 -- 172.21.15.72:0/2839747418 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55681f8bd180 msgr2=0x55681fa111a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:35.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.223+0000 7f0454241000 1 --2- 172.21.15.72:0/2839747418 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55681f8bd180 0x55681fa111a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f043005bc60 tx=0x7f043005b6d0 comp rx=0 tx=0).stop 2024-05-09T05:53:35.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.223+0000 7f0454241000 1 -- 172.21.15.72:0/2839747418 shutdown_connections 2024-05-09T05:53:35.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.223+0000 7f0454241000 1 --2- 172.21.15.72:0/2839747418 >> [v2:172.21.15.110:6834/4134424941,v1:172.21.15.110:6836/4134424941] conn(0x55681f4b77d0 0x55681f9c7330 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:35.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.223+0000 7f0454241000 1 --2- 172.21.15.72:0/2839747418 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55681f8c4bd0 0x55681f9c6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:35.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.223+0000 7f0454241000 1 --2- 172.21.15.72:0/2839747418 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55681f8bd180 0x55681fa111a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:35.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.223+0000 7f0454241000 1 --2- 172.21.15.72:0/2839747418 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55681f8a6d50 0x55681fa10c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:35.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.223+0000 7f0454241000 1 -- 172.21.15.72:0/2839747418 >> 172.21.15.72:0/2839747418 conn(0x55681f4d1730 msgr2=0x55681fa02b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:35.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.223+0000 7f04257fa640 0 client.4392 ms_handle_reset on v2:172.21.15.110:6834/4134424941 2024-05-09T05:53:35.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.223+0000 7f0454241000 1 -- 172.21.15.72:0/2839747418 shutdown_connections 2024-05-09T05:53:35.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.223+0000 7f0454241000 1 -- 172.21.15.72:0/2839747418 wait complete. 2024-05-09T05:53:35.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.223+0000 7f0454241000 20 client.4392 trim_cache size 0 max 16384 2024-05-09T05:53:35.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.251+0000 7f0454241000 1 Processor -- start 2024-05-09T05:53:35.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.251+0000 7f0454241000 1 -- start start 2024-05-09T05:53:35.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.255+0000 7f0454241000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55681f8a6d50 0x55681fa757f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:35.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.255+0000 7f0454241000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55681f8bd180 0x55681f9c9340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:35.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.255+0000 7f0454241000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55681f8c4bd0 0x55681f9c9880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:35.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.255+0000 7f0454241000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f0448202540 con 0x55681f8bd180 2024-05-09T05:53:35.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.255+0000 7f0454241000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f0448202b90 con 0x55681f8a6d50 2024-05-09T05:53:35.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.255+0000 7f0454241000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x55681fa00740 con 0x55681f8c4bd0 2024-05-09T05:53:35.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.255+0000 7f043ffff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55681f8bd180 0x55681f9c9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:35.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.255+0000 7f043ffff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55681f8bd180 0x55681f9c9340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42882/0 (socket says 172.21.15.72:42882) 2024-05-09T05:53:35.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.255+0000 7f043ffff640 1 -- 172.21.15.72:0/1520380659 learned_addr learned my addr 172.21.15.72:0/1520380659 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:35.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.255+0000 7f044659c640 1 --2- 172.21.15.72:0/1520380659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55681f8a6d50 0x55681fa757f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:35.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.255+0000 7f0446d9d640 1 --2- 172.21.15.72:0/1520380659 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55681f8c4bd0 0x55681f9c9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:35.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.255+0000 7f043ffff640 1 -- 172.21.15.72:0/1520380659 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55681f8c4bd0 msgr2=0x55681f9c9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:35.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.255+0000 7f043ffff640 1 --2- 172.21.15.72:0/1520380659 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55681f8c4bd0 0x55681f9c9880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:35.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.255+0000 7f043ffff640 1 -- 172.21.15.72:0/1520380659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55681f8a6d50 msgr2=0x55681fa757f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:35.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.255+0000 7f043ffff640 1 --2- 172.21.15.72:0/1520380659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55681f8a6d50 0x55681fa757f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:35.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.255+0000 7f043ffff640 1 -- 172.21.15.72:0/1520380659 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55681f8950e0 con 0x55681f8bd180 2024-05-09T05:53:35.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.255+0000 7f043ffff640 1 --2- 172.21.15.72:0/1520380659 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55681f8bd180 0x55681f9c9340 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f043008fcb0 tx=0x7f043008f070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f62d73c66b7f7e6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:35.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.255+0000 7f04277fe640 1 -- 172.21.15.72:0/1520380659 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f043005bd30 con 0x55681f8bd180 2024-05-09T05:53:35.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.255+0000 7f04277fe640 1 -- 172.21.15.72:0/1520380659 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f043005ba70 con 0x55681f8bd180 2024-05-09T05:53:35.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.255+0000 7f04277fe640 1 -- 172.21.15.72:0/1520380659 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f043005bf60 con 0x55681f8bd180 2024-05-09T05:53:35.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.259+0000 7f0454241000 1 -- 172.21.15.72:0/1520380659 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55681f8bd180 msgr2=0x55681f9c9340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:35.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.259+0000 7f0454241000 1 --2- 172.21.15.72:0/1520380659 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55681f8bd180 0x55681f9c9340 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f043008fcb0 tx=0x7f043008f070 comp rx=0 tx=0).stop 2024-05-09T05:53:35.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.259+0000 7f0454241000 1 -- 172.21.15.72:0/1520380659 shutdown_connections 2024-05-09T05:53:35.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.259+0000 7f0454241000 1 --2- 172.21.15.72:0/1520380659 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55681f8c4bd0 0x55681f9c9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:35.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.259+0000 7f0454241000 1 --2- 172.21.15.72:0/1520380659 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55681f8bd180 0x55681f9c9340 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:35.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.259+0000 7f0454241000 1 --2- 172.21.15.72:0/1520380659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55681f8a6d50 0x55681fa757f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:35.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.259+0000 7f0454241000 1 -- 172.21.15.72:0/1520380659 >> 172.21.15.72:0/1520380659 conn(0x55681f4d1730 msgr2=0x55681fa74ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:35.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.259+0000 7f0454241000 1 -- 172.21.15.72:0/1520380659 shutdown_connections 2024-05-09T05:53:35.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.259+0000 7f0454241000 1 -- 172.21.15.72:0/1520380659 wait complete. 2024-05-09T05:53:35.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.259+0000 7f0454241000 1 -- start start 2024-05-09T05:53:35.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.259+0000 7f0454241000 1 Processor -- start 2024-05-09T05:53:35.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.259+0000 7f0454241000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55681f8a6d50 0x55681fa163e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:35.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.259+0000 7f0454241000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55681f8bd180 0x55681fa3d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:35.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.259+0000 7f0454241000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55681f8c4bd0 0x55681fa3dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:35.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.259+0000 7f0454241000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55681f812bd0 con 0x55681f8a6d50 2024-05-09T05:53:35.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.259+0000 7f0454241000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55681f9cdd90 con 0x55681f8bd180 2024-05-09T05:53:35.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.259+0000 7f0454241000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x55681f820cc0 con 0x55681f8c4bd0 2024-05-09T05:53:35.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.259+0000 7f0454241000 10 client.0 _ll_register_callbacks cb 0x7f04300073c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T05:53:35.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.259+0000 7f044659c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55681f8a6d50 0x55681fa163e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:35.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.259+0000 7f044659c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55681f8a6d50 0x55681fa163e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42894/0 (socket says 172.21.15.72:42894) 2024-05-09T05:53:35.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.259+0000 7f044659c640 1 -- 172.21.15.72:0/2462602668 learned_addr learned my addr 172.21.15.72:0/2462602668 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:35.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.259+0000 7f043ffff640 1 --2- 172.21.15.72:0/2462602668 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55681f8bd180 0x55681fa3d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:35.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.259+0000 7f0446d9d640 1 --2- 172.21.15.72:0/2462602668 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55681f8c4bd0 0x55681fa3dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:35.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.259+0000 7f044659c640 1 -- 172.21.15.72:0/2462602668 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55681f8c4bd0 msgr2=0x55681fa3dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:35.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.259+0000 7f044659c640 1 --2- 172.21.15.72:0/2462602668 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55681f8c4bd0 0x55681fa3dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:35.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.259+0000 7f044659c640 1 -- 172.21.15.72:0/2462602668 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55681f8bd180 msgr2=0x55681fa3d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:35.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.259+0000 7f044659c640 1 --2- 172.21.15.72:0/2462602668 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55681f8bd180 0x55681fa3d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:35.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.259+0000 7f044659c640 1 -- 172.21.15.72:0/2462602668 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55681f86bf90 con 0x55681f8a6d50 2024-05-09T05:53:35.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.259+0000 7f043ffff640 1 --2- 172.21.15.72:0/2462602668 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55681f8bd180 0x55681fa3d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:53:35.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.259+0000 7f044659c640 1 --2- 172.21.15.72:0/2462602668 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55681f8a6d50 0x55681fa163e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0438007330 tx=0x7f0438000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=840e55b30201b1be server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:35.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.259+0000 7f04257fa640 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-09T05:53:35.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.259+0000 7f04257fa640 1 -- 172.21.15.72:0/2462602668 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f043802fe60 con 0x55681f8a6d50 2024-05-09T05:53:35.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.259+0000 7f04257fa640 1 -- 172.21.15.72:0/2462602668 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f0438014a20 con 0x55681f8a6d50 2024-05-09T05:53:35.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.259+0000 7f0454241000 1 -- 172.21.15.72:0/2462602668 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f043005ba70 con 0x55681f8a6d50 2024-05-09T05:53:35.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.259+0000 7f04257fa640 1 -- 172.21.15.72:0/2462602668 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f0438014c20 con 0x55681f8a6d50 2024-05-09T05:53:35.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.259+0000 7f0454241000 10 client.4398 fetch_fsmap learned FSMap version 7 2024-05-09T05:53:35.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.259+0000 7f0454241000 1 -- 172.21.15.72:0/2462602668 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55681f7b7f30 con 0x55681f8a6d50 2024-05-09T05:53:35.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.263+0000 7f04257fa640 1 -- 172.21.15.72:0/2462602668 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f043005ba70 con 0x55681f8a6d50 2024-05-09T05:53:35.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.263+0000 7f04257fa640 1 -- 172.21.15.72:0/2462602668 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 7) ==== 4712+0+0 (secure 0 0 0) 0x7f043802f3e0 con 0x55681f8a6d50 2024-05-09T05:53:35.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.263+0000 7f0454241000 10 client.4398 fetch_fsmap finished waiting for FSMap version 7 2024-05-09T05:53:35.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.263+0000 7f0454241000 10 client.4398 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-09T05:53:35.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.263+0000 7f0454241000 20 client.4398 populate_metadata read hostname 'smithi072' 2024-05-09T05:53:35.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.263+0000 7f0454241000 1 --2- 172.21.15.72:0/2462602668 >> [v2:172.21.15.110:6834/4134424941,v1:172.21.15.110:6836/4134424941] conn(0x55681f4a5830 0x55681fa84d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:35.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.263+0000 7f0454241000 4 client.4398 mds_command: new command op to 4297 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-09T05:53:35.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.263+0000 7f0454241000 1 -- 172.21.15.72:0/2462602668 --> [v2:172.21.15.110:6834/4134424941,v1:172.21.15.110:6836/4134424941] -- command(tid 0: {"prefix": "status"}) -- 0x55681f8214d0 con 0x55681f4a5830 2024-05-09T05:53:35.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.263+0000 7f043ffff640 1 --2- 172.21.15.72:0/2462602668 >> [v2:172.21.15.110:6834/4134424941,v1:172.21.15.110:6836/4134424941] conn(0x55681f4a5830 0x55681fa84d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:35.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.263+0000 7f043ffff640 1 --2- 172.21.15.72:0/2462602668 >> [v2:172.21.15.110:6834/4134424941,v1:172.21.15.110:6836/4134424941] conn(0x55681f4a5830 0x55681fa84d90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b0b52b69c9a2d0 server_cookie=89c5a2947555554a in_seq=0 out_seq=0 2024-05-09T05:53:35.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.263+0000 7f04257fa640 10 client.4398 ms_handle_connect on v2:172.21.15.110:6834/4134424941 2024-05-09T05:53:35.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.263+0000 7f04257fa640 1 -- 172.21.15.72:0/2462602668 <== mds.0 v2:172.21.15.110:6834/4134424941 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55681f8214d0 con 0x55681f4a5830 2024-05-09T05:53:35.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.263+0000 7f04257fa640 10 client.4398 handle_command_reply: tid=0 2024-05-09T05:53:35.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.263+0000 7f0454241000 1 client.4398 shutdown 2024-05-09T05:53:35.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.263+0000 7f0454241000 1 -- 172.21.15.72:0/2462602668 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55681f8a6d50 msgr2=0x55681fa163e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:35.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.263+0000 7f0454241000 1 --2- 172.21.15.72:0/2462602668 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55681f8a6d50 0x55681fa163e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0438007330 tx=0x7f0438000ee0 comp rx=0 tx=0).stop 2024-05-09T05:53:35.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.263+0000 7f0454241000 1 -- 172.21.15.72:0/2462602668 shutdown_connections 2024-05-09T05:53:35.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.263+0000 7f0454241000 1 --2- 172.21.15.72:0/2462602668 >> [v2:172.21.15.110:6834/4134424941,v1:172.21.15.110:6836/4134424941] conn(0x55681f4a5830 0x55681fa84d90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:35.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.263+0000 7f0454241000 1 --2- 172.21.15.72:0/2462602668 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55681f8c4bd0 0x55681fa3dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:35.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.263+0000 7f0454241000 1 --2- 172.21.15.72:0/2462602668 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55681f8bd180 0x55681fa3d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:35.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.263+0000 7f04257fa640 0 client.4398 ms_handle_reset on v2:172.21.15.110:6834/4134424941 2024-05-09T05:53:35.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.263+0000 7f0454241000 1 --2- 172.21.15.72:0/2462602668 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55681f8a6d50 0x55681fa163e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:35.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.263+0000 7f0454241000 1 -- 172.21.15.72:0/2462602668 >> 172.21.15.72:0/2462602668 conn(0x55681f4d1730 msgr2=0x55681f9ca770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:35.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.263+0000 7f0454241000 1 -- 172.21.15.72:0/2462602668 shutdown_connections 2024-05-09T05:53:35.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.263+0000 7f0454241000 1 -- 172.21.15.72:0/2462602668 wait complete. 2024-05-09T05:53:35.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.263+0000 7f0454241000 20 client.4398 trim_cache size 0 max 16384 2024-05-09T05:53:35.258 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-05-09T05:53:35.259 INFO:teuthology.orchestra.run.smithi072.stdout: "cluster_fsid": "44c88cb9-b39b-4787-a871-80ddf0ad6292", 2024-05-09T05:53:35.259 INFO:teuthology.orchestra.run.smithi072.stdout: "whoami": 0, 2024-05-09T05:53:35.259 INFO:teuthology.orchestra.run.smithi072.stdout: "id": 4297, 2024-05-09T05:53:35.259 INFO:teuthology.orchestra.run.smithi072.stdout: "want_state": "up:active", 2024-05-09T05:53:35.259 INFO:teuthology.orchestra.run.smithi072.stdout: "state": "up:active", 2024-05-09T05:53:35.259 INFO:teuthology.orchestra.run.smithi072.stdout: "fs_name": "cephfs", 2024-05-09T05:53:35.259 INFO:teuthology.orchestra.run.smithi072.stdout: "rank_uptime": 11.154451903, 2024-05-09T05:53:35.259 INFO:teuthology.orchestra.run.smithi072.stdout: "mdsmap_epoch": 6, 2024-05-09T05:53:35.259 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch": 25, 2024-05-09T05:53:35.259 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch_barrier": 25, 2024-05-09T05:53:35.259 INFO:teuthology.orchestra.run.smithi072.stdout: "uptime": 16.990004334999998 2024-05-09T05:53:35.259 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-05-09T05:53:35.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.263+0000 7f044cee3640 1 -- 172.21.15.72:0/3828181032 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f042806f400 msgr2=0x7f0428071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:35.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.263+0000 7f044cee3640 1 --2- 172.21.15.72:0/3828181032 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f042806f400 0x7f0428071910 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0438007fd0 tx=0x7f0438009040 comp rx=0 tx=0).stop 2024-05-09T05:53:35.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.263+0000 7f044cee3640 1 -- 172.21.15.72:0/3828181032 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f044815e470 msgr2=0x7f04481f6610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:35.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.263+0000 7f044cee3640 1 --2- 172.21.15.72:0/3828181032 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f044815e470 0x7f04481f6610 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f043000d620 tx=0x7f043000dae0 comp rx=0 tx=0).stop 2024-05-09T05:53:35.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.263+0000 7f044cee3640 1 -- 172.21.15.72:0/3828181032 shutdown_connections 2024-05-09T05:53:35.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.263+0000 7f044cee3640 1 --2- 172.21.15.72:0/3828181032 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f042806f400 0x7f0428071910 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:35.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.263+0000 7f044cee3640 1 --2- 172.21.15.72:0/3828181032 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f044815edc0 0x7f04481ef960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:35.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.263+0000 7f044cee3640 1 --2- 172.21.15.72:0/3828181032 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f044815e470 0x7f04481f6610 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:35.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.263+0000 7f044cee3640 1 --2- 172.21.15.72:0/3828181032 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0448156b50 0x7f044814d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:35.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.263+0000 7f044cee3640 1 -- 172.21.15.72:0/3828181032 >> 172.21.15.72:0/3828181032 conn(0x7f04480d1b70 msgr2=0x7f04480d1f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:35.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.263+0000 7f044cee3640 1 -- 172.21.15.72:0/3828181032 shutdown_connections 2024-05-09T05:53:35.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.263+0000 7f044cee3640 1 -- 172.21.15.72:0/3828181032 wait complete. 2024-05-09T05:53:35.278 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-09T05:53:35.278 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-05-09T05:53:35.278 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-09T05:53:35.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.431+0000 7f9c35098640 1 Processor -- start 2024-05-09T05:53:35.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.431+0000 7f9c35098640 1 -- start start 2024-05-09T05:53:35.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.435+0000 7f9c35098640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9c3015dea0 0x7f9c300745b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:35.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.435+0000 7f9c35098640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9c30074af0 0x7f9c30164e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:35.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.435+0000 7f9c35098640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c300c7c80 con 0x7f9c3015da90 2024-05-09T05:53:35.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.435+0000 7f9c35098640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f9c301513f0 con 0x7f9c3015dea0 2024-05-09T05:53:35.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.435+0000 7f9c35098640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f9c3015a4f0 con 0x7f9c30074af0 2024-05-09T05:53:35.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.435+0000 7f9c2ed9d640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f9c3015da90 0x7f9c300c7570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:50090/0 (socket says 172.21.15.72:50090) 2024-05-09T05:53:35.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.435+0000 7f9c2ed9d640 1 -- 172.21.15.72:0/2949718119 learned_addr learned my addr 172.21.15.72:0/2949718119 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:53:35.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.435+0000 7f9c2659c640 1 --2- 172.21.15.72:0/2949718119 >> v2:172.21.15.110:3300/0 conn(0x7f9c3015dea0 0x7f9c300745b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:35.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.435+0000 7f9c2f59e640 1 --2- 172.21.15.72:0/2949718119 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9c30074af0 0x7f9c30164e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:35.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.435+0000 7f9c2e59c640 1 -- 172.21.15.72:0/2949718119 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1065706483 0 0) 0x7f9c300c7c80 con 0x7f9c3015da90 2024-05-09T05:53:35.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.435+0000 7f9c2e59c640 1 -- 172.21.15.72:0/2949718119 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c1c003530 con 0x7f9c3015da90 2024-05-09T05:53:35.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.435+0000 7f9c2e59c640 1 -- 172.21.15.72:0/2949718119 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 309427395 0 0) 0x7f9c1c003530 con 0x7f9c3015da90 2024-05-09T05:53:35.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.435+0000 7f9c2e59c640 1 -- 172.21.15.72:0/2949718119 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9c30074af0 msgr2=0x7f9c30164e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:35.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.435+0000 7f9c2e59c640 1 --2- 172.21.15.72:0/2949718119 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9c30074af0 0x7f9c30164e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:35.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.435+0000 7f9c2e59c640 1 -- 172.21.15.72:0/2949718119 >> v2:172.21.15.110:3300/0 conn(0x7f9c3015dea0 msgr2=0x7f9c300745b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:35.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.435+0000 7f9c2e59c640 1 --2- 172.21.15.72:0/2949718119 >> v2:172.21.15.110:3300/0 conn(0x7f9c3015dea0 0x7f9c300745b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:35.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.435+0000 7f9c2e59c640 1 -- 172.21.15.72:0/2949718119 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c300c84f0 con 0x7f9c3015da90 2024-05-09T05:53:35.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.435+0000 7f9c2e59c640 1 -- 172.21.15.72:0/2949718119 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2749052815 0 0) 0x7f9c20001700 con 0x7f9c3015da90 2024-05-09T05:53:35.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.435+0000 7f9c2e59c640 1 -- 172.21.15.72:0/2949718119 >> v1:172.21.15.72:6789/0 conn(0x7f9c3015da90 legacy=0x7f9c300c7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:35.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.435+0000 7f9c2e59c640 1 --2- 172.21.15.72:0/2949718119 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c1c003a10 0x7f9c1c003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:35.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.435+0000 7f9c2e59c640 1 --2- 172.21.15.72:0/2949718119 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c1c004810 0x7f9c1c004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:35.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.435+0000 7f9c2e59c640 1 --2- 172.21.15.72:0/2949718119 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9c30074af0 0x7f9c1c005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:35.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.435+0000 7f9c2e59c640 1 -- 172.21.15.72:0/2949718119 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f9c3015a4f0 con 0x7f9c1c004810 2024-05-09T05:53:35.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.435+0000 7f9c2e59c640 1 -- 172.21.15.72:0/2949718119 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f9c1c00ba80 con 0x7f9c1c003a10 2024-05-09T05:53:35.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.435+0000 7f9c2e59c640 1 -- 172.21.15.72:0/2949718119 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f9c1c00bc00 con 0x7f9c30074af0 2024-05-09T05:53:35.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.435+0000 7f9c2659c640 1 --2- 172.21.15.72:0/2949718119 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c1c004810 0x7f9c1c004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:35.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.435+0000 7f9c2ed9d640 1 --2- 172.21.15.72:0/2949718119 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c1c003a10 0x7f9c1c003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:35.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.435+0000 7f9c2f59e640 1 --2- 172.21.15.72:0/2949718119 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9c30074af0 0x7f9c1c005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:35.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.435+0000 7f9c2659c640 1 -- 172.21.15.72:0/2949718119 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9c30074af0 msgr2=0x7f9c1c005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:35.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.435+0000 7f9c2659c640 1 --2- 172.21.15.72:0/2949718119 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9c30074af0 0x7f9c1c005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:35.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.435+0000 7f9c2659c640 1 -- 172.21.15.72:0/2949718119 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c1c003a10 msgr2=0x7f9c1c003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:35.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.435+0000 7f9c2659c640 1 --2- 172.21.15.72:0/2949718119 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c1c003a10 0x7f9c1c003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:35.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.435+0000 7f9c2659c640 1 -- 172.21.15.72:0/2949718119 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c1c003530 con 0x7f9c1c004810 2024-05-09T05:53:35.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.439+0000 7f9c2659c640 1 --2- 172.21.15.72:0/2949718119 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c1c004810 0x7f9c1c004c20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9c3006f000 tx=0x7f9c1801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d060561387e8425e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:35.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.439+0000 7f9c2e59c640 1 -- 172.21.15.72:0/2949718119 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c180b2070 con 0x7f9c1c004810 2024-05-09T05:53:35.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.439+0000 7f9c2e59c640 1 -- 172.21.15.72:0/2949718119 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c180a5530 con 0x7f9c1c004810 2024-05-09T05:53:35.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.439+0000 7f9c2e59c640 1 -- 172.21.15.72:0/2949718119 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c180096b0 con 0x7f9c1c004810 2024-05-09T05:53:35.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.439+0000 7f9c35098640 1 -- 172.21.15.72:0/2949718119 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c1c004810 msgr2=0x7f9c1c004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:35.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.439+0000 7f9c35098640 1 --2- 172.21.15.72:0/2949718119 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c1c004810 0x7f9c1c004c20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9c3006f000 tx=0x7f9c1801ca50 comp rx=0 tx=0).stop 2024-05-09T05:53:35.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.439+0000 7f9c2f59e640 1 -- 172.21.15.72:0/2949718119 reap_dead start 2024-05-09T05:53:35.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.439+0000 7f9c35098640 1 -- 172.21.15.72:0/2949718119 shutdown_connections 2024-05-09T05:53:35.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.439+0000 7f9c35098640 1 -- 172.21.15.72:0/2949718119 >> 172.21.15.72:0/2949718119 conn(0x7f9c300cde90 msgr2=0x7f9c300ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:35.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.439+0000 7f9c35098640 1 -- 172.21.15.72:0/2949718119 shutdown_connections 2024-05-09T05:53:35.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.439+0000 7f9c35098640 1 -- 172.21.15.72:0/2949718119 wait complete. 2024-05-09T05:53:35.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.439+0000 7f9c35098640 1 Processor -- start 2024-05-09T05:53:35.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.439+0000 7f9c35098640 1 -- start start 2024-05-09T05:53:35.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.443+0000 7f9c35098640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c1c004810 0x7f9c300cbe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:35.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.443+0000 7f9c35098640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c30159b70 0x7f9c30073b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:35.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.443+0000 7f9c35098640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9c30159f80 0x7f9c3006f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:35.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.443+0000 7f9c35098640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f9c3015aa90 con 0x7f9c30159b70 2024-05-09T05:53:35.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.443+0000 7f9c35098640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f9c3015a7b0 con 0x7f9c1c004810 2024-05-09T05:53:35.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.443+0000 7f9c35098640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f9c3015ad70 con 0x7f9c30159f80 2024-05-09T05:53:35.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.443+0000 7f9c2659c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c30159b70 0x7f9c30073b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:35.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.443+0000 7f9c2659c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c30159b70 0x7f9c30073b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42918/0 (socket says 172.21.15.72:42918) 2024-05-09T05:53:35.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.443+0000 7f9c2659c640 1 -- 172.21.15.72:0/863900694 learned_addr learned my addr 172.21.15.72:0/863900694 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:35.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.443+0000 7f9c2ed9d640 1 --2- 172.21.15.72:0/863900694 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c1c004810 0x7f9c300cbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:35.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.443+0000 7f9c2f59e640 1 --2- 172.21.15.72:0/863900694 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9c30159f80 0x7f9c3006f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:35.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.443+0000 7f9c2659c640 1 -- 172.21.15.72:0/863900694 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9c30159f80 msgr2=0x7f9c3006f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:35.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.443+0000 7f9c2659c640 1 --2- 172.21.15.72:0/863900694 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9c30159f80 0x7f9c3006f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:35.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.443+0000 7f9c2659c640 1 -- 172.21.15.72:0/863900694 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c1c004810 msgr2=0x7f9c300cbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:35.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.443+0000 7f9c2659c640 1 --2- 172.21.15.72:0/863900694 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c1c004810 0x7f9c300cbe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:35.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.443+0000 7f9c2659c640 1 -- 172.21.15.72:0/863900694 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c300cc370 con 0x7f9c30159b70 2024-05-09T05:53:35.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.443+0000 7f9c2659c640 1 --2- 172.21.15.72:0/863900694 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c30159b70 0x7f9c30073b40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9c1801c880 tx=0x7f9c1c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:35.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.443+0000 7f9c27fff640 1 -- 172.21.15.72:0/863900694 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c180b2040 con 0x7f9c30159b70 2024-05-09T05:53:35.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.443+0000 7f9c27fff640 1 -- 172.21.15.72:0/863900694 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c1800f000 con 0x7f9c30159b70 2024-05-09T05:53:35.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.443+0000 7f9c35098640 1 -- 172.21.15.72:0/863900694 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c301f6140 con 0x7f9c30159b70 2024-05-09T05:53:35.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.443+0000 7f9c27fff640 1 -- 172.21.15.72:0/863900694 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c180096b0 con 0x7f9c30159b70 2024-05-09T05:53:35.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.443+0000 7f9c35098640 1 -- 172.21.15.72:0/863900694 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c301f6700 con 0x7f9c30159b70 2024-05-09T05:53:35.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.443+0000 7f9c35098640 1 -- 172.21.15.72:0/863900694 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c301f5eb0 con 0x7f9c30159b70 2024-05-09T05:53:35.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.443+0000 7f9c27fff640 1 -- 172.21.15.72:0/863900694 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f9c180c0030 con 0x7f9c30159b70 2024-05-09T05:53:35.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.447+0000 7f9c27fff640 1 --2- 172.21.15.72:0/863900694 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f9c1006f430 0x7f9c10071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:35.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.447+0000 7f9c27fff640 1 -- 172.21.15.72:0/863900694 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9c18129e10 con 0x7f9c30159b70 2024-05-09T05:53:35.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.447+0000 7f9c2ed9d640 1 --2- 172.21.15.72:0/863900694 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f9c1006f430 0x7f9c10071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:35.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.447+0000 7f9c2ed9d640 1 --2- 172.21.15.72:0/863900694 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f9c1006f430 0x7f9c10071940 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9c20001ec0 tx=0x7f9c20009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:35.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.451+0000 7f9c27fff640 1 -- 172.21.15.72:0/863900694 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f9c180c7060 con 0x7f9c30159b70 2024-05-09T05:53:35.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.639+0000 7f9c35098640 1 -- 172.21.15.72:0/863900694 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f9c3006a520 con 0x7f9c30159b70 2024-05-09T05:53:35.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.639+0000 7f9c27fff640 1 -- 172.21.15.72:0/863900694 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+88 (secure 0 0 0) 0x7f9c18016760 con 0x7f9c30159b70 2024-05-09T05:53:35.632 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-09T05:53:35.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.643+0000 7f9c35098640 1 -- 172.21.15.72:0/863900694 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f9c1006f430 msgr2=0x7f9c10071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:35.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.643+0000 7f9c35098640 1 --2- 172.21.15.72:0/863900694 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f9c1006f430 0x7f9c10071940 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9c20001ec0 tx=0x7f9c20009040 comp rx=0 tx=0).stop 2024-05-09T05:53:35.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.643+0000 7f9c35098640 1 -- 172.21.15.72:0/863900694 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c30159b70 msgr2=0x7f9c30073b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:35.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.643+0000 7f9c35098640 1 --2- 172.21.15.72:0/863900694 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c30159b70 0x7f9c30073b40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9c1801c880 tx=0x7f9c1c005840 comp rx=0 tx=0).stop 2024-05-09T05:53:35.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.643+0000 7f9c35098640 1 -- 172.21.15.72:0/863900694 shutdown_connections 2024-05-09T05:53:35.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.643+0000 7f9c35098640 1 --2- 172.21.15.72:0/863900694 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f9c1006f430 0x7f9c10071940 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:35.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.643+0000 7f9c35098640 1 --2- 172.21.15.72:0/863900694 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9c30159f80 0x7f9c3006f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:35.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.643+0000 7f9c35098640 1 --2- 172.21.15.72:0/863900694 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c30159b70 0x7f9c30073b40 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:35.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.643+0000 7f9c35098640 1 --2- 172.21.15.72:0/863900694 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c1c004810 0x7f9c300cbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:35.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.643+0000 7f9c35098640 1 -- 172.21.15.72:0/863900694 >> 172.21.15.72:0/863900694 conn(0x7f9c300cde90 msgr2=0x7f9c3014f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:35.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.643+0000 7f9c35098640 1 -- 172.21.15.72:0/863900694 shutdown_connections 2024-05-09T05:53:35.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35.643+0000 7f9c35098640 1 -- 172.21.15.72:0/863900694 wait complete. 2024-05-09T05:53:35.652 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-09T05:53:35.652 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-09T05:53:35.652 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi072.front.sepia.ceph.com 2024-05-09T05:53:35.652 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-05-09T05:53:35.652 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-05-09T05:53:35.652 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-09T05:53:35.652 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-09T05:53:35.652 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-09T05:53:35.653 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-05-09T05:53:35.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:53:35.653 DEBUG:teuthology.orchestra.run.smithi072:> ip addr 2024-05-09T05:53:35.658 INFO:teuthology.orchestra.run.smithi072.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-09T05:53:35.658 INFO:teuthology.orchestra.run.smithi072.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-09T05:53:35.658 INFO:teuthology.orchestra.run.smithi072.stdout: inet 127.0.0.1/8 scope host lo 2024-05-09T05:53:35.658 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-05-09T05:53:35.659 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 ::1/128 scope host 2024-05-09T05:53:35.659 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-05-09T05:53:35.659 INFO:teuthology.orchestra.run.smithi072.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-09T05:53:35.659 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f4 brd ff:ff:ff:ff:ff:ff 2024-05-09T05:53:35.659 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f0 2024-05-09T05:53:35.659 INFO:teuthology.orchestra.run.smithi072.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-09T05:53:35.659 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f5 brd ff:ff:ff:ff:ff:ff 2024-05-09T05:53:35.659 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f1 2024-05-09T05:53:35.659 INFO:teuthology.orchestra.run.smithi072.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-09T05:53:35.659 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:64 brd ff:ff:ff:ff:ff:ff 2024-05-09T05:53:35.659 INFO:teuthology.orchestra.run.smithi072.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-09T05:53:35.659 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:65 brd ff:ff:ff:ff:ff:ff 2024-05-09T05:53:35.659 INFO:teuthology.orchestra.run.smithi072.stdout: inet 172.21.15.72/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-09T05:53:35.659 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft 42492sec preferred_lft 42492sec 2024-05-09T05:53:35.660 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::ec4:7aff:fe8f:b765/64 scope link 2024-05-09T05:53:35.660 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-05-09T05:53:35.660 INFO:teuthology.orchestra.run.smithi072.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-05-09T05:53:35.660 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 02:42:8f:f6:66:bc brd ff:ff:ff:ff:ff:ff 2024-05-09T05:53:35.660 INFO:teuthology.orchestra.run.smithi072.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-05-09T05:53:35.660 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-05-09T05:53:35.660 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-09T05:53:35.661 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T05:53:35.661 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2024-05-09T05:53:35.661 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link add name ceph-brx type bridge 2024-05-09T05:53:35.661 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip addr flush dev ceph-brx 2024-05-09T05:53:35.661 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set ceph-brx up 2024-05-09T05:53:35.661 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-09T05:53:35.661 DEBUG:teuthology.orchestra.run.smithi072:> ') 2024-05-09T05:53:35.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T05:53:35.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T05:53:35.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:53:35.777 DEBUG:teuthology.orchestra.run.smithi072:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-09T05:53:35.829 INFO:teuthology.orchestra.run.smithi072.stdout:1 2024-05-09T05:53:35.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:53:35.830 DEBUG:teuthology.orchestra.run.smithi072:> route 2024-05-09T05:53:35.897 INFO:teuthology.orchestra.run.smithi072.stdout:Kernel IP routing table 2024-05-09T05:53:35.897 INFO:teuthology.orchestra.run.smithi072.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-09T05:53:35.897 INFO:teuthology.orchestra.run.smithi072.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-05-09T05:53:35.898 INFO:teuthology.orchestra.run.smithi072.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-09T05:53:35.898 INFO:teuthology.orchestra.run.smithi072.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-05-09T05:53:35.898 INFO:teuthology.orchestra.run.smithi072.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-05-09T05:53:35.898 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-09T05:53:35.898 INFO:teuthology.orchestra.run.smithi072.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-09T05:53:35.898 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-09T05:53:35.898 INFO:teuthology.orchestra.run.smithi072.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-09T05:53:35.898 INFO:teuthology.orchestra.run.smithi072.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-09T05:53:35.899 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T05:53:35.899 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2024-05-09T05:53:35.899 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-09T05:53:35.899 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-09T05:53:35.899 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-09T05:53:35.899 DEBUG:teuthology.orchestra.run.smithi072:> ') 2024-05-09T05:53:35.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T05:53:36.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T05:53:36.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:53:36.018 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2024-05-09T05:53:36.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:53:36.066 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list-id 2024-05-09T05:53:36.113 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T05:53:36.113 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2024-05-09T05:53:36.113 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-09T05:53:36.113 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-05-09T05:53:36.114 DEBUG:teuthology.orchestra.run.smithi072:> ') 2024-05-09T05:53:36.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T05:53:36.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T05:53:36.230 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-05-09T05:53:36.231 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T05:53:36.231 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2024-05-09T05:53:36.231 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-05-09T05:53:36.231 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-09T05:53:36.231 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-05-09T05:53:36.231 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-05-09T05:53:36.231 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-05-09T05:53:36.231 DEBUG:teuthology.orchestra.run.smithi072:> ') 2024-05-09T05:53:36.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T05:53:36.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T05:53:36.329 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T05:53:36.329 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2024-05-09T05:53:36.330 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set brx.0 up 2024-05-09T05:53:36.330 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set dev brx.0 master ceph-brx 2024-05-09T05:53:36.330 DEBUG:teuthology.orchestra.run.smithi072:> ') 2024-05-09T05:53:36.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T05:53:36.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T05:53:36.432 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-05-09T05:53:36.432 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-09T05:53:36.432 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-05-09T05:53:36.480 INFO:teuthology.orchestra.run.smithi072.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-05-09T05:53:36.481 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-09T05:53:36.481 DEBUG:teuthology.orchestra.run.smithi072:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-05-09T05:53:36.529 DEBUG:teuthology.orchestra.run.smithi072:> sudo modprobe fuse 2024-05-09T05:53:36.590 DEBUG:teuthology.orchestra.run.smithi072:> cat /proc/self/mounts | awk '{print $2}' 2024-05-09T05:53:36.638 INFO:teuthology.orchestra.run.smithi072.stdout:/sys 2024-05-09T05:53:36.638 INFO:teuthology.orchestra.run.smithi072.stdout:/proc 2024-05-09T05:53:36.638 INFO:teuthology.orchestra.run.smithi072.stdout:/dev 2024-05-09T05:53:36.639 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/pts 2024-05-09T05:53:36.639 INFO:teuthology.orchestra.run.smithi072.stdout:/run 2024-05-09T05:53:36.639 INFO:teuthology.orchestra.run.smithi072.stdout:/ 2024-05-09T05:53:36.639 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/security 2024-05-09T05:53:36.639 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/shm 2024-05-09T05:53:36.639 INFO:teuthology.orchestra.run.smithi072.stdout:/run/lock 2024-05-09T05:53:36.639 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/cgroup 2024-05-09T05:53:36.639 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/pstore 2024-05-09T05:53:36.639 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/bpf 2024-05-09T05:53:36.639 INFO:teuthology.orchestra.run.smithi072.stdout:/proc/sys/fs/binfmt_misc 2024-05-09T05:53:36.639 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/hugepages 2024-05-09T05:53:36.639 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/mqueue 2024-05-09T05:53:36.639 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/debug 2024-05-09T05:53:36.639 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/tracing 2024-05-09T05:53:36.640 INFO:teuthology.orchestra.run.smithi072.stdout:/proc/fs/nfsd 2024-05-09T05:53:36.640 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/fuse/connections 2024-05-09T05:53:36.640 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/config 2024-05-09T05:53:36.640 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-sysusers.service 2024-05-09T05:53:36.640 INFO:teuthology.orchestra.run.smithi072.stdout:/run/rpc_pipefs 2024-05-09T05:53:36.640 INFO:teuthology.orchestra.run.smithi072.stdout:/run/user/1000 2024-05-09T05:53:36.640 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph 2024-05-09T05:53:36.640 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-0 2024-05-09T05:53:36.640 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-1 2024-05-09T05:53:36.640 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-2 2024-05-09T05:53:36.640 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-3 2024-05-09T05:53:36.640 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns 2024-05-09T05:53:36.640 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-09T05:53:36.641 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-09T05:53:36.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:53:36.641 DEBUG:teuthology.orchestra.run.smithi072:> ls /sys/fs/fuse/connections 2024-05-09T05:53:36.689 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-09T05:53:36.689 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-05-09T05:53:36.734 DEBUG:teuthology.orchestra.run.smithi072:> sudo modprobe fuse 2024-05-09T05:53:36.747 DEBUG:teuthology.orchestra.run.smithi072:> cat /proc/self/mounts | awk '{print $2}' 2024-05-09T05:53:36.793 INFO:teuthology.orchestra.run.smithi072.stdout:/sys 2024-05-09T05:53:36.793 INFO:teuthology.orchestra.run.smithi072.stdout:/proc 2024-05-09T05:53:36.794 INFO:teuthology.orchestra.run.smithi072.stdout:/dev 2024-05-09T05:53:36.794 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/pts 2024-05-09T05:53:36.794 INFO:teuthology.orchestra.run.smithi072.stdout:/run 2024-05-09T05:53:36.794 INFO:teuthology.orchestra.run.smithi072.stdout:/ 2024-05-09T05:53:36.794 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/security 2024-05-09T05:53:36.794 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/shm 2024-05-09T05:53:36.794 INFO:teuthology.orchestra.run.smithi072.stdout:/run/lock 2024-05-09T05:53:36.794 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/cgroup 2024-05-09T05:53:36.794 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/pstore 2024-05-09T05:53:36.794 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/bpf 2024-05-09T05:53:36.794 INFO:teuthology.orchestra.run.smithi072.stdout:/proc/sys/fs/binfmt_misc 2024-05-09T05:53:36.794 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/hugepages 2024-05-09T05:53:36.794 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/mqueue 2024-05-09T05:53:36.794 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/debug 2024-05-09T05:53:36.795 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/tracing 2024-05-09T05:53:36.795 INFO:teuthology.orchestra.run.smithi072.stdout:/proc/fs/nfsd 2024-05-09T05:53:36.795 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/fuse/connections 2024-05-09T05:53:36.795 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/config 2024-05-09T05:53:36.795 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-sysusers.service 2024-05-09T05:53:36.795 INFO:teuthology.orchestra.run.smithi072.stdout:/run/rpc_pipefs 2024-05-09T05:53:36.795 INFO:teuthology.orchestra.run.smithi072.stdout:/run/user/1000 2024-05-09T05:53:36.795 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph 2024-05-09T05:53:36.795 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-0 2024-05-09T05:53:36.795 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-1 2024-05-09T05:53:36.795 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-2 2024-05-09T05:53:36.795 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-3 2024-05-09T05:53:36.795 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns 2024-05-09T05:53:36.795 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-09T05:53:36.795 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-09T05:53:36.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:53:36.796 DEBUG:teuthology.orchestra.run.smithi072:> ls /sys/fs/fuse/connections 2024-05-09T05:53:36.841 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi072.stderr:2024-05-09T05:53:36.851+0000 7f21ee58a580 -1 init, newargv = 0x5653e856b2e0 newargc=15 2024-05-09T05:53:36.841 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi072.stderr:ceph-fuse[33666]: starting ceph client 2024-05-09T05:53:36.851 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi072.stderr:ceph-fuse[33666]: starting fuse 2024-05-09T05:53:37.947 DEBUG:teuthology.orchestra.run.smithi072:> sudo modprobe fuse 2024-05-09T05:53:37.963 DEBUG:teuthology.orchestra.run.smithi072:> cat /proc/self/mounts | awk '{print $2}' 2024-05-09T05:53:38.010 INFO:teuthology.orchestra.run.smithi072.stdout:/sys 2024-05-09T05:53:38.011 INFO:teuthology.orchestra.run.smithi072.stdout:/proc 2024-05-09T05:53:38.011 INFO:teuthology.orchestra.run.smithi072.stdout:/dev 2024-05-09T05:53:38.011 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/pts 2024-05-09T05:53:38.011 INFO:teuthology.orchestra.run.smithi072.stdout:/run 2024-05-09T05:53:38.011 INFO:teuthology.orchestra.run.smithi072.stdout:/ 2024-05-09T05:53:38.011 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/security 2024-05-09T05:53:38.011 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/shm 2024-05-09T05:53:38.011 INFO:teuthology.orchestra.run.smithi072.stdout:/run/lock 2024-05-09T05:53:38.011 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/cgroup 2024-05-09T05:53:38.011 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/pstore 2024-05-09T05:53:38.011 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/bpf 2024-05-09T05:53:38.011 INFO:teuthology.orchestra.run.smithi072.stdout:/proc/sys/fs/binfmt_misc 2024-05-09T05:53:38.011 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/hugepages 2024-05-09T05:53:38.012 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/mqueue 2024-05-09T05:53:38.012 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/debug 2024-05-09T05:53:38.012 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/tracing 2024-05-09T05:53:38.012 INFO:teuthology.orchestra.run.smithi072.stdout:/proc/fs/nfsd 2024-05-09T05:53:38.012 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/fuse/connections 2024-05-09T05:53:38.012 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/config 2024-05-09T05:53:38.012 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-sysusers.service 2024-05-09T05:53:38.012 INFO:teuthology.orchestra.run.smithi072.stdout:/run/rpc_pipefs 2024-05-09T05:53:38.012 INFO:teuthology.orchestra.run.smithi072.stdout:/run/user/1000 2024-05-09T05:53:38.012 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph 2024-05-09T05:53:38.012 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-0 2024-05-09T05:53:38.012 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-1 2024-05-09T05:53:38.012 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-2 2024-05-09T05:53:38.012 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-3 2024-05-09T05:53:38.012 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns 2024-05-09T05:53:38.013 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-09T05:53:38.013 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-09T05:53:38.013 INFO:teuthology.orchestra.run.smithi072.stdout:/home/ubuntu/cephtest/mnt.admin 2024-05-09T05:53:38.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:53:38.014 DEBUG:teuthology.orchestra.run.smithi072:> ls /sys/fs/fuse/connections 2024-05-09T05:53:38.062 INFO:teuthology.orchestra.run.smithi072.stdout:45 2024-05-09T05:53:38.062 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-05-09T05:53:38.062 DEBUG:teuthology.orchestra.run.smithi072:> sudo stdin-killer -- python3 -c ' 2024-05-09T05:53:38.062 DEBUG:teuthology.orchestra.run.smithi072:> import glob 2024-05-09T05:53:38.062 DEBUG:teuthology.orchestra.run.smithi072:> import re 2024-05-09T05:53:38.062 DEBUG:teuthology.orchestra.run.smithi072:> import os 2024-05-09T05:53:38.062 DEBUG:teuthology.orchestra.run.smithi072:> import subprocess 2024-05-09T05:53:38.062 DEBUG:teuthology.orchestra.run.smithi072:> 2024-05-09T05:53:38.063 DEBUG:teuthology.orchestra.run.smithi072:> def _find_admin_socket(client_name): 2024-05-09T05:53:38.063 DEBUG:teuthology.orchestra.run.smithi072:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-05-09T05:53:38.063 DEBUG:teuthology.orchestra.run.smithi072:> files = glob.glob(asok_path) 2024-05-09T05:53:38.063 DEBUG:teuthology.orchestra.run.smithi072:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-05-09T05:53:38.063 DEBUG:teuthology.orchestra.run.smithi072:> 2024-05-09T05:53:38.063 DEBUG:teuthology.orchestra.run.smithi072:> # Given a non-glob path, it better be there 2024-05-09T05:53:38.063 DEBUG:teuthology.orchestra.run.smithi072:> if "*" not in asok_path: 2024-05-09T05:53:38.063 DEBUG:teuthology.orchestra.run.smithi072:> assert(len(files) == 1) 2024-05-09T05:53:38.063 DEBUG:teuthology.orchestra.run.smithi072:> return files[0] 2024-05-09T05:53:38.063 DEBUG:teuthology.orchestra.run.smithi072:> 2024-05-09T05:53:38.063 DEBUG:teuthology.orchestra.run.smithi072:> for f in files: 2024-05-09T05:53:38.064 DEBUG:teuthology.orchestra.run.smithi072:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-09T05:53:38.064 DEBUG:teuthology.orchestra.run.smithi072:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-09T05:53:38.064 DEBUG:teuthology.orchestra.run.smithi072:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-09T05:53:38.064 DEBUG:teuthology.orchestra.run.smithi072:> contents = proc_f.read() 2024-05-09T05:53:38.064 DEBUG:teuthology.orchestra.run.smithi072:> if mountpoint in contents: 2024-05-09T05:53:38.064 DEBUG:teuthology.orchestra.run.smithi072:> return f 2024-05-09T05:53:38.064 DEBUG:teuthology.orchestra.run.smithi072:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-09T05:53:38.064 DEBUG:teuthology.orchestra.run.smithi072:> 2024-05-09T05:53:38.064 DEBUG:teuthology.orchestra.run.smithi072:> print(_find_admin_socket("client.admin")) 2024-05-09T05:53:38.064 DEBUG:teuthology.orchestra.run.smithi072:> ' 2024-05-09T05:53:38.188 INFO:teuthology.orchestra.run.smithi072.stdout:/var/run/ceph/ceph-client.admin.33666.asok 2024-05-09T05:53:38.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T05:53:38.200 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.33666.asok 2024-05-09T05:53:38.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:53:38.200 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.33666.asok status 2024-05-09T05:53:38.376 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-05-09T05:53:38.376 INFO:teuthology.orchestra.run.smithi072.stdout: "metadata": { 2024-05-09T05:53:38.376 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph_sha1": "c9da4049f638c0f84bdd9b4e33c42e86046ac554", 2024-05-09T05:53:38.376 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph_version": "ceph version 19.0.0-3594-gc9da4049 (c9da4049f638c0f84bdd9b4e33c42e86046ac554) squid (dev)", 2024-05-09T05:53:38.376 INFO:teuthology.orchestra.run.smithi072.stdout: "entity_id": "admin", 2024-05-09T05:53:38.376 INFO:teuthology.orchestra.run.smithi072.stdout: "hostname": "smithi072", 2024-05-09T05:53:38.376 INFO:teuthology.orchestra.run.smithi072.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-05-09T05:53:38.376 INFO:teuthology.orchestra.run.smithi072.stdout: "pid": "33666", 2024-05-09T05:53:38.376 INFO:teuthology.orchestra.run.smithi072.stdout: "root": "/" 2024-05-09T05:53:38.376 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-09T05:53:38.376 INFO:teuthology.orchestra.run.smithi072.stdout: "dentry_count": 0, 2024-05-09T05:53:38.376 INFO:teuthology.orchestra.run.smithi072.stdout: "dentry_pinned_count": 0, 2024-05-09T05:53:38.377 INFO:teuthology.orchestra.run.smithi072.stdout: "id": 4413, 2024-05-09T05:53:38.377 INFO:teuthology.orchestra.run.smithi072.stdout: "inst": { 2024-05-09T05:53:38.377 INFO:teuthology.orchestra.run.smithi072.stdout: "name": { 2024-05-09T05:53:38.377 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "client", 2024-05-09T05:53:38.377 INFO:teuthology.orchestra.run.smithi072.stdout: "num": 4413 2024-05-09T05:53:38.377 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-09T05:53:38.377 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": { 2024-05-09T05:53:38.377 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "v1", 2024-05-09T05:53:38.377 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": "192.168.0.1:0", 2024-05-09T05:53:38.377 INFO:teuthology.orchestra.run.smithi072.stdout: "nonce": 956053830 2024-05-09T05:53:38.377 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-05-09T05:53:38.377 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-09T05:53:38.377 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": { 2024-05-09T05:53:38.377 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "v1", 2024-05-09T05:53:38.377 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": "192.168.0.1:0", 2024-05-09T05:53:38.378 INFO:teuthology.orchestra.run.smithi072.stdout: "nonce": 956053830 2024-05-09T05:53:38.378 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-09T05:53:38.378 INFO:teuthology.orchestra.run.smithi072.stdout: "inst_str": "client.4413 192.168.0.1:0/956053830", 2024-05-09T05:53:38.378 INFO:teuthology.orchestra.run.smithi072.stdout: "addr_str": "192.168.0.1:0/956053830", 2024-05-09T05:53:38.378 INFO:teuthology.orchestra.run.smithi072.stdout: "inode_count": 1, 2024-05-09T05:53:38.378 INFO:teuthology.orchestra.run.smithi072.stdout: "mds_epoch": 6, 2024-05-09T05:53:38.378 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_epoch": 25, 2024-05-09T05:53:38.378 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_epoch_barrier": 0, 2024-05-09T05:53:38.378 INFO:teuthology.orchestra.run.smithi072.stdout: "blocklisted": false, 2024-05-09T05:53:38.378 INFO:teuthology.orchestra.run.smithi072.stdout: "fs_name": "cephfs" 2024-05-09T05:53:38.378 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-05-09T05:53:38.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:53:38.392 DEBUG:teuthology.orchestra.run.smithi072:> stat --file-system '--printf=%T 2024-05-09T05:53:38.392 DEBUG:teuthology.orchestra.run.smithi072:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-05-09T05:53:38.398 INFO:teuthology.orchestra.run.smithi072.stdout:fuseblk 2024-05-09T05:53:38.398 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-05-09T05:53:38.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:53:38.399 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-05-09T05:53:38.453 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-05-09T05:53:38.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-09T05:53:38.750 INFO:teuthology.orchestra.run.smithi072.stdout:# file: . 2024-05-09T05:53:38.750 INFO:teuthology.orchestra.run.smithi072.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-05-09T05:53:38.750 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:53:38.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T05:53:38.758 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-09T05:53:38.759 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T05:53:38.764 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-09T05:53:38.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:38.971+0000 7f4de6709640 1 Processor -- start 2024-05-09T05:53:38.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:38.971+0000 7f4de6709640 1 -- start start 2024-05-09T05:53:38.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:38.971+0000 7f4de6709640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4de0159770 0x7f4de0152ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:38.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:38.971+0000 7f4de6709640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4de015c5b0 con 0x7f4de00727b0 2024-05-09T05:53:38.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:38.971+0000 7f4de6709640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4de0159b80 con 0x7f4de00723a0 2024-05-09T05:53:38.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:38.971+0000 7f4de6709640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f4de0153410 con 0x7f4de0159770 2024-05-09T05:53:38.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:38.971+0000 7f4ddffff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4de0159770 0x7f4de0152ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:38.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:38.971+0000 7f4de4ca6640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f4de00727b0 0x7f4de0163500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:50098/0 (socket says 172.21.15.72:50098) 2024-05-09T05:53:38.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:38.971+0000 7f4de4ca6640 1 -- 172.21.15.72:0/962492979 learned_addr learned my addr 172.21.15.72:0/962492979 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:53:38.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:38.971+0000 7f4ddeffd640 1 -- 172.21.15.72:0/962492979 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2253775487 0 0) 0x7f4de015c5b0 con 0x7f4de00727b0 2024-05-09T05:53:38.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:38.971+0000 7f4ddeffd640 1 -- 172.21.15.72:0/962492979 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4dc8003530 con 0x7f4de00727b0 2024-05-09T05:53:38.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:38.971+0000 7f4ddffff640 1 -- 172.21.15.72:0/962492979 >> v1:172.21.15.110:6789/0 conn(0x7f4de00723a0 legacy=0x7f4de006fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:38.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:38.971+0000 7f4ddffff640 1 -- 172.21.15.72:0/962492979 >> v1:172.21.15.72:6789/0 conn(0x7f4de00727b0 legacy=0x7f4de0163500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:38.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:38.971+0000 7f4ddffff640 1 -- 172.21.15.72:0/962492979 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4de0073270 con 0x7f4de0159770 2024-05-09T05:53:38.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:38.975+0000 7f4ddffff640 1 --2- 172.21.15.72:0/962492979 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4de0159770 0x7f4de0152ed0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4dd00097c0 tx=0x7f4dd001ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6298e16c3b8d1a99 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:38.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:38.975+0000 7f4ddeffd640 1 -- 172.21.15.72:0/962492979 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dd00b5070 con 0x7f4de0159770 2024-05-09T05:53:38.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:38.975+0000 7f4ddeffd640 1 -- 172.21.15.72:0/962492979 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dd00a8990 con 0x7f4de0159770 2024-05-09T05:53:38.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:38.975+0000 7f4ddeffd640 1 -- 172.21.15.72:0/962492979 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dd00a8d60 con 0x7f4de0159770 2024-05-09T05:53:38.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:38.975+0000 7f4de6709640 1 -- 172.21.15.72:0/962492979 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4de0159770 msgr2=0x7f4de0152ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:38.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:38.975+0000 7f4de6709640 1 --2- 172.21.15.72:0/962492979 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4de0159770 0x7f4de0152ed0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4dd00097c0 tx=0x7f4dd001ec90 comp rx=0 tx=0).stop 2024-05-09T05:53:38.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:38.975+0000 7f4de6709640 1 -- 172.21.15.72:0/962492979 shutdown_connections 2024-05-09T05:53:38.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:38.975+0000 7f4de6709640 1 --2- 172.21.15.72:0/962492979 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4de0159770 0x7f4de0152ed0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:38.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:38.975+0000 7f4de6709640 1 -- 172.21.15.72:0/962492979 >> 172.21.15.72:0/962492979 conn(0x7f4de00cde90 msgr2=0x7f4de00ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:38.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:38.975+0000 7f4de6709640 1 -- 172.21.15.72:0/962492979 shutdown_connections 2024-05-09T05:53:38.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:38.975+0000 7f4de6709640 1 -- 172.21.15.72:0/962492979 wait complete. 2024-05-09T05:53:38.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:38.979+0000 7f4de6709640 1 Processor -- start 2024-05-09T05:53:38.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:38.979+0000 7f4de6709640 1 -- start start 2024-05-09T05:53:38.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:38.979+0000 7f4de6709640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4de00723a0 0x7f4de0143040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:38.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:38.979+0000 7f4de6709640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4de00727b0 0x7f4de0140f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:38.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:38.979+0000 7f4de6709640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4de0159770 0x7f4de0141460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:38.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:38.979+0000 7f4de6709640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f4de0073810 con 0x7f4de00727b0 2024-05-09T05:53:38.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:38.979+0000 7f4de6709640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f4de0072bc0 con 0x7f4de00723a0 2024-05-09T05:53:38.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:38.979+0000 7f4de6709640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f4de0073af0 con 0x7f4de0159770 2024-05-09T05:53:38.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:38.979+0000 7f4ddf7fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4de00727b0 0x7f4de0140f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:38.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:38.979+0000 7f4ddf7fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4de00727b0 0x7f4de0140f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42930/0 (socket says 172.21.15.72:42930) 2024-05-09T05:53:38.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:38.979+0000 7f4ddf7fe640 1 -- 172.21.15.72:0/2043758324 learned_addr learned my addr 172.21.15.72:0/2043758324 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:38.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:38.979+0000 7f4de4ca6640 1 --2- 172.21.15.72:0/2043758324 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4de0159770 0x7f4de0141460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:38.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:38.979+0000 7f4ddffff640 1 --2- 172.21.15.72:0/2043758324 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4de00723a0 0x7f4de0143040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:38.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:38.979+0000 7f4ddf7fe640 1 -- 172.21.15.72:0/2043758324 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4de0159770 msgr2=0x7f4de0141460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:38.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:38.979+0000 7f4ddf7fe640 1 --2- 172.21.15.72:0/2043758324 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4de0159770 0x7f4de0141460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:38.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:38.979+0000 7f4ddf7fe640 1 -- 172.21.15.72:0/2043758324 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4de00723a0 msgr2=0x7f4de0143040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:38.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:38.979+0000 7f4ddf7fe640 1 --2- 172.21.15.72:0/2043758324 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4de00723a0 0x7f4de0143040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:38.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:38.979+0000 7f4ddf7fe640 1 -- 172.21.15.72:0/2043758324 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4de015b8d0 con 0x7f4de00727b0 2024-05-09T05:53:38.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:38.979+0000 7f4ddffff640 1 --2- 172.21.15.72:0/2043758324 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4de00723a0 0x7f4de0143040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:53:38.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:38.979+0000 7f4ddf7fe640 1 --2- 172.21.15.72:0/2043758324 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4de00727b0 0x7f4de0140f20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4dd400c400 tx=0x7f4dd400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:38.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:38.979+0000 7f4ddcff9640 1 -- 172.21.15.72:0/2043758324 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dd4017070 con 0x7f4de00727b0 2024-05-09T05:53:38.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:38.979+0000 7f4ddcff9640 1 -- 172.21.15.72:0/2043758324 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dd4005310 con 0x7f4de00727b0 2024-05-09T05:53:38.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:38.979+0000 7f4ddcff9640 1 -- 172.21.15.72:0/2043758324 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dd40054c0 con 0x7f4de00727b0 2024-05-09T05:53:38.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:38.979+0000 7f4de6709640 1 -- 172.21.15.72:0/2043758324 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4de014eb20 con 0x7f4de00727b0 2024-05-09T05:53:38.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:38.979+0000 7f4de6709640 1 -- 172.21.15.72:0/2043758324 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4de015b3b0 con 0x7f4de00727b0 2024-05-09T05:53:38.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:38.983+0000 7f4de6709640 1 -- 172.21.15.72:0/2043758324 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4de006a520 con 0x7f4de00727b0 2024-05-09T05:53:38.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:38.983+0000 7f4ddcff9640 1 -- 172.21.15.72:0/2043758324 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f4dd401a070 con 0x7f4de00727b0 2024-05-09T05:53:38.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:38.983+0000 7f4ddcff9640 1 --2- 172.21.15.72:0/2043758324 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f4dcc06f430 0x7f4dcc071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:38.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:38.983+0000 7f4ddcff9640 1 -- 172.21.15.72:0/2043758324 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4dd408e810 con 0x7f4de00727b0 2024-05-09T05:53:38.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:38.983+0000 7f4ddffff640 1 --2- 172.21.15.72:0/2043758324 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f4dcc06f430 0x7f4dcc071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:38.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:38.983+0000 7f4ddffff640 1 --2- 172.21.15.72:0/2043758324 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f4dcc06f430 0x7f4dcc071940 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4dd00b2000 tx=0x7f4dd0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:38.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:38.987+0000 7f4ddcff9640 1 -- 172.21.15.72:0/2043758324 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f4dd405ad60 con 0x7f4de00727b0 2024-05-09T05:53:39.049 INFO:tasks.ceph.mds.b.smithi110.stderr:2024-05-09T05:53:39.059+0000 7f6833aba640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-09T05:53:39.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.159+0000 7f4de6709640 1 -- 172.21.15.72:0/2043758324 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4de014ecf0 con 0x7f4de00727b0 2024-05-09T05:53:39.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.163+0000 7f4ddcff9640 1 -- 172.21.15.72:0/2043758324 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7f4dd405f060 con 0x7f4de00727b0 2024-05-09T05:53:39.153 INFO:teuthology.orchestra.run.smithi072.stderr:listed 0 entries 2024-05-09T05:53:39.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.163+0000 7f4de6709640 1 -- 172.21.15.72:0/2043758324 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f4dcc06f430 msgr2=0x7f4dcc071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:39.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.163+0000 7f4de6709640 1 --2- 172.21.15.72:0/2043758324 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f4dcc06f430 0x7f4dcc071940 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4dd00b2000 tx=0x7f4dd0008040 comp rx=0 tx=0).stop 2024-05-09T05:53:39.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.163+0000 7f4de6709640 1 -- 172.21.15.72:0/2043758324 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4de00727b0 msgr2=0x7f4de0140f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:39.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.163+0000 7f4de6709640 1 --2- 172.21.15.72:0/2043758324 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4de00727b0 0x7f4de0140f20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4dd400c400 tx=0x7f4dd400c8c0 comp rx=0 tx=0).stop 2024-05-09T05:53:39.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.163+0000 7f4de6709640 1 -- 172.21.15.72:0/2043758324 shutdown_connections 2024-05-09T05:53:39.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.163+0000 7f4de6709640 1 --2- 172.21.15.72:0/2043758324 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f4dcc06f430 0x7f4dcc071940 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:39.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.163+0000 7f4de6709640 1 --2- 172.21.15.72:0/2043758324 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4de0159770 0x7f4de0141460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:39.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.163+0000 7f4de6709640 1 --2- 172.21.15.72:0/2043758324 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4de00727b0 0x7f4de0140f20 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:39.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.163+0000 7f4de6709640 1 --2- 172.21.15.72:0/2043758324 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4de00723a0 0x7f4de0143040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:39.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.163+0000 7f4de6709640 1 -- 172.21.15.72:0/2043758324 >> 172.21.15.72:0/2043758324 conn(0x7f4de00cde90 msgr2=0x7f4de015c940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:39.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.163+0000 7f4de6709640 1 -- 172.21.15.72:0/2043758324 shutdown_connections 2024-05-09T05:53:39.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.163+0000 7f4de6709640 1 -- 172.21.15.72:0/2043758324 wait complete. 2024-05-09T05:53:39.174 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-09T05:53:39.174 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T05:53:39.180 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-09T05:53:39.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.379+0000 7f3bc07e1640 1 Processor -- start 2024-05-09T05:53:39.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.379+0000 7f3bc07e1640 1 -- start start 2024-05-09T05:53:39.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.379+0000 7f3bc07e1640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3bb8153860 0x7f3bb80c6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:39.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.379+0000 7f3bc07e1640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bb80c7210 0x7f3bb8163d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:39.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.379+0000 7f3bc07e1640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bb8072b00 con 0x7f3bb8159ed0 2024-05-09T05:53:39.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.379+0000 7f3bc07e1640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f3bb8153c70 con 0x7f3bb8153860 2024-05-09T05:53:39.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.379+0000 7f3bc07e1640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f3bb8072540 con 0x7f3bb80c7210 2024-05-09T05:53:39.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.379+0000 7f3bbdd7c640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3bb8153860 0x7f3bb80c6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:39.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.379+0000 7f3bbdd7c640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3bb8153860 0x7f3bb80c6cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42936/0 (socket says 172.21.15.72:42936) 2024-05-09T05:53:39.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.379+0000 7f3bbdd7c640 1 -- 172.21.15.72:0/3486270484 learned_addr learned my addr 172.21.15.72:0/3486270484 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:39.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.379+0000 7f3bbed7e640 1 --2- 172.21.15.72:0/3486270484 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bb80c7210 0x7f3bb8163d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:39.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.379+0000 7f3bbdd7c640 1 -- 172.21.15.72:0/3486270484 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bb80c7210 msgr2=0x7f3bb8163d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:39.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.379+0000 7f3bbdd7c640 1 --2- 172.21.15.72:0/3486270484 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bb80c7210 0x7f3bb8163d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:39.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.379+0000 7f3bbdd7c640 1 -- 172.21.15.72:0/3486270484 >> v1:172.21.15.110:6789/0 conn(0x7f3bb8159ed0 legacy=0x7f3bb8072f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:39.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.379+0000 7f3bbdd7c640 1 -- 172.21.15.72:0/3486270484 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bb8072820 con 0x7f3bb8153860 2024-05-09T05:53:39.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.383+0000 7f3bbdd7c640 1 --2- 172.21.15.72:0/3486270484 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bb8153860 0x7f3bb80c6cd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3bac009870 tx=0x7f3bac01ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39d3e2a6a43bb7e4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:39.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.383+0000 7f3bbd57b640 1 -- 172.21.15.72:0/3486270484 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bac0b5070 con 0x7f3bb8153860 2024-05-09T05:53:39.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.383+0000 7f3bbd57b640 1 -- 172.21.15.72:0/3486270484 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bac0a8a50 con 0x7f3bb8153860 2024-05-09T05:53:39.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.383+0000 7f3bbd57b640 1 -- 172.21.15.72:0/3486270484 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bac0a8e20 con 0x7f3bb8153860 2024-05-09T05:53:39.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.383+0000 7f3bc07e1640 1 -- 172.21.15.72:0/3486270484 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bb8153860 msgr2=0x7f3bb80c6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:39.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.383+0000 7f3bc07e1640 1 --2- 172.21.15.72:0/3486270484 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bb8153860 0x7f3bb80c6cd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3bac009870 tx=0x7f3bac01ed50 comp rx=0 tx=0).stop 2024-05-09T05:53:39.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.383+0000 7f3bc07e1640 1 -- 172.21.15.72:0/3486270484 shutdown_connections 2024-05-09T05:53:39.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.383+0000 7f3bc07e1640 1 --2- 172.21.15.72:0/3486270484 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bb80c7210 0x7f3bb8163d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:39.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.383+0000 7f3bc07e1640 1 --2- 172.21.15.72:0/3486270484 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bb8153860 0x7f3bb80c6cd0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:39.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.383+0000 7f3bc07e1640 1 -- 172.21.15.72:0/3486270484 >> 172.21.15.72:0/3486270484 conn(0x7f3bb80cde90 msgr2=0x7f3bb80ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:39.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.383+0000 7f3bc07e1640 1 -- 172.21.15.72:0/3486270484 shutdown_connections 2024-05-09T05:53:39.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.383+0000 7f3bc07e1640 1 -- 172.21.15.72:0/3486270484 wait complete. 2024-05-09T05:53:39.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.387+0000 7f3bc07e1640 1 Processor -- start 2024-05-09T05:53:39.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.387+0000 7f3bc07e1640 1 -- start start 2024-05-09T05:53:39.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.387+0000 7f3bc07e1640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bb80c7210 0x7f3bb815a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:39.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.387+0000 7f3bc07e1640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bb8153860 0x7f3bb814af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:39.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.387+0000 7f3bc07e1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3bb8159ed0 0x7f3bb8158490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:39.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.387+0000 7f3bc07e1640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f3bb80c4920 con 0x7f3bb8153860 2024-05-09T05:53:39.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.387+0000 7f3bc07e1640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f3bb80c7620 con 0x7f3bb8159ed0 2024-05-09T05:53:39.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.387+0000 7f3bc07e1640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f3bb80c4cb0 con 0x7f3bb80c7210 2024-05-09T05:53:39.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.387+0000 7f3bbdd7c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bb8153860 0x7f3bb814af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:39.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.387+0000 7f3bbdd7c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bb8153860 0x7f3bb814af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42944/0 (socket says 172.21.15.72:42944) 2024-05-09T05:53:39.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.387+0000 7f3bbdd7c640 1 -- 172.21.15.72:0/2694212736 learned_addr learned my addr 172.21.15.72:0/2694212736 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:39.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.387+0000 7f3bbed7e640 1 --2- 172.21.15.72:0/2694212736 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3bb8159ed0 0x7f3bb8158490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:39.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.387+0000 7f3bbe57d640 1 --2- 172.21.15.72:0/2694212736 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bb80c7210 0x7f3bb815a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:39.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.387+0000 7f3bbdd7c640 1 -- 172.21.15.72:0/2694212736 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bb80c7210 msgr2=0x7f3bb815a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:39.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.387+0000 7f3bbdd7c640 1 --2- 172.21.15.72:0/2694212736 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bb80c7210 0x7f3bb815a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:39.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.387+0000 7f3bbdd7c640 1 -- 172.21.15.72:0/2694212736 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3bb8159ed0 msgr2=0x7f3bb8158490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:39.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.387+0000 7f3bbdd7c640 1 --2- 172.21.15.72:0/2694212736 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3bb8159ed0 0x7f3bb8158490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:39.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.387+0000 7f3bbdd7c640 1 -- 172.21.15.72:0/2694212736 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bb8155210 con 0x7f3bb8153860 2024-05-09T05:53:39.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.387+0000 7f3bbdd7c640 1 --2- 172.21.15.72:0/2694212736 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bb8153860 0x7f3bb814af70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3bac0b3040 tx=0x7f3bac01baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:39.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.387+0000 7f3baaffd640 1 -- 172.21.15.72:0/2694212736 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bac0c0070 con 0x7f3bb8153860 2024-05-09T05:53:39.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.387+0000 7f3baaffd640 1 -- 172.21.15.72:0/2694212736 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bac0ae550 con 0x7f3bb8153860 2024-05-09T05:53:39.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.387+0000 7f3bc07e1640 1 -- 172.21.15.72:0/2694212736 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bb81f33a0 con 0x7f3bb8153860 2024-05-09T05:53:39.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.387+0000 7f3baaffd640 1 -- 172.21.15.72:0/2694212736 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bac0b5070 con 0x7f3bb8153860 2024-05-09T05:53:39.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.387+0000 7f3bc07e1640 1 -- 172.21.15.72:0/2694212736 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bb81f3960 con 0x7f3bb8153860 2024-05-09T05:53:39.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.387+0000 7f3bc07e1640 1 -- 172.21.15.72:0/2694212736 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bb815d7f0 con 0x7f3bb8153860 2024-05-09T05:53:39.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.391+0000 7f3baaffd640 1 -- 172.21.15.72:0/2694212736 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f3bac0c3070 con 0x7f3bb8153860 2024-05-09T05:53:39.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.391+0000 7f3baaffd640 1 --2- 172.21.15.72:0/2694212736 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f3b9c06f400 0x7f3b9c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:39.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.391+0000 7f3baaffd640 1 -- 172.21.15.72:0/2694212736 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3bac12cf00 con 0x7f3bb8153860 2024-05-09T05:53:39.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.391+0000 7f3bbe57d640 1 --2- 172.21.15.72:0/2694212736 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f3b9c06f400 0x7f3b9c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:39.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.391+0000 7f3bbe57d640 1 --2- 172.21.15.72:0/2694212736 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f3b9c06f400 0x7f3b9c071910 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4000f70 tx=0x7f3bb4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:39.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.395+0000 7f3baaffd640 1 -- 172.21.15.72:0/2694212736 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f3bb815d7f0 con 0x7f3bb8153860 2024-05-09T05:53:39.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.567+0000 7f3bc07e1640 1 -- 172.21.15.72:0/2694212736 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f3bb806a520 con 0x7f3bb8153860 2024-05-09T05:53:39.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.567+0000 7f3baaffd640 1 -- 172.21.15.72:0/2694212736 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7f3bac0188b0 con 0x7f3bb8153860 2024-05-09T05:53:39.561 INFO:teuthology.orchestra.run.smithi072.stderr:listed 0 entries 2024-05-09T05:53:39.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.571+0000 7f3bc07e1640 1 -- 172.21.15.72:0/2694212736 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f3b9c06f400 msgr2=0x7f3b9c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:39.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.571+0000 7f3bc07e1640 1 --2- 172.21.15.72:0/2694212736 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f3b9c06f400 0x7f3b9c071910 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4000f70 tx=0x7f3bb4009040 comp rx=0 tx=0).stop 2024-05-09T05:53:39.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.571+0000 7f3bc07e1640 1 -- 172.21.15.72:0/2694212736 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bb8153860 msgr2=0x7f3bb814af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:39.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.571+0000 7f3bc07e1640 1 --2- 172.21.15.72:0/2694212736 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bb8153860 0x7f3bb814af70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3bac0b3040 tx=0x7f3bac01baf0 comp rx=0 tx=0).stop 2024-05-09T05:53:39.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.571+0000 7f3bc07e1640 1 -- 172.21.15.72:0/2694212736 shutdown_connections 2024-05-09T05:53:39.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.571+0000 7f3bc07e1640 1 --2- 172.21.15.72:0/2694212736 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f3b9c06f400 0x7f3b9c071910 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:39.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.571+0000 7f3bc07e1640 1 --2- 172.21.15.72:0/2694212736 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3bb8159ed0 0x7f3bb8158490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:39.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.571+0000 7f3bc07e1640 1 --2- 172.21.15.72:0/2694212736 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bb8153860 0x7f3bb814af70 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:39.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.571+0000 7f3bc07e1640 1 --2- 172.21.15.72:0/2694212736 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bb80c7210 0x7f3bb815a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:39.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.571+0000 7f3bc07e1640 1 -- 172.21.15.72:0/2694212736 >> 172.21.15.72:0/2694212736 conn(0x7f3bb80cde90 msgr2=0x7f3bb806f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:39.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.571+0000 7f3bc07e1640 1 -- 172.21.15.72:0/2694212736 shutdown_connections 2024-05-09T05:53:39.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:39.571+0000 7f3bc07e1640 1 -- 172.21.15.72:0/2694212736 wait complete. 2024-05-09T05:53:39.580 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi072.front.sepia.ceph.com... 2024-05-09T05:53:39.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:53:39.580 DEBUG:teuthology.orchestra.run.smithi072:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-05-09T05:53:39.600 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi072.stderr:ceph-fuse[33666]: fuse finished with error 0 and tester_r 0 2024-05-09T05:53:39.601 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T05:53:45.703 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi072.front.sepia.ceph.com 2024-05-09T05:53:45.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:53:45.704 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-05-09T05:53:45.718 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T05:53:45.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:45.923+0000 7f47e7b82640 1 Processor -- start 2024-05-09T05:53:45.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:45.923+0000 7f47e7b82640 1 -- start start 2024-05-09T05:53:45.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:45.923+0000 7f47e7b82640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47e015da90 0x7f47e00c7570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:45.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:45.923+0000 7f47e7b82640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f47e015dea0 0x7f47e00745b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:45.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:45.923+0000 7f47e7b82640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f47e0074af0 0x7f47e006fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:45.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:45.923+0000 7f47e7b82640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f47e01513f0 con 0x7f47e015dea0 2024-05-09T05:53:45.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:45.923+0000 7f47e7b82640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f47e015a4f0 con 0x7f47e0074af0 2024-05-09T05:53:45.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:45.923+0000 7f47e7b82640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f47e00c84f0 con 0x7f47e015da90 2024-05-09T05:53:45.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:45.923+0000 7f47e511d640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f47e015dea0 0x7f47e00745b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:45.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:45.923+0000 7f47e511d640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f47e015dea0 0x7f47e00745b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46296/0 (socket says 172.21.15.72:46296) 2024-05-09T05:53:45.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:45.923+0000 7f47e511d640 1 -- 172.21.15.72:0/1366309021 learned_addr learned my addr 172.21.15.72:0/1366309021 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:45.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:45.927+0000 7f47e591e640 1 --2- 172.21.15.72:0/1366309021 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47e015da90 0x7f47e00c7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:45.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:45.927+0000 7f47e611f640 1 --2- 172.21.15.72:0/1366309021 >> v2:172.21.15.110:3300/0 conn(0x7f47e0074af0 0x7f47e006fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:45.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:45.927+0000 7f47e511d640 1 -- 172.21.15.72:0/1366309021 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47e015da90 msgr2=0x7f47e00c7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:45.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:45.927+0000 7f47e511d640 1 --2- 172.21.15.72:0/1366309021 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47e015da90 0x7f47e00c7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:45.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:45.927+0000 7f47e511d640 1 -- 172.21.15.72:0/1366309021 >> v2:172.21.15.110:3300/0 conn(0x7f47e0074af0 msgr2=0x7f47e006fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:45.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:45.927+0000 7f47e511d640 1 --2- 172.21.15.72:0/1366309021 >> v2:172.21.15.110:3300/0 conn(0x7f47e0074af0 0x7f47e006fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:45.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:45.927+0000 7f47e511d640 1 -- 172.21.15.72:0/1366309021 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47e00c87d0 con 0x7f47e015dea0 2024-05-09T05:53:45.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:45.927+0000 7f47e511d640 1 --2- 172.21.15.72:0/1366309021 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47e015dea0 0x7f47e00745b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f47e0070ca0 tx=0x7f47d001c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba858693be796f4c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:45.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:45.927+0000 7f47e491c640 1 -- 172.21.15.72:0/1366309021 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d00b0070 con 0x7f47e015dea0 2024-05-09T05:53:45.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:45.927+0000 7f47e491c640 1 -- 172.21.15.72:0/1366309021 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47d00ab600 con 0x7f47e015dea0 2024-05-09T05:53:45.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:45.927+0000 7f47e491c640 1 -- 172.21.15.72:0/1366309021 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d00ab9d0 con 0x7f47e015dea0 2024-05-09T05:53:45.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:45.927+0000 7f47e7b82640 1 -- 172.21.15.72:0/1366309021 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47e015dea0 msgr2=0x7f47e00745b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:45.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:45.927+0000 7f47e7b82640 1 --2- 172.21.15.72:0/1366309021 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47e015dea0 0x7f47e00745b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f47e0070ca0 tx=0x7f47d001c260 comp rx=0 tx=0).stop 2024-05-09T05:53:45.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:45.927+0000 7f47e7b82640 1 -- 172.21.15.72:0/1366309021 shutdown_connections 2024-05-09T05:53:45.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:45.927+0000 7f47e7b82640 1 --2- 172.21.15.72:0/1366309021 >> v2:172.21.15.110:3300/0 conn(0x7f47e0074af0 0x7f47e006fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:45.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:45.927+0000 7f47e7b82640 1 --2- 172.21.15.72:0/1366309021 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47e015dea0 0x7f47e00745b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:45.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:45.927+0000 7f47e7b82640 1 --2- 172.21.15.72:0/1366309021 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47e015da90 0x7f47e00c7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:45.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:45.927+0000 7f47e7b82640 1 -- 172.21.15.72:0/1366309021 >> 172.21.15.72:0/1366309021 conn(0x7f47e00cde90 msgr2=0x7f47e00ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:45.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:45.927+0000 7f47e7b82640 1 -- 172.21.15.72:0/1366309021 shutdown_connections 2024-05-09T05:53:45.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:45.927+0000 7f47e7b82640 1 -- 172.21.15.72:0/1366309021 wait complete. 2024-05-09T05:53:45.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:45.931+0000 7f47e7b82640 1 Processor -- start 2024-05-09T05:53:45.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:45.931+0000 7f47e7b82640 1 -- start start 2024-05-09T05:53:45.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:45.931+0000 7f47e7b82640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47e0074af0 0x7f47e01486a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:45.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:45.931+0000 7f47e7b82640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47e015da90 0x7f47e0142350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:45.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:45.931+0000 7f47e7b82640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47e015dea0 0x7f47e0158b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:45.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:45.931+0000 7f47e7b82640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f47e00c81b0 con 0x7f47e015da90 2024-05-09T05:53:45.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:45.931+0000 7f47e7b82640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f47e00c70e0 con 0x7f47e015dea0 2024-05-09T05:53:45.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:45.931+0000 7f47e7b82640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f47e0154ab0 con 0x7f47e0074af0 2024-05-09T05:53:45.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:45.931+0000 7f47e511d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47e015da90 0x7f47e0142350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:45.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:45.931+0000 7f47e511d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47e015da90 0x7f47e0142350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46310/0 (socket says 172.21.15.72:46310) 2024-05-09T05:53:45.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:45.931+0000 7f47e511d640 1 -- 172.21.15.72:0/1019264885 learned_addr learned my addr 172.21.15.72:0/1019264885 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:45.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:45.931+0000 7f47e591e640 1 --2- 172.21.15.72:0/1019264885 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47e0074af0 0x7f47e01486a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:45.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:45.931+0000 7f47e611f640 1 --2- 172.21.15.72:0/1019264885 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47e015dea0 0x7f47e0158b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:45.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:45.931+0000 7f47e511d640 1 -- 172.21.15.72:0/1019264885 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47e0074af0 msgr2=0x7f47e01486a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:45.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:45.931+0000 7f47e511d640 1 --2- 172.21.15.72:0/1019264885 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47e0074af0 0x7f47e01486a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:45.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:45.931+0000 7f47e511d640 1 -- 172.21.15.72:0/1019264885 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47e015dea0 msgr2=0x7f47e0158b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:45.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:45.931+0000 7f47e511d640 1 --2- 172.21.15.72:0/1019264885 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47e015dea0 0x7f47e0158b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:45.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:45.931+0000 7f47e511d640 1 -- 172.21.15.72:0/1019264885 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47e01410b0 con 0x7f47e015da90 2024-05-09T05:53:45.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:45.931+0000 7f47e511d640 1 --2- 172.21.15.72:0/1019264885 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47e015da90 0x7f47e0142350 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f47d001a910 tx=0x7f47d0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:45.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:45.931+0000 7f47d67fc640 1 -- 172.21.15.72:0/1019264885 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d00b0040 con 0x7f47e015da90 2024-05-09T05:53:45.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:45.931+0000 7f47d67fc640 1 -- 172.21.15.72:0/1019264885 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47d00b4620 con 0x7f47e015da90 2024-05-09T05:53:45.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:45.931+0000 7f47e7b82640 1 -- 172.21.15.72:0/1019264885 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47e00cd3d0 con 0x7f47e015da90 2024-05-09T05:53:45.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:45.931+0000 7f47d67fc640 1 -- 172.21.15.72:0/1019264885 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d00b4a10 con 0x7f47e015da90 2024-05-09T05:53:45.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:45.931+0000 7f47e7b82640 1 -- 172.21.15.72:0/1019264885 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47e00cb750 con 0x7f47e015da90 2024-05-09T05:53:45.927 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:45.935+0000 7f47e7b82640 1 -- 172.21.15.72:0/1019264885 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47e006a520 con 0x7f47e015da90 2024-05-09T05:53:45.927 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:45.935+0000 7f47d67fc640 1 -- 172.21.15.72:0/1019264885 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f47d00ab4c0 con 0x7f47e015da90 2024-05-09T05:53:45.927 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:45.935+0000 7f47d67fc640 1 --2- 172.21.15.72:0/1019264885 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f47c406f400 0x7f47c4071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:45.927 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:45.935+0000 7f47d67fc640 1 -- 172.21.15.72:0/1019264885 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f47d01291a0 con 0x7f47e015da90 2024-05-09T05:53:45.927 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:45.935+0000 7f47e591e640 1 --2- 172.21.15.72:0/1019264885 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f47c406f400 0x7f47c4071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:45.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:45.935+0000 7f47e591e640 1 --2- 172.21.15.72:0/1019264885 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f47c406f400 0x7f47c4071910 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f47e00754b0 tx=0x7f47dc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:45.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:45.939+0000 7f47d67fc640 1 -- 172.21.15.72:0/1019264885 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f47d0016110 con 0x7f47e015da90 2024-05-09T05:53:46.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.099+0000 7f47e7b82640 1 -- 172.21.15.72:0/1019264885 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f47e00c8b30 con 0x7f47e015da90 2024-05-09T05:53:46.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.099+0000 7f47d67fc640 1 -- 172.21.15.72:0/1019264885 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18494 (secure 0 0 0) 0x7f47d00f5e70 con 0x7f47e015da90 2024-05-09T05:53:46.092 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:53:46.092 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"fsid":"44c88cb9-b39b-4787-a871-80ddf0ad6292","created":"2024-05-09T05:52:59.591187+0000","modified":"2024-05-09T05:53:28.584684+0000","last_up_change":"2024-05-09T05:53:10.902489+0000","last_in_change":"2024-05-09T05:53:02.200254+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T05:53:10.503537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T05:53:21.364958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T05:53:22.461477+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-09T05:53:26.171144+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e4af2aa1-ba5c-4411-a72a-a0e38e589a74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":331913921},{"type":"v1","addr":"172.21.15.72:6817","nonce":331913921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":331913921},{"type":"v1","addr":"172.21.15.72:6819","nonce":331913921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":331913921},{"type":"v1","addr":"172.21.15.72:6823","nonce":331913921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":331913921},{"type":"v1","addr":"172.21.15.72:6821","nonce":331913921}]},"public_addr":"172.21.15.72:6817/331913921","cluster_addr":"172.21.15.72:6819/331913921","heartbeat_back_addr":"172.21.15.72:6823/331913921","heartbeat_front_addr":"172.21.15.72:6821/331913921","state":["exists","up"]},{"osd":1,"uuid":"052504f5-a523-4922-bdc7-ce2890faa5ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2197151836},{"type":"v1","addr":"172.21.15.72:6801","nonce":2197151836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2197151836},{"type":"v1","addr":"172.21.15.72:6803","nonce":2197151836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2197151836},{"type":"v1","addr":"172.21.15.72:6811","nonce":2197151836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2197151836},{"type":"v1","addr":"172.21.15.72:6807","nonce":2197151836}]},"public_addr":"172.21.15.72:6801/2197151836","cluster_addr":"172.21.15.72:6803/2197151836","heartbeat_back_addr":"172.21.15.72:6811/2197151836","heartbeat_front_addr":"172.21.15.72:6807/2197151836","state":["exists","up"]},{"osd":2,"uuid":"28bc1c95-6d0d-4263-baad-314d86e6a670","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1273581990},{"type":"v1","addr":"172.21.15.72:6825","nonce":1273581990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":1273581990},{"type":"v1","addr":"172.21.15.72:6827","nonce":1273581990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1273581990},{"type":"v1","addr":"172.21.15.72:6831","nonce":1273581990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1273581990},{"type":"v1","addr":"172.21.15.72:6829","nonce":1273581990}]},"public_addr":"172.21.15.72:6825/1273581990","cluster_addr":"172.21.15.72:6827/1273581990","heartbeat_back_addr":"172.21.15.72:6831/1273581990","heartbeat_front_addr":"172.21.15.72:6829/1273581990","state":["exists","up"]},{"osd":3,"uuid":"edcc86cb-f178-4533-8069-de9d781531ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2180866263},{"type":"v1","addr":"172.21.15.72:6806","nonce":2180866263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2180866263},{"type":"v1","addr":"172.21.15.72:6810","nonce":2180866263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2180866263},{"type":"v1","addr":"172.21.15.72:6815","nonce":2180866263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2180866263},{"type":"v1","addr":"172.21.15.72:6813","nonce":2180866263}]},"public_addr":"172.21.15.72:6806/2180866263","cluster_addr":"172.21.15.72:6810/2180866263","heartbeat_back_addr":"172.21.15.72:6815/2180866263","heartbeat_front_addr":"172.21.15.72:6813/2180866263","state":["exists","up"]},{"osd":4,"uuid":"8d138128-4829-4109-87a1-25f339f3e953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3437318248},{"type":"v1","addr":"172.21.15.110:6817","nonce":3437318248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3437318248},{"type":"v1","addr":"172.21.15.110:6819","nonce":3437318248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3437318248},{"type":"v1","addr":"172.21.15.110:6823","nonce":3437318248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3437318248},{"type":"v1","addr":"172.21.15.110:6821","nonce":3437318248}]},"public_addr":"172.21.15.110:6817/3437318248","cluster_addr":"172.21.15.110:6819/3437318248","heartbeat_back_addr":"172.21.15.110:6823/3437318248","heartbeat_front_addr":"172.21.15.110:6821/3437318248","state":["exists","up"]},{"osd":5,"uuid":"99a4a914-0a0e-4d25-94ae-3e86b8b1aa4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":977576181},{"type":"v1","addr":"172.21.15.110:6825","nonce":977576181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":977576181},{"type":"v1","addr":"172.21.15.110:6827","nonce":977576181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":977576181},{"type":"v1","addr":"172.21.15.110:6831","nonce":977576181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":977576181},{"type":"v1","addr":"172.21.15.110:6829","nonce":977576181}]},"public_addr":"172.21.15.110:6825/977576181","cluster_addr":"172.21.15.110:6827/977576181","heartbeat_back_addr":"172.21.15.110:6831/977576181","heartbeat_front_addr":"172.21.15.110:6829/977576181","state":["exists","up"]},{"osd":6,"uuid":"6e04b295-afc9-4f80-80f7-3df1f5168608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":1817638786},{"type":"v1","addr":"172.21.15.110:6809","nonce":1817638786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":1817638786},{"type":"v1","addr":"172.21.15.110:6811","nonce":1817638786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":1817638786},{"type":"v1","addr":"172.21.15.110:6815","nonce":1817638786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":1817638786},{"type":"v1","addr":"172.21.15.110:6813","nonce":1817638786}]},"public_addr":"172.21.15.110:6809/1817638786","cluster_addr":"172.21.15.110:6811/1817638786","heartbeat_back_addr":"172.21.15.110:6815/1817638786","heartbeat_front_addr":"172.21.15.110:6813/1817638786","state":["exists","up"]},{"osd":7,"uuid":"835de5c9-1e2c-41d8-bd28-d7ffe5ad8fdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":214675920},{"type":"v1","addr":"172.21.15.110:6801","nonce":214675920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":214675920},{"type":"v1","addr":"172.21.15.110:6803","nonce":214675920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":214675920},{"type":"v1","addr":"172.21.15.110:6807","nonce":214675920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":214675920},{"type":"v1","addr":"172.21.15.110:6805","nonce":214675920}]},"public_addr":"172.21.15.110:6801/214675920","cluster_addr":"172.21.15.110:6803/214675920","heartbeat_back_addr":"172.21.15.110:6807/214675920","heartbeat_front_addr":"172.21.15.110:6805/214675920","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.849761+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.670554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.743789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:08.516367+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.665550+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.518775+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.786468+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.794984+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T05:53:46.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.103+0000 7f47e7b82640 1 -- 172.21.15.72:0/1019264885 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f47c406f400 msgr2=0x7f47c4071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:46.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.103+0000 7f47e7b82640 1 --2- 172.21.15.72:0/1019264885 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f47c406f400 0x7f47c4071910 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f47e00754b0 tx=0x7f47dc008040 comp rx=0 tx=0).stop 2024-05-09T05:53:46.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.103+0000 7f47e7b82640 1 -- 172.21.15.72:0/1019264885 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47e015da90 msgr2=0x7f47e0142350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:46.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.103+0000 7f47e7b82640 1 --2- 172.21.15.72:0/1019264885 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47e015da90 0x7f47e0142350 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f47d001a910 tx=0x7f47d0019000 comp rx=0 tx=0).stop 2024-05-09T05:53:46.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.103+0000 7f47e7b82640 1 -- 172.21.15.72:0/1019264885 shutdown_connections 2024-05-09T05:53:46.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.103+0000 7f47e7b82640 1 --2- 172.21.15.72:0/1019264885 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f47c406f400 0x7f47c4071910 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:46.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.103+0000 7f47e7b82640 1 --2- 172.21.15.72:0/1019264885 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47e015dea0 0x7f47e0158b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:46.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.103+0000 7f47e7b82640 1 --2- 172.21.15.72:0/1019264885 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47e015da90 0x7f47e0142350 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:46.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.103+0000 7f47e7b82640 1 --2- 172.21.15.72:0/1019264885 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47e0074af0 0x7f47e01486a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:46.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.103+0000 7f47e7b82640 1 -- 172.21.15.72:0/1019264885 >> 172.21.15.72:0/1019264885 conn(0x7f47e00cde90 msgr2=0x7f47e014ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:46.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.103+0000 7f47e7b82640 1 -- 172.21.15.72:0/1019264885 shutdown_connections 2024-05-09T05:53:46.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.103+0000 7f47e7b82640 1 -- 172.21.15.72:0/1019264885 wait complete. 2024-05-09T05:53:46.113 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T05:53:46.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.267+0000 7f1b14d15640 1 Processor -- start 2024-05-09T05:53:46.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.267+0000 7f1b14d15640 1 -- start start 2024-05-09T05:53:46.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.267+0000 7f1b14d15640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b1015da90 0x7f1b100c7570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:46.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.267+0000 7f1b14d15640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b1015a4f0 con 0x7f1b1015dea0 2024-05-09T05:53:46.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.267+0000 7f1b14d15640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b100c84f0 con 0x7f1b10162e60 2024-05-09T05:53:46.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.267+0000 7f1b14d15640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f1b101513f0 con 0x7f1b1015da90 2024-05-09T05:53:46.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.267+0000 7f1b0dd9b640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f1b1015dea0 0x7f1b100745b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:45694/0 (socket says 172.21.15.72:45694) 2024-05-09T05:53:46.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.267+0000 7f1b0dd9b640 1 -- 172.21.15.72:0/3070748468 learned_addr learned my addr 172.21.15.72:0/3070748468 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:53:46.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.267+0000 7f1b0e59c640 1 --2- 172.21.15.72:0/3070748468 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b1015da90 0x7f1b100c7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:46.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.267+0000 7f1b0d59a640 1 -- 172.21.15.72:0/3070748468 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4242496749 0 0) 0x7f1b1015a4f0 con 0x7f1b1015dea0 2024-05-09T05:53:46.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.267+0000 7f1b0d59a640 1 -- 172.21.15.72:0/3070748468 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1afc003530 con 0x7f1b1015dea0 2024-05-09T05:53:46.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.267+0000 7f1b0d59a640 1 -- 172.21.15.72:0/3070748468 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 672188185 0 0) 0x7f1afc003530 con 0x7f1b1015dea0 2024-05-09T05:53:46.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.267+0000 7f1b0d59a640 1 -- 172.21.15.72:0/3070748468 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b1015da90 msgr2=0x7f1b100c7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:46.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.267+0000 7f1b0d59a640 1 --2- 172.21.15.72:0/3070748468 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b1015da90 0x7f1b100c7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:46.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.267+0000 7f1b0d59a640 1 -- 172.21.15.72:0/3070748468 >> v1:172.21.15.110:6789/0 conn(0x7f1b10162e60 legacy=0x7f1b10165280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:46.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.267+0000 7f1b0d59a640 1 -- 172.21.15.72:0/3070748468 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b100c87d0 con 0x7f1b1015dea0 2024-05-09T05:53:46.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.267+0000 7f1b0d59a640 1 -- 172.21.15.72:0/3070748468 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2749052815 0 0) 0x7f1af8001700 con 0x7f1b1015dea0 2024-05-09T05:53:46.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.267+0000 7f1b0d59a640 1 -- 172.21.15.72:0/3070748468 >> v1:172.21.15.72:6789/0 conn(0x7f1b1015dea0 legacy=0x7f1b100745b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:46.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.267+0000 7f1b0d59a640 1 --2- 172.21.15.72:0/3070748468 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b1015da90 0x7f1afc003a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:46.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.267+0000 7f1b0d59a640 1 --2- 172.21.15.72:0/3070748468 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1afc004010 0x7f1afc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:46.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.267+0000 7f1b0d59a640 1 --2- 172.21.15.72:0/3070748468 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1afc004d50 0x7f1afc005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:46.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.267+0000 7f1b0d59a640 1 -- 172.21.15.72:0/3070748468 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f1afc00bbe0 con 0x7f1afc004d50 2024-05-09T05:53:46.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.267+0000 7f1b0d59a640 1 -- 172.21.15.72:0/3070748468 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f1afc00bd90 con 0x7f1afc004010 2024-05-09T05:53:46.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.267+0000 7f1b0d59a640 1 -- 172.21.15.72:0/3070748468 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f1afc00bf90 con 0x7f1b1015da90 2024-05-09T05:53:46.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.267+0000 7f1b0ed9d640 1 --2- 172.21.15.72:0/3070748468 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1afc004d50 0x7f1afc005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:46.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.267+0000 7f1b0dd9b640 1 --2- 172.21.15.72:0/3070748468 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1afc004010 0x7f1afc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:46.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.267+0000 7f1b0e59c640 1 --2- 172.21.15.72:0/3070748468 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b1015da90 0x7f1afc003a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:46.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.267+0000 7f1b0ed9d640 1 -- 172.21.15.72:0/3070748468 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b1015da90 msgr2=0x7f1afc003a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:46.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.267+0000 7f1b0ed9d640 1 --2- 172.21.15.72:0/3070748468 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b1015da90 0x7f1afc003a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:46.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.267+0000 7f1b0ed9d640 1 -- 172.21.15.72:0/3070748468 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1afc004010 msgr2=0x7f1afc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:46.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.267+0000 7f1b0ed9d640 1 --2- 172.21.15.72:0/3070748468 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1afc004010 0x7f1afc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:46.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.267+0000 7f1b0ed9d640 1 -- 172.21.15.72:0/3070748468 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1afc003530 con 0x7f1afc004d50 2024-05-09T05:53:46.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.271+0000 7f1b0ed9d640 1 --2- 172.21.15.72:0/3070748468 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1afc004d50 0x7f1afc005200 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1b100c74d0 tx=0x7f1b0801c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=107fc03fa44e636e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:46.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.271+0000 7f1b0d59a640 1 -- 172.21.15.72:0/3070748468 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b08001ae0 con 0x7f1afc004d50 2024-05-09T05:53:46.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.271+0000 7f1b0d59a640 1 -- 172.21.15.72:0/3070748468 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b08003b80 con 0x7f1afc004d50 2024-05-09T05:53:46.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.271+0000 7f1b0d59a640 1 -- 172.21.15.72:0/3070748468 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b080050d0 con 0x7f1afc004d50 2024-05-09T05:53:46.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.271+0000 7f1b14d15640 1 -- 172.21.15.72:0/3070748468 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1afc004d50 msgr2=0x7f1afc005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:46.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.271+0000 7f1b14d15640 1 --2- 172.21.15.72:0/3070748468 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1afc004d50 0x7f1afc005200 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1b100c74d0 tx=0x7f1b0801c750 comp rx=0 tx=0).stop 2024-05-09T05:53:46.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.271+0000 7f1b0ed9d640 1 -- 172.21.15.72:0/3070748468 reap_dead start 2024-05-09T05:53:46.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.271+0000 7f1b14d15640 1 -- 172.21.15.72:0/3070748468 shutdown_connections 2024-05-09T05:53:46.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.271+0000 7f1b14d15640 1 -- 172.21.15.72:0/3070748468 >> 172.21.15.72:0/3070748468 conn(0x7f1b100cde90 msgr2=0x7f1b100ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:46.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.271+0000 7f1b14d15640 1 -- 172.21.15.72:0/3070748468 shutdown_connections 2024-05-09T05:53:46.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.271+0000 7f1b14d15640 1 -- 172.21.15.72:0/3070748468 wait complete. 2024-05-09T05:53:46.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.275+0000 7f1b14d15640 1 Processor -- start 2024-05-09T05:53:46.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.275+0000 7f1b14d15640 1 -- start start 2024-05-09T05:53:46.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.275+0000 7f1b14d15640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1afc004d50 0x7f1b10156410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:46.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.275+0000 7f1b14d15640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b10158360 0x7f1b101590b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:46.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.275+0000 7f1b14d15640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b10154fb0 0x7f1b1014aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:46.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.275+0000 7f1b14d15640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f1b1015ad70 con 0x7f1b10158360 2024-05-09T05:53:46.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.275+0000 7f1b14d15640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f1b1015aa90 con 0x7f1afc004d50 2024-05-09T05:53:46.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.275+0000 7f1b14d15640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f1b100c70e0 con 0x7f1b10154fb0 2024-05-09T05:53:46.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.275+0000 7f1b0dd9b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b10158360 0x7f1b101590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:46.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.275+0000 7f1b0dd9b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b10158360 0x7f1b101590b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46320/0 (socket says 172.21.15.72:46320) 2024-05-09T05:53:46.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.275+0000 7f1b0dd9b640 1 -- 172.21.15.72:0/2071398667 learned_addr learned my addr 172.21.15.72:0/2071398667 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:46.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.275+0000 7f1b0e59c640 1 --2- 172.21.15.72:0/2071398667 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1afc004d50 0x7f1b10156410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:46.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.275+0000 7f1b0ed9d640 1 --2- 172.21.15.72:0/2071398667 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b10154fb0 0x7f1b1014aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:46.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.275+0000 7f1b0dd9b640 1 -- 172.21.15.72:0/2071398667 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b10154fb0 msgr2=0x7f1b1014aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:46.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.275+0000 7f1b0dd9b640 1 --2- 172.21.15.72:0/2071398667 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b10154fb0 0x7f1b1014aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:46.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.275+0000 7f1b0dd9b640 1 -- 172.21.15.72:0/2071398667 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1afc004d50 msgr2=0x7f1b10156410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:46.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.275+0000 7f1b0dd9b640 1 --2- 172.21.15.72:0/2071398667 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1afc004d50 0x7f1b10156410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:46.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.275+0000 7f1b0dd9b640 1 -- 172.21.15.72:0/2071398667 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b101595f0 con 0x7f1b10158360 2024-05-09T05:53:46.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.275+0000 7f1b0dd9b640 1 --2- 172.21.15.72:0/2071398667 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b10158360 0x7f1b101590b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1af800e820 tx=0x7f1af800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:46.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.275+0000 7f1b06ffd640 1 -- 172.21.15.72:0/2071398667 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af800c870 con 0x7f1b10158360 2024-05-09T05:53:46.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.275+0000 7f1b06ffd640 1 -- 172.21.15.72:0/2071398667 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1af8018070 con 0x7f1b10158360 2024-05-09T05:53:46.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.275+0000 7f1b06ffd640 1 -- 172.21.15.72:0/2071398667 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af800cc70 con 0x7f1b10158360 2024-05-09T05:53:46.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.275+0000 7f1b14d15640 1 -- 172.21.15.72:0/2071398667 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b101f3e10 con 0x7f1b10158360 2024-05-09T05:53:46.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.275+0000 7f1b14d15640 1 -- 172.21.15.72:0/2071398667 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b101f3850 con 0x7f1b10158360 2024-05-09T05:53:46.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.275+0000 7f1b14d15640 1 -- 172.21.15.72:0/2071398667 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b101f32c0 con 0x7f1b10158360 2024-05-09T05:53:46.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.279+0000 7f1b06ffd640 1 -- 172.21.15.72:0/2071398667 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f1af801d460 con 0x7f1b10158360 2024-05-09T05:53:46.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.279+0000 7f1b06ffd640 1 --2- 172.21.15.72:0/2071398667 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f1af006f430 0x7f1af0071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:46.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.279+0000 7f1b06ffd640 1 -- 172.21.15.72:0/2071398667 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1af808f380 con 0x7f1b10158360 2024-05-09T05:53:46.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.279+0000 7f1b0e59c640 1 --2- 172.21.15.72:0/2071398667 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f1af006f430 0x7f1af0071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:46.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.279+0000 7f1b0e59c640 1 --2- 172.21.15.72:0/2071398667 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f1af006f430 0x7f1af0071940 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1b100754b0 tx=0x7f1b00008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:46.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.283+0000 7f1b06ffd640 1 -- 172.21.15.72:0/2071398667 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f1af805bfc0 con 0x7f1b10158360 2024-05-09T05:53:46.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.431+0000 7f1b14d15640 1 -- 172.21.15.72:0/2071398667 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1b1006a520 con 0x7f1b10158360 2024-05-09T05:53:46.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.431+0000 7f1b06ffd640 1 -- 172.21.15.72:0/2071398667 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18494 (secure 0 0 0) 0x7f1af805b8c0 con 0x7f1b10158360 2024-05-09T05:53:46.424 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:53:46.424 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"fsid":"44c88cb9-b39b-4787-a871-80ddf0ad6292","created":"2024-05-09T05:52:59.591187+0000","modified":"2024-05-09T05:53:28.584684+0000","last_up_change":"2024-05-09T05:53:10.902489+0000","last_in_change":"2024-05-09T05:53:02.200254+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T05:53:10.503537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T05:53:21.364958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T05:53:22.461477+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-09T05:53:26.171144+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e4af2aa1-ba5c-4411-a72a-a0e38e589a74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":331913921},{"type":"v1","addr":"172.21.15.72:6817","nonce":331913921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":331913921},{"type":"v1","addr":"172.21.15.72:6819","nonce":331913921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":331913921},{"type":"v1","addr":"172.21.15.72:6823","nonce":331913921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":331913921},{"type":"v1","addr":"172.21.15.72:6821","nonce":331913921}]},"public_addr":"172.21.15.72:6817/331913921","cluster_addr":"172.21.15.72:6819/331913921","heartbeat_back_addr":"172.21.15.72:6823/331913921","heartbeat_front_addr":"172.21.15.72:6821/331913921","state":["exists","up"]},{"osd":1,"uuid":"052504f5-a523-4922-bdc7-ce2890faa5ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2197151836},{"type":"v1","addr":"172.21.15.72:6801","nonce":2197151836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2197151836},{"type":"v1","addr":"172.21.15.72:6803","nonce":2197151836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2197151836},{"type":"v1","addr":"172.21.15.72:6811","nonce":2197151836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2197151836},{"type":"v1","addr":"172.21.15.72:6807","nonce":2197151836}]},"public_addr":"172.21.15.72:6801/2197151836","cluster_addr":"172.21.15.72:6803/2197151836","heartbeat_back_addr":"172.21.15.72:6811/2197151836","heartbeat_front_addr":"172.21.15.72:6807/2197151836","state":["exists","up"]},{"osd":2,"uuid":"28bc1c95-6d0d-4263-baad-314d86e6a670","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1273581990},{"type":"v1","addr":"172.21.15.72:6825","nonce":1273581990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":1273581990},{"type":"v1","addr":"172.21.15.72:6827","nonce":1273581990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1273581990},{"type":"v1","addr":"172.21.15.72:6831","nonce":1273581990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1273581990},{"type":"v1","addr":"172.21.15.72:6829","nonce":1273581990}]},"public_addr":"172.21.15.72:6825/1273581990","cluster_addr":"172.21.15.72:6827/1273581990","heartbeat_back_addr":"172.21.15.72:6831/1273581990","heartbeat_front_addr":"172.21.15.72:6829/1273581990","state":["exists","up"]},{"osd":3,"uuid":"edcc86cb-f178-4533-8069-de9d781531ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2180866263},{"type":"v1","addr":"172.21.15.72:6806","nonce":2180866263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2180866263},{"type":"v1","addr":"172.21.15.72:6810","nonce":2180866263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2180866263},{"type":"v1","addr":"172.21.15.72:6815","nonce":2180866263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2180866263},{"type":"v1","addr":"172.21.15.72:6813","nonce":2180866263}]},"public_addr":"172.21.15.72:6806/2180866263","cluster_addr":"172.21.15.72:6810/2180866263","heartbeat_back_addr":"172.21.15.72:6815/2180866263","heartbeat_front_addr":"172.21.15.72:6813/2180866263","state":["exists","up"]},{"osd":4,"uuid":"8d138128-4829-4109-87a1-25f339f3e953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3437318248},{"type":"v1","addr":"172.21.15.110:6817","nonce":3437318248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3437318248},{"type":"v1","addr":"172.21.15.110:6819","nonce":3437318248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3437318248},{"type":"v1","addr":"172.21.15.110:6823","nonce":3437318248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3437318248},{"type":"v1","addr":"172.21.15.110:6821","nonce":3437318248}]},"public_addr":"172.21.15.110:6817/3437318248","cluster_addr":"172.21.15.110:6819/3437318248","heartbeat_back_addr":"172.21.15.110:6823/3437318248","heartbeat_front_addr":"172.21.15.110:6821/3437318248","state":["exists","up"]},{"osd":5,"uuid":"99a4a914-0a0e-4d25-94ae-3e86b8b1aa4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":977576181},{"type":"v1","addr":"172.21.15.110:6825","nonce":977576181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":977576181},{"type":"v1","addr":"172.21.15.110:6827","nonce":977576181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":977576181},{"type":"v1","addr":"172.21.15.110:6831","nonce":977576181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":977576181},{"type":"v1","addr":"172.21.15.110:6829","nonce":977576181}]},"public_addr":"172.21.15.110:6825/977576181","cluster_addr":"172.21.15.110:6827/977576181","heartbeat_back_addr":"172.21.15.110:6831/977576181","heartbeat_front_addr":"172.21.15.110:6829/977576181","state":["exists","up"]},{"osd":6,"uuid":"6e04b295-afc9-4f80-80f7-3df1f5168608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":1817638786},{"type":"v1","addr":"172.21.15.110:6809","nonce":1817638786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":1817638786},{"type":"v1","addr":"172.21.15.110:6811","nonce":1817638786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":1817638786},{"type":"v1","addr":"172.21.15.110:6815","nonce":1817638786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":1817638786},{"type":"v1","addr":"172.21.15.110:6813","nonce":1817638786}]},"public_addr":"172.21.15.110:6809/1817638786","cluster_addr":"172.21.15.110:6811/1817638786","heartbeat_back_addr":"172.21.15.110:6815/1817638786","heartbeat_front_addr":"172.21.15.110:6813/1817638786","state":["exists","up"]},{"osd":7,"uuid":"835de5c9-1e2c-41d8-bd28-d7ffe5ad8fdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":214675920},{"type":"v1","addr":"172.21.15.110:6801","nonce":214675920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":214675920},{"type":"v1","addr":"172.21.15.110:6803","nonce":214675920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":214675920},{"type":"v1","addr":"172.21.15.110:6807","nonce":214675920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":214675920},{"type":"v1","addr":"172.21.15.110:6805","nonce":214675920}]},"public_addr":"172.21.15.110:6801/214675920","cluster_addr":"172.21.15.110:6803/214675920","heartbeat_back_addr":"172.21.15.110:6807/214675920","heartbeat_front_addr":"172.21.15.110:6805/214675920","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.849761+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.670554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.743789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:08.516367+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.665550+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.518775+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.786468+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.794984+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T05:53:46.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.435+0000 7f1b14d15640 1 -- 172.21.15.72:0/2071398667 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f1af006f430 msgr2=0x7f1af0071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:46.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.435+0000 7f1b14d15640 1 --2- 172.21.15.72:0/2071398667 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f1af006f430 0x7f1af0071940 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1b100754b0 tx=0x7f1b00008040 comp rx=0 tx=0).stop 2024-05-09T05:53:46.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.435+0000 7f1b14d15640 1 -- 172.21.15.72:0/2071398667 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b10158360 msgr2=0x7f1b101590b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:46.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.435+0000 7f1b14d15640 1 --2- 172.21.15.72:0/2071398667 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b10158360 0x7f1b101590b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1af800e820 tx=0x7f1af800ece0 comp rx=0 tx=0).stop 2024-05-09T05:53:46.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.435+0000 7f1b14d15640 1 -- 172.21.15.72:0/2071398667 shutdown_connections 2024-05-09T05:53:46.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.435+0000 7f1b14d15640 1 --2- 172.21.15.72:0/2071398667 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f1af006f430 0x7f1af0071940 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:46.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.435+0000 7f1b14d15640 1 --2- 172.21.15.72:0/2071398667 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b10154fb0 0x7f1b1014aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:46.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.435+0000 7f1b14d15640 1 --2- 172.21.15.72:0/2071398667 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b10158360 0x7f1b101590b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:46.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.435+0000 7f1b14d15640 1 --2- 172.21.15.72:0/2071398667 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1afc004d50 0x7f1b10156410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:46.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.435+0000 7f1b14d15640 1 -- 172.21.15.72:0/2071398667 >> 172.21.15.72:0/2071398667 conn(0x7f1b100cde90 msgr2=0x7f1b1014e210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:46.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.435+0000 7f1b14d15640 1 -- 172.21.15.72:0/2071398667 shutdown_connections 2024-05-09T05:53:46.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.435+0000 7f1b14d15640 1 -- 172.21.15.72:0/2071398667 wait complete. 2024-05-09T05:53:46.444 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-09T05:53:46.585 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.595+0000 7fb8df875640 1 Processor -- start 2024-05-09T05:53:46.585 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.595+0000 7fb8df875640 1 -- start start 2024-05-09T05:53:46.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.595+0000 7fb8df875640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb8d815e470 0x7fb8d815e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:46.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.595+0000 7fb8df875640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb8d815edc0 0x7fb8d815f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:46.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.595+0000 7fb8df875640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8d80cda30 con 0x7fb8d8156b50 2024-05-09T05:53:46.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.595+0000 7fb8df875640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fb8d80cc020 con 0x7fb8d815edc0 2024-05-09T05:53:46.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.595+0000 7fb8df875640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fb8d815dfe0 con 0x7fb8d815e470 2024-05-09T05:53:46.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.595+0000 7fb8dde12640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb8d815edc0 0x7fb8d815f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:46.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.595+0000 7fb8dde12640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb8d815edc0 0x7fb8d815f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46332/0 (socket says 172.21.15.72:46332) 2024-05-09T05:53:46.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.595+0000 7fb8dde12640 1 -- 172.21.15.72:0/4229507987 learned_addr learned my addr 172.21.15.72:0/4229507987 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:46.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.595+0000 7fb8dce10640 1 --2- 172.21.15.72:0/4229507987 >> v2:172.21.15.110:3300/0 conn(0x7fb8d815e470 0x7fb8d815e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:46.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.595+0000 7fb8dde12640 1 -- 172.21.15.72:0/4229507987 >> v2:172.21.15.110:3300/0 conn(0x7fb8d815e470 msgr2=0x7fb8d815e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:46.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.595+0000 7fb8dde12640 1 --2- 172.21.15.72:0/4229507987 >> v2:172.21.15.110:3300/0 conn(0x7fb8d815e470 0x7fb8d815e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:46.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.595+0000 7fb8dde12640 1 -- 172.21.15.72:0/4229507987 >> v1:172.21.15.110:6789/0 conn(0x7fb8d8156b50 legacy=0x7fb8d8073ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:46.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.595+0000 7fb8dde12640 1 -- 172.21.15.72:0/4229507987 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8d815cdd0 con 0x7fb8d815edc0 2024-05-09T05:53:46.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.595+0000 7fb8dce10640 1 --2- 172.21.15.72:0/4229507987 >> v2:172.21.15.110:3300/0 conn(0x7fb8d815e470 0x7fb8d815e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:53:46.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.599+0000 7fb8dde12640 1 --2- 172.21.15.72:0/4229507987 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8d815edc0 0x7fb8d815f1d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb8d808f980 tx=0x7fb8d001c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cf0d3e59a0d586b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:46.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.599+0000 7fb8cffff640 1 -- 172.21.15.72:0/4229507987 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8d00ac020 con 0x7fb8d815edc0 2024-05-09T05:53:46.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.599+0000 7fb8cffff640 1 -- 172.21.15.72:0/4229507987 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8d00a64a0 con 0x7fb8d815edc0 2024-05-09T05:53:46.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.599+0000 7fb8cffff640 1 -- 172.21.15.72:0/4229507987 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8d00a6870 con 0x7fb8d815edc0 2024-05-09T05:53:46.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.599+0000 7fb8df875640 1 -- 172.21.15.72:0/4229507987 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8d815edc0 msgr2=0x7fb8d815f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:46.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.599+0000 7fb8df875640 1 --2- 172.21.15.72:0/4229507987 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8d815edc0 0x7fb8d815f1d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb8d808f980 tx=0x7fb8d001c810 comp rx=0 tx=0).stop 2024-05-09T05:53:46.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.599+0000 7fb8df875640 1 -- 172.21.15.72:0/4229507987 shutdown_connections 2024-05-09T05:53:46.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.599+0000 7fb8df875640 1 --2- 172.21.15.72:0/4229507987 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8d815edc0 0x7fb8d815f1d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:46.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.599+0000 7fb8df875640 1 --2- 172.21.15.72:0/4229507987 >> v2:172.21.15.110:3300/0 conn(0x7fb8d815e470 0x7fb8d815e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:46.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.599+0000 7fb8df875640 1 -- 172.21.15.72:0/4229507987 >> 172.21.15.72:0/4229507987 conn(0x7fb8d80d1b70 msgr2=0x7fb8d80d1f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:46.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.599+0000 7fb8df875640 1 -- 172.21.15.72:0/4229507987 shutdown_connections 2024-05-09T05:53:46.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.599+0000 7fb8df875640 1 -- 172.21.15.72:0/4229507987 wait complete. 2024-05-09T05:53:46.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.599+0000 7fb8df875640 1 Processor -- start 2024-05-09T05:53:46.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.599+0000 7fb8df875640 1 -- start start 2024-05-09T05:53:46.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.603+0000 7fb8df875640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8d8156b50 0x7fb8d80ca840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:46.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.603+0000 7fb8df875640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8d815e470 0x7fb8d814ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:46.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.603+0000 7fb8df875640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8d815edc0 0x7fb8d814d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:46.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.603+0000 7fb8df875640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d815c9b0 con 0x7fb8d815e470 2024-05-09T05:53:46.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.603+0000 7fb8df875640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d8074cf0 con 0x7fb8d815edc0 2024-05-09T05:53:46.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.603+0000 7fb8df875640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fb8d815cb30 con 0x7fb8d8156b50 2024-05-09T05:53:46.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.603+0000 7fb8dce10640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8d815e470 0x7fb8d814ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:46.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.603+0000 7fb8dce10640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8d815e470 0x7fb8d814ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46338/0 (socket says 172.21.15.72:46338) 2024-05-09T05:53:46.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.603+0000 7fb8dce10640 1 -- 172.21.15.72:0/4148815714 learned_addr learned my addr 172.21.15.72:0/4148815714 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:46.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.603+0000 7fb8dde12640 1 --2- 172.21.15.72:0/4148815714 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8d815edc0 0x7fb8d814d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:46.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.603+0000 7fb8dd611640 1 --2- 172.21.15.72:0/4148815714 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8d8156b50 0x7fb8d80ca840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:46.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.603+0000 7fb8dce10640 1 -- 172.21.15.72:0/4148815714 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8d8156b50 msgr2=0x7fb8d80ca840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:46.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.603+0000 7fb8dce10640 1 --2- 172.21.15.72:0/4148815714 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8d8156b50 0x7fb8d80ca840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:46.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.603+0000 7fb8dce10640 1 -- 172.21.15.72:0/4148815714 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8d815edc0 msgr2=0x7fb8d814d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:46.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.603+0000 7fb8dce10640 1 --2- 172.21.15.72:0/4148815714 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8d815edc0 0x7fb8d814d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:46.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.603+0000 7fb8dce10640 1 -- 172.21.15.72:0/4148815714 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8d80cad80 con 0x7fb8d815e470 2024-05-09T05:53:46.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.603+0000 7fb8dde12640 1 --2- 172.21.15.72:0/4148815714 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8d815edc0 0x7fb8d814d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:53:46.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.603+0000 7fb8dce10640 1 --2- 172.21.15.72:0/4148815714 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8d815e470 0x7fb8d814ced0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb8c800c7f0 tx=0x7fb8c800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:46.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.603+0000 7fb8cdffb640 1 -- 172.21.15.72:0/4148815714 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c8015070 con 0x7fb8d815e470 2024-05-09T05:53:46.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.603+0000 7fb8cdffb640 1 -- 172.21.15.72:0/4148815714 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8c80077c0 con 0x7fb8d815e470 2024-05-09T05:53:46.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.603+0000 7fb8df875640 1 -- 172.21.15.72:0/4148815714 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8d80c9610 con 0x7fb8d815e470 2024-05-09T05:53:46.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.603+0000 7fb8cdffb640 1 -- 172.21.15.72:0/4148815714 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c8007bb0 con 0x7fb8d815e470 2024-05-09T05:53:46.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.603+0000 7fb8df875640 1 -- 172.21.15.72:0/4148815714 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8d81f6510 con 0x7fb8d815e470 2024-05-09T05:53:46.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.603+0000 7fb8df875640 1 -- 172.21.15.72:0/4148815714 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8d81f6280 con 0x7fb8d815e470 2024-05-09T05:53:46.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.603+0000 7fb8cdffb640 1 -- 172.21.15.72:0/4148815714 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fb8c8018070 con 0x7fb8d815e470 2024-05-09T05:53:46.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.603+0000 7fb8cdffb640 1 --2- 172.21.15.72:0/4148815714 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fb8bc06f430 0x7fb8bc071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:46.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.603+0000 7fb8cdffb640 1 -- 172.21.15.72:0/4148815714 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb8c808f500 con 0x7fb8d815e470 2024-05-09T05:53:46.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.603+0000 7fb8dd611640 1 --2- 172.21.15.72:0/4148815714 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fb8bc06f430 0x7fb8bc071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:46.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.607+0000 7fb8dd611640 1 --2- 172.21.15.72:0/4148815714 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fb8bc06f430 0x7fb8bc071940 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb8d400a750 tx=0x7fb8d4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:46.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.607+0000 7fb8cdffb640 1 -- 172.21.15.72:0/4148815714 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fb8c805c0b0 con 0x7fb8d815e470 2024-05-09T05:53:46.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:46.807+0000 7fb8df875640 1 -- 172.21.15.72:0/4148815714 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fb8d806a520 con 0x7fb8d815e470 2024-05-09T05:53:47.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.575+0000 7fb8cdffb640 1 -- 172.21.15.72:0/4148815714 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) ==== 118+0+0 (secure 0 0 0) 0x7fb8c805b9b0 con 0x7fb8d815e470 2024-05-09T05:53:47.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.579+0000 7fb8df875640 1 -- 172.21.15.72:0/4148815714 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fb8bc06f430 msgr2=0x7fb8bc071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:47.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.579+0000 7fb8df875640 1 --2- 172.21.15.72:0/4148815714 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fb8bc06f430 0x7fb8bc071940 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb8d400a750 tx=0x7fb8d4008040 comp rx=0 tx=0).stop 2024-05-09T05:53:47.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.579+0000 7fb8df875640 1 -- 172.21.15.72:0/4148815714 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8d815e470 msgr2=0x7fb8d814ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:47.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.579+0000 7fb8df875640 1 --2- 172.21.15.72:0/4148815714 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8d815e470 0x7fb8d814ced0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb8c800c7f0 tx=0x7fb8c800ccb0 comp rx=0 tx=0).stop 2024-05-09T05:53:47.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.579+0000 7fb8df875640 1 -- 172.21.15.72:0/4148815714 shutdown_connections 2024-05-09T05:53:47.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.579+0000 7fb8df875640 1 --2- 172.21.15.72:0/4148815714 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fb8bc06f430 0x7fb8bc071940 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:47.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.579+0000 7fb8df875640 1 --2- 172.21.15.72:0/4148815714 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8d815edc0 0x7fb8d814d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:47.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.579+0000 7fb8df875640 1 --2- 172.21.15.72:0/4148815714 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8d815e470 0x7fb8d814ced0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:47.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.579+0000 7fb8df875640 1 --2- 172.21.15.72:0/4148815714 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8d8156b50 0x7fb8d80ca840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:47.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.579+0000 7fb8df875640 1 -- 172.21.15.72:0/4148815714 >> 172.21.15.72:0/4148815714 conn(0x7fb8d80d1b70 msgr2=0x7fb8d80b64a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:47.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.579+0000 7fb8df875640 1 -- 172.21.15.72:0/4148815714 shutdown_connections 2024-05-09T05:53:47.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.579+0000 7fb8df875640 1 -- 172.21.15.72:0/4148815714 wait complete. 2024-05-09T05:53:47.592 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300} 2024-05-09T05:53:47.592 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2024-05-09T05:53:47.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.759+0000 7f16530b1640 1 Processor -- start 2024-05-09T05:53:47.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.759+0000 7f16530b1640 1 -- start start 2024-05-09T05:53:47.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.759+0000 7f16530b1640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f164c073ad0 0x7f164c073ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:47.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.759+0000 7f16530b1640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f164c074660 con 0x7f164c0c9150 2024-05-09T05:53:47.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.759+0000 7f16530b1640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f164c15c8c0 con 0x7f164c1567f0 2024-05-09T05:53:47.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.759+0000 7f16530b1640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f164c074420 con 0x7f164c073ad0 2024-05-09T05:53:47.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.759+0000 7f165164e640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f164c0c9150 0x7f164c166f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:45706/0 (socket says 172.21.15.72:45706) 2024-05-09T05:53:47.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.759+0000 7f165164e640 1 -- 172.21.15.72:0/1963912836 learned_addr learned my addr 172.21.15.72:0/1963912836 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:53:47.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.759+0000 7f164b7fe640 1 -- 172.21.15.72:0/1963912836 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3858174690 0 0) 0x7f164c074660 con 0x7f164c0c9150 2024-05-09T05:53:47.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.759+0000 7f164bfff640 1 --2- 172.21.15.72:0/1963912836 >> v2:172.21.15.110:3300/0 conn(0x7f164c073ad0 0x7f164c073ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:47.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.759+0000 7f164b7fe640 1 -- 172.21.15.72:0/1963912836 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1634003530 con 0x7f164c0c9150 2024-05-09T05:53:47.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.759+0000 7f164b7fe640 1 -- 172.21.15.72:0/1963912836 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2458953844 0 0) 0x7f1634003530 con 0x7f164c0c9150 2024-05-09T05:53:47.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.759+0000 7f164b7fe640 1 -- 172.21.15.72:0/1963912836 >> v2:172.21.15.110:3300/0 conn(0x7f164c073ad0 msgr2=0x7f164c073ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:47.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.759+0000 7f164b7fe640 1 --2- 172.21.15.72:0/1963912836 >> v2:172.21.15.110:3300/0 conn(0x7f164c073ad0 0x7f164c073ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:47.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.759+0000 7f164b7fe640 1 -- 172.21.15.72:0/1963912836 >> v1:172.21.15.110:6789/0 conn(0x7f164c1567f0 legacy=0x7f164c06c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:47.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.759+0000 7f164b7fe640 1 -- 172.21.15.72:0/1963912836 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f164c15cba0 con 0x7f164c0c9150 2024-05-09T05:53:47.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.759+0000 7f164b7fe640 1 -- 172.21.15.72:0/1963912836 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2749052815 0 0) 0x7f163c001700 con 0x7f164c0c9150 2024-05-09T05:53:47.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.759+0000 7f164b7fe640 1 -- 172.21.15.72:0/1963912836 >> v1:172.21.15.72:6789/0 conn(0x7f164c0c9150 legacy=0x7f164c166f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:47.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.759+0000 7f164b7fe640 1 --2- 172.21.15.72:0/1963912836 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1634003a90 0x7f1634003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:47.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.759+0000 7f164b7fe640 1 --2- 172.21.15.72:0/1963912836 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1634004810 0x7f1634004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:47.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.759+0000 7f164b7fe640 1 --2- 172.21.15.72:0/1963912836 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1634005360 0x7f163400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:47.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.759+0000 7f164b7fe640 1 -- 172.21.15.72:0/1963912836 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f164c074420 con 0x7f1634004810 2024-05-09T05:53:47.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.759+0000 7f164b7fe640 1 -- 172.21.15.72:0/1963912836 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f163400c240 con 0x7f1634005360 2024-05-09T05:53:47.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.759+0000 7f164b7fe640 1 -- 172.21.15.72:0/1963912836 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f163400c440 con 0x7f1634003a90 2024-05-09T05:53:47.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.759+0000 7f164bfff640 1 --2- 172.21.15.72:0/1963912836 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1634004810 0x7f1634004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:47.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.759+0000 7f1650e4d640 1 --2- 172.21.15.72:0/1963912836 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1634003a90 0x7f1634003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:47.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.763+0000 7f164bfff640 1 -- 172.21.15.72:0/1963912836 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1634003a90 msgr2=0x7f1634003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:47.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.763+0000 7f164bfff640 1 --2- 172.21.15.72:0/1963912836 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1634003a90 0x7f1634003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:47.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.763+0000 7f164bfff640 1 -- 172.21.15.72:0/1963912836 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1634005360 msgr2=0x7f163400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:47.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.763+0000 7f165164e640 1 --2- 172.21.15.72:0/1963912836 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1634005360 0x7f163400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:47.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.763+0000 7f164bfff640 1 --2- 172.21.15.72:0/1963912836 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1634005360 0x7f163400b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:47.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.763+0000 7f165164e640 1 -- 172.21.15.72:0/1963912836 reap_dead start 2024-05-09T05:53:47.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.763+0000 7f164bfff640 1 -- 172.21.15.72:0/1963912836 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1634003530 con 0x7f1634004810 2024-05-09T05:53:47.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.763+0000 7f164bfff640 1 --2- 172.21.15.72:0/1963912836 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1634004810 0x7f1634004c20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1640009ab0 tx=0x7f164001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45e4802fa1a6aa85 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:47.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.763+0000 7f164b7fe640 1 -- 172.21.15.72:0/1963912836 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16400b2070 con 0x7f1634004810 2024-05-09T05:53:47.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.763+0000 7f164b7fe640 1 -- 172.21.15.72:0/1963912836 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16400a5640 con 0x7f1634004810 2024-05-09T05:53:47.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.763+0000 7f164b7fe640 1 -- 172.21.15.72:0/1963912836 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16400096b0 con 0x7f1634004810 2024-05-09T05:53:47.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.763+0000 7f16530b1640 1 -- 172.21.15.72:0/1963912836 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1634004810 msgr2=0x7f1634004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:47.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.763+0000 7f16530b1640 1 --2- 172.21.15.72:0/1963912836 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1634004810 0x7f1634004c20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1640009ab0 tx=0x7f164001ca50 comp rx=0 tx=0).stop 2024-05-09T05:53:47.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.763+0000 7f16530b1640 1 -- 172.21.15.72:0/1963912836 shutdown_connections 2024-05-09T05:53:47.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.763+0000 7f16530b1640 1 --2- 172.21.15.72:0/1963912836 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1634004810 0x7f1634004c20 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:47.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.763+0000 7f16530b1640 1 -- 172.21.15.72:0/1963912836 >> 172.21.15.72:0/1963912836 conn(0x7f164c071620 msgr2=0x7f164c0ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:47.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.763+0000 7f16530b1640 1 -- 172.21.15.72:0/1963912836 shutdown_connections 2024-05-09T05:53:47.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.763+0000 7f16530b1640 1 -- 172.21.15.72:0/1963912836 wait complete. 2024-05-09T05:53:47.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.767+0000 7f16530b1640 1 Processor -- start 2024-05-09T05:53:47.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.767+0000 7f16530b1640 1 -- start start 2024-05-09T05:53:47.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.767+0000 7f16530b1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1634004810 0x7f164c0cc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:47.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.767+0000 7f16530b1640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f164c0c7b30 0x7f164c1508f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:47.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.767+0000 7f16530b1640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f164c1595f0 0x7f164c159a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:47.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.767+0000 7f16530b1640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f164c15c5b0 con 0x7f164c1595f0 2024-05-09T05:53:47.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.767+0000 7f16530b1640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f164c15d160 con 0x7f1634004810 2024-05-09T05:53:47.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.767+0000 7f16530b1640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f164c156c00 con 0x7f164c0c7b30 2024-05-09T05:53:47.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.767+0000 7f165164e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f164c1595f0 0x7f164c159a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:47.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.767+0000 7f165164e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f164c1595f0 0x7f164c159a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46358/0 (socket says 172.21.15.72:46358) 2024-05-09T05:53:47.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.767+0000 7f165164e640 1 -- 172.21.15.72:0/2056033351 learned_addr learned my addr 172.21.15.72:0/2056033351 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:47.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.767+0000 7f1650e4d640 1 --2- 172.21.15.72:0/2056033351 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1634004810 0x7f164c0cc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:47.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.767+0000 7f164bfff640 1 --2- 172.21.15.72:0/2056033351 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f164c0c7b30 0x7f164c1508f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:47.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.767+0000 7f165164e640 1 -- 172.21.15.72:0/2056033351 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f164c0c7b30 msgr2=0x7f164c1508f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:47.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.767+0000 7f165164e640 1 --2- 172.21.15.72:0/2056033351 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f164c0c7b30 0x7f164c1508f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:47.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.767+0000 7f165164e640 1 -- 172.21.15.72:0/2056033351 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1634004810 msgr2=0x7f164c0cc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:47.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.767+0000 7f165164e640 1 --2- 172.21.15.72:0/2056033351 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1634004810 0x7f164c0cc5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:47.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.767+0000 7f165164e640 1 -- 172.21.15.72:0/2056033351 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f164c15c3e0 con 0x7f164c1595f0 2024-05-09T05:53:47.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.767+0000 7f165164e640 1 --2- 172.21.15.72:0/2056033351 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f164c1595f0 0x7f164c159a00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f163c004880 tx=0x7f163c010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:47.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.767+0000 7f16497fa640 1 -- 172.21.15.72:0/2056033351 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f163c01a070 con 0x7f164c1595f0 2024-05-09T05:53:47.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.767+0000 7f16497fa640 1 -- 172.21.15.72:0/2056033351 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f163c011040 con 0x7f164c1595f0 2024-05-09T05:53:47.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.767+0000 7f16530b1640 1 -- 172.21.15.72:0/2056033351 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f164c154fe0 con 0x7f164c1595f0 2024-05-09T05:53:47.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.767+0000 7f16497fa640 1 -- 172.21.15.72:0/2056033351 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f163c00ed00 con 0x7f164c1595f0 2024-05-09T05:53:47.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.771+0000 7f16530b1640 1 -- 172.21.15.72:0/2056033351 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f164c1f2ed0 con 0x7f164c1595f0 2024-05-09T05:53:47.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.771+0000 7f16530b1640 1 -- 172.21.15.72:0/2056033351 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f164c1f39b0 con 0x7f164c1595f0 2024-05-09T05:53:47.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.771+0000 7f16497fa640 1 -- 172.21.15.72:0/2056033351 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f163c01d070 con 0x7f164c1595f0 2024-05-09T05:53:47.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.771+0000 7f16497fa640 1 --2- 172.21.15.72:0/2056033351 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f163806f430 0x7f1638071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:47.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.771+0000 7f16497fa640 1 -- 172.21.15.72:0/2056033351 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f163c091cb0 con 0x7f164c1595f0 2024-05-09T05:53:47.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.771+0000 7f1650e4d640 1 --2- 172.21.15.72:0/2056033351 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f163806f430 0x7f1638071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:47.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.771+0000 7f1650e4d640 1 --2- 172.21.15.72:0/2056033351 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f163806f430 0x7f1638071940 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1644000f90 tx=0x7f1644009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:47.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.775+0000 7f16497fa640 1 -- 172.21.15.72:0/2056033351 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f163c05e980 con 0x7f164c1595f0 2024-05-09T05:53:47.950 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:47.959+0000 7f16530b1640 1 -- 172.21.15.72:0/2056033351 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7f164c06a520 con 0x7f164c1595f0 2024-05-09T05:53:48.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.583+0000 7f16497fa640 1 -- 172.21.15.72:0/2056033351 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v9) ==== 105+0+0 (secure 0 0 0) 0x7f163c05e280 con 0x7f164c1595f0 2024-05-09T05:53:48.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.587+0000 7f16530b1640 1 -- 172.21.15.72:0/2056033351 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f163806f430 msgr2=0x7f1638071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:48.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.587+0000 7f16530b1640 1 --2- 172.21.15.72:0/2056033351 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f163806f430 0x7f1638071940 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1644000f90 tx=0x7f1644009040 comp rx=0 tx=0).stop 2024-05-09T05:53:48.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.587+0000 7f16530b1640 1 -- 172.21.15.72:0/2056033351 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f164c1595f0 msgr2=0x7f164c159a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:48.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.587+0000 7f16530b1640 1 --2- 172.21.15.72:0/2056033351 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f164c1595f0 0x7f164c159a00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f163c004880 tx=0x7f163c010d70 comp rx=0 tx=0).stop 2024-05-09T05:53:48.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.587+0000 7f16530b1640 1 -- 172.21.15.72:0/2056033351 shutdown_connections 2024-05-09T05:53:48.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.587+0000 7f16530b1640 1 --2- 172.21.15.72:0/2056033351 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f163806f430 0x7f1638071940 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:48.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.587+0000 7f16530b1640 1 --2- 172.21.15.72:0/2056033351 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f164c1595f0 0x7f164c159a00 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:48.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.587+0000 7f16530b1640 1 --2- 172.21.15.72:0/2056033351 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f164c0c7b30 0x7f164c1508f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:48.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.587+0000 7f16530b1640 1 --2- 172.21.15.72:0/2056033351 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1634004810 0x7f164c0cc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:48.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.587+0000 7f16530b1640 1 -- 172.21.15.72:0/2056033351 >> 172.21.15.72:0/2056033351 conn(0x7f164c071620 msgr2=0x7f164c0cba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:48.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.587+0000 7f16530b1640 1 -- 172.21.15.72:0/2056033351 shutdown_connections 2024-05-09T05:53:48.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.587+0000 7f16530b1640 1 -- 172.21.15.72:0/2056033351 wait complete. 2024-05-09T05:53:48.603 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-09T05:53:48.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.767+0000 7f146b536640 1 Processor -- start 2024-05-09T05:53:48.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.767+0000 7f146b536640 1 -- start start 2024-05-09T05:53:48.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.767+0000 7f146b536640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f146415e470 0x7f146415e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:48.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.767+0000 7f146b536640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f146415edc0 0x7f146415f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:48.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.767+0000 7f146b536640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14640cda30 con 0x7f1464156b50 2024-05-09T05:53:48.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.767+0000 7f146b536640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f14640cc020 con 0x7f146415e470 2024-05-09T05:53:48.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.767+0000 7f146b536640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f146415dfe0 con 0x7f146415edc0 2024-05-09T05:53:48.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.767+0000 7f1468ad1640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f146415e470 0x7f146415e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:48.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.767+0000 7f14692d2640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f1464156b50 0x7f1464073ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:45718/0 (socket says 172.21.15.72:45718) 2024-05-09T05:53:48.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.767+0000 7f1468ad1640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f146415e470 0x7f146415e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46364/0 (socket says 172.21.15.72:46364) 2024-05-09T05:53:48.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.767+0000 7f14692d2640 1 -- 172.21.15.72:0/3008833371 learned_addr learned my addr 172.21.15.72:0/3008833371 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:53:48.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.767+0000 7f1469ad3640 1 --2- 172.21.15.72:0/3008833371 >> v2:172.21.15.110:3300/0 conn(0x7f146415edc0 0x7f146415f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:48.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.767+0000 7f1468ad1640 1 -- 172.21.15.72:0/3008833371 >> v2:172.21.15.110:3300/0 conn(0x7f146415edc0 msgr2=0x7f146415f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:48.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.767+0000 7f1468ad1640 1 --2- 172.21.15.72:0/3008833371 >> v2:172.21.15.110:3300/0 conn(0x7f146415edc0 0x7f146415f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:48.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.767+0000 7f1468ad1640 1 -- 172.21.15.72:0/3008833371 >> v1:172.21.15.72:6789/0 conn(0x7f1464156b50 legacy=0x7f1464073ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:48.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.767+0000 7f1468ad1640 1 -- 172.21.15.72:0/3008833371 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f146415cdd0 con 0x7f146415e470 2024-05-09T05:53:48.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.767+0000 7f145bfff640 1 -- 172.21.15.72:0/3008833371 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4127101875 0 0) 0x7f1460001120 con 0x7f1464156b50 2024-05-09T05:53:48.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.767+0000 7f1469ad3640 1 --2- 172.21.15.72:0/3008833371 >> v2:172.21.15.110:3300/0 conn(0x7f146415edc0 0x7f146415f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:53:48.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.771+0000 7f1468ad1640 1 --2- 172.21.15.72:0/3008833371 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f146415e470 0x7f146415e880 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f146408f4a0 tx=0x7f145401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d935af2f422d6186 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:48.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.771+0000 7f145bfff640 1 -- 172.21.15.72:0/3008833371 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14540b0070 con 0x7f146415e470 2024-05-09T05:53:48.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.771+0000 7f145bfff640 1 -- 172.21.15.72:0/3008833371 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14540ab600 con 0x7f146415e470 2024-05-09T05:53:48.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.771+0000 7f145bfff640 1 -- 172.21.15.72:0/3008833371 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14540ab9d0 con 0x7f146415e470 2024-05-09T05:53:48.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.771+0000 7f146b536640 1 -- 172.21.15.72:0/3008833371 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f146415e470 msgr2=0x7f146415e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:48.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.771+0000 7f146b536640 1 --2- 172.21.15.72:0/3008833371 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f146415e470 0x7f146415e880 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f146408f4a0 tx=0x7f145401c480 comp rx=0 tx=0).stop 2024-05-09T05:53:48.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.771+0000 7f146b536640 1 -- 172.21.15.72:0/3008833371 shutdown_connections 2024-05-09T05:53:48.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.771+0000 7f146b536640 1 --2- 172.21.15.72:0/3008833371 >> v2:172.21.15.110:3300/0 conn(0x7f146415edc0 0x7f146415f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:48.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.771+0000 7f146b536640 1 --2- 172.21.15.72:0/3008833371 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f146415e470 0x7f146415e880 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:48.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.771+0000 7f146b536640 1 -- 172.21.15.72:0/3008833371 >> 172.21.15.72:0/3008833371 conn(0x7f14640d1b70 msgr2=0x7f14640d1f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:48.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.771+0000 7f146b536640 1 -- 172.21.15.72:0/3008833371 shutdown_connections 2024-05-09T05:53:48.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.771+0000 7f146b536640 1 -- 172.21.15.72:0/3008833371 wait complete. 2024-05-09T05:53:48.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.775+0000 7f146b536640 1 Processor -- start 2024-05-09T05:53:48.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.775+0000 7f146b536640 1 -- start start 2024-05-09T05:53:48.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.775+0000 7f146b536640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1464156b50 0x7f1464153d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:48.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.775+0000 7f146b536640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f146415e470 0x7f1464149c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:48.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.775+0000 7f146b536640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f146415edc0 0x7f146414a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:48.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.775+0000 7f146b536640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f146415c9b0 con 0x7f146415e470 2024-05-09T05:53:48.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.775+0000 7f146b536640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f1464074cf0 con 0x7f146415edc0 2024-05-09T05:53:48.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.775+0000 7f146b536640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f146415cb30 con 0x7f1464156b50 2024-05-09T05:53:48.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.775+0000 7f1468ad1640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f146415e470 0x7f1464149c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:48.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.775+0000 7f1468ad1640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f146415e470 0x7f1464149c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46378/0 (socket says 172.21.15.72:46378) 2024-05-09T05:53:48.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.775+0000 7f1468ad1640 1 -- 172.21.15.72:0/937131141 learned_addr learned my addr 172.21.15.72:0/937131141 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:48.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.775+0000 7f1468ad1640 1 -- 172.21.15.72:0/937131141 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1464156b50 msgr2=0x7f1464153d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:48.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.775+0000 7f1468ad1640 1 --2- 172.21.15.72:0/937131141 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1464156b50 0x7f1464153d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:48.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.775+0000 7f1468ad1640 1 -- 172.21.15.72:0/937131141 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f146415edc0 msgr2=0x7f146414a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:48.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.775+0000 7f1468ad1640 1 --2- 172.21.15.72:0/937131141 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f146415edc0 0x7f146414a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:48.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.775+0000 7f1468ad1640 1 -- 172.21.15.72:0/937131141 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f146414fd60 con 0x7f146415e470 2024-05-09T05:53:48.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.775+0000 7f1468ad1640 1 --2- 172.21.15.72:0/937131141 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f146415e470 0x7f1464149c90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f14540ae040 tx=0x7f145401acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:48.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.775+0000 7f1459ffb640 1 -- 172.21.15.72:0/937131141 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14540bd070 con 0x7f146415e470 2024-05-09T05:53:48.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.775+0000 7f1459ffb640 1 -- 172.21.15.72:0/937131141 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1454004030 con 0x7f146415e470 2024-05-09T05:53:48.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.775+0000 7f1459ffb640 1 -- 172.21.15.72:0/937131141 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14540b0040 con 0x7f146415e470 2024-05-09T05:53:48.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.775+0000 7f146b536640 1 -- 172.21.15.72:0/937131141 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14641f6060 con 0x7f146415e470 2024-05-09T05:53:48.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.775+0000 7f146b536640 1 -- 172.21.15.72:0/937131141 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14641f5d30 con 0x7f146415e470 2024-05-09T05:53:48.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.779+0000 7f146b536640 1 -- 172.21.15.72:0/937131141 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f146406a520 con 0x7f146415e470 2024-05-09T05:53:48.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.779+0000 7f1459ffb640 1 -- 172.21.15.72:0/937131141 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f14540c0070 con 0x7f146415e470 2024-05-09T05:53:48.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.779+0000 7f1459ffb640 1 --2- 172.21.15.72:0/937131141 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f144806f430 0x7f1448071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:48.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.779+0000 7f1459ffb640 1 -- 172.21.15.72:0/937131141 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f14541293e0 con 0x7f146415e470 2024-05-09T05:53:48.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.779+0000 7f14692d2640 1 --2- 172.21.15.72:0/937131141 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f144806f430 0x7f1448071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:48.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.779+0000 7f14692d2640 1 --2- 172.21.15.72:0/937131141 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f144806f430 0x7f1448071940 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1460001550 tx=0x7f1460007970 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:48.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.783+0000 7f1459ffb640 1 -- 172.21.15.72:0/937131141 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f1454016070 con 0x7f146415e470 2024-05-09T05:53:48.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:48.975+0000 7f146b536640 1 -- 172.21.15.72:0/937131141 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f14640cdcb0 con 0x7f146415e470 2024-05-09T05:53:49.585 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.595+0000 7f1459ffb640 1 -- 172.21.15.72:0/937131141 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v11) ==== 122+0+0 (secure 0 0 0) 0x7f14540f5f90 con 0x7f146415e470 2024-05-09T05:53:49.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.599+0000 7f146b536640 1 -- 172.21.15.72:0/937131141 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f144806f430 msgr2=0x7f1448071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:49.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.599+0000 7f146b536640 1 --2- 172.21.15.72:0/937131141 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f144806f430 0x7f1448071940 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1460001550 tx=0x7f1460007970 comp rx=0 tx=0).stop 2024-05-09T05:53:49.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.599+0000 7f146b536640 1 -- 172.21.15.72:0/937131141 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f146415e470 msgr2=0x7f1464149c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:49.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.599+0000 7f146b536640 1 --2- 172.21.15.72:0/937131141 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f146415e470 0x7f1464149c90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f14540ae040 tx=0x7f145401acc0 comp rx=0 tx=0).stop 2024-05-09T05:53:49.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.599+0000 7f146b536640 1 -- 172.21.15.72:0/937131141 shutdown_connections 2024-05-09T05:53:49.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.599+0000 7f146b536640 1 --2- 172.21.15.72:0/937131141 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f144806f430 0x7f1448071940 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:49.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.599+0000 7f146b536640 1 --2- 172.21.15.72:0/937131141 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f146415edc0 0x7f146414a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:49.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.599+0000 7f146b536640 1 --2- 172.21.15.72:0/937131141 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f146415e470 0x7f1464149c90 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:49.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.599+0000 7f146b536640 1 --2- 172.21.15.72:0/937131141 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1464156b50 0x7f1464153d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:49.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.599+0000 7f146b536640 1 -- 172.21.15.72:0/937131141 >> 172.21.15.72:0/937131141 conn(0x7f14640d1b70 msgr2=0x7f14640cf950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:49.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.599+0000 7f146b536640 1 -- 172.21.15.72:0/937131141 shutdown_connections 2024-05-09T05:53:49.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.599+0000 7f146b536640 1 -- 172.21.15.72:0/937131141 wait complete. 2024-05-09T05:53:49.617 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-05-09T05:53:49.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.787+0000 7f773a0f2640 1 Processor -- start 2024-05-09T05:53:49.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.787+0000 7f773a0f2640 1 -- start start 2024-05-09T05:53:49.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.787+0000 7f773a0f2640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77340c9c00 0x7f7734160620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:49.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.787+0000 7f773a0f2640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f773406fc00 0x7f7734070010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:49.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.787+0000 7f773a0f2640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f77340c8ee0 0x7f77340c92f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:49.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.787+0000 7f773a0f2640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f77340c81b0 con 0x7f77340c8ee0 2024-05-09T05:53:49.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.787+0000 7f773a0f2640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f7734072520 con 0x7f773406fc00 2024-05-09T05:53:49.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.787+0000 7f773a0f2640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f7734072800 con 0x7f77340c9c00 2024-05-09T05:53:49.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.787+0000 7f7733fff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f77340c8ee0 0x7f77340c92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:49.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.787+0000 7f7733fff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f77340c8ee0 0x7f77340c92f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46382/0 (socket says 172.21.15.72:46382) 2024-05-09T05:53:49.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.787+0000 7f7733fff640 1 -- 172.21.15.72:0/918500786 learned_addr learned my addr 172.21.15.72:0/918500786 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:49.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.787+0000 7f772bfff640 1 --2- 172.21.15.72:0/918500786 >> v2:172.21.15.110:3300/0 conn(0x7f773406fc00 0x7f7734070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:49.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.787+0000 7f77337fe640 1 --2- 172.21.15.72:0/918500786 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77340c9c00 0x7f7734160620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:49.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.787+0000 7f7733fff640 1 -- 172.21.15.72:0/918500786 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77340c9c00 msgr2=0x7f7734160620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:49.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.787+0000 7f7733fff640 1 --2- 172.21.15.72:0/918500786 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77340c9c00 0x7f7734160620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:49.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.787+0000 7f7733fff640 1 -- 172.21.15.72:0/918500786 >> v2:172.21.15.110:3300/0 conn(0x7f773406fc00 msgr2=0x7f7734070010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:49.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.787+0000 7f7733fff640 1 --2- 172.21.15.72:0/918500786 >> v2:172.21.15.110:3300/0 conn(0x7f773406fc00 0x7f7734070010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:49.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.787+0000 7f7733fff640 1 -- 172.21.15.72:0/918500786 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77340c8400 con 0x7f77340c8ee0 2024-05-09T05:53:49.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.787+0000 7f772bfff640 1 --2- 172.21.15.72:0/918500786 >> v2:172.21.15.110:3300/0 conn(0x7f773406fc00 0x7f7734070010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:53:49.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.791+0000 7f7733fff640 1 --2- 172.21.15.72:0/918500786 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f77340c8ee0 0x7f77340c92f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f77340ce780 tx=0x7f772c01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eab2fbf36eae31c4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:49.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.791+0000 7f7732ffd640 1 -- 172.21.15.72:0/918500786 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f772c0a5670 con 0x7f77340c8ee0 2024-05-09T05:53:49.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.791+0000 7f7732ffd640 1 -- 172.21.15.72:0/918500786 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f772c0a5810 con 0x7f77340c8ee0 2024-05-09T05:53:49.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.791+0000 7f7732ffd640 1 -- 172.21.15.72:0/918500786 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f772c0a5be0 con 0x7f77340c8ee0 2024-05-09T05:53:49.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.791+0000 7f773a0f2640 1 -- 172.21.15.72:0/918500786 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f77340c8ee0 msgr2=0x7f77340c92f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:49.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.791+0000 7f773a0f2640 1 --2- 172.21.15.72:0/918500786 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f77340c8ee0 0x7f77340c92f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f77340ce780 tx=0x7f772c01c9f0 comp rx=0 tx=0).stop 2024-05-09T05:53:49.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.791+0000 7f773a0f2640 1 -- 172.21.15.72:0/918500786 shutdown_connections 2024-05-09T05:53:49.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.791+0000 7f773a0f2640 1 --2- 172.21.15.72:0/918500786 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f77340c8ee0 0x7f77340c92f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:49.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.791+0000 7f773a0f2640 1 --2- 172.21.15.72:0/918500786 >> v2:172.21.15.110:3300/0 conn(0x7f773406fc00 0x7f7734070010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:49.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.791+0000 7f773a0f2640 1 --2- 172.21.15.72:0/918500786 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77340c9c00 0x7f7734160620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:49.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.791+0000 7f773a0f2640 1 -- 172.21.15.72:0/918500786 >> 172.21.15.72:0/918500786 conn(0x7f77340cde90 msgr2=0x7f77340ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:49.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.791+0000 7f773a0f2640 1 -- 172.21.15.72:0/918500786 shutdown_connections 2024-05-09T05:53:49.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.791+0000 7f773a0f2640 1 -- 172.21.15.72:0/918500786 wait complete. 2024-05-09T05:53:49.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.795+0000 7f773a0f2640 1 Processor -- start 2024-05-09T05:53:49.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.795+0000 7f773a0f2640 1 -- start start 2024-05-09T05:53:49.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.795+0000 7f773a0f2640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f773406fc00 0x7f773415dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:49.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.795+0000 7f773a0f2640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77340c8ee0 0x7f7734143040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:49.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.795+0000 7f773a0f2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77340c9c00 0x7f7734143580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:49.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.795+0000 7f773a0f2640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f773415d020 con 0x7f773406fc00 2024-05-09T05:53:49.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.795+0000 7f773a0f2640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f773415cea0 con 0x7f77340c9c00 2024-05-09T05:53:49.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.795+0000 7f773a0f2640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f773415d1a0 con 0x7f77340c8ee0 2024-05-09T05:53:49.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.795+0000 7f77337fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f773406fc00 0x7f773415dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:49.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.795+0000 7f77337fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f773406fc00 0x7f773415dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46384/0 (socket says 172.21.15.72:46384) 2024-05-09T05:53:49.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.795+0000 7f77337fe640 1 -- 172.21.15.72:0/3883271775 learned_addr learned my addr 172.21.15.72:0/3883271775 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:49.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.795+0000 7f77337fe640 1 -- 172.21.15.72:0/3883271775 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77340c8ee0 msgr2=0x7f7734143040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:49.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.795+0000 7f77337fe640 1 --2- 172.21.15.72:0/3883271775 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77340c8ee0 0x7f7734143040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:49.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.795+0000 7f77337fe640 1 -- 172.21.15.72:0/3883271775 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77340c9c00 msgr2=0x7f7734143580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:49.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.795+0000 7f77337fe640 1 --2- 172.21.15.72:0/3883271775 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77340c9c00 0x7f7734143580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:49.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.795+0000 7f77337fe640 1 -- 172.21.15.72:0/3883271775 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f773415e4e0 con 0x7f773406fc00 2024-05-09T05:53:49.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.795+0000 7f77337fe640 1 --2- 172.21.15.72:0/3883271775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f773406fc00 0x7f773415dfa0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f772400d5f0 tx=0x7f772400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:49.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.795+0000 7f7730ff9640 1 -- 172.21.15.72:0/3883271775 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77240125f0 con 0x7f773406fc00 2024-05-09T05:53:49.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.795+0000 7f7730ff9640 1 -- 172.21.15.72:0/3883271775 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7724019070 con 0x7f773406fc00 2024-05-09T05:53:49.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.795+0000 7f773a0f2640 1 -- 172.21.15.72:0/3883271775 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7734075fa0 con 0x7f773406fc00 2024-05-09T05:53:49.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.795+0000 7f7730ff9640 1 -- 172.21.15.72:0/3883271775 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77240129b0 con 0x7f773406fc00 2024-05-09T05:53:49.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.795+0000 7f773a0f2640 1 -- 172.21.15.72:0/3883271775 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f773414c460 con 0x7f773406fc00 2024-05-09T05:53:49.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.795+0000 7f773a0f2640 1 -- 172.21.15.72:0/3883271775 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f773406a520 con 0x7f773406fc00 2024-05-09T05:53:49.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.799+0000 7f7730ff9640 1 -- 172.21.15.72:0/3883271775 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f7724012b50 con 0x7f773406fc00 2024-05-09T05:53:49.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.799+0000 7f7730ff9640 1 --2- 172.21.15.72:0/3883271775 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f771406f400 0x7f7714071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:49.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.799+0000 7f7730ff9640 1 -- 172.21.15.72:0/3883271775 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f772408f910 con 0x7f773406fc00 2024-05-09T05:53:49.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.799+0000 7f772bfff640 1 --2- 172.21.15.72:0/3883271775 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f771406f400 0x7f7714071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:49.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.799+0000 7f772bfff640 1 --2- 172.21.15.72:0/3883271775 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f771406f400 0x7f7714071910 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f773415ef70 tx=0x7f771c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:49.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.803+0000 7f7730ff9640 1 -- 172.21.15.72:0/3883271775 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f772405c5e0 con 0x7f773406fc00 2024-05-09T05:53:49.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:49.987+0000 7f773a0f2640 1 -- 172.21.15.72:0/3883271775 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f77340c99e0 con 0x7f773406fc00 2024-05-09T05:53:50.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.603+0000 7f7730ff9640 1 -- 172.21.15.72:0/3883271775 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v12) ==== 115+0+0 (secure 0 0 0) 0x7f772405bee0 con 0x7f773406fc00 2024-05-09T05:53:50.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.607+0000 7f773a0f2640 1 -- 172.21.15.72:0/3883271775 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f771406f400 msgr2=0x7f7714071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:50.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.607+0000 7f773a0f2640 1 --2- 172.21.15.72:0/3883271775 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f771406f400 0x7f7714071910 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f773415ef70 tx=0x7f771c008040 comp rx=0 tx=0).stop 2024-05-09T05:53:50.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.607+0000 7f773a0f2640 1 -- 172.21.15.72:0/3883271775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f773406fc00 msgr2=0x7f773415dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:50.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.607+0000 7f773a0f2640 1 --2- 172.21.15.72:0/3883271775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f773406fc00 0x7f773415dfa0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f772400d5f0 tx=0x7f772400dab0 comp rx=0 tx=0).stop 2024-05-09T05:53:50.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.607+0000 7f773a0f2640 1 -- 172.21.15.72:0/3883271775 shutdown_connections 2024-05-09T05:53:50.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.607+0000 7f773a0f2640 1 --2- 172.21.15.72:0/3883271775 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f771406f400 0x7f7714071910 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:50.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.607+0000 7f773a0f2640 1 --2- 172.21.15.72:0/3883271775 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77340c9c00 0x7f7734143580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:50.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.607+0000 7f773a0f2640 1 --2- 172.21.15.72:0/3883271775 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77340c8ee0 0x7f7734143040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:50.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.607+0000 7f773a0f2640 1 --2- 172.21.15.72:0/3883271775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f773406fc00 0x7f773415dfa0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:50.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.607+0000 7f773a0f2640 1 -- 172.21.15.72:0/3883271775 >> 172.21.15.72:0/3883271775 conn(0x7f77340cde90 msgr2=0x7f7734146ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:50.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.607+0000 7f773a0f2640 1 -- 172.21.15.72:0/3883271775 shutdown_connections 2024-05-09T05:53:50.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.607+0000 7f773a0f2640 1 -- 172.21.15.72:0/3883271775 wait complete. 2024-05-09T05:53:50.618 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-09T05:53:50.618 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:53:50.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.779+0000 7f4f150ad640 1 Processor -- start 2024-05-09T05:53:50.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.779+0000 7f4f150ad640 1 -- start start 2024-05-09T05:53:50.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.783+0000 7f4f150ad640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4f10159770 0x7f4f10152ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:50.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.783+0000 7f4f150ad640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4f100723a0 0x7f4f100727b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:50.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.783+0000 7f4f150ad640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f1006fc00 0x7f4f10070010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:50.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.783+0000 7f4f150ad640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f4f10153410 con 0x7f4f100723a0 2024-05-09T05:53:50.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.783+0000 7f4f150ad640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f4f1015c5b0 con 0x7f4f10159770 2024-05-09T05:53:50.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.783+0000 7f4f150ad640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f4f10159b80 con 0x7f4f1006fc00 2024-05-09T05:53:50.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.783+0000 7f4f0e59c640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4f100723a0 0x7f4f100727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:50.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.783+0000 7f4f0e59c640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4f100723a0 0x7f4f100727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46388/0 (socket says 172.21.15.72:46388) 2024-05-09T05:53:50.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.783+0000 7f4f0e59c640 1 -- 172.21.15.72:0/4176045418 learned_addr learned my addr 172.21.15.72:0/4176045418 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:50.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.783+0000 7f4f0ed9d640 1 --2- 172.21.15.72:0/4176045418 >> v2:172.21.15.110:3300/0 conn(0x7f4f10159770 0x7f4f10152ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:50.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.783+0000 7f4f0f59e640 1 --2- 172.21.15.72:0/4176045418 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f1006fc00 0x7f4f10070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:50.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.783+0000 7f4f0e59c640 1 -- 172.21.15.72:0/4176045418 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f1006fc00 msgr2=0x7f4f10070010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:50.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.783+0000 7f4f0e59c640 1 --2- 172.21.15.72:0/4176045418 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f1006fc00 0x7f4f10070010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:50.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.783+0000 7f4f0e59c640 1 -- 172.21.15.72:0/4176045418 >> v2:172.21.15.110:3300/0 conn(0x7f4f10159770 msgr2=0x7f4f10152ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:50.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.783+0000 7f4f0e59c640 1 --2- 172.21.15.72:0/4176045418 >> v2:172.21.15.110:3300/0 conn(0x7f4f10159770 0x7f4f10152ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:50.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.783+0000 7f4f0e59c640 1 -- 172.21.15.72:0/4176045418 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f10073270 con 0x7f4f100723a0 2024-05-09T05:53:50.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.783+0000 7f4f0e59c640 1 --2- 172.21.15.72:0/4176045418 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f100723a0 0x7f4f100727b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4f10071b70 tx=0x7f4f040211c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=641a09e642993d68 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:50.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.783+0000 7f4f0dd9b640 1 -- 172.21.15.72:0/4176045418 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f04004030 con 0x7f4f100723a0 2024-05-09T05:53:50.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.787+0000 7f4f0dd9b640 1 -- 172.21.15.72:0/4176045418 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f040041d0 con 0x7f4f100723a0 2024-05-09T05:53:50.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.787+0000 7f4f0dd9b640 1 -- 172.21.15.72:0/4176045418 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f04003620 con 0x7f4f100723a0 2024-05-09T05:53:50.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.787+0000 7f4f150ad640 1 -- 172.21.15.72:0/4176045418 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f100723a0 msgr2=0x7f4f100727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:50.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.787+0000 7f4f150ad640 1 --2- 172.21.15.72:0/4176045418 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f100723a0 0x7f4f100727b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4f10071b70 tx=0x7f4f040211c0 comp rx=0 tx=0).stop 2024-05-09T05:53:50.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.787+0000 7f4f150ad640 1 -- 172.21.15.72:0/4176045418 shutdown_connections 2024-05-09T05:53:50.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.787+0000 7f4f150ad640 1 --2- 172.21.15.72:0/4176045418 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f1006fc00 0x7f4f10070010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:50.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.787+0000 7f4f150ad640 1 --2- 172.21.15.72:0/4176045418 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f100723a0 0x7f4f100727b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:50.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.787+0000 7f4f150ad640 1 --2- 172.21.15.72:0/4176045418 >> v2:172.21.15.110:3300/0 conn(0x7f4f10159770 0x7f4f10152ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:50.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.787+0000 7f4f150ad640 1 -- 172.21.15.72:0/4176045418 >> 172.21.15.72:0/4176045418 conn(0x7f4f100cde90 msgr2=0x7f4f100ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:50.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.787+0000 7f4f150ad640 1 -- 172.21.15.72:0/4176045418 shutdown_connections 2024-05-09T05:53:50.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.787+0000 7f4f150ad640 1 -- 172.21.15.72:0/4176045418 wait complete. 2024-05-09T05:53:50.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.787+0000 7f4f150ad640 1 Processor -- start 2024-05-09T05:53:50.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.787+0000 7f4f150ad640 1 -- start start 2024-05-09T05:53:50.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.787+0000 7f4f150ad640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f1006fc00 0x7f4f100c5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:50.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.787+0000 7f4f150ad640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f100723a0 0x7f4f100cb880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:50.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.787+0000 7f4f150ad640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f10159770 0x7f4f1013de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:50.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.787+0000 7f4f150ad640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f4f10073af0 con 0x7f4f10159770 2024-05-09T05:53:50.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.787+0000 7f4f150ad640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f4f10073810 con 0x7f4f100723a0 2024-05-09T05:53:50.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.787+0000 7f4f150ad640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f4f10158f70 con 0x7f4f1006fc00 2024-05-09T05:53:50.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.791+0000 7f4f0f59e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f10159770 0x7f4f1013de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:50.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.791+0000 7f4f0f59e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f10159770 0x7f4f1013de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46404/0 (socket says 172.21.15.72:46404) 2024-05-09T05:53:50.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.791+0000 7f4f0f59e640 1 -- 172.21.15.72:0/1173730656 learned_addr learned my addr 172.21.15.72:0/1173730656 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:50.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.791+0000 7f4f0e59c640 1 --2- 172.21.15.72:0/1173730656 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f100723a0 0x7f4f100cb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:50.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.791+0000 7f4f0ed9d640 1 --2- 172.21.15.72:0/1173730656 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f1006fc00 0x7f4f100c5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:50.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.791+0000 7f4f0f59e640 1 -- 172.21.15.72:0/1173730656 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f1006fc00 msgr2=0x7f4f100c5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:50.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.791+0000 7f4f0f59e640 1 --2- 172.21.15.72:0/1173730656 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f1006fc00 0x7f4f100c5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:50.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.791+0000 7f4f0f59e640 1 -- 172.21.15.72:0/1173730656 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f100723a0 msgr2=0x7f4f100cb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:50.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.791+0000 7f4f0f59e640 1 --2- 172.21.15.72:0/1173730656 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f100723a0 0x7f4f100cb880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:50.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.791+0000 7f4f0f59e640 1 -- 172.21.15.72:0/1173730656 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f100c6230 con 0x7f4f10159770 2024-05-09T05:53:50.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.791+0000 7f4f0e59c640 1 --2- 172.21.15.72:0/1173730656 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f100723a0 0x7f4f100cb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:53:50.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.791+0000 7f4f0f59e640 1 --2- 172.21.15.72:0/1173730656 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f10159770 0x7f4f1013de60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4f08007d40 tx=0x7f4f0800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:50.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.791+0000 7f4ef77fe640 1 -- 172.21.15.72:0/1173730656 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f08014420 con 0x7f4f10159770 2024-05-09T05:53:50.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.791+0000 7f4ef77fe640 1 -- 172.21.15.72:0/1173730656 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f08019070 con 0x7f4f10159770 2024-05-09T05:53:50.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.791+0000 7f4f150ad640 1 -- 172.21.15.72:0/1173730656 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f10147ea0 con 0x7f4f10159770 2024-05-09T05:53:50.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.791+0000 7f4ef77fe640 1 -- 172.21.15.72:0/1173730656 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f08014800 con 0x7f4f10159770 2024-05-09T05:53:50.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.791+0000 7f4f150ad640 1 -- 172.21.15.72:0/1173730656 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f10148460 con 0x7f4f10159770 2024-05-09T05:53:50.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.791+0000 7f4f150ad640 1 -- 172.21.15.72:0/1173730656 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f1006a520 con 0x7f4f10159770 2024-05-09T05:53:50.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.791+0000 7f4ef77fe640 1 -- 172.21.15.72:0/1173730656 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f4f080149a0 con 0x7f4f10159770 2024-05-09T05:53:50.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.791+0000 7f4ef77fe640 1 --2- 172.21.15.72:0/1173730656 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f4efc06f400 0x7f4efc071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:50.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.795+0000 7f4ef77fe640 1 -- 172.21.15.72:0/1173730656 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4f08090620 con 0x7f4f10159770 2024-05-09T05:53:50.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.795+0000 7f4f0ed9d640 1 --2- 172.21.15.72:0/1173730656 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f4efc06f400 0x7f4efc071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:50.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.795+0000 7f4f0ed9d640 1 --2- 172.21.15.72:0/1173730656 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f4efc06f400 0x7f4efc071910 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4f0000b930 tx=0x7f4f00008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:50.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.795+0000 7f4ef77fe640 1 -- 172.21.15.72:0/1173730656 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f4f0805d3d0 con 0x7f4f10159770 2024-05-09T05:53:50.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.991+0000 7f4f150ad640 1 -- 172.21.15.72:0/1173730656 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4f101522b0 con 0x7f4f10159770 2024-05-09T05:53:50.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.995+0000 7f4ef77fe640 1 -- 172.21.15.72:0/1173730656 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6848 (secure 0 0 0) 0x7f4f080653c0 con 0x7f4f10159770 2024-05-09T05:53:50.985 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:53:50.985 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6834/1142956298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1142956298},{"type":"v1","addr":"172.21.15.72:6834","nonce":1142956298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/3946563056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":3946563056},{"type":"v1","addr":"172.21.15.72:6835","nonce":3946563056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4259,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6838/840351907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":840351907},{"type":"v1","addr":"172.21.15.110:6838","nonce":840351907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/1048256382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":1048256382},{"type":"v1","addr":"172.21.15.72:6837","nonce":1048256382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:53:23.494975+0000","modified":"2024-05-09T05:53:49.993033+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1],"up":{"mds_0":4297,"mds_1":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"d","rank":1,"incarnation":10,"state":"up:creating","state_seq":1,"addr":"172.21.15.110:6839/966325499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6837","nonce":966325499},{"type":"v1","addr":"172.21.15.110:6839","nonce":966325499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6836/4134424941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":4134424941},{"type":"v1","addr":"172.21.15.110:6836","nonce":4134424941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4297]},"id":1}]} 2024-05-09T05:53:50.985 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 12 2024-05-09T05:53:50.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.995+0000 7f4f150ad640 1 -- 172.21.15.72:0/1173730656 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f4efc06f400 msgr2=0x7f4efc071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:50.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.995+0000 7f4f150ad640 1 --2- 172.21.15.72:0/1173730656 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f4efc06f400 0x7f4efc071910 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4f0000b930 tx=0x7f4f00008040 comp rx=0 tx=0).stop 2024-05-09T05:53:50.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.995+0000 7f4f150ad640 1 -- 172.21.15.72:0/1173730656 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f10159770 msgr2=0x7f4f1013de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:50.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.995+0000 7f4f150ad640 1 --2- 172.21.15.72:0/1173730656 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f10159770 0x7f4f1013de60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4f08007d40 tx=0x7f4f0800e4b0 comp rx=0 tx=0).stop 2024-05-09T05:53:50.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.995+0000 7f4f150ad640 1 -- 172.21.15.72:0/1173730656 shutdown_connections 2024-05-09T05:53:50.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.995+0000 7f4f150ad640 1 --2- 172.21.15.72:0/1173730656 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f4efc06f400 0x7f4efc071910 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:50.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.995+0000 7f4f150ad640 1 --2- 172.21.15.72:0/1173730656 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f10159770 0x7f4f1013de60 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:50.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.995+0000 7f4f150ad640 1 --2- 172.21.15.72:0/1173730656 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f100723a0 0x7f4f100cb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:50.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.995+0000 7f4f150ad640 1 --2- 172.21.15.72:0/1173730656 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f1006fc00 0x7f4f100c5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:50.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.995+0000 7f4f150ad640 1 -- 172.21.15.72:0/1173730656 >> 172.21.15.72:0/1173730656 conn(0x7f4f100cde90 msgr2=0x7f4f10144f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:50.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.995+0000 7f4f150ad640 1 -- 172.21.15.72:0/1173730656 shutdown_connections 2024-05-09T05:53:50.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:50.995+0000 7f4f150ad640 1 -- 172.21.15.72:0/1173730656 wait complete. 2024-05-09T05:53:51.008 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T05:53:51.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.155+0000 7f278ab4a640 1 Processor -- start 2024-05-09T05:53:51.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.155+0000 7f278ab4a640 1 -- start start 2024-05-09T05:53:51.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.155+0000 7f278ab4a640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f27840cc150 0x7f27840ca620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:51.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.155+0000 7f278ab4a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2784156b50 0x7f2784160420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:51.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.155+0000 7f278ab4a640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27840cc6b0 con 0x7f2784160960 2024-05-09T05:53:51.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.155+0000 7f278ab4a640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f2784074570 con 0x7f27840cc150 2024-05-09T05:53:51.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.155+0000 7f278ab4a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f2784156f60 con 0x7f2784156b50 2024-05-09T05:53:51.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.155+0000 7f27890e7640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f2784160960 0x7f278406e1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:45728/0 (socket says 172.21.15.72:45728) 2024-05-09T05:53:51.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.155+0000 7f27890e7640 1 -- 172.21.15.72:0/2287583989 learned_addr learned my addr 172.21.15.72:0/2287583989 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:53:51.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.155+0000 7f27888e6640 1 --2- 172.21.15.72:0/2287583989 >> v2:172.21.15.72:3300/0 conn(0x7f27840cc150 0x7f27840ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:51.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.155+0000 7f2783fff640 1 --2- 172.21.15.72:0/2287583989 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2784156b50 0x7f2784160420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:51.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.155+0000 7f27888e6640 1 -- 172.21.15.72:0/2287583989 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2784156b50 msgr2=0x7f2784160420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:51.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.155+0000 7f27888e6640 1 --2- 172.21.15.72:0/2287583989 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2784156b50 0x7f2784160420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:51.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.155+0000 7f27888e6640 1 -- 172.21.15.72:0/2287583989 >> v1:172.21.15.72:6789/0 conn(0x7f2784160960 legacy=0x7f278406e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:51.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.155+0000 7f27888e6640 1 -- 172.21.15.72:0/2287583989 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27840cc990 con 0x7f27840cc150 2024-05-09T05:53:51.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.159+0000 7f27888e6640 1 --2- 172.21.15.72:0/2287583989 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27840cc150 0x7f27840ca620 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f277c009d90 tx=0x7f277c01f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb3986c06e993890 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:51.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.159+0000 7f27837fe640 1 -- 172.21.15.72:0/2287583989 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f277c0b4070 con 0x7f27840cc150 2024-05-09T05:53:51.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.159+0000 7f27837fe640 1 -- 172.21.15.72:0/2287583989 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f277c0af600 con 0x7f27840cc150 2024-05-09T05:53:51.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.159+0000 7f27837fe640 1 -- 172.21.15.72:0/2287583989 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f277c0af9d0 con 0x7f27840cc150 2024-05-09T05:53:51.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.159+0000 7f278ab4a640 1 -- 172.21.15.72:0/2287583989 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27840cc150 msgr2=0x7f27840ca620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:51.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.159+0000 7f278ab4a640 1 --2- 172.21.15.72:0/2287583989 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27840cc150 0x7f27840ca620 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f277c009d90 tx=0x7f277c01f150 comp rx=0 tx=0).stop 2024-05-09T05:53:51.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.159+0000 7f278ab4a640 1 -- 172.21.15.72:0/2287583989 shutdown_connections 2024-05-09T05:53:51.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.159+0000 7f278ab4a640 1 --2- 172.21.15.72:0/2287583989 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2784156b50 0x7f2784160420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:51.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.159+0000 7f278ab4a640 1 --2- 172.21.15.72:0/2287583989 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27840cc150 0x7f27840ca620 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:51.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.159+0000 7f278ab4a640 1 -- 172.21.15.72:0/2287583989 >> 172.21.15.72:0/2287583989 conn(0x7f2784072080 msgr2=0x7f2784072490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:51.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.159+0000 7f278ab4a640 1 -- 172.21.15.72:0/2287583989 shutdown_connections 2024-05-09T05:53:51.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.159+0000 7f278ab4a640 1 -- 172.21.15.72:0/2287583989 wait complete. 2024-05-09T05:53:51.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.163+0000 7f278ab4a640 1 Processor -- start 2024-05-09T05:53:51.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.163+0000 7f278ab4a640 1 -- start start 2024-05-09T05:53:51.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.163+0000 7f278ab4a640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27840cc150 0x7f278415bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:51.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.163+0000 7f278ab4a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2784156b50 0x7f2784072660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:51.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.163+0000 7f278ab4a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2784160960 0x7f2784157930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:51.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.163+0000 7f278ab4a640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f27840ccf50 con 0x7f27840cc150 2024-05-09T05:53:51.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.163+0000 7f278ab4a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f278415fca0 con 0x7f2784160960 2024-05-09T05:53:51.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.163+0000 7f278ab4a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f278406e8b0 con 0x7f2784156b50 2024-05-09T05:53:51.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.163+0000 7f27888e6640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27840cc150 0x7f278415bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:51.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.163+0000 7f27888e6640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27840cc150 0x7f278415bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46416/0 (socket says 172.21.15.72:46416) 2024-05-09T05:53:51.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.163+0000 7f27888e6640 1 -- 172.21.15.72:0/1026647163 learned_addr learned my addr 172.21.15.72:0/1026647163 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:51.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.163+0000 7f27890e7640 1 --2- 172.21.15.72:0/1026647163 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2784160960 0x7f2784157930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:51.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.163+0000 7f27888e6640 1 -- 172.21.15.72:0/1026647163 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2784156b50 msgr2=0x7f2784072660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:51.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.163+0000 7f2783fff640 1 --2- 172.21.15.72:0/1026647163 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2784156b50 0x7f2784072660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:51.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.163+0000 7f27888e6640 1 --2- 172.21.15.72:0/1026647163 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2784156b50 0x7f2784072660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:51.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.163+0000 7f27888e6640 1 -- 172.21.15.72:0/1026647163 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2784160960 msgr2=0x7f2784157930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:51.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.163+0000 7f27888e6640 1 --2- 172.21.15.72:0/1026647163 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2784160960 0x7f2784157930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:51.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.163+0000 7f27888e6640 1 -- 172.21.15.72:0/1026647163 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f278415c070 con 0x7f27840cc150 2024-05-09T05:53:51.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.163+0000 7f27890e7640 1 --2- 172.21.15.72:0/1026647163 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2784160960 0x7f2784157930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:53:51.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.163+0000 7f2783fff640 1 --2- 172.21.15.72:0/1026647163 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2784156b50 0x7f2784072660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:53:51.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.163+0000 7f27888e6640 1 --2- 172.21.15.72:0/1026647163 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27840cc150 0x7f278415bb30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f277c0b2040 tx=0x7f277c01bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:51.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.163+0000 7f27817fa640 1 -- 172.21.15.72:0/1026647163 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f277c0b4040 con 0x7f27840cc150 2024-05-09T05:53:51.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.163+0000 7f27817fa640 1 -- 172.21.15.72:0/1026647163 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f277c0c1070 con 0x7f27840cc150 2024-05-09T05:53:51.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.163+0000 7f278ab4a640 1 -- 172.21.15.72:0/1026647163 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f278415d3b0 con 0x7f27840cc150 2024-05-09T05:53:51.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.163+0000 7f27817fa640 1 -- 172.21.15.72:0/1026647163 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f277c009450 con 0x7f27840cc150 2024-05-09T05:53:51.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.163+0000 7f278ab4a640 1 -- 172.21.15.72:0/1026647163 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27840cdf10 con 0x7f27840cc150 2024-05-09T05:53:51.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.163+0000 7f278ab4a640 1 -- 172.21.15.72:0/1026647163 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f278415b770 con 0x7f27840cc150 2024-05-09T05:53:51.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.167+0000 7f27817fa640 1 -- 172.21.15.72:0/1026647163 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f277c0ba670 con 0x7f27840cc150 2024-05-09T05:53:51.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.167+0000 7f27817fa640 1 --2- 172.21.15.72:0/1026647163 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f276406f400 0x7f2764071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:51.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.167+0000 7f27817fa640 1 -- 172.21.15.72:0/1026647163 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f277c12e160 con 0x7f27840cc150 2024-05-09T05:53:51.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.167+0000 7f2783fff640 1 --2- 172.21.15.72:0/1026647163 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f276406f400 0x7f2764071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:51.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.167+0000 7f2783fff640 1 --2- 172.21.15.72:0/1026647163 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f276406f400 0x7f2764071910 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f278415e770 tx=0x7f276c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:51.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.171+0000 7f27817fa640 1 -- 172.21.15.72:0/1026647163 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f277c018cb0 con 0x7f27840cc150 2024-05-09T05:53:51.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.331+0000 7f278ab4a640 1 -- 172.21.15.72:0/1026647163 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f278406a520 con 0x7f27840cc150 2024-05-09T05:53:51.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.331+0000 7f27817fa640 1 -- 172.21.15.72:0/1026647163 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18494 (secure 0 0 0) 0x7f277c0fad50 con 0x7f27840cc150 2024-05-09T05:53:51.323 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:53:51.323 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"fsid":"44c88cb9-b39b-4787-a871-80ddf0ad6292","created":"2024-05-09T05:52:59.591187+0000","modified":"2024-05-09T05:53:28.584684+0000","last_up_change":"2024-05-09T05:53:10.902489+0000","last_in_change":"2024-05-09T05:53:02.200254+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T05:53:10.503537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T05:53:21.364958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T05:53:22.461477+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-09T05:53:26.171144+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e4af2aa1-ba5c-4411-a72a-a0e38e589a74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":331913921},{"type":"v1","addr":"172.21.15.72:6817","nonce":331913921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":331913921},{"type":"v1","addr":"172.21.15.72:6819","nonce":331913921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":331913921},{"type":"v1","addr":"172.21.15.72:6823","nonce":331913921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":331913921},{"type":"v1","addr":"172.21.15.72:6821","nonce":331913921}]},"public_addr":"172.21.15.72:6817/331913921","cluster_addr":"172.21.15.72:6819/331913921","heartbeat_back_addr":"172.21.15.72:6823/331913921","heartbeat_front_addr":"172.21.15.72:6821/331913921","state":["exists","up"]},{"osd":1,"uuid":"052504f5-a523-4922-bdc7-ce2890faa5ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2197151836},{"type":"v1","addr":"172.21.15.72:6801","nonce":2197151836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2197151836},{"type":"v1","addr":"172.21.15.72:6803","nonce":2197151836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2197151836},{"type":"v1","addr":"172.21.15.72:6811","nonce":2197151836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2197151836},{"type":"v1","addr":"172.21.15.72:6807","nonce":2197151836}]},"public_addr":"172.21.15.72:6801/2197151836","cluster_addr":"172.21.15.72:6803/2197151836","heartbeat_back_addr":"172.21.15.72:6811/2197151836","heartbeat_front_addr":"172.21.15.72:6807/2197151836","state":["exists","up"]},{"osd":2,"uuid":"28bc1c95-6d0d-4263-baad-314d86e6a670","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1273581990},{"type":"v1","addr":"172.21.15.72:6825","nonce":1273581990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":1273581990},{"type":"v1","addr":"172.21.15.72:6827","nonce":1273581990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1273581990},{"type":"v1","addr":"172.21.15.72:6831","nonce":1273581990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1273581990},{"type":"v1","addr":"172.21.15.72:6829","nonce":1273581990}]},"public_addr":"172.21.15.72:6825/1273581990","cluster_addr":"172.21.15.72:6827/1273581990","heartbeat_back_addr":"172.21.15.72:6831/1273581990","heartbeat_front_addr":"172.21.15.72:6829/1273581990","state":["exists","up"]},{"osd":3,"uuid":"edcc86cb-f178-4533-8069-de9d781531ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2180866263},{"type":"v1","addr":"172.21.15.72:6806","nonce":2180866263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2180866263},{"type":"v1","addr":"172.21.15.72:6810","nonce":2180866263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2180866263},{"type":"v1","addr":"172.21.15.72:6815","nonce":2180866263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2180866263},{"type":"v1","addr":"172.21.15.72:6813","nonce":2180866263}]},"public_addr":"172.21.15.72:6806/2180866263","cluster_addr":"172.21.15.72:6810/2180866263","heartbeat_back_addr":"172.21.15.72:6815/2180866263","heartbeat_front_addr":"172.21.15.72:6813/2180866263","state":["exists","up"]},{"osd":4,"uuid":"8d138128-4829-4109-87a1-25f339f3e953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3437318248},{"type":"v1","addr":"172.21.15.110:6817","nonce":3437318248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3437318248},{"type":"v1","addr":"172.21.15.110:6819","nonce":3437318248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3437318248},{"type":"v1","addr":"172.21.15.110:6823","nonce":3437318248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3437318248},{"type":"v1","addr":"172.21.15.110:6821","nonce":3437318248}]},"public_addr":"172.21.15.110:6817/3437318248","cluster_addr":"172.21.15.110:6819/3437318248","heartbeat_back_addr":"172.21.15.110:6823/3437318248","heartbeat_front_addr":"172.21.15.110:6821/3437318248","state":["exists","up"]},{"osd":5,"uuid":"99a4a914-0a0e-4d25-94ae-3e86b8b1aa4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":977576181},{"type":"v1","addr":"172.21.15.110:6825","nonce":977576181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":977576181},{"type":"v1","addr":"172.21.15.110:6827","nonce":977576181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":977576181},{"type":"v1","addr":"172.21.15.110:6831","nonce":977576181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":977576181},{"type":"v1","addr":"172.21.15.110:6829","nonce":977576181}]},"public_addr":"172.21.15.110:6825/977576181","cluster_addr":"172.21.15.110:6827/977576181","heartbeat_back_addr":"172.21.15.110:6831/977576181","heartbeat_front_addr":"172.21.15.110:6829/977576181","state":["exists","up"]},{"osd":6,"uuid":"6e04b295-afc9-4f80-80f7-3df1f5168608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":1817638786},{"type":"v1","addr":"172.21.15.110:6809","nonce":1817638786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":1817638786},{"type":"v1","addr":"172.21.15.110:6811","nonce":1817638786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":1817638786},{"type":"v1","addr":"172.21.15.110:6815","nonce":1817638786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":1817638786},{"type":"v1","addr":"172.21.15.110:6813","nonce":1817638786}]},"public_addr":"172.21.15.110:6809/1817638786","cluster_addr":"172.21.15.110:6811/1817638786","heartbeat_back_addr":"172.21.15.110:6815/1817638786","heartbeat_front_addr":"172.21.15.110:6813/1817638786","state":["exists","up"]},{"osd":7,"uuid":"835de5c9-1e2c-41d8-bd28-d7ffe5ad8fdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":214675920},{"type":"v1","addr":"172.21.15.110:6801","nonce":214675920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":214675920},{"type":"v1","addr":"172.21.15.110:6803","nonce":214675920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":214675920},{"type":"v1","addr":"172.21.15.110:6807","nonce":214675920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":214675920},{"type":"v1","addr":"172.21.15.110:6805","nonce":214675920}]},"public_addr":"172.21.15.110:6801/214675920","cluster_addr":"172.21.15.110:6803/214675920","heartbeat_back_addr":"172.21.15.110:6807/214675920","heartbeat_front_addr":"172.21.15.110:6805/214675920","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.849761+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.670554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.743789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:08.516367+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.665550+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.518775+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.786468+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.794984+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T05:53:51.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.331+0000 7f278ab4a640 1 -- 172.21.15.72:0/1026647163 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f276406f400 msgr2=0x7f2764071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:51.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.331+0000 7f278ab4a640 1 --2- 172.21.15.72:0/1026647163 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f276406f400 0x7f2764071910 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f278415e770 tx=0x7f276c008040 comp rx=0 tx=0).stop 2024-05-09T05:53:51.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.335+0000 7f278ab4a640 1 -- 172.21.15.72:0/1026647163 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27840cc150 msgr2=0x7f278415bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:51.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.335+0000 7f278ab4a640 1 --2- 172.21.15.72:0/1026647163 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27840cc150 0x7f278415bb30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f277c0b2040 tx=0x7f277c01bef0 comp rx=0 tx=0).stop 2024-05-09T05:53:51.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.335+0000 7f278ab4a640 1 -- 172.21.15.72:0/1026647163 shutdown_connections 2024-05-09T05:53:51.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.335+0000 7f278ab4a640 1 --2- 172.21.15.72:0/1026647163 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f276406f400 0x7f2764071910 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:51.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.335+0000 7f278ab4a640 1 --2- 172.21.15.72:0/1026647163 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2784160960 0x7f2784157930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:51.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.335+0000 7f278ab4a640 1 --2- 172.21.15.72:0/1026647163 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2784156b50 0x7f2784072660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:51.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.335+0000 7f278ab4a640 1 --2- 172.21.15.72:0/1026647163 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27840cc150 0x7f278415bb30 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:51.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.335+0000 7f278ab4a640 1 -- 172.21.15.72:0/1026647163 >> 172.21.15.72:0/1026647163 conn(0x7f2784072080 msgr2=0x7f2784155790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:51.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.335+0000 7f278ab4a640 1 -- 172.21.15.72:0/1026647163 shutdown_connections 2024-05-09T05:53:51.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.335+0000 7f278ab4a640 1 -- 172.21.15.72:0/1026647163 wait complete. 2024-05-09T05:53:51.343 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-09T05:53:51.343 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T05:53:51.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.487+0000 7f7c5440a640 1 Processor -- start 2024-05-09T05:53:51.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.487+0000 7f7c5440a640 1 -- start start 2024-05-09T05:53:51.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.487+0000 7f7c5440a640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7c4c075020 0x7f7c4c074090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:51.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.487+0000 7f7c5440a640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7c4c161f80 0x7f7c4c1643a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:51.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.487+0000 7f7c5440a640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c4c06e960 con 0x7f7c4c0745d0 2024-05-09T05:53:51.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.487+0000 7f7c5440a640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f7c4c072b20 con 0x7f7c4c161f80 2024-05-09T05:53:51.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.487+0000 7f7c5440a640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f7c4c072840 con 0x7f7c4c075020 2024-05-09T05:53:51.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.487+0000 7f7c519a5640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f7c4c0745d0 0x7f7c4c0c7480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:45736/0 (socket says 172.21.15.72:45736) 2024-05-09T05:53:51.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.487+0000 7f7c519a5640 1 -- 172.21.15.72:0/1552038972 learned_addr learned my addr 172.21.15.72:0/1552038972 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:53:51.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.487+0000 7f7c529a7640 1 --2- 172.21.15.72:0/1552038972 >> v2:172.21.15.72:3300/0 conn(0x7f7c4c161f80 0x7f7c4c1643a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:51.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.487+0000 7f7c521a6640 1 --2- 172.21.15.72:0/1552038972 >> v2:172.21.15.110:3300/0 conn(0x7f7c4c075020 0x7f7c4c074090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:51.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.487+0000 7f7c511a4640 1 -- 172.21.15.72:0/1552038972 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3961669448 0 0) 0x7f7c4c06e960 con 0x7f7c4c0745d0 2024-05-09T05:53:51.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.487+0000 7f7c511a4640 1 -- 172.21.15.72:0/1552038972 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c38003530 con 0x7f7c4c0745d0 2024-05-09T05:53:51.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.487+0000 7f7c529a7640 1 -- 172.21.15.72:0/1552038972 >> v2:172.21.15.110:3300/0 conn(0x7f7c4c075020 msgr2=0x7f7c4c074090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:51.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.487+0000 7f7c529a7640 1 --2- 172.21.15.72:0/1552038972 >> v2:172.21.15.110:3300/0 conn(0x7f7c4c075020 0x7f7c4c074090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:51.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.487+0000 7f7c529a7640 1 -- 172.21.15.72:0/1552038972 >> v1:172.21.15.72:6789/0 conn(0x7f7c4c0745d0 legacy=0x7f7c4c0c7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:51.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.487+0000 7f7c511a4640 1 -- 172.21.15.72:0/1552038972 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 48433227 0 0) 0x7f7c38003530 con 0x7f7c4c0745d0 2024-05-09T05:53:51.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.487+0000 7f7c529a7640 1 -- 172.21.15.72:0/1552038972 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c4c06ec20 con 0x7f7c4c161f80 2024-05-09T05:53:51.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.491+0000 7f7c529a7640 1 --2- 172.21.15.72:0/1552038972 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c4c161f80 0x7f7c4c1643a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c050a00 tx=0x7f7c4401f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d88026eda8fa795d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:51.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.491+0000 7f7c511a4640 1 -- 172.21.15.72:0/1552038972 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c440b5070 con 0x7f7c4c161f80 2024-05-09T05:53:51.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.491+0000 7f7c511a4640 1 -- 172.21.15.72:0/1552038972 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c440a8bd0 con 0x7f7c4c161f80 2024-05-09T05:53:51.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.491+0000 7f7c511a4640 1 -- 172.21.15.72:0/1552038972 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c40001700 con 0x7f7c4c161f80 2024-05-09T05:53:51.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.491+0000 7f7c5440a640 1 -- 172.21.15.72:0/1552038972 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c4c161f80 msgr2=0x7f7c4c1643a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:51.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.491+0000 7f7c5440a640 1 --2- 172.21.15.72:0/1552038972 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c4c161f80 0x7f7c4c1643a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c050a00 tx=0x7f7c4401f040 comp rx=0 tx=0).stop 2024-05-09T05:53:51.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.491+0000 7f7c5440a640 1 -- 172.21.15.72:0/1552038972 shutdown_connections 2024-05-09T05:53:51.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.491+0000 7f7c5440a640 1 --2- 172.21.15.72:0/1552038972 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c4c161f80 0x7f7c4c1643a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:51.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.491+0000 7f7c5440a640 1 --2- 172.21.15.72:0/1552038972 >> v2:172.21.15.110:3300/0 conn(0x7f7c4c075020 0x7f7c4c074090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:51.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.491+0000 7f7c5440a640 1 -- 172.21.15.72:0/1552038972 >> 172.21.15.72:0/1552038972 conn(0x7f7c4c0cb350 msgr2=0x7f7c4c0cb760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:51.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.491+0000 7f7c5440a640 1 -- 172.21.15.72:0/1552038972 shutdown_connections 2024-05-09T05:53:51.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.491+0000 7f7c5440a640 1 -- 172.21.15.72:0/1552038972 wait complete. 2024-05-09T05:53:51.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.491+0000 7f7c5440a640 1 Processor -- start 2024-05-09T05:53:51.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.491+0000 7f7c5440a640 1 -- start start 2024-05-09T05:53:51.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.495+0000 7f7c5440a640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c4c0745d0 0x7f7c4c0cd710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:51.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.495+0000 7f7c5440a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7c4c075020 0x7f7c4c14b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:51.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.495+0000 7f7c5440a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c4c161f80 0x7f7c4c146330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:51.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.495+0000 7f7c5440a640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4c159dc0 con 0x7f7c4c0745d0 2024-05-09T05:53:51.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.495+0000 7f7c5440a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4c159ae0 con 0x7f7c4c161f80 2024-05-09T05:53:51.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.495+0000 7f7c5440a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f7c4c15a0a0 con 0x7f7c4c075020 2024-05-09T05:53:51.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.495+0000 7f7c521a6640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c4c0745d0 0x7f7c4c0cd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:51.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.495+0000 7f7c521a6640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c4c0745d0 0x7f7c4c0cd710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46426/0 (socket says 172.21.15.72:46426) 2024-05-09T05:53:51.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.495+0000 7f7c521a6640 1 -- 172.21.15.72:0/1973180225 learned_addr learned my addr 172.21.15.72:0/1973180225 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:51.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.495+0000 7f7c529a7640 1 --2- 172.21.15.72:0/1973180225 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c4c161f80 0x7f7c4c146330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:51.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.495+0000 7f7c519a5640 1 --2- 172.21.15.72:0/1973180225 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7c4c075020 0x7f7c4c14b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:51.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.495+0000 7f7c521a6640 1 -- 172.21.15.72:0/1973180225 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7c4c075020 msgr2=0x7f7c4c14b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:51.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.495+0000 7f7c521a6640 1 --2- 172.21.15.72:0/1973180225 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7c4c075020 0x7f7c4c14b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:51.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.495+0000 7f7c521a6640 1 -- 172.21.15.72:0/1973180225 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c4c161f80 msgr2=0x7f7c4c146330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:51.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.495+0000 7f7c521a6640 1 --2- 172.21.15.72:0/1973180225 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c4c161f80 0x7f7c4c146330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:51.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.495+0000 7f7c521a6640 1 -- 172.21.15.72:0/1973180225 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c4c155ad0 con 0x7f7c4c0745d0 2024-05-09T05:53:51.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.495+0000 7f7c529a7640 1 --2- 172.21.15.72:0/1973180225 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c4c161f80 0x7f7c4c146330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:53:51.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.495+0000 7f7c521a6640 1 --2- 172.21.15.72:0/1973180225 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c4c0745d0 0x7f7c4c0cd710 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7c4800e8a0 tx=0x7f7c4800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:51.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.495+0000 7f7c3effd640 1 -- 172.21.15.72:0/1973180225 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c48017070 con 0x7f7c4c0745d0 2024-05-09T05:53:51.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.495+0000 7f7c3effd640 1 -- 172.21.15.72:0/1973180225 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c4800c940 con 0x7f7c4c0745d0 2024-05-09T05:53:51.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.495+0000 7f7c5440a640 1 -- 172.21.15.72:0/1973180225 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c4c155db0 con 0x7f7c4c0745d0 2024-05-09T05:53:51.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.495+0000 7f7c3effd640 1 -- 172.21.15.72:0/1973180225 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c4800ccf0 con 0x7f7c4c0745d0 2024-05-09T05:53:51.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.495+0000 7f7c5440a640 1 -- 172.21.15.72:0/1973180225 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c4c0cddb0 con 0x7f7c4c0745d0 2024-05-09T05:53:51.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.495+0000 7f7c5440a640 1 -- 172.21.15.72:0/1973180225 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c4c06a520 con 0x7f7c4c0745d0 2024-05-09T05:53:51.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.495+0000 7f7c3effd640 1 -- 172.21.15.72:0/1973180225 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f7c4801a070 con 0x7f7c4c0745d0 2024-05-09T05:53:51.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.495+0000 7f7c3effd640 1 --2- 172.21.15.72:0/1973180225 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f7c3006f400 0x7f7c30071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:51.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.499+0000 7f7c3effd640 1 -- 172.21.15.72:0/1973180225 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f7c4808fbf0 con 0x7f7c4c0745d0 2024-05-09T05:53:51.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.499+0000 7f7c519a5640 1 --2- 172.21.15.72:0/1973180225 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f7c3006f400 0x7f7c30071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:51.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.499+0000 7f7c519a5640 1 --2- 172.21.15.72:0/1973180225 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f7c3006f400 0x7f7c30071910 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7c40001230 tx=0x7f7c40009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:51.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.499+0000 7f7c3effd640 1 -- 172.21.15.72:0/1973180225 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f7c4805c910 con 0x7f7c4c0745d0 2024-05-09T05:53:51.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.647+0000 7f7c5440a640 1 -- 172.21.15.72:0/1973180225 --> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7c4c1538f0 con 0x7f7c3006f400 2024-05-09T05:53:51.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.675+0000 7f7c3effd640 1 -- 172.21.15.72:0/1973180225 <== mgr.4102 v2:172.21.15.110:6832/1113420672 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332519 (secure 0 0 0) 0x7f7c4c1538f0 con 0x7f7c3006f400 2024-05-09T05:53:51.672 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:53:51.675 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2024-05-09T05:53:51.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.683+0000 7f7c5440a640 1 -- 172.21.15.72:0/1973180225 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f7c3006f400 msgr2=0x7f7c30071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:51.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.683+0000 7f7c5440a640 1 --2- 172.21.15.72:0/1973180225 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f7c3006f400 0x7f7c30071910 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7c40001230 tx=0x7f7c40009040 comp rx=0 tx=0).stop 2024-05-09T05:53:51.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.683+0000 7f7c5440a640 1 -- 172.21.15.72:0/1973180225 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c4c0745d0 msgr2=0x7f7c4c0cd710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:51.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.683+0000 7f7c5440a640 1 --2- 172.21.15.72:0/1973180225 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c4c0745d0 0x7f7c4c0cd710 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7c4800e8a0 tx=0x7f7c4800eca0 comp rx=0 tx=0).stop 2024-05-09T05:53:51.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.683+0000 7f7c5440a640 1 -- 172.21.15.72:0/1973180225 shutdown_connections 2024-05-09T05:53:51.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.683+0000 7f7c5440a640 1 --2- 172.21.15.72:0/1973180225 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f7c3006f400 0x7f7c30071910 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:51.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.683+0000 7f7c5440a640 1 --2- 172.21.15.72:0/1973180225 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c4c161f80 0x7f7c4c146330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:51.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.683+0000 7f7c5440a640 1 --2- 172.21.15.72:0/1973180225 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7c4c075020 0x7f7c4c14b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:51.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.683+0000 7f7c5440a640 1 --2- 172.21.15.72:0/1973180225 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c4c0745d0 0x7f7c4c0cd710 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:51.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.683+0000 7f7c5440a640 1 -- 172.21.15.72:0/1973180225 >> 172.21.15.72:0/1973180225 conn(0x7f7c4c0cb350 msgr2=0x7f7c4c156370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:51.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.683+0000 7f7c5440a640 1 -- 172.21.15.72:0/1973180225 shutdown_connections 2024-05-09T05:53:51.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.683+0000 7f7c5440a640 1 -- 172.21.15.72:0/1973180225 wait complete. 2024-05-09T05:53:51.692 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2024-05-09T05:53:50.471606+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236056,"kb_used_data":3240,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738664,"statfs":{"total":773094113280,"available":772852391936,"internally_reserved":0,"allocated":3317760,"data_stored":2004280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006385"},"pg_stats":[{"pgid":"2.1f","version":"24'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.214757+0000","last_change":"2024-05-09T05:53:23.121824+0000","last_active":"2024-05-09T05:53:29.214757+0000","last_peered":"2024-05-09T05:53:29.214757+0000","last_clean":"2024-05-09T05:53:29.214757+0000","last_became_active":"2024-05-09T05:53:23.121097+0000","last_became_peered":"2024-05-09T05:53:23.121097+0000","last_unstale":"2024-05-09T05:53:29.214757+0000","last_undegraded":"2024-05-09T05:53:29.214757+0000","last_fullsized":"2024-05-09T05:53:29.214757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:50:51.880238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.698789+0000","last_change":"2024-05-09T05:53:24.146985+0000","last_active":"2024-05-09T05:53:29.698789+0000","last_peered":"2024-05-09T05:53:29.698789+0000","last_clean":"2024-05-09T05:53:29.698789+0000","last_became_active":"2024-05-09T05:53:24.146540+0000","last_became_peered":"2024-05-09T05:53:24.146540+0000","last_unstale":"2024-05-09T05:53:29.698789+0000","last_undegraded":"2024-05-09T05:53:29.698789+0000","last_fullsized":"2024-05-09T05:53:29.698789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:02:29.318131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.696155+0000","last_change":"2024-05-09T05:53:28.236386+0000","last_active":"2024-05-09T05:53:29.696155+0000","last_peered":"2024-05-09T05:53:29.696155+0000","last_clean":"2024-05-09T05:53:29.696155+0000","last_became_active":"2024-05-09T05:53:28.235305+0000","last_became_peered":"2024-05-09T05:53:28.235305+0000","last_unstale":"2024-05-09T05:53:29.696155+0000","last_undegraded":"2024-05-09T05:53:29.696155+0000","last_fullsized":"2024-05-09T05:53:29.696155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:57:57.134819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.699128+0000","last_change":"2024-05-09T05:53:23.139000+0000","last_active":"2024-05-09T05:53:29.699128+0000","last_peered":"2024-05-09T05:53:29.699128+0000","last_clean":"2024-05-09T05:53:29.699128+0000","last_became_active":"2024-05-09T05:53:23.138431+0000","last_became_peered":"2024-05-09T05:53:23.138431+0000","last_unstale":"2024-05-09T05:53:29.699128+0000","last_undegraded":"2024-05-09T05:53:29.699128+0000","last_fullsized":"2024-05-09T05:53:29.699128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:33:56.977263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.699378+0000","last_change":"2024-05-09T05:53:24.151811+0000","last_active":"2024-05-09T05:53:29.699378+0000","last_peered":"2024-05-09T05:53:29.699378+0000","last_clean":"2024-05-09T05:53:29.699378+0000","last_became_active":"2024-05-09T05:53:24.151407+0000","last_became_peered":"2024-05-09T05:53:24.151407+0000","last_unstale":"2024-05-09T05:53:29.699378+0000","last_undegraded":"2024-05-09T05:53:29.699378+0000","last_fullsized":"2024-05-09T05:53:29.699378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:54:17.819787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.329660+0000","last_change":"2024-05-09T05:53:28.213485+0000","last_active":"2024-05-09T05:53:29.329660+0000","last_peered":"2024-05-09T05:53:29.329660+0000","last_clean":"2024-05-09T05:53:29.329660+0000","last_became_active":"2024-05-09T05:53:28.213021+0000","last_became_peered":"2024-05-09T05:53:28.213021+0000","last_unstale":"2024-05-09T05:53:29.329660+0000","last_undegraded":"2024-05-09T05:53:29.329660+0000","last_fullsized":"2024-05-09T05:53:29.329660+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:58:22.493166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.519704+0000","last_change":"2024-05-09T05:53:23.095209+0000","last_active":"2024-05-09T05:53:29.519704+0000","last_peered":"2024-05-09T05:53:29.519704+0000","last_clean":"2024-05-09T05:53:29.519704+0000","last_became_active":"2024-05-09T05:53:23.094826+0000","last_became_peered":"2024-05-09T05:53:23.094826+0000","last_unstale":"2024-05-09T05:53:29.519704+0000","last_undegraded":"2024-05-09T05:53:29.519704+0000","last_fullsized":"2024-05-09T05:53:29.519704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:38:47.390311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.211795+0000","last_change":"2024-05-09T05:53:24.135281+0000","last_active":"2024-05-09T05:53:29.211795+0000","last_peered":"2024-05-09T05:53:29.211795+0000","last_clean":"2024-05-09T05:53:29.211795+0000","last_became_active":"2024-05-09T05:53:24.134610+0000","last_became_peered":"2024-05-09T05:53:24.134610+0000","last_unstale":"2024-05-09T05:53:29.211795+0000","last_undegraded":"2024-05-09T05:53:29.211795+0000","last_fullsized":"2024-05-09T05:53:29.211795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:28:03.947961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.329917+0000","last_change":"2024-05-09T05:53:28.205763+0000","last_active":"2024-05-09T05:53:29.329917+0000","last_peered":"2024-05-09T05:53:29.329917+0000","last_clean":"2024-05-09T05:53:29.329917+0000","last_became_active":"2024-05-09T05:53:28.205229+0000","last_became_peered":"2024-05-09T05:53:28.205229+0000","last_unstale":"2024-05-09T05:53:29.329917+0000","last_undegraded":"2024-05-09T05:53:29.329917+0000","last_fullsized":"2024-05-09T05:53:29.329917+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:38:51.267769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.519170+0000","last_change":"2024-05-09T05:53:23.097616+0000","last_active":"2024-05-09T05:53:29.519170+0000","last_peered":"2024-05-09T05:53:29.519170+0000","last_clean":"2024-05-09T05:53:29.519170+0000","last_became_active":"2024-05-09T05:53:23.094760+0000","last_became_peered":"2024-05-09T05:53:23.094760+0000","last_unstale":"2024-05-09T05:53:29.519170+0000","last_undegraded":"2024-05-09T05:53:29.519170+0000","last_fullsized":"2024-05-09T05:53:29.519170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:21:32.558852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.214927+0000","last_change":"2024-05-09T05:53:24.139467+0000","last_active":"2024-05-09T05:53:29.214927+0000","last_peered":"2024-05-09T05:53:29.214927+0000","last_clean":"2024-05-09T05:53:29.214927+0000","last_became_active":"2024-05-09T05:53:24.139109+0000","last_became_peered":"2024-05-09T05:53:24.139109+0000","last_unstale":"2024-05-09T05:53:29.214927+0000","last_undegraded":"2024-05-09T05:53:29.214927+0000","last_fullsized":"2024-05-09T05:53:29.214927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:36.783615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.329829+0000","last_change":"2024-05-09T05:53:28.216127+0000","last_active":"2024-05-09T05:53:29.329829+0000","last_peered":"2024-05-09T05:53:29.329829+0000","last_clean":"2024-05-09T05:53:29.329829+0000","last_became_active":"2024-05-09T05:53:28.215482+0000","last_became_peered":"2024-05-09T05:53:28.215482+0000","last_unstale":"2024-05-09T05:53:29.329829+0000","last_undegraded":"2024-05-09T05:53:29.329829+0000","last_fullsized":"2024-05-09T05:53:29.329829+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:48:58.387701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.213472+0000","last_change":"2024-05-09T05:53:24.132483+0000","last_active":"2024-05-09T05:53:29.213472+0000","last_peered":"2024-05-09T05:53:29.213472+0000","last_clean":"2024-05-09T05:53:29.213472+0000","last_became_active":"2024-05-09T05:53:24.132118+0000","last_became_peered":"2024-05-09T05:53:24.132118+0000","last_unstale":"2024-05-09T05:53:29.213472+0000","last_undegraded":"2024-05-09T05:53:29.213472+0000","last_fullsized":"2024-05-09T05:53:29.213472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:06:01.787707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"24'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.215407+0000","last_change":"2024-05-09T05:53:23.117460+0000","last_active":"2024-05-09T05:53:29.215407+0000","last_peered":"2024-05-09T05:53:29.215407+0000","last_clean":"2024-05-09T05:53:29.215407+0000","last_became_active":"2024-05-09T05:53:23.114179+0000","last_became_peered":"2024-05-09T05:53:23.114179+0000","last_unstale":"2024-05-09T05:53:29.215407+0000","last_undegraded":"2024-05-09T05:53:29.215407+0000","last_fullsized":"2024-05-09T05:53:29.215407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:44:01.784905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.214595+0000","last_change":"2024-05-09T05:53:28.227135+0000","last_active":"2024-05-09T05:53:29.214595+0000","last_peered":"2024-05-09T05:53:29.214595+0000","last_clean":"2024-05-09T05:53:29.214595+0000","last_became_active":"2024-05-09T05:53:28.226427+0000","last_became_peered":"2024-05-09T05:53:28.226427+0000","last_unstale":"2024-05-09T05:53:29.214595+0000","last_undegraded":"2024-05-09T05:53:29.214595+0000","last_fullsized":"2024-05-09T05:53:29.214595+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:37:04.413804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.695764+0000","last_change":"2024-05-09T05:53:24.135982+0000","last_active":"2024-05-09T05:53:29.695764+0000","last_peered":"2024-05-09T05:53:29.695764+0000","last_clean":"2024-05-09T05:53:29.695764+0000","last_became_active":"2024-05-09T05:53:24.135580+0000","last_became_peered":"2024-05-09T05:53:24.135580+0000","last_unstale":"2024-05-09T05:53:29.695764+0000","last_undegraded":"2024-05-09T05:53:29.695764+0000","last_fullsized":"2024-05-09T05:53:29.695764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:03:04.589608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.696302+0000","last_change":"2024-05-09T05:53:23.142679+0000","last_active":"2024-05-09T05:53:29.696302+0000","last_peered":"2024-05-09T05:53:29.696302+0000","last_clean":"2024-05-09T05:53:29.696302+0000","last_became_active":"2024-05-09T05:53:23.142018+0000","last_became_peered":"2024-05-09T05:53:23.142018+0000","last_unstale":"2024-05-09T05:53:29.696302+0000","last_undegraded":"2024-05-09T05:53:29.696302+0000","last_fullsized":"2024-05-09T05:53:29.696302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:08:29.312049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.518874+0000","last_change":"2024-05-09T05:53:28.214167+0000","last_active":"2024-05-09T05:53:29.518874+0000","last_peered":"2024-05-09T05:53:29.518874+0000","last_clean":"2024-05-09T05:53:29.518874+0000","last_became_active":"2024-05-09T05:53:28.213623+0000","last_became_peered":"2024-05-09T05:53:28.213623+0000","last_unstale":"2024-05-09T05:53:29.518874+0000","last_undegraded":"2024-05-09T05:53:29.518874+0000","last_fullsized":"2024-05-09T05:53:29.518874+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:53:53.976485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.212618+0000","last_change":"2024-05-09T05:53:24.130342+0000","last_active":"2024-05-09T05:53:29.212618+0000","last_peered":"2024-05-09T05:53:29.212618+0000","last_clean":"2024-05-09T05:53:29.212618+0000","last_became_active":"2024-05-09T05:53:24.129938+0000","last_became_peered":"2024-05-09T05:53:24.129938+0000","last_unstale":"2024-05-09T05:53:29.212618+0000","last_undegraded":"2024-05-09T05:53:29.212618+0000","last_fullsized":"2024-05-09T05:53:29.212618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:58:13.879633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.213484+0000","last_change":"2024-05-09T05:53:23.111169+0000","last_active":"2024-05-09T05:53:29.213484+0000","last_peered":"2024-05-09T05:53:29.213484+0000","last_clean":"2024-05-09T05:53:29.213484+0000","last_became_active":"2024-05-09T05:53:23.110140+0000","last_became_peered":"2024-05-09T05:53:23.110140+0000","last_unstale":"2024-05-09T05:53:29.213484+0000","last_undegraded":"2024-05-09T05:53:29.213484+0000","last_fullsized":"2024-05-09T05:53:29.213484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:18:55.367553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.696432+0000","last_change":"2024-05-09T05:53:28.233648+0000","last_active":"2024-05-09T05:53:29.696432+0000","last_peered":"2024-05-09T05:53:29.696432+0000","last_clean":"2024-05-09T05:53:29.696432+0000","last_became_active":"2024-05-09T05:53:28.227087+0000","last_became_peered":"2024-05-09T05:53:28.227087+0000","last_unstale":"2024-05-09T05:53:29.696432+0000","last_undegraded":"2024-05-09T05:53:29.696432+0000","last_fullsized":"2024-05-09T05:53:29.696432+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:03:49.709580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.213120+0000","last_change":"2024-05-09T05:53:24.147343+0000","last_active":"2024-05-09T05:53:29.213120+0000","last_peered":"2024-05-09T05:53:29.213120+0000","last_clean":"2024-05-09T05:53:29.213120+0000","last_became_active":"2024-05-09T05:53:24.144596+0000","last_became_peered":"2024-05-09T05:53:24.144596+0000","last_unstale":"2024-05-09T05:53:29.213120+0000","last_undegraded":"2024-05-09T05:53:29.213120+0000","last_fullsized":"2024-05-09T05:53:29.213120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:52:43.052055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.517799+0000","last_change":"2024-05-09T05:53:23.102976+0000","last_active":"2024-05-09T05:53:29.517799+0000","last_peered":"2024-05-09T05:53:29.517799+0000","last_clean":"2024-05-09T05:53:29.517799+0000","last_became_active":"2024-05-09T05:53:23.102420+0000","last_became_peered":"2024-05-09T05:53:23.102420+0000","last_unstale":"2024-05-09T05:53:29.517799+0000","last_undegraded":"2024-05-09T05:53:29.517799+0000","last_fullsized":"2024-05-09T05:53:29.517799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:45:11.479140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.329786+0000","last_change":"2024-05-09T05:53:28.195537+0000","last_active":"2024-05-09T05:53:29.329786+0000","last_peered":"2024-05-09T05:53:29.329786+0000","last_clean":"2024-05-09T05:53:29.329786+0000","last_became_active":"2024-05-09T05:53:28.194915+0000","last_became_peered":"2024-05-09T05:53:28.194915+0000","last_unstale":"2024-05-09T05:53:29.329786+0000","last_undegraded":"2024-05-09T05:53:29.329786+0000","last_fullsized":"2024-05-09T05:53:29.329786+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:07.554137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.214059+0000","last_change":"2024-05-09T05:53:24.130312+0000","last_active":"2024-05-09T05:53:29.214059+0000","last_peered":"2024-05-09T05:53:29.214059+0000","last_clean":"2024-05-09T05:53:29.214059+0000","last_became_active":"2024-05-09T05:53:24.129953+0000","last_became_peered":"2024-05-09T05:53:24.129953+0000","last_unstale":"2024-05-09T05:53:29.214059+0000","last_undegraded":"2024-05-09T05:53:29.214059+0000","last_fullsized":"2024-05-09T05:53:29.214059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:07:09.368521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"24'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.216954+0000","last_change":"2024-05-09T05:53:23.127219+0000","last_active":"2024-05-09T05:53:29.216954+0000","last_peered":"2024-05-09T05:53:29.216954+0000","last_clean":"2024-05-09T05:53:29.216954+0000","last_became_active":"2024-05-09T05:53:23.126691+0000","last_became_peered":"2024-05-09T05:53:23.126691+0000","last_unstale":"2024-05-09T05:53:29.216954+0000","last_undegraded":"2024-05-09T05:53:29.216954+0000","last_fullsized":"2024-05-09T05:53:29.216954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:17:26.711941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.329067+0000","last_change":"2024-05-09T05:53:28.191045+0000","last_active":"2024-05-09T05:53:29.329067+0000","last_peered":"2024-05-09T05:53:29.329067+0000","last_clean":"2024-05-09T05:53:29.329067+0000","last_became_active":"2024-05-09T05:53:28.190564+0000","last_became_peered":"2024-05-09T05:53:28.190564+0000","last_unstale":"2024-05-09T05:53:29.329067+0000","last_undegraded":"2024-05-09T05:53:29.329067+0000","last_fullsized":"2024-05-09T05:53:29.329067+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:53:30.541681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.214756+0000","last_change":"2024-05-09T05:53:24.138682+0000","last_active":"2024-05-09T05:53:29.214756+0000","last_peered":"2024-05-09T05:53:29.214756+0000","last_clean":"2024-05-09T05:53:29.214756+0000","last_became_active":"2024-05-09T05:53:24.138417+0000","last_became_peered":"2024-05-09T05:53:24.138417+0000","last_unstale":"2024-05-09T05:53:29.214756+0000","last_undegraded":"2024-05-09T05:53:29.214756+0000","last_fullsized":"2024-05-09T05:53:29.214756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:57:55.403156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.214850+0000","last_change":"2024-05-09T05:53:23.102986+0000","last_active":"2024-05-09T05:53:29.214850+0000","last_peered":"2024-05-09T05:53:29.214850+0000","last_clean":"2024-05-09T05:53:29.214850+0000","last_became_active":"2024-05-09T05:53:23.102020+0000","last_became_peered":"2024-05-09T05:53:23.102020+0000","last_unstale":"2024-05-09T05:53:29.214850+0000","last_undegraded":"2024-05-09T05:53:29.214850+0000","last_fullsized":"2024-05-09T05:53:29.214850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:18:11.582575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.213744+0000","last_change":"2024-05-09T05:53:28.218326+0000","last_active":"2024-05-09T05:53:29.213744+0000","last_peered":"2024-05-09T05:53:29.213744+0000","last_clean":"2024-05-09T05:53:29.213744+0000","last_became_active":"2024-05-09T05:53:28.216634+0000","last_became_peered":"2024-05-09T05:53:28.216634+0000","last_unstale":"2024-05-09T05:53:29.213744+0000","last_undegraded":"2024-05-09T05:53:29.213744+0000","last_fullsized":"2024-05-09T05:53:29.213744+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:13:05.321932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.698266+0000","last_change":"2024-05-09T05:53:24.143161+0000","last_active":"2024-05-09T05:53:29.698266+0000","last_peered":"2024-05-09T05:53:29.698266+0000","last_clean":"2024-05-09T05:53:29.698266+0000","last_became_active":"2024-05-09T05:53:24.139369+0000","last_became_peered":"2024-05-09T05:53:24.139369+0000","last_unstale":"2024-05-09T05:53:29.698266+0000","last_undegraded":"2024-05-09T05:53:29.698266+0000","last_fullsized":"2024-05-09T05:53:29.698266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:25:21.472460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.216290+0000","last_change":"2024-05-09T05:53:23.123560+0000","last_active":"2024-05-09T05:53:29.216290+0000","last_peered":"2024-05-09T05:53:29.216290+0000","last_clean":"2024-05-09T05:53:29.216290+0000","last_became_active":"2024-05-09T05:53:23.123081+0000","last_became_peered":"2024-05-09T05:53:23.123081+0000","last_unstale":"2024-05-09T05:53:29.216290+0000","last_undegraded":"2024-05-09T05:53:29.216290+0000","last_fullsized":"2024-05-09T05:53:29.216290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:15:31.371756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.695946+0000","last_change":"2024-05-09T05:53:28.229352+0000","last_active":"2024-05-09T05:53:29.695946+0000","last_peered":"2024-05-09T05:53:29.695946+0000","last_clean":"2024-05-09T05:53:29.695946+0000","last_became_active":"2024-05-09T05:53:28.225810+0000","last_became_peered":"2024-05-09T05:53:28.225810+0000","last_unstale":"2024-05-09T05:53:29.695946+0000","last_undegraded":"2024-05-09T05:53:29.695946+0000","last_fullsized":"2024-05-09T05:53:29.695946+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:17:07.192105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.329438+0000","last_change":"2024-05-09T05:53:24.130533+0000","last_active":"2024-05-09T05:53:29.329438+0000","last_peered":"2024-05-09T05:53:29.329438+0000","last_clean":"2024-05-09T05:53:29.329438+0000","last_became_active":"2024-05-09T05:53:24.129787+0000","last_became_peered":"2024-05-09T05:53:24.129787+0000","last_unstale":"2024-05-09T05:53:29.329438+0000","last_undegraded":"2024-05-09T05:53:29.329438+0000","last_fullsized":"2024-05-09T05:53:29.329438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:37:36.036271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.698698+0000","last_change":"2024-05-09T05:53:23.134379+0000","last_active":"2024-05-09T05:53:29.698698+0000","last_peered":"2024-05-09T05:53:29.698698+0000","last_clean":"2024-05-09T05:53:29.698698+0000","last_became_active":"2024-05-09T05:53:23.133587+0000","last_became_peered":"2024-05-09T05:53:23.133587+0000","last_unstale":"2024-05-09T05:53:29.698698+0000","last_undegraded":"2024-05-09T05:53:29.698698+0000","last_fullsized":"2024-05-09T05:53:29.698698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:00:33.973787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.695393+0000","last_change":"2024-05-09T05:53:28.233620+0000","last_active":"2024-05-09T05:53:29.695393+0000","last_peered":"2024-05-09T05:53:29.695393+0000","last_clean":"2024-05-09T05:53:29.695393+0000","last_became_active":"2024-05-09T05:53:28.232539+0000","last_became_peered":"2024-05-09T05:53:28.232539+0000","last_unstale":"2024-05-09T05:53:29.695393+0000","last_undegraded":"2024-05-09T05:53:29.695393+0000","last_fullsized":"2024-05-09T05:53:29.695393+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:13.789448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.519002+0000","last_change":"2024-05-09T05:53:24.132702+0000","last_active":"2024-05-09T05:53:29.519002+0000","last_peered":"2024-05-09T05:53:29.519002+0000","last_clean":"2024-05-09T05:53:29.519002+0000","last_became_active":"2024-05-09T05:53:24.132309+0000","last_became_peered":"2024-05-09T05:53:24.132309+0000","last_unstale":"2024-05-09T05:53:29.519002+0000","last_undegraded":"2024-05-09T05:53:29.519002+0000","last_fullsized":"2024-05-09T05:53:29.519002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:53:13.592038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.214038+0000","last_change":"2024-05-09T05:53:23.120384+0000","last_active":"2024-05-09T05:53:29.214038+0000","last_peered":"2024-05-09T05:53:29.214038+0000","last_clean":"2024-05-09T05:53:29.214038+0000","last_became_active":"2024-05-09T05:53:23.118321+0000","last_became_peered":"2024-05-09T05:53:23.118321+0000","last_unstale":"2024-05-09T05:53:29.214038+0000","last_undegraded":"2024-05-09T05:53:29.214038+0000","last_fullsized":"2024-05-09T05:53:29.214038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:15:51.297111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.697961+0000","last_change":"2024-05-09T05:53:28.208383+0000","last_active":"2024-05-09T05:53:29.697961+0000","last_peered":"2024-05-09T05:53:29.697961+0000","last_clean":"2024-05-09T05:53:29.697961+0000","last_became_active":"2024-05-09T05:53:28.199359+0000","last_became_peered":"2024-05-09T05:53:28.199359+0000","last_unstale":"2024-05-09T05:53:29.697961+0000","last_undegraded":"2024-05-09T05:53:29.697961+0000","last_fullsized":"2024-05-09T05:53:29.697961+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:50:19.715242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.696850+0000","last_change":"2024-05-09T05:53:24.142740+0000","last_active":"2024-05-09T05:53:29.696850+0000","last_peered":"2024-05-09T05:53:29.696850+0000","last_clean":"2024-05-09T05:53:29.696850+0000","last_became_active":"2024-05-09T05:53:24.142265+0000","last_became_peered":"2024-05-09T05:53:24.142265+0000","last_unstale":"2024-05-09T05:53:29.696850+0000","last_undegraded":"2024-05-09T05:53:29.696850+0000","last_fullsized":"2024-05-09T05:53:29.696850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:46:53.729151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.696611+0000","last_change":"2024-05-09T05:53:23.142455+0000","last_active":"2024-05-09T05:53:29.696611+0000","last_peered":"2024-05-09T05:53:29.696611+0000","last_clean":"2024-05-09T05:53:29.696611+0000","last_became_active":"2024-05-09T05:53:23.141770+0000","last_became_peered":"2024-05-09T05:53:23.141770+0000","last_unstale":"2024-05-09T05:53:29.696611+0000","last_undegraded":"2024-05-09T05:53:29.696611+0000","last_fullsized":"2024-05-09T05:53:29.696611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:30:34.301349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.697220+0000","last_change":"2024-05-09T05:53:28.212176+0000","last_active":"2024-05-09T05:53:29.697220+0000","last_peered":"2024-05-09T05:53:29.697220+0000","last_clean":"2024-05-09T05:53:29.697220+0000","last_became_active":"2024-05-09T05:53:28.210981+0000","last_became_peered":"2024-05-09T05:53:28.210981+0000","last_unstale":"2024-05-09T05:53:29.697220+0000","last_undegraded":"2024-05-09T05:53:29.697220+0000","last_fullsized":"2024-05-09T05:53:29.697220+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:17:24.122805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.698671+0000","last_change":"2024-05-09T05:53:24.132887+0000","last_active":"2024-05-09T05:53:29.698671+0000","last_peered":"2024-05-09T05:53:29.698671+0000","last_clean":"2024-05-09T05:53:29.698671+0000","last_became_active":"2024-05-09T05:53:24.132398+0000","last_became_peered":"2024-05-09T05:53:24.132398+0000","last_unstale":"2024-05-09T05:53:29.698671+0000","last_undegraded":"2024-05-09T05:53:29.698671+0000","last_fullsized":"2024-05-09T05:53:29.698671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:36:49.369162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.213025+0000","last_change":"2024-05-09T05:53:23.126202+0000","last_active":"2024-05-09T05:53:29.213025+0000","last_peered":"2024-05-09T05:53:29.213025+0000","last_clean":"2024-05-09T05:53:29.213025+0000","last_became_active":"2024-05-09T05:53:23.125799+0000","last_became_peered":"2024-05-09T05:53:23.125799+0000","last_unstale":"2024-05-09T05:53:29.213025+0000","last_undegraded":"2024-05-09T05:53:29.213025+0000","last_fullsized":"2024-05-09T05:53:29.213025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:33:12.831705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.698065+0000","last_change":"2024-05-09T05:53:28.241997+0000","last_active":"2024-05-09T05:53:29.698065+0000","last_peered":"2024-05-09T05:53:29.698065+0000","last_clean":"2024-05-09T05:53:29.698065+0000","last_became_active":"2024-05-09T05:53:28.240989+0000","last_became_peered":"2024-05-09T05:53:28.240989+0000","last_unstale":"2024-05-09T05:53:29.698065+0000","last_undegraded":"2024-05-09T05:53:29.698065+0000","last_fullsized":"2024-05-09T05:53:29.698065+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:24:16.820771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.213186+0000","last_change":"2024-05-09T05:53:24.139586+0000","last_active":"2024-05-09T05:53:29.213186+0000","last_peered":"2024-05-09T05:53:29.213186+0000","last_clean":"2024-05-09T05:53:29.213186+0000","last_became_active":"2024-05-09T05:53:24.138835+0000","last_became_peered":"2024-05-09T05:53:24.138835+0000","last_unstale":"2024-05-09T05:53:29.213186+0000","last_undegraded":"2024-05-09T05:53:29.213186+0000","last_fullsized":"2024-05-09T05:53:29.213186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:37:13.012588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.215708+0000","last_change":"2024-05-09T05:53:23.117121+0000","last_active":"2024-05-09T05:53:29.215708+0000","last_peered":"2024-05-09T05:53:29.215708+0000","last_clean":"2024-05-09T05:53:29.215708+0000","last_became_active":"2024-05-09T05:53:23.113294+0000","last_became_peered":"2024-05-09T05:53:23.113294+0000","last_unstale":"2024-05-09T05:53:29.215708+0000","last_undegraded":"2024-05-09T05:53:29.215708+0000","last_fullsized":"2024-05-09T05:53:29.215708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:53:41.591371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":117,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.210326+0000","last_change":"2024-05-09T05:53:12.484358+0000","last_active":"2024-05-09T05:53:29.210326+0000","last_peered":"2024-05-09T05:53:29.210326+0000","last_clean":"2024-05-09T05:53:29.210326+0000","last_became_active":"2024-05-09T05:53:12.481529+0000","last_became_peered":"2024-05-09T05:53:12.481529+0000","last_unstale":"2024-05-09T05:53:29.210326+0000","last_undegraded":"2024-05-09T05:53:29.210326+0000","last_fullsized":"2024-05-09T05:53:29.210326+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:10.902489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:10.902489+0000","last_clean_scrub_stamp":"2024-05-09T05:53:10.902489+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:28:50.650299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.215635+0000","last_change":"2024-05-09T05:53:28.190861+0000","last_active":"2024-05-09T05:53:29.215635+0000","last_peered":"2024-05-09T05:53:29.215635+0000","last_clean":"2024-05-09T05:53:29.215635+0000","last_became_active":"2024-05-09T05:53:28.190393+0000","last_became_peered":"2024-05-09T05:53:28.190393+0000","last_unstale":"2024-05-09T05:53:29.215635+0000","last_undegraded":"2024-05-09T05:53:29.215635+0000","last_fullsized":"2024-05-09T05:53:29.215635+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:05:37.653010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.215187+0000","last_change":"2024-05-09T05:53:24.143283+0000","last_active":"2024-05-09T05:53:29.215187+0000","last_peered":"2024-05-09T05:53:29.215187+0000","last_clean":"2024-05-09T05:53:29.215187+0000","last_became_active":"2024-05-09T05:53:24.139813+0000","last_became_peered":"2024-05-09T05:53:24.139813+0000","last_unstale":"2024-05-09T05:53:29.215187+0000","last_undegraded":"2024-05-09T05:53:29.215187+0000","last_fullsized":"2024-05-09T05:53:29.215187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:07:38.471778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.698418+0000","last_change":"2024-05-09T05:53:23.115534+0000","last_active":"2024-05-09T05:53:29.698418+0000","last_peered":"2024-05-09T05:53:29.698418+0000","last_clean":"2024-05-09T05:53:29.698418+0000","last_became_active":"2024-05-09T05:53:23.112260+0000","last_became_peered":"2024-05-09T05:53:23.112260+0000","last_unstale":"2024-05-09T05:53:29.698418+0000","last_undegraded":"2024-05-09T05:53:29.698418+0000","last_fullsized":"2024-05-09T05:53:29.698418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:46:53.520691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.330364+0000","last_change":"2024-05-09T05:53:28.195687+0000","last_active":"2024-05-09T05:53:29.330364+0000","last_peered":"2024-05-09T05:53:29.330364+0000","last_clean":"2024-05-09T05:53:29.330364+0000","last_became_active":"2024-05-09T05:53:28.195082+0000","last_became_peered":"2024-05-09T05:53:28.195082+0000","last_unstale":"2024-05-09T05:53:29.330364+0000","last_undegraded":"2024-05-09T05:53:29.330364+0000","last_fullsized":"2024-05-09T05:53:29.330364+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:45:56.633547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.519045+0000","last_change":"2024-05-09T05:53:24.130460+0000","last_active":"2024-05-09T05:53:29.519045+0000","last_peered":"2024-05-09T05:53:29.519045+0000","last_clean":"2024-05-09T05:53:29.519045+0000","last_became_active":"2024-05-09T05:53:24.129808+0000","last_became_peered":"2024-05-09T05:53:24.129808+0000","last_unstale":"2024-05-09T05:53:29.519045+0000","last_undegraded":"2024-05-09T05:53:29.519045+0000","last_fullsized":"2024-05-09T05:53:29.519045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:36:04.881676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.698264+0000","last_change":"2024-05-09T05:53:23.139063+0000","last_active":"2024-05-09T05:53:29.698264+0000","last_peered":"2024-05-09T05:53:29.698264+0000","last_clean":"2024-05-09T05:53:29.698264+0000","last_became_active":"2024-05-09T05:53:23.138303+0000","last_became_peered":"2024-05-09T05:53:23.138303+0000","last_unstale":"2024-05-09T05:53:29.698264+0000","last_undegraded":"2024-05-09T05:53:29.698264+0000","last_fullsized":"2024-05-09T05:53:29.698264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:18:20.172877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.696725+0000","last_change":"2024-05-09T05:53:28.214251+0000","last_active":"2024-05-09T05:53:29.696725+0000","last_peered":"2024-05-09T05:53:29.696725+0000","last_clean":"2024-05-09T05:53:29.696725+0000","last_became_active":"2024-05-09T05:53:28.206229+0000","last_became_peered":"2024-05-09T05:53:28.206229+0000","last_unstale":"2024-05-09T05:53:29.696725+0000","last_undegraded":"2024-05-09T05:53:29.696725+0000","last_fullsized":"2024-05-09T05:53:29.696725+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:12:26.761543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.519894+0000","last_change":"2024-05-09T05:53:24.135578+0000","last_active":"2024-05-09T05:53:29.519894+0000","last_peered":"2024-05-09T05:53:29.519894+0000","last_clean":"2024-05-09T05:53:29.519894+0000","last_became_active":"2024-05-09T05:53:24.135253+0000","last_became_peered":"2024-05-09T05:53:24.135253+0000","last_unstale":"2024-05-09T05:53:29.519894+0000","last_undegraded":"2024-05-09T05:53:29.519894+0000","last_fullsized":"2024-05-09T05:53:29.519894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:20:23.093397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.214436+0000","last_change":"2024-05-09T05:53:23.140175+0000","last_active":"2024-05-09T05:53:29.214436+0000","last_peered":"2024-05-09T05:53:29.214436+0000","last_clean":"2024-05-09T05:53:29.214436+0000","last_became_active":"2024-05-09T05:53:23.139516+0000","last_became_peered":"2024-05-09T05:53:23.139516+0000","last_unstale":"2024-05-09T05:53:29.214436+0000","last_undegraded":"2024-05-09T05:53:29.214436+0000","last_fullsized":"2024-05-09T05:53:29.214436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:48:42.473155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.212056+0000","last_change":"2024-05-09T05:53:28.199385+0000","last_active":"2024-05-09T05:53:29.212056+0000","last_peered":"2024-05-09T05:53:29.212056+0000","last_clean":"2024-05-09T05:53:29.212056+0000","last_became_active":"2024-05-09T05:53:28.198825+0000","last_became_peered":"2024-05-09T05:53:28.198825+0000","last_unstale":"2024-05-09T05:53:29.212056+0000","last_undegraded":"2024-05-09T05:53:29.212056+0000","last_fullsized":"2024-05-09T05:53:29.212056+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:48:22.224140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.330189+0000","last_change":"2024-05-09T05:53:24.133293+0000","last_active":"2024-05-09T05:53:29.330189+0000","last_peered":"2024-05-09T05:53:29.330189+0000","last_clean":"2024-05-09T05:53:29.330189+0000","last_became_active":"2024-05-09T05:53:24.131741+0000","last_became_peered":"2024-05-09T05:53:24.131741+0000","last_unstale":"2024-05-09T05:53:29.330189+0000","last_undegraded":"2024-05-09T05:53:29.330189+0000","last_fullsized":"2024-05-09T05:53:29.330189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:01:33.701742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.520045+0000","last_change":"2024-05-09T05:53:23.112592+0000","last_active":"2024-05-09T05:53:29.520045+0000","last_peered":"2024-05-09T05:53:29.520045+0000","last_clean":"2024-05-09T05:53:29.520045+0000","last_became_active":"2024-05-09T05:53:23.111968+0000","last_became_peered":"2024-05-09T05:53:23.111968+0000","last_unstale":"2024-05-09T05:53:29.520045+0000","last_undegraded":"2024-05-09T05:53:29.520045+0000","last_fullsized":"2024-05-09T05:53:29.520045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:32:54.694588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.210561+0000","last_change":"2024-05-09T05:53:28.227755+0000","last_active":"2024-05-09T05:53:29.210561+0000","last_peered":"2024-05-09T05:53:29.210561+0000","last_clean":"2024-05-09T05:53:29.210561+0000","last_became_active":"2024-05-09T05:53:28.227272+0000","last_became_peered":"2024-05-09T05:53:28.227272+0000","last_unstale":"2024-05-09T05:53:29.210561+0000","last_undegraded":"2024-05-09T05:53:29.210561+0000","last_fullsized":"2024-05-09T05:53:29.210561+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:13:32.020862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.212986+0000","last_change":"2024-05-09T05:53:24.144025+0000","last_active":"2024-05-09T05:53:29.212986+0000","last_peered":"2024-05-09T05:53:29.212986+0000","last_clean":"2024-05-09T05:53:29.212986+0000","last_became_active":"2024-05-09T05:53:24.143540+0000","last_became_peered":"2024-05-09T05:53:24.143540+0000","last_unstale":"2024-05-09T05:53:29.212986+0000","last_undegraded":"2024-05-09T05:53:29.212986+0000","last_fullsized":"2024-05-09T05:53:29.212986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:22:58.062541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"24'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.213687+0000","last_change":"2024-05-09T05:53:23.104452+0000","last_active":"2024-05-09T05:53:29.213687+0000","last_peered":"2024-05-09T05:53:29.213687+0000","last_clean":"2024-05-09T05:53:29.213687+0000","last_became_active":"2024-05-09T05:53:23.103471+0000","last_became_peered":"2024-05-09T05:53:23.103471+0000","last_unstale":"2024-05-09T05:53:29.213687+0000","last_undegraded":"2024-05-09T05:53:29.213687+0000","last_fullsized":"2024-05-09T05:53:29.213687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:33:30.508464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.698789+0000","last_change":"2024-05-09T05:53:28.241338+0000","last_active":"2024-05-09T05:53:29.698789+0000","last_peered":"2024-05-09T05:53:29.698789+0000","last_clean":"2024-05-09T05:53:29.698789+0000","last_became_active":"2024-05-09T05:53:28.239841+0000","last_became_peered":"2024-05-09T05:53:28.239841+0000","last_unstale":"2024-05-09T05:53:29.698789+0000","last_undegraded":"2024-05-09T05:53:29.698789+0000","last_fullsized":"2024-05-09T05:53:29.698789+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:44:47.854598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.210371+0000","last_change":"2024-05-09T05:53:24.149958+0000","last_active":"2024-05-09T05:53:29.210371+0000","last_peered":"2024-05-09T05:53:29.210371+0000","last_clean":"2024-05-09T05:53:29.210371+0000","last_became_active":"2024-05-09T05:53:24.149578+0000","last_became_peered":"2024-05-09T05:53:24.149578+0000","last_unstale":"2024-05-09T05:53:29.210371+0000","last_undegraded":"2024-05-09T05:53:29.210371+0000","last_fullsized":"2024-05-09T05:53:29.210371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:27:43.555218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.518385+0000","last_change":"2024-05-09T05:53:23.121266+0000","last_active":"2024-05-09T05:53:29.518385+0000","last_peered":"2024-05-09T05:53:29.518385+0000","last_clean":"2024-05-09T05:53:29.518385+0000","last_became_active":"2024-05-09T05:53:23.120857+0000","last_became_peered":"2024-05-09T05:53:23.120857+0000","last_unstale":"2024-05-09T05:53:29.518385+0000","last_undegraded":"2024-05-09T05:53:29.518385+0000","last_fullsized":"2024-05-09T05:53:29.518385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:03:30.185640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.698426+0000","last_change":"2024-05-09T05:53:28.240774+0000","last_active":"2024-05-09T05:53:29.698426+0000","last_peered":"2024-05-09T05:53:29.698426+0000","last_clean":"2024-05-09T05:53:29.698426+0000","last_became_active":"2024-05-09T05:53:28.240070+0000","last_became_peered":"2024-05-09T05:53:28.240070+0000","last_unstale":"2024-05-09T05:53:29.698426+0000","last_undegraded":"2024-05-09T05:53:29.698426+0000","last_fullsized":"2024-05-09T05:53:29.698426+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:25:24.019344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.214869+0000","last_change":"2024-05-09T05:53:24.132792+0000","last_active":"2024-05-09T05:53:29.214869+0000","last_peered":"2024-05-09T05:53:29.214869+0000","last_clean":"2024-05-09T05:53:29.214869+0000","last_became_active":"2024-05-09T05:53:24.132439+0000","last_became_peered":"2024-05-09T05:53:24.132439+0000","last_unstale":"2024-05-09T05:53:29.214869+0000","last_undegraded":"2024-05-09T05:53:29.214869+0000","last_fullsized":"2024-05-09T05:53:29.214869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:52:45.857475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.213818+0000","last_change":"2024-05-09T05:53:23.120680+0000","last_active":"2024-05-09T05:53:29.213818+0000","last_peered":"2024-05-09T05:53:29.213818+0000","last_clean":"2024-05-09T05:53:29.213818+0000","last_became_active":"2024-05-09T05:53:23.118358+0000","last_became_peered":"2024-05-09T05:53:23.118358+0000","last_unstale":"2024-05-09T05:53:29.213818+0000","last_undegraded":"2024-05-09T05:53:29.213818+0000","last_fullsized":"2024-05-09T05:53:29.213818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:52:52.360128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.697847+0000","last_change":"2024-05-09T05:53:28.222341+0000","last_active":"2024-05-09T05:53:29.697847+0000","last_peered":"2024-05-09T05:53:29.697847+0000","last_clean":"2024-05-09T05:53:29.697847+0000","last_became_active":"2024-05-09T05:53:28.219636+0000","last_became_peered":"2024-05-09T05:53:28.219636+0000","last_unstale":"2024-05-09T05:53:29.697847+0000","last_undegraded":"2024-05-09T05:53:29.697847+0000","last_fullsized":"2024-05-09T05:53:29.697847+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:29:03.459851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.696019+0000","last_change":"2024-05-09T05:53:24.143495+0000","last_active":"2024-05-09T05:53:29.696019+0000","last_peered":"2024-05-09T05:53:29.696019+0000","last_clean":"2024-05-09T05:53:29.696019+0000","last_became_active":"2024-05-09T05:53:24.143181+0000","last_became_peered":"2024-05-09T05:53:24.143181+0000","last_unstale":"2024-05-09T05:53:29.696019+0000","last_undegraded":"2024-05-09T05:53:29.696019+0000","last_fullsized":"2024-05-09T05:53:29.696019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:40:20.997659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"24'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.698981+0000","last_change":"2024-05-09T05:53:23.114815+0000","last_active":"2024-05-09T05:53:29.698981+0000","last_peered":"2024-05-09T05:53:29.698981+0000","last_clean":"2024-05-09T05:53:29.698981+0000","last_became_active":"2024-05-09T05:53:23.113524+0000","last_became_peered":"2024-05-09T05:53:23.113524+0000","last_unstale":"2024-05-09T05:53:29.698981+0000","last_undegraded":"2024-05-09T05:53:29.698981+0000","last_fullsized":"2024-05-09T05:53:29.698981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:35:45.537715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.216033+0000","last_change":"2024-05-09T05:53:28.226682+0000","last_active":"2024-05-09T05:53:29.216033+0000","last_peered":"2024-05-09T05:53:29.216033+0000","last_clean":"2024-05-09T05:53:29.216033+0000","last_became_active":"2024-05-09T05:53:28.226279+0000","last_became_peered":"2024-05-09T05:53:28.226279+0000","last_unstale":"2024-05-09T05:53:29.216033+0000","last_undegraded":"2024-05-09T05:53:29.216033+0000","last_fullsized":"2024-05-09T05:53:29.216033+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:15:55.146695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.519441+0000","last_change":"2024-05-09T05:53:24.135119+0000","last_active":"2024-05-09T05:53:29.519441+0000","last_peered":"2024-05-09T05:53:29.519441+0000","last_clean":"2024-05-09T05:53:29.519441+0000","last_became_active":"2024-05-09T05:53:24.134690+0000","last_became_peered":"2024-05-09T05:53:24.134690+0000","last_unstale":"2024-05-09T05:53:29.519441+0000","last_undegraded":"2024-05-09T05:53:29.519441+0000","last_fullsized":"2024-05-09T05:53:29.519441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:15:36.608441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:38.739048+0000","last_change":"2024-05-09T05:53:23.119626+0000","last_active":"2024-05-09T05:53:38.739048+0000","last_peered":"2024-05-09T05:53:38.739048+0000","last_clean":"2024-05-09T05:53:38.739048+0000","last_became_active":"2024-05-09T05:53:23.119173+0000","last_became_peered":"2024-05-09T05:53:23.119173+0000","last_unstale":"2024-05-09T05:53:38.739048+0000","last_undegraded":"2024-05-09T05:53:38.739048+0000","last_fullsized":"2024-05-09T05:53:38.739048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:24:03.188897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.213285+0000","last_change":"2024-05-09T05:53:28.223167+0000","last_active":"2024-05-09T05:53:29.213285+0000","last_peered":"2024-05-09T05:53:29.213285+0000","last_clean":"2024-05-09T05:53:29.213285+0000","last_became_active":"2024-05-09T05:53:28.221846+0000","last_became_peered":"2024-05-09T05:53:28.221846+0000","last_unstale":"2024-05-09T05:53:29.213285+0000","last_undegraded":"2024-05-09T05:53:29.213285+0000","last_fullsized":"2024-05-09T05:53:29.213285+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:47:12.366900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.214789+0000","last_change":"2024-05-09T05:53:24.133007+0000","last_active":"2024-05-09T05:53:29.214789+0000","last_peered":"2024-05-09T05:53:29.214789+0000","last_clean":"2024-05-09T05:53:29.214789+0000","last_became_active":"2024-05-09T05:53:24.132545+0000","last_became_peered":"2024-05-09T05:53:24.132545+0000","last_unstale":"2024-05-09T05:53:29.214789+0000","last_undegraded":"2024-05-09T05:53:29.214789+0000","last_fullsized":"2024-05-09T05:53:29.214789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:10:26.299015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"24'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.697142+0000","last_change":"2024-05-09T05:53:23.121124+0000","last_active":"2024-05-09T05:53:29.697142+0000","last_peered":"2024-05-09T05:53:29.697142+0000","last_clean":"2024-05-09T05:53:29.697142+0000","last_became_active":"2024-05-09T05:53:23.120303+0000","last_became_peered":"2024-05-09T05:53:23.120303+0000","last_unstale":"2024-05-09T05:53:29.697142+0000","last_undegraded":"2024-05-09T05:53:29.697142+0000","last_fullsized":"2024-05-09T05:53:29.697142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:36:49.445673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.329359+0000","last_change":"2024-05-09T05:53:28.188712+0000","last_active":"2024-05-09T05:53:29.329359+0000","last_peered":"2024-05-09T05:53:29.329359+0000","last_clean":"2024-05-09T05:53:29.329359+0000","last_became_active":"2024-05-09T05:53:28.184259+0000","last_became_peered":"2024-05-09T05:53:28.184259+0000","last_unstale":"2024-05-09T05:53:29.329359+0000","last_undegraded":"2024-05-09T05:53:29.329359+0000","last_fullsized":"2024-05-09T05:53:29.329359+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:56:39.668106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.698810+0000","last_change":"2024-05-09T05:53:24.146147+0000","last_active":"2024-05-09T05:53:29.698810+0000","last_peered":"2024-05-09T05:53:29.698810+0000","last_clean":"2024-05-09T05:53:29.698810+0000","last_became_active":"2024-05-09T05:53:24.145704+0000","last_became_peered":"2024-05-09T05:53:24.145704+0000","last_unstale":"2024-05-09T05:53:29.698810+0000","last_undegraded":"2024-05-09T05:53:29.698810+0000","last_fullsized":"2024-05-09T05:53:29.698810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:47:03.047479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.519380+0000","last_change":"2024-05-09T05:53:23.095689+0000","last_active":"2024-05-09T05:53:29.519380+0000","last_peered":"2024-05-09T05:53:29.519380+0000","last_clean":"2024-05-09T05:53:29.519380+0000","last_became_active":"2024-05-09T05:53:23.094889+0000","last_became_peered":"2024-05-09T05:53:23.094889+0000","last_unstale":"2024-05-09T05:53:29.519380+0000","last_undegraded":"2024-05-09T05:53:29.519380+0000","last_fullsized":"2024-05-09T05:53:29.519380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:25:35.069184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.694877+0000","last_change":"2024-05-09T05:53:28.223954+0000","last_active":"2024-05-09T05:53:29.694877+0000","last_peered":"2024-05-09T05:53:29.694877+0000","last_clean":"2024-05-09T05:53:29.694877+0000","last_became_active":"2024-05-09T05:53:28.222700+0000","last_became_peered":"2024-05-09T05:53:28.222700+0000","last_unstale":"2024-05-09T05:53:29.694877+0000","last_undegraded":"2024-05-09T05:53:29.694877+0000","last_fullsized":"2024-05-09T05:53:29.694877+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:17:17.864782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.330144+0000","last_change":"2024-05-09T05:53:24.140698+0000","last_active":"2024-05-09T05:53:29.330144+0000","last_peered":"2024-05-09T05:53:29.330144+0000","last_clean":"2024-05-09T05:53:29.330144+0000","last_became_active":"2024-05-09T05:53:24.139612+0000","last_became_peered":"2024-05-09T05:53:24.139612+0000","last_unstale":"2024-05-09T05:53:29.330144+0000","last_undegraded":"2024-05-09T05:53:29.330144+0000","last_fullsized":"2024-05-09T05:53:29.330144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:09:39.609750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.215436+0000","last_change":"2024-05-09T05:53:23.106167+0000","last_active":"2024-05-09T05:53:29.215436+0000","last_peered":"2024-05-09T05:53:29.215436+0000","last_clean":"2024-05-09T05:53:29.215436+0000","last_became_active":"2024-05-09T05:53:23.105346+0000","last_became_peered":"2024-05-09T05:53:23.105346+0000","last_unstale":"2024-05-09T05:53:29.215436+0000","last_undegraded":"2024-05-09T05:53:29.215436+0000","last_fullsized":"2024-05-09T05:53:29.215436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:06:46.109056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.213366+0000","last_change":"2024-05-09T05:53:28.194037+0000","last_active":"2024-05-09T05:53:29.213366+0000","last_peered":"2024-05-09T05:53:29.213366+0000","last_clean":"2024-05-09T05:53:29.213366+0000","last_became_active":"2024-05-09T05:53:28.192944+0000","last_became_peered":"2024-05-09T05:53:28.192944+0000","last_unstale":"2024-05-09T05:53:29.213366+0000","last_undegraded":"2024-05-09T05:53:29.213366+0000","last_fullsized":"2024-05-09T05:53:29.213366+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:28:47.664198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.214534+0000","last_change":"2024-05-09T05:53:28.226664+0000","last_active":"2024-05-09T05:53:29.214534+0000","last_peered":"2024-05-09T05:53:29.214534+0000","last_clean":"2024-05-09T05:53:29.214534+0000","last_became_active":"2024-05-09T05:53:28.222225+0000","last_became_peered":"2024-05-09T05:53:28.222225+0000","last_unstale":"2024-05-09T05:53:29.214534+0000","last_undegraded":"2024-05-09T05:53:29.214534+0000","last_fullsized":"2024-05-09T05:53:29.214534+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:24:23.614210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.213172+0000","last_change":"2024-05-09T05:53:24.128343+0000","last_active":"2024-05-09T05:53:29.213172+0000","last_peered":"2024-05-09T05:53:29.213172+0000","last_clean":"2024-05-09T05:53:29.213172+0000","last_became_active":"2024-05-09T05:53:24.127989+0000","last_became_peered":"2024-05-09T05:53:24.127989+0000","last_unstale":"2024-05-09T05:53:29.213172+0000","last_undegraded":"2024-05-09T05:53:29.213172+0000","last_fullsized":"2024-05-09T05:53:29.213172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:56:14.176175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.212772+0000","last_change":"2024-05-09T05:53:23.118882+0000","last_active":"2024-05-09T05:53:29.212772+0000","last_peered":"2024-05-09T05:53:29.212772+0000","last_clean":"2024-05-09T05:53:29.212772+0000","last_became_active":"2024-05-09T05:53:23.118119+0000","last_became_peered":"2024-05-09T05:53:23.118119+0000","last_unstale":"2024-05-09T05:53:29.212772+0000","last_undegraded":"2024-05-09T05:53:29.212772+0000","last_fullsized":"2024-05-09T05:53:29.212772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:06:48.203396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.215588+0000","last_change":"2024-05-09T05:53:28.235313+0000","last_active":"2024-05-09T05:53:29.215588+0000","last_peered":"2024-05-09T05:53:29.215588+0000","last_clean":"2024-05-09T05:53:29.215588+0000","last_became_active":"2024-05-09T05:53:28.234771+0000","last_became_peered":"2024-05-09T05:53:28.234771+0000","last_unstale":"2024-05-09T05:53:29.215588+0000","last_undegraded":"2024-05-09T05:53:29.215588+0000","last_fullsized":"2024-05-09T05:53:29.215588+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:38:46.942863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.697143+0000","last_change":"2024-05-09T05:53:24.141956+0000","last_active":"2024-05-09T05:53:29.697143+0000","last_peered":"2024-05-09T05:53:29.697143+0000","last_clean":"2024-05-09T05:53:29.697143+0000","last_became_active":"2024-05-09T05:53:24.139093+0000","last_became_peered":"2024-05-09T05:53:24.139093+0000","last_unstale":"2024-05-09T05:53:29.697143+0000","last_undegraded":"2024-05-09T05:53:29.697143+0000","last_fullsized":"2024-05-09T05:53:29.697143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:44:32.901168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.698890+0000","last_change":"2024-05-09T05:53:23.113865+0000","last_active":"2024-05-09T05:53:29.698890+0000","last_peered":"2024-05-09T05:53:29.698890+0000","last_clean":"2024-05-09T05:53:29.698890+0000","last_became_active":"2024-05-09T05:53:23.112020+0000","last_became_peered":"2024-05-09T05:53:23.112020+0000","last_unstale":"2024-05-09T05:53:29.698890+0000","last_undegraded":"2024-05-09T05:53:29.698890+0000","last_fullsized":"2024-05-09T05:53:29.698890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:37:04.425229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"24'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.213736+0000","last_change":"2024-05-09T05:53:23.127463+0000","last_active":"2024-05-09T05:53:29.213736+0000","last_peered":"2024-05-09T05:53:29.213736+0000","last_clean":"2024-05-09T05:53:29.213736+0000","last_became_active":"2024-05-09T05:53:23.126911+0000","last_became_peered":"2024-05-09T05:53:23.126911+0000","last_unstale":"2024-05-09T05:53:29.213736+0000","last_undegraded":"2024-05-09T05:53:29.213736+0000","last_fullsized":"2024-05-09T05:53:29.213736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:06:28.458926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.213862+0000","last_change":"2024-05-09T05:53:24.134391+0000","last_active":"2024-05-09T05:53:29.213862+0000","last_peered":"2024-05-09T05:53:29.213862+0000","last_clean":"2024-05-09T05:53:29.213862+0000","last_became_active":"2024-05-09T05:53:24.133994+0000","last_became_peered":"2024-05-09T05:53:24.133994+0000","last_unstale":"2024-05-09T05:53:29.213862+0000","last_undegraded":"2024-05-09T05:53:29.213862+0000","last_fullsized":"2024-05-09T05:53:29.213862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:30:32.872657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.213741+0000","last_change":"2024-05-09T05:53:28.223524+0000","last_active":"2024-05-09T05:53:29.213741+0000","last_peered":"2024-05-09T05:53:29.213741+0000","last_clean":"2024-05-09T05:53:29.213741+0000","last_became_active":"2024-05-09T05:53:28.222433+0000","last_became_peered":"2024-05-09T05:53:28.222433+0000","last_unstale":"2024-05-09T05:53:29.213741+0000","last_undegraded":"2024-05-09T05:53:29.213741+0000","last_fullsized":"2024-05-09T05:53:29.213741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:52:35.361812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"24'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.697023+0000","last_change":"2024-05-09T05:53:23.133700+0000","last_active":"2024-05-09T05:53:29.697023+0000","last_peered":"2024-05-09T05:53:29.697023+0000","last_clean":"2024-05-09T05:53:29.697023+0000","last_became_active":"2024-05-09T05:53:23.132946+0000","last_became_peered":"2024-05-09T05:53:23.132946+0000","last_unstale":"2024-05-09T05:53:29.697023+0000","last_undegraded":"2024-05-09T05:53:29.697023+0000","last_fullsized":"2024-05-09T05:53:29.697023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:39:49.829592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.210913+0000","last_change":"2024-05-09T05:53:24.138174+0000","last_active":"2024-05-09T05:53:29.210913+0000","last_peered":"2024-05-09T05:53:29.210913+0000","last_clean":"2024-05-09T05:53:29.210913+0000","last_became_active":"2024-05-09T05:53:24.137794+0000","last_became_peered":"2024-05-09T05:53:24.137794+0000","last_unstale":"2024-05-09T05:53:29.210913+0000","last_undegraded":"2024-05-09T05:53:29.210913+0000","last_fullsized":"2024-05-09T05:53:29.210913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:57:26.359258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.696516+0000","last_change":"2024-05-09T05:53:28.238375+0000","last_active":"2024-05-09T05:53:29.696516+0000","last_peered":"2024-05-09T05:53:29.696516+0000","last_clean":"2024-05-09T05:53:29.696516+0000","last_became_active":"2024-05-09T05:53:28.237414+0000","last_became_peered":"2024-05-09T05:53:28.237414+0000","last_unstale":"2024-05-09T05:53:29.696516+0000","last_undegraded":"2024-05-09T05:53:29.696516+0000","last_fullsized":"2024-05-09T05:53:29.696516+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:13:50.396951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.329027+0000","last_change":"2024-05-09T05:53:24.130839+0000","last_active":"2024-05-09T05:53:29.329027+0000","last_peered":"2024-05-09T05:53:29.329027+0000","last_clean":"2024-05-09T05:53:29.329027+0000","last_became_active":"2024-05-09T05:53:24.130201+0000","last_became_peered":"2024-05-09T05:53:24.130201+0000","last_unstale":"2024-05-09T05:53:29.329027+0000","last_undegraded":"2024-05-09T05:53:29.329027+0000","last_fullsized":"2024-05-09T05:53:29.329027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:26:03.973553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.696321+0000","last_change":"2024-05-09T05:53:24.138681+0000","last_active":"2024-05-09T05:53:29.696321+0000","last_peered":"2024-05-09T05:53:29.696321+0000","last_clean":"2024-05-09T05:53:29.696321+0000","last_became_active":"2024-05-09T05:53:24.138366+0000","last_became_peered":"2024-05-09T05:53:24.138366+0000","last_unstale":"2024-05-09T05:53:29.696321+0000","last_undegraded":"2024-05-09T05:53:29.696321+0000","last_fullsized":"2024-05-09T05:53:29.696321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:49.856205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.213330+0000","last_change":"2024-05-09T05:53:24.139915+0000","last_active":"2024-05-09T05:53:29.213330+0000","last_peered":"2024-05-09T05:53:29.213330+0000","last_clean":"2024-05-09T05:53:29.213330+0000","last_became_active":"2024-05-09T05:53:24.139058+0000","last_became_peered":"2024-05-09T05:53:24.139058+0000","last_unstale":"2024-05-09T05:53:29.213330+0000","last_undegraded":"2024-05-09T05:53:29.213330+0000","last_fullsized":"2024-05-09T05:53:29.213330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:06:00.768431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.696712+0000","last_change":"2024-05-09T05:53:24.149759+0000","last_active":"2024-05-09T05:53:29.696712+0000","last_peered":"2024-05-09T05:53:29.696712+0000","last_clean":"2024-05-09T05:53:29.696712+0000","last_became_active":"2024-05-09T05:53:24.142812+0000","last_became_peered":"2024-05-09T05:53:24.142812+0000","last_unstale":"2024-05-09T05:53:29.696712+0000","last_undegraded":"2024-05-09T05:53:29.696712+0000","last_fullsized":"2024-05-09T05:53:29.696712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:04.522514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.698128+0000","last_change":"2024-05-09T05:53:24.135373+0000","last_active":"2024-05-09T05:53:29.698128+0000","last_peered":"2024-05-09T05:53:29.698128+0000","last_clean":"2024-05-09T05:53:29.698128+0000","last_became_active":"2024-05-09T05:53:24.135043+0000","last_became_peered":"2024-05-09T05:53:24.135043+0000","last_unstale":"2024-05-09T05:53:29.698128+0000","last_undegraded":"2024-05-09T05:53:29.698128+0000","last_fullsized":"2024-05-09T05:53:29.698128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:20:03.245696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.696921+0000","last_change":"2024-05-09T05:53:24.134712+0000","last_active":"2024-05-09T05:53:29.696921+0000","last_peered":"2024-05-09T05:53:29.696921+0000","last_clean":"2024-05-09T05:53:29.696921+0000","last_became_active":"2024-05-09T05:53:24.132453+0000","last_became_peered":"2024-05-09T05:53:24.132453+0000","last_unstale":"2024-05-09T05:53:29.696921+0000","last_undegraded":"2024-05-09T05:53:29.696921+0000","last_fullsized":"2024-05-09T05:53:29.696921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:47:30.716995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.330002+0000","last_change":"2024-05-09T05:53:24.140714+0000","last_active":"2024-05-09T05:53:29.330002+0000","last_peered":"2024-05-09T05:53:29.330002+0000","last_clean":"2024-05-09T05:53:29.330002+0000","last_became_active":"2024-05-09T05:53:24.140045+0000","last_became_peered":"2024-05-09T05:53:24.140045+0000","last_unstale":"2024-05-09T05:53:29.330002+0000","last_undegraded":"2024-05-09T05:53:29.330002+0000","last_fullsized":"2024-05-09T05:53:29.330002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:36:06.166411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.697852+0000","last_change":"2024-05-09T05:53:24.151591+0000","last_active":"2024-05-09T05:53:29.697852+0000","last_peered":"2024-05-09T05:53:29.697852+0000","last_clean":"2024-05-09T05:53:29.697852+0000","last_became_active":"2024-05-09T05:53:24.151275+0000","last_became_peered":"2024-05-09T05:53:24.151275+0000","last_unstale":"2024-05-09T05:53:29.697852+0000","last_undegraded":"2024-05-09T05:53:29.697852+0000","last_fullsized":"2024-05-09T05:53:29.697852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:28:28.552732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.212703+0000","last_change":"2024-05-09T05:53:24.144315+0000","last_active":"2024-05-09T05:53:29.212703+0000","last_peered":"2024-05-09T05:53:29.212703+0000","last_clean":"2024-05-09T05:53:29.212703+0000","last_became_active":"2024-05-09T05:53:24.144005+0000","last_became_peered":"2024-05-09T05:53:24.144005+0000","last_unstale":"2024-05-09T05:53:29.212703+0000","last_undegraded":"2024-05-09T05:53:29.212703+0000","last_fullsized":"2024-05-09T05:53:29.212703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:06:37.312541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.697839+0000","last_change":"2024-05-09T05:53:24.149852+0000","last_active":"2024-05-09T05:53:29.697839+0000","last_peered":"2024-05-09T05:53:29.697839+0000","last_clean":"2024-05-09T05:53:29.697839+0000","last_became_active":"2024-05-09T05:53:24.146965+0000","last_became_peered":"2024-05-09T05:53:24.146965+0000","last_unstale":"2024-05-09T05:53:29.697839+0000","last_undegraded":"2024-05-09T05:53:29.697839+0000","last_fullsized":"2024-05-09T05:53:29.697839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:02:26.991425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.210907+0000","last_change":"2024-05-09T05:53:24.131735+0000","last_active":"2024-05-09T05:53:29.210907+0000","last_peered":"2024-05-09T05:53:29.210907+0000","last_clean":"2024-05-09T05:53:29.210907+0000","last_became_active":"2024-05-09T05:53:24.131417+0000","last_became_peered":"2024-05-09T05:53:24.131417+0000","last_unstale":"2024-05-09T05:53:29.210907+0000","last_undegraded":"2024-05-09T05:53:29.210907+0000","last_fullsized":"2024-05-09T05:53:29.210907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:59.750972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.213503+0000","last_change":"2024-05-09T05:53:24.140697+0000","last_active":"2024-05-09T05:53:29.213503+0000","last_peered":"2024-05-09T05:53:29.213503+0000","last_clean":"2024-05-09T05:53:29.213503+0000","last_became_active":"2024-05-09T05:53:24.140024+0000","last_became_peered":"2024-05-09T05:53:24.140024+0000","last_unstale":"2024-05-09T05:53:29.213503+0000","last_undegraded":"2024-05-09T05:53:29.213503+0000","last_fullsized":"2024-05-09T05:53:29.213503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:14:14.543827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.519088+0000","last_change":"2024-05-09T05:53:24.136878+0000","last_active":"2024-05-09T05:53:29.519088+0000","last_peered":"2024-05-09T05:53:29.519088+0000","last_clean":"2024-05-09T05:53:29.519088+0000","last_became_active":"2024-05-09T05:53:24.136572+0000","last_became_peered":"2024-05-09T05:53:24.136572+0000","last_unstale":"2024-05-09T05:53:29.519088+0000","last_undegraded":"2024-05-09T05:53:29.519088+0000","last_fullsized":"2024-05-09T05:53:29.519088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:46:47.509355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.216011+0000","last_change":"2024-05-09T05:53:24.147372+0000","last_active":"2024-05-09T05:53:29.216011+0000","last_peered":"2024-05-09T05:53:29.216011+0000","last_clean":"2024-05-09T05:53:29.216011+0000","last_became_active":"2024-05-09T05:53:24.144573+0000","last_became_peered":"2024-05-09T05:53:24.144573+0000","last_unstale":"2024-05-09T05:53:29.216011+0000","last_undegraded":"2024-05-09T05:53:29.216011+0000","last_fullsized":"2024-05-09T05:53:29.216011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:51:09.845748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.698543+0000","last_change":"2024-05-09T05:53:24.135964+0000","last_active":"2024-05-09T05:53:29.698543+0000","last_peered":"2024-05-09T05:53:29.698543+0000","last_clean":"2024-05-09T05:53:29.698543+0000","last_became_active":"2024-05-09T05:53:24.135625+0000","last_became_peered":"2024-05-09T05:53:24.135625+0000","last_unstale":"2024-05-09T05:53:29.698543+0000","last_undegraded":"2024-05-09T05:53:29.698543+0000","last_fullsized":"2024-05-09T05:53:29.698543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:52:02.026146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.216721+0000","last_change":"2024-05-09T05:53:24.133916+0000","last_active":"2024-05-09T05:53:29.216721+0000","last_peered":"2024-05-09T05:53:29.216721+0000","last_clean":"2024-05-09T05:53:29.216721+0000","last_became_active":"2024-05-09T05:53:24.133405+0000","last_became_peered":"2024-05-09T05:53:24.133405+0000","last_unstale":"2024-05-09T05:53:29.216721+0000","last_undegraded":"2024-05-09T05:53:29.216721+0000","last_fullsized":"2024-05-09T05:53:29.216721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:30:16.477715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.212403+0000","last_change":"2024-05-09T05:53:24.139697+0000","last_active":"2024-05-09T05:53:29.212403+0000","last_peered":"2024-05-09T05:53:29.212403+0000","last_clean":"2024-05-09T05:53:29.212403+0000","last_became_active":"2024-05-09T05:53:24.139374+0000","last_became_peered":"2024-05-09T05:53:24.139374+0000","last_unstale":"2024-05-09T05:53:29.212403+0000","last_undegraded":"2024-05-09T05:53:29.212403+0000","last_fullsized":"2024-05-09T05:53:29.212403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:26:28.502867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.697314+0000","last_change":"2024-05-09T05:53:24.147755+0000","last_active":"2024-05-09T05:53:29.697314+0000","last_peered":"2024-05-09T05:53:29.697314+0000","last_clean":"2024-05-09T05:53:29.697314+0000","last_became_active":"2024-05-09T05:53:24.145616+0000","last_became_peered":"2024-05-09T05:53:24.145616+0000","last_unstale":"2024-05-09T05:53:29.697314+0000","last_undegraded":"2024-05-09T05:53:29.697314+0000","last_fullsized":"2024-05-09T05:53:29.697314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:21:10.387393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.695743+0000","last_change":"2024-05-09T05:53:24.131741+0000","last_active":"2024-05-09T05:53:29.695743+0000","last_peered":"2024-05-09T05:53:29.695743+0000","last_clean":"2024-05-09T05:53:29.695743+0000","last_became_active":"2024-05-09T05:53:24.128870+0000","last_became_peered":"2024-05-09T05:53:24.128870+0000","last_unstale":"2024-05-09T05:53:29.695743+0000","last_undegraded":"2024-05-09T05:53:29.695743+0000","last_fullsized":"2024-05-09T05:53:29.695743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:28:25.103524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.696503+0000","last_change":"2024-05-09T05:53:24.133443+0000","last_active":"2024-05-09T05:53:29.696503+0000","last_peered":"2024-05-09T05:53:29.696503+0000","last_clean":"2024-05-09T05:53:29.696503+0000","last_became_active":"2024-05-09T05:53:24.132688+0000","last_became_peered":"2024-05-09T05:53:24.132688+0000","last_unstale":"2024-05-09T05:53:29.696503+0000","last_undegraded":"2024-05-09T05:53:29.696503+0000","last_fullsized":"2024-05-09T05:53:29.696503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:43:24.750805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.518884+0000","last_change":"2024-05-09T05:53:24.142600+0000","last_active":"2024-05-09T05:53:29.518884+0000","last_peered":"2024-05-09T05:53:29.518884+0000","last_clean":"2024-05-09T05:53:29.518884+0000","last_became_active":"2024-05-09T05:53:24.142280+0000","last_became_peered":"2024-05-09T05:53:24.142280+0000","last_unstale":"2024-05-09T05:53:29.518884+0000","last_undegraded":"2024-05-09T05:53:29.518884+0000","last_fullsized":"2024-05-09T05:53:29.518884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:20:58.962379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.519367+0000","last_change":"2024-05-09T05:53:24.144839+0000","last_active":"2024-05-09T05:53:29.519367+0000","last_peered":"2024-05-09T05:53:29.519367+0000","last_clean":"2024-05-09T05:53:29.519367+0000","last_became_active":"2024-05-09T05:53:24.144381+0000","last_became_peered":"2024-05-09T05:53:24.144381+0000","last_unstale":"2024-05-09T05:53:29.519367+0000","last_undegraded":"2024-05-09T05:53:29.519367+0000","last_fullsized":"2024-05-09T05:53:29.519367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:40:46.738053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.519277+0000","last_change":"2024-05-09T05:53:24.131521+0000","last_active":"2024-05-09T05:53:29.519277+0000","last_peered":"2024-05-09T05:53:29.519277+0000","last_clean":"2024-05-09T05:53:29.519277+0000","last_became_active":"2024-05-09T05:53:24.131218+0000","last_became_peered":"2024-05-09T05:53:24.131218+0000","last_unstale":"2024-05-09T05:53:29.519277+0000","last_undegraded":"2024-05-09T05:53:29.519277+0000","last_fullsized":"2024-05-09T05:53:29.519277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:25:59.410270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.215388+0000","last_change":"2024-05-09T05:53:24.139922+0000","last_active":"2024-05-09T05:53:29.215388+0000","last_peered":"2024-05-09T05:53:29.215388+0000","last_clean":"2024-05-09T05:53:29.215388+0000","last_became_active":"2024-05-09T05:53:24.139473+0000","last_became_peered":"2024-05-09T05:53:24.139473+0000","last_unstale":"2024-05-09T05:53:29.215388+0000","last_undegraded":"2024-05-09T05:53:29.215388+0000","last_fullsized":"2024-05-09T05:53:29.215388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:37:50.839899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.696349+0000","last_change":"2024-05-09T05:53:24.143338+0000","last_active":"2024-05-09T05:53:29.696349+0000","last_peered":"2024-05-09T05:53:29.696349+0000","last_clean":"2024-05-09T05:53:29.696349+0000","last_became_active":"2024-05-09T05:53:24.143053+0000","last_became_peered":"2024-05-09T05:53:24.143053+0000","last_unstale":"2024-05-09T05:53:29.696349+0000","last_undegraded":"2024-05-09T05:53:29.696349+0000","last_fullsized":"2024-05-09T05:53:29.696349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:22:16.337090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.518199+0000","last_change":"2024-05-09T05:53:24.145517+0000","last_active":"2024-05-09T05:53:29.518199+0000","last_peered":"2024-05-09T05:53:29.518199+0000","last_clean":"2024-05-09T05:53:29.518199+0000","last_became_active":"2024-05-09T05:53:24.145150+0000","last_became_peered":"2024-05-09T05:53:24.145150+0000","last_unstale":"2024-05-09T05:53:29.518199+0000","last_undegraded":"2024-05-09T05:53:29.518199+0000","last_fullsized":"2024-05-09T05:53:29.518199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:19:53.947349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.330681+0000","last_change":"2024-05-09T05:53:24.129669+0000","last_active":"2024-05-09T05:53:29.330681+0000","last_peered":"2024-05-09T05:53:29.330681+0000","last_clean":"2024-05-09T05:53:29.330681+0000","last_became_active":"2024-05-09T05:53:24.129339+0000","last_became_peered":"2024-05-09T05:53:24.129339+0000","last_unstale":"2024-05-09T05:53:29.330681+0000","last_undegraded":"2024-05-09T05:53:29.330681+0000","last_fullsized":"2024-05-09T05:53:29.330681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:05:51.845643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.518947+0000","last_change":"2024-05-09T05:53:24.138914+0000","last_active":"2024-05-09T05:53:29.518947+0000","last_peered":"2024-05-09T05:53:29.518947+0000","last_clean":"2024-05-09T05:53:29.518947+0000","last_became_active":"2024-05-09T05:53:24.138499+0000","last_became_peered":"2024-05-09T05:53:24.138499+0000","last_unstale":"2024-05-09T05:53:29.518947+0000","last_undegraded":"2024-05-09T05:53:29.518947+0000","last_fullsized":"2024-05-09T05:53:29.518947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:29:00.338046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.329427+0000","last_change":"2024-05-09T05:53:24.144296+0000","last_active":"2024-05-09T05:53:29.329427+0000","last_peered":"2024-05-09T05:53:29.329427+0000","last_clean":"2024-05-09T05:53:29.329427+0000","last_became_active":"2024-05-09T05:53:24.143890+0000","last_became_peered":"2024-05-09T05:53:24.143890+0000","last_unstale":"2024-05-09T05:53:29.329427+0000","last_undegraded":"2024-05-09T05:53:29.329427+0000","last_fullsized":"2024-05-09T05:53:29.329427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:34:56.860849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.697600+0000","last_change":"2024-05-09T05:53:24.152635+0000","last_active":"2024-05-09T05:53:29.697600+0000","last_peered":"2024-05-09T05:53:29.697600+0000","last_clean":"2024-05-09T05:53:29.697600+0000","last_became_active":"2024-05-09T05:53:24.151674+0000","last_became_peered":"2024-05-09T05:53:24.151674+0000","last_unstale":"2024-05-09T05:53:29.697600+0000","last_undegraded":"2024-05-09T05:53:29.697600+0000","last_fullsized":"2024-05-09T05:53:29.697600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:18:47.495857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.698463+0000","last_change":"2024-05-09T05:53:24.152746+0000","last_active":"2024-05-09T05:53:29.698463+0000","last_peered":"2024-05-09T05:53:29.698463+0000","last_clean":"2024-05-09T05:53:29.698463+0000","last_became_active":"2024-05-09T05:53:24.151418+0000","last_became_peered":"2024-05-09T05:53:24.151418+0000","last_unstale":"2024-05-09T05:53:29.698463+0000","last_undegraded":"2024-05-09T05:53:29.698463+0000","last_fullsized":"2024-05-09T05:53:29.698463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:27:19.121790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.519905+0000","last_change":"2024-05-09T05:53:24.140908+0000","last_active":"2024-05-09T05:53:29.519905+0000","last_peered":"2024-05-09T05:53:29.519905+0000","last_clean":"2024-05-09T05:53:29.519905+0000","last_became_active":"2024-05-09T05:53:24.140589+0000","last_became_peered":"2024-05-09T05:53:24.140589+0000","last_unstale":"2024-05-09T05:53:29.519905+0000","last_undegraded":"2024-05-09T05:53:29.519905+0000","last_fullsized":"2024-05-09T05:53:29.519905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:51:03.458547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":266240,"data_stored":101907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509451,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":258048,"data_stored":101783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509451,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":278528,"data_stored":106297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":270336,"data_stored":105625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":856064,"data_stored":692221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":101839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32020,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339820,"statfs":{"total":96636764160,"available":96603975680,"internally_reserved":0,"allocated":860160,"data_stored":692243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":102365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T05:53:51.698 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T05:53:51.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.891+0000 7f3f832f9640 1 Processor -- start 2024-05-09T05:53:51.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.891+0000 7f3f832f9640 1 -- start start 2024-05-09T05:53:51.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.891+0000 7f3f832f9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3f7c0c77a0 0x7f3f7c1537d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:51.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.891+0000 7f3f832f9640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3f7c161d70 0x7f3f7c164190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:51.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.891+0000 7f3f832f9640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f7c0c72c0 con 0x7f3f7c074740 2024-05-09T05:53:51.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.891+0000 7f3f832f9640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f3f7c0c7bb0 con 0x7f3f7c161d70 2024-05-09T05:53:51.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.891+0000 7f3f832f9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f3f7c074460 con 0x7f3f7c0c77a0 2024-05-09T05:53:51.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.891+0000 7f3f81896640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3f7c161d70 0x7f3f7c164190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:51.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.891+0000 7f3f81896640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3f7c161d70 0x7f3f7c164190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46438/0 (socket says 172.21.15.72:46438) 2024-05-09T05:53:51.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.891+0000 7f3f81896640 1 -- 172.21.15.72:0/2009964104 learned_addr learned my addr 172.21.15.72:0/2009964104 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:51.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.891+0000 7f3f81095640 1 --2- 172.21.15.72:0/2009964104 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3f7c0c77a0 0x7f3f7c1537d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:51.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.891+0000 7f3f81896640 1 -- 172.21.15.72:0/2009964104 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3f7c0c77a0 msgr2=0x7f3f7c1537d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:51.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.891+0000 7f3f81896640 1 --2- 172.21.15.72:0/2009964104 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3f7c0c77a0 0x7f3f7c1537d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:51.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.891+0000 7f3f81896640 1 -- 172.21.15.72:0/2009964104 >> v1:172.21.15.110:6789/0 conn(0x7f3f7c074740 legacy=0x7f3f7c072e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:51.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.891+0000 7f3f81896640 1 -- 172.21.15.72:0/2009964104 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f7c073af0 con 0x7f3f7c161d70 2024-05-09T05:53:51.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.891+0000 7f3f81095640 1 --2- 172.21.15.72:0/2009964104 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3f7c0c77a0 0x7f3f7c1537d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:53:51.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.895+0000 7f3f81896640 1 --2- 172.21.15.72:0/2009964104 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f7c161d70 0x7f3f7c164190 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3f74009870 tx=0x7f3f7401c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39b7838097578325 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:51.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.895+0000 7f3f7bfff640 1 -- 172.21.15.72:0/2009964104 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f740a9610 con 0x7f3f7c161d70 2024-05-09T05:53:51.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.895+0000 7f3f7bfff640 1 -- 172.21.15.72:0/2009964104 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f740a97b0 con 0x7f3f7c161d70 2024-05-09T05:53:51.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.895+0000 7f3f7bfff640 1 -- 172.21.15.72:0/2009964104 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f740a9b80 con 0x7f3f7c161d70 2024-05-09T05:53:51.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.895+0000 7f3f832f9640 1 -- 172.21.15.72:0/2009964104 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f7c161d70 msgr2=0x7f3f7c164190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:51.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.895+0000 7f3f832f9640 1 --2- 172.21.15.72:0/2009964104 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f7c161d70 0x7f3f7c164190 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3f74009870 tx=0x7f3f7401c530 comp rx=0 tx=0).stop 2024-05-09T05:53:51.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.895+0000 7f3f832f9640 1 -- 172.21.15.72:0/2009964104 shutdown_connections 2024-05-09T05:53:51.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.895+0000 7f3f832f9640 1 --2- 172.21.15.72:0/2009964104 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f7c161d70 0x7f3f7c164190 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:51.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.895+0000 7f3f832f9640 1 --2- 172.21.15.72:0/2009964104 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3f7c0c77a0 0x7f3f7c1537d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:51.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.895+0000 7f3f832f9640 1 -- 172.21.15.72:0/2009964104 >> 172.21.15.72:0/2009964104 conn(0x7f3f7c0cde90 msgr2=0x7f3f7c0ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:51.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.895+0000 7f3f832f9640 1 -- 172.21.15.72:0/2009964104 shutdown_connections 2024-05-09T05:53:51.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.895+0000 7f3f832f9640 1 -- 172.21.15.72:0/2009964104 wait complete. 2024-05-09T05:53:51.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.899+0000 7f3f832f9640 1 Processor -- start 2024-05-09T05:53:51.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.899+0000 7f3f832f9640 1 -- start start 2024-05-09T05:53:51.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.899+0000 7f3f832f9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3f7c074740 0x7f3f7c14c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:51.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.899+0000 7f3f832f9640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f7c0c77a0 0x7f3f7c149e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:51.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.899+0000 7f3f832f9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f7c161d70 0x7f3f7c14ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:51.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.899+0000 7f3f832f9640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f3f7c0c4cb0 con 0x7f3f7c0c77a0 2024-05-09T05:53:51.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.899+0000 7f3f832f9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f3f7c072940 con 0x7f3f7c161d70 2024-05-09T05:53:51.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.899+0000 7f3f832f9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f3f7c0c4e30 con 0x7f3f7c074740 2024-05-09T05:53:51.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.899+0000 7f3f80894640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f7c0c77a0 0x7f3f7c149e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:51.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.899+0000 7f3f80894640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f7c0c77a0 0x7f3f7c149e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46442/0 (socket says 172.21.15.72:46442) 2024-05-09T05:53:51.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.899+0000 7f3f80894640 1 -- 172.21.15.72:0/2979428005 learned_addr learned my addr 172.21.15.72:0/2979428005 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:51.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.899+0000 7f3f80894640 1 -- 172.21.15.72:0/2979428005 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3f7c074740 msgr2=0x7f3f7c14c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:51.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.899+0000 7f3f80894640 1 --2- 172.21.15.72:0/2979428005 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3f7c074740 0x7f3f7c14c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:51.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.899+0000 7f3f80894640 1 -- 172.21.15.72:0/2979428005 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f7c161d70 msgr2=0x7f3f7c14ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:51.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.899+0000 7f3f81896640 1 --2- 172.21.15.72:0/2979428005 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f7c161d70 0x7f3f7c14ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:51.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.899+0000 7f3f80894640 1 --2- 172.21.15.72:0/2979428005 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f7c161d70 0x7f3f7c14ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:51.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.899+0000 7f3f80894640 1 -- 172.21.15.72:0/2979428005 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f7c152d50 con 0x7f3f7c0c77a0 2024-05-09T05:53:51.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.899+0000 7f3f80894640 1 --2- 172.21.15.72:0/2979428005 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f7c0c77a0 0x7f3f7c149e80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3f7000c390 tx=0x7f3f7000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:51.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.899+0000 7f3f79ffb640 1 -- 172.21.15.72:0/2979428005 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f700052d0 con 0x7f3f7c0c77a0 2024-05-09T05:53:51.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.899+0000 7f3f79ffb640 1 -- 172.21.15.72:0/2979428005 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f70005490 con 0x7f3f7c0c77a0 2024-05-09T05:53:51.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.899+0000 7f3f79ffb640 1 -- 172.21.15.72:0/2979428005 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f70007240 con 0x7f3f7c0c77a0 2024-05-09T05:53:51.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.899+0000 7f3f832f9640 1 -- 172.21.15.72:0/2979428005 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f7c149ba0 con 0x7f3f7c0c77a0 2024-05-09T05:53:51.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.899+0000 7f3f832f9640 1 -- 172.21.15.72:0/2979428005 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f7c14e9c0 con 0x7f3f7c0c77a0 2024-05-09T05:53:51.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.899+0000 7f3f832f9640 1 -- 172.21.15.72:0/2979428005 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f7c06a520 con 0x7f3f7c0c77a0 2024-05-09T05:53:51.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.903+0000 7f3f79ffb640 1 -- 172.21.15.72:0/2979428005 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f3f700073e0 con 0x7f3f7c0c77a0 2024-05-09T05:53:51.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.903+0000 7f3f79ffb640 1 --2- 172.21.15.72:0/2979428005 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f3f6806f400 0x7f3f68071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:51.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.903+0000 7f3f79ffb640 1 -- 172.21.15.72:0/2979428005 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3f7008eaa0 con 0x7f3f7c0c77a0 2024-05-09T05:53:51.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.903+0000 7f3f81095640 1 --2- 172.21.15.72:0/2979428005 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f3f6806f400 0x7f3f68071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:51.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.903+0000 7f3f81095640 1 --2- 172.21.15.72:0/2979428005 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f3f6806f400 0x7f3f68071910 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c0c41c0 tx=0x7f3f6c0094c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:51.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:51.907+0000 7f3f79ffb640 1 -- 172.21.15.72:0/2979428005 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f3f7c152d50 con 0x7f3f7c0c77a0 2024-05-09T05:53:52.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.059+0000 7f3f832f9640 1 -- 172.21.15.72:0/2979428005 --> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3f7c0cac50 con 0x7f3f6806f400 2024-05-09T05:53:52.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.087+0000 7f3f79ffb640 1 -- 172.21.15.72:0/2979428005 <== mgr.4102 v2:172.21.15.110:6832/1113420672 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332519 (secure 0 0 0) 0x7f3f7c0cac50 con 0x7f3f6806f400 2024-05-09T05:53:52.077 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:53:52.081 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2024-05-09T05:53:52.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.091+0000 7f3f832f9640 1 -- 172.21.15.72:0/2979428005 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f3f6806f400 msgr2=0x7f3f68071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:52.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.091+0000 7f3f832f9640 1 --2- 172.21.15.72:0/2979428005 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f3f6806f400 0x7f3f68071910 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c0c41c0 tx=0x7f3f6c0094c0 comp rx=0 tx=0).stop 2024-05-09T05:53:52.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.091+0000 7f3f832f9640 1 -- 172.21.15.72:0/2979428005 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f7c0c77a0 msgr2=0x7f3f7c149e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:52.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.091+0000 7f3f832f9640 1 --2- 172.21.15.72:0/2979428005 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f7c0c77a0 0x7f3f7c149e80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3f7000c390 tx=0x7f3f7000c850 comp rx=0 tx=0).stop 2024-05-09T05:53:52.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.091+0000 7f3f832f9640 1 -- 172.21.15.72:0/2979428005 shutdown_connections 2024-05-09T05:53:52.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.091+0000 7f3f832f9640 1 --2- 172.21.15.72:0/2979428005 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f3f6806f400 0x7f3f68071910 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:52.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.091+0000 7f3f832f9640 1 --2- 172.21.15.72:0/2979428005 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f7c161d70 0x7f3f7c14ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:52.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.091+0000 7f3f832f9640 1 --2- 172.21.15.72:0/2979428005 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f7c0c77a0 0x7f3f7c149e80 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:52.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.091+0000 7f3f832f9640 1 --2- 172.21.15.72:0/2979428005 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3f7c074740 0x7f3f7c14c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:52.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.091+0000 7f3f832f9640 1 -- 172.21.15.72:0/2979428005 >> 172.21.15.72:0/2979428005 conn(0x7f3f7c0cde90 msgr2=0x7f3f7c0c43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:52.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.091+0000 7f3f832f9640 1 -- 172.21.15.72:0/2979428005 shutdown_connections 2024-05-09T05:53:52.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.091+0000 7f3f832f9640 1 -- 172.21.15.72:0/2979428005 wait complete. 2024-05-09T05:53:52.099 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2024-05-09T05:53:50.471606+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236056,"kb_used_data":3240,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738664,"statfs":{"total":773094113280,"available":772852391936,"internally_reserved":0,"allocated":3317760,"data_stored":2004280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006385"},"pg_stats":[{"pgid":"2.1f","version":"24'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.214757+0000","last_change":"2024-05-09T05:53:23.121824+0000","last_active":"2024-05-09T05:53:29.214757+0000","last_peered":"2024-05-09T05:53:29.214757+0000","last_clean":"2024-05-09T05:53:29.214757+0000","last_became_active":"2024-05-09T05:53:23.121097+0000","last_became_peered":"2024-05-09T05:53:23.121097+0000","last_unstale":"2024-05-09T05:53:29.214757+0000","last_undegraded":"2024-05-09T05:53:29.214757+0000","last_fullsized":"2024-05-09T05:53:29.214757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:50:51.880238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.698789+0000","last_change":"2024-05-09T05:53:24.146985+0000","last_active":"2024-05-09T05:53:29.698789+0000","last_peered":"2024-05-09T05:53:29.698789+0000","last_clean":"2024-05-09T05:53:29.698789+0000","last_became_active":"2024-05-09T05:53:24.146540+0000","last_became_peered":"2024-05-09T05:53:24.146540+0000","last_unstale":"2024-05-09T05:53:29.698789+0000","last_undegraded":"2024-05-09T05:53:29.698789+0000","last_fullsized":"2024-05-09T05:53:29.698789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:02:29.318131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.696155+0000","last_change":"2024-05-09T05:53:28.236386+0000","last_active":"2024-05-09T05:53:29.696155+0000","last_peered":"2024-05-09T05:53:29.696155+0000","last_clean":"2024-05-09T05:53:29.696155+0000","last_became_active":"2024-05-09T05:53:28.235305+0000","last_became_peered":"2024-05-09T05:53:28.235305+0000","last_unstale":"2024-05-09T05:53:29.696155+0000","last_undegraded":"2024-05-09T05:53:29.696155+0000","last_fullsized":"2024-05-09T05:53:29.696155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:57:57.134819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.699128+0000","last_change":"2024-05-09T05:53:23.139000+0000","last_active":"2024-05-09T05:53:29.699128+0000","last_peered":"2024-05-09T05:53:29.699128+0000","last_clean":"2024-05-09T05:53:29.699128+0000","last_became_active":"2024-05-09T05:53:23.138431+0000","last_became_peered":"2024-05-09T05:53:23.138431+0000","last_unstale":"2024-05-09T05:53:29.699128+0000","last_undegraded":"2024-05-09T05:53:29.699128+0000","last_fullsized":"2024-05-09T05:53:29.699128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:33:56.977263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.699378+0000","last_change":"2024-05-09T05:53:24.151811+0000","last_active":"2024-05-09T05:53:29.699378+0000","last_peered":"2024-05-09T05:53:29.699378+0000","last_clean":"2024-05-09T05:53:29.699378+0000","last_became_active":"2024-05-09T05:53:24.151407+0000","last_became_peered":"2024-05-09T05:53:24.151407+0000","last_unstale":"2024-05-09T05:53:29.699378+0000","last_undegraded":"2024-05-09T05:53:29.699378+0000","last_fullsized":"2024-05-09T05:53:29.699378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:54:17.819787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.329660+0000","last_change":"2024-05-09T05:53:28.213485+0000","last_active":"2024-05-09T05:53:29.329660+0000","last_peered":"2024-05-09T05:53:29.329660+0000","last_clean":"2024-05-09T05:53:29.329660+0000","last_became_active":"2024-05-09T05:53:28.213021+0000","last_became_peered":"2024-05-09T05:53:28.213021+0000","last_unstale":"2024-05-09T05:53:29.329660+0000","last_undegraded":"2024-05-09T05:53:29.329660+0000","last_fullsized":"2024-05-09T05:53:29.329660+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:58:22.493166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.519704+0000","last_change":"2024-05-09T05:53:23.095209+0000","last_active":"2024-05-09T05:53:29.519704+0000","last_peered":"2024-05-09T05:53:29.519704+0000","last_clean":"2024-05-09T05:53:29.519704+0000","last_became_active":"2024-05-09T05:53:23.094826+0000","last_became_peered":"2024-05-09T05:53:23.094826+0000","last_unstale":"2024-05-09T05:53:29.519704+0000","last_undegraded":"2024-05-09T05:53:29.519704+0000","last_fullsized":"2024-05-09T05:53:29.519704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:38:47.390311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.211795+0000","last_change":"2024-05-09T05:53:24.135281+0000","last_active":"2024-05-09T05:53:29.211795+0000","last_peered":"2024-05-09T05:53:29.211795+0000","last_clean":"2024-05-09T05:53:29.211795+0000","last_became_active":"2024-05-09T05:53:24.134610+0000","last_became_peered":"2024-05-09T05:53:24.134610+0000","last_unstale":"2024-05-09T05:53:29.211795+0000","last_undegraded":"2024-05-09T05:53:29.211795+0000","last_fullsized":"2024-05-09T05:53:29.211795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:28:03.947961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.329917+0000","last_change":"2024-05-09T05:53:28.205763+0000","last_active":"2024-05-09T05:53:29.329917+0000","last_peered":"2024-05-09T05:53:29.329917+0000","last_clean":"2024-05-09T05:53:29.329917+0000","last_became_active":"2024-05-09T05:53:28.205229+0000","last_became_peered":"2024-05-09T05:53:28.205229+0000","last_unstale":"2024-05-09T05:53:29.329917+0000","last_undegraded":"2024-05-09T05:53:29.329917+0000","last_fullsized":"2024-05-09T05:53:29.329917+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:38:51.267769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.519170+0000","last_change":"2024-05-09T05:53:23.097616+0000","last_active":"2024-05-09T05:53:29.519170+0000","last_peered":"2024-05-09T05:53:29.519170+0000","last_clean":"2024-05-09T05:53:29.519170+0000","last_became_active":"2024-05-09T05:53:23.094760+0000","last_became_peered":"2024-05-09T05:53:23.094760+0000","last_unstale":"2024-05-09T05:53:29.519170+0000","last_undegraded":"2024-05-09T05:53:29.519170+0000","last_fullsized":"2024-05-09T05:53:29.519170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:21:32.558852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.214927+0000","last_change":"2024-05-09T05:53:24.139467+0000","last_active":"2024-05-09T05:53:29.214927+0000","last_peered":"2024-05-09T05:53:29.214927+0000","last_clean":"2024-05-09T05:53:29.214927+0000","last_became_active":"2024-05-09T05:53:24.139109+0000","last_became_peered":"2024-05-09T05:53:24.139109+0000","last_unstale":"2024-05-09T05:53:29.214927+0000","last_undegraded":"2024-05-09T05:53:29.214927+0000","last_fullsized":"2024-05-09T05:53:29.214927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:36.783615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.329829+0000","last_change":"2024-05-09T05:53:28.216127+0000","last_active":"2024-05-09T05:53:29.329829+0000","last_peered":"2024-05-09T05:53:29.329829+0000","last_clean":"2024-05-09T05:53:29.329829+0000","last_became_active":"2024-05-09T05:53:28.215482+0000","last_became_peered":"2024-05-09T05:53:28.215482+0000","last_unstale":"2024-05-09T05:53:29.329829+0000","last_undegraded":"2024-05-09T05:53:29.329829+0000","last_fullsized":"2024-05-09T05:53:29.329829+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:48:58.387701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.213472+0000","last_change":"2024-05-09T05:53:24.132483+0000","last_active":"2024-05-09T05:53:29.213472+0000","last_peered":"2024-05-09T05:53:29.213472+0000","last_clean":"2024-05-09T05:53:29.213472+0000","last_became_active":"2024-05-09T05:53:24.132118+0000","last_became_peered":"2024-05-09T05:53:24.132118+0000","last_unstale":"2024-05-09T05:53:29.213472+0000","last_undegraded":"2024-05-09T05:53:29.213472+0000","last_fullsized":"2024-05-09T05:53:29.213472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:06:01.787707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"24'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.215407+0000","last_change":"2024-05-09T05:53:23.117460+0000","last_active":"2024-05-09T05:53:29.215407+0000","last_peered":"2024-05-09T05:53:29.215407+0000","last_clean":"2024-05-09T05:53:29.215407+0000","last_became_active":"2024-05-09T05:53:23.114179+0000","last_became_peered":"2024-05-09T05:53:23.114179+0000","last_unstale":"2024-05-09T05:53:29.215407+0000","last_undegraded":"2024-05-09T05:53:29.215407+0000","last_fullsized":"2024-05-09T05:53:29.215407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:44:01.784905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.214595+0000","last_change":"2024-05-09T05:53:28.227135+0000","last_active":"2024-05-09T05:53:29.214595+0000","last_peered":"2024-05-09T05:53:29.214595+0000","last_clean":"2024-05-09T05:53:29.214595+0000","last_became_active":"2024-05-09T05:53:28.226427+0000","last_became_peered":"2024-05-09T05:53:28.226427+0000","last_unstale":"2024-05-09T05:53:29.214595+0000","last_undegraded":"2024-05-09T05:53:29.214595+0000","last_fullsized":"2024-05-09T05:53:29.214595+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:37:04.413804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.695764+0000","last_change":"2024-05-09T05:53:24.135982+0000","last_active":"2024-05-09T05:53:29.695764+0000","last_peered":"2024-05-09T05:53:29.695764+0000","last_clean":"2024-05-09T05:53:29.695764+0000","last_became_active":"2024-05-09T05:53:24.135580+0000","last_became_peered":"2024-05-09T05:53:24.135580+0000","last_unstale":"2024-05-09T05:53:29.695764+0000","last_undegraded":"2024-05-09T05:53:29.695764+0000","last_fullsized":"2024-05-09T05:53:29.695764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:03:04.589608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.696302+0000","last_change":"2024-05-09T05:53:23.142679+0000","last_active":"2024-05-09T05:53:29.696302+0000","last_peered":"2024-05-09T05:53:29.696302+0000","last_clean":"2024-05-09T05:53:29.696302+0000","last_became_active":"2024-05-09T05:53:23.142018+0000","last_became_peered":"2024-05-09T05:53:23.142018+0000","last_unstale":"2024-05-09T05:53:29.696302+0000","last_undegraded":"2024-05-09T05:53:29.696302+0000","last_fullsized":"2024-05-09T05:53:29.696302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:08:29.312049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.518874+0000","last_change":"2024-05-09T05:53:28.214167+0000","last_active":"2024-05-09T05:53:29.518874+0000","last_peered":"2024-05-09T05:53:29.518874+0000","last_clean":"2024-05-09T05:53:29.518874+0000","last_became_active":"2024-05-09T05:53:28.213623+0000","last_became_peered":"2024-05-09T05:53:28.213623+0000","last_unstale":"2024-05-09T05:53:29.518874+0000","last_undegraded":"2024-05-09T05:53:29.518874+0000","last_fullsized":"2024-05-09T05:53:29.518874+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:53:53.976485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.212618+0000","last_change":"2024-05-09T05:53:24.130342+0000","last_active":"2024-05-09T05:53:29.212618+0000","last_peered":"2024-05-09T05:53:29.212618+0000","last_clean":"2024-05-09T05:53:29.212618+0000","last_became_active":"2024-05-09T05:53:24.129938+0000","last_became_peered":"2024-05-09T05:53:24.129938+0000","last_unstale":"2024-05-09T05:53:29.212618+0000","last_undegraded":"2024-05-09T05:53:29.212618+0000","last_fullsized":"2024-05-09T05:53:29.212618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:58:13.879633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.213484+0000","last_change":"2024-05-09T05:53:23.111169+0000","last_active":"2024-05-09T05:53:29.213484+0000","last_peered":"2024-05-09T05:53:29.213484+0000","last_clean":"2024-05-09T05:53:29.213484+0000","last_became_active":"2024-05-09T05:53:23.110140+0000","last_became_peered":"2024-05-09T05:53:23.110140+0000","last_unstale":"2024-05-09T05:53:29.213484+0000","last_undegraded":"2024-05-09T05:53:29.213484+0000","last_fullsized":"2024-05-09T05:53:29.213484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:18:55.367553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.696432+0000","last_change":"2024-05-09T05:53:28.233648+0000","last_active":"2024-05-09T05:53:29.696432+0000","last_peered":"2024-05-09T05:53:29.696432+0000","last_clean":"2024-05-09T05:53:29.696432+0000","last_became_active":"2024-05-09T05:53:28.227087+0000","last_became_peered":"2024-05-09T05:53:28.227087+0000","last_unstale":"2024-05-09T05:53:29.696432+0000","last_undegraded":"2024-05-09T05:53:29.696432+0000","last_fullsized":"2024-05-09T05:53:29.696432+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:03:49.709580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.213120+0000","last_change":"2024-05-09T05:53:24.147343+0000","last_active":"2024-05-09T05:53:29.213120+0000","last_peered":"2024-05-09T05:53:29.213120+0000","last_clean":"2024-05-09T05:53:29.213120+0000","last_became_active":"2024-05-09T05:53:24.144596+0000","last_became_peered":"2024-05-09T05:53:24.144596+0000","last_unstale":"2024-05-09T05:53:29.213120+0000","last_undegraded":"2024-05-09T05:53:29.213120+0000","last_fullsized":"2024-05-09T05:53:29.213120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:52:43.052055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.517799+0000","last_change":"2024-05-09T05:53:23.102976+0000","last_active":"2024-05-09T05:53:29.517799+0000","last_peered":"2024-05-09T05:53:29.517799+0000","last_clean":"2024-05-09T05:53:29.517799+0000","last_became_active":"2024-05-09T05:53:23.102420+0000","last_became_peered":"2024-05-09T05:53:23.102420+0000","last_unstale":"2024-05-09T05:53:29.517799+0000","last_undegraded":"2024-05-09T05:53:29.517799+0000","last_fullsized":"2024-05-09T05:53:29.517799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:45:11.479140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.329786+0000","last_change":"2024-05-09T05:53:28.195537+0000","last_active":"2024-05-09T05:53:29.329786+0000","last_peered":"2024-05-09T05:53:29.329786+0000","last_clean":"2024-05-09T05:53:29.329786+0000","last_became_active":"2024-05-09T05:53:28.194915+0000","last_became_peered":"2024-05-09T05:53:28.194915+0000","last_unstale":"2024-05-09T05:53:29.329786+0000","last_undegraded":"2024-05-09T05:53:29.329786+0000","last_fullsized":"2024-05-09T05:53:29.329786+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:07.554137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.214059+0000","last_change":"2024-05-09T05:53:24.130312+0000","last_active":"2024-05-09T05:53:29.214059+0000","last_peered":"2024-05-09T05:53:29.214059+0000","last_clean":"2024-05-09T05:53:29.214059+0000","last_became_active":"2024-05-09T05:53:24.129953+0000","last_became_peered":"2024-05-09T05:53:24.129953+0000","last_unstale":"2024-05-09T05:53:29.214059+0000","last_undegraded":"2024-05-09T05:53:29.214059+0000","last_fullsized":"2024-05-09T05:53:29.214059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:07:09.368521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"24'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.216954+0000","last_change":"2024-05-09T05:53:23.127219+0000","last_active":"2024-05-09T05:53:29.216954+0000","last_peered":"2024-05-09T05:53:29.216954+0000","last_clean":"2024-05-09T05:53:29.216954+0000","last_became_active":"2024-05-09T05:53:23.126691+0000","last_became_peered":"2024-05-09T05:53:23.126691+0000","last_unstale":"2024-05-09T05:53:29.216954+0000","last_undegraded":"2024-05-09T05:53:29.216954+0000","last_fullsized":"2024-05-09T05:53:29.216954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:17:26.711941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.329067+0000","last_change":"2024-05-09T05:53:28.191045+0000","last_active":"2024-05-09T05:53:29.329067+0000","last_peered":"2024-05-09T05:53:29.329067+0000","last_clean":"2024-05-09T05:53:29.329067+0000","last_became_active":"2024-05-09T05:53:28.190564+0000","last_became_peered":"2024-05-09T05:53:28.190564+0000","last_unstale":"2024-05-09T05:53:29.329067+0000","last_undegraded":"2024-05-09T05:53:29.329067+0000","last_fullsized":"2024-05-09T05:53:29.329067+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:53:30.541681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.214756+0000","last_change":"2024-05-09T05:53:24.138682+0000","last_active":"2024-05-09T05:53:29.214756+0000","last_peered":"2024-05-09T05:53:29.214756+0000","last_clean":"2024-05-09T05:53:29.214756+0000","last_became_active":"2024-05-09T05:53:24.138417+0000","last_became_peered":"2024-05-09T05:53:24.138417+0000","last_unstale":"2024-05-09T05:53:29.214756+0000","last_undegraded":"2024-05-09T05:53:29.214756+0000","last_fullsized":"2024-05-09T05:53:29.214756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:57:55.403156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.214850+0000","last_change":"2024-05-09T05:53:23.102986+0000","last_active":"2024-05-09T05:53:29.214850+0000","last_peered":"2024-05-09T05:53:29.214850+0000","last_clean":"2024-05-09T05:53:29.214850+0000","last_became_active":"2024-05-09T05:53:23.102020+0000","last_became_peered":"2024-05-09T05:53:23.102020+0000","last_unstale":"2024-05-09T05:53:29.214850+0000","last_undegraded":"2024-05-09T05:53:29.214850+0000","last_fullsized":"2024-05-09T05:53:29.214850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:18:11.582575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.213744+0000","last_change":"2024-05-09T05:53:28.218326+0000","last_active":"2024-05-09T05:53:29.213744+0000","last_peered":"2024-05-09T05:53:29.213744+0000","last_clean":"2024-05-09T05:53:29.213744+0000","last_became_active":"2024-05-09T05:53:28.216634+0000","last_became_peered":"2024-05-09T05:53:28.216634+0000","last_unstale":"2024-05-09T05:53:29.213744+0000","last_undegraded":"2024-05-09T05:53:29.213744+0000","last_fullsized":"2024-05-09T05:53:29.213744+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:13:05.321932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.698266+0000","last_change":"2024-05-09T05:53:24.143161+0000","last_active":"2024-05-09T05:53:29.698266+0000","last_peered":"2024-05-09T05:53:29.698266+0000","last_clean":"2024-05-09T05:53:29.698266+0000","last_became_active":"2024-05-09T05:53:24.139369+0000","last_became_peered":"2024-05-09T05:53:24.139369+0000","last_unstale":"2024-05-09T05:53:29.698266+0000","last_undegraded":"2024-05-09T05:53:29.698266+0000","last_fullsized":"2024-05-09T05:53:29.698266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:25:21.472460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.216290+0000","last_change":"2024-05-09T05:53:23.123560+0000","last_active":"2024-05-09T05:53:29.216290+0000","last_peered":"2024-05-09T05:53:29.216290+0000","last_clean":"2024-05-09T05:53:29.216290+0000","last_became_active":"2024-05-09T05:53:23.123081+0000","last_became_peered":"2024-05-09T05:53:23.123081+0000","last_unstale":"2024-05-09T05:53:29.216290+0000","last_undegraded":"2024-05-09T05:53:29.216290+0000","last_fullsized":"2024-05-09T05:53:29.216290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:15:31.371756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.695946+0000","last_change":"2024-05-09T05:53:28.229352+0000","last_active":"2024-05-09T05:53:29.695946+0000","last_peered":"2024-05-09T05:53:29.695946+0000","last_clean":"2024-05-09T05:53:29.695946+0000","last_became_active":"2024-05-09T05:53:28.225810+0000","last_became_peered":"2024-05-09T05:53:28.225810+0000","last_unstale":"2024-05-09T05:53:29.695946+0000","last_undegraded":"2024-05-09T05:53:29.695946+0000","last_fullsized":"2024-05-09T05:53:29.695946+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:17:07.192105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.329438+0000","last_change":"2024-05-09T05:53:24.130533+0000","last_active":"2024-05-09T05:53:29.329438+0000","last_peered":"2024-05-09T05:53:29.329438+0000","last_clean":"2024-05-09T05:53:29.329438+0000","last_became_active":"2024-05-09T05:53:24.129787+0000","last_became_peered":"2024-05-09T05:53:24.129787+0000","last_unstale":"2024-05-09T05:53:29.329438+0000","last_undegraded":"2024-05-09T05:53:29.329438+0000","last_fullsized":"2024-05-09T05:53:29.329438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:37:36.036271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.698698+0000","last_change":"2024-05-09T05:53:23.134379+0000","last_active":"2024-05-09T05:53:29.698698+0000","last_peered":"2024-05-09T05:53:29.698698+0000","last_clean":"2024-05-09T05:53:29.698698+0000","last_became_active":"2024-05-09T05:53:23.133587+0000","last_became_peered":"2024-05-09T05:53:23.133587+0000","last_unstale":"2024-05-09T05:53:29.698698+0000","last_undegraded":"2024-05-09T05:53:29.698698+0000","last_fullsized":"2024-05-09T05:53:29.698698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:00:33.973787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.695393+0000","last_change":"2024-05-09T05:53:28.233620+0000","last_active":"2024-05-09T05:53:29.695393+0000","last_peered":"2024-05-09T05:53:29.695393+0000","last_clean":"2024-05-09T05:53:29.695393+0000","last_became_active":"2024-05-09T05:53:28.232539+0000","last_became_peered":"2024-05-09T05:53:28.232539+0000","last_unstale":"2024-05-09T05:53:29.695393+0000","last_undegraded":"2024-05-09T05:53:29.695393+0000","last_fullsized":"2024-05-09T05:53:29.695393+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:13.789448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.519002+0000","last_change":"2024-05-09T05:53:24.132702+0000","last_active":"2024-05-09T05:53:29.519002+0000","last_peered":"2024-05-09T05:53:29.519002+0000","last_clean":"2024-05-09T05:53:29.519002+0000","last_became_active":"2024-05-09T05:53:24.132309+0000","last_became_peered":"2024-05-09T05:53:24.132309+0000","last_unstale":"2024-05-09T05:53:29.519002+0000","last_undegraded":"2024-05-09T05:53:29.519002+0000","last_fullsized":"2024-05-09T05:53:29.519002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:53:13.592038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.214038+0000","last_change":"2024-05-09T05:53:23.120384+0000","last_active":"2024-05-09T05:53:29.214038+0000","last_peered":"2024-05-09T05:53:29.214038+0000","last_clean":"2024-05-09T05:53:29.214038+0000","last_became_active":"2024-05-09T05:53:23.118321+0000","last_became_peered":"2024-05-09T05:53:23.118321+0000","last_unstale":"2024-05-09T05:53:29.214038+0000","last_undegraded":"2024-05-09T05:53:29.214038+0000","last_fullsized":"2024-05-09T05:53:29.214038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:15:51.297111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.697961+0000","last_change":"2024-05-09T05:53:28.208383+0000","last_active":"2024-05-09T05:53:29.697961+0000","last_peered":"2024-05-09T05:53:29.697961+0000","last_clean":"2024-05-09T05:53:29.697961+0000","last_became_active":"2024-05-09T05:53:28.199359+0000","last_became_peered":"2024-05-09T05:53:28.199359+0000","last_unstale":"2024-05-09T05:53:29.697961+0000","last_undegraded":"2024-05-09T05:53:29.697961+0000","last_fullsized":"2024-05-09T05:53:29.697961+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:50:19.715242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.696850+0000","last_change":"2024-05-09T05:53:24.142740+0000","last_active":"2024-05-09T05:53:29.696850+0000","last_peered":"2024-05-09T05:53:29.696850+0000","last_clean":"2024-05-09T05:53:29.696850+0000","last_became_active":"2024-05-09T05:53:24.142265+0000","last_became_peered":"2024-05-09T05:53:24.142265+0000","last_unstale":"2024-05-09T05:53:29.696850+0000","last_undegraded":"2024-05-09T05:53:29.696850+0000","last_fullsized":"2024-05-09T05:53:29.696850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:46:53.729151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.696611+0000","last_change":"2024-05-09T05:53:23.142455+0000","last_active":"2024-05-09T05:53:29.696611+0000","last_peered":"2024-05-09T05:53:29.696611+0000","last_clean":"2024-05-09T05:53:29.696611+0000","last_became_active":"2024-05-09T05:53:23.141770+0000","last_became_peered":"2024-05-09T05:53:23.141770+0000","last_unstale":"2024-05-09T05:53:29.696611+0000","last_undegraded":"2024-05-09T05:53:29.696611+0000","last_fullsized":"2024-05-09T05:53:29.696611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:30:34.301349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.697220+0000","last_change":"2024-05-09T05:53:28.212176+0000","last_active":"2024-05-09T05:53:29.697220+0000","last_peered":"2024-05-09T05:53:29.697220+0000","last_clean":"2024-05-09T05:53:29.697220+0000","last_became_active":"2024-05-09T05:53:28.210981+0000","last_became_peered":"2024-05-09T05:53:28.210981+0000","last_unstale":"2024-05-09T05:53:29.697220+0000","last_undegraded":"2024-05-09T05:53:29.697220+0000","last_fullsized":"2024-05-09T05:53:29.697220+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:17:24.122805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.698671+0000","last_change":"2024-05-09T05:53:24.132887+0000","last_active":"2024-05-09T05:53:29.698671+0000","last_peered":"2024-05-09T05:53:29.698671+0000","last_clean":"2024-05-09T05:53:29.698671+0000","last_became_active":"2024-05-09T05:53:24.132398+0000","last_became_peered":"2024-05-09T05:53:24.132398+0000","last_unstale":"2024-05-09T05:53:29.698671+0000","last_undegraded":"2024-05-09T05:53:29.698671+0000","last_fullsized":"2024-05-09T05:53:29.698671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:36:49.369162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.213025+0000","last_change":"2024-05-09T05:53:23.126202+0000","last_active":"2024-05-09T05:53:29.213025+0000","last_peered":"2024-05-09T05:53:29.213025+0000","last_clean":"2024-05-09T05:53:29.213025+0000","last_became_active":"2024-05-09T05:53:23.125799+0000","last_became_peered":"2024-05-09T05:53:23.125799+0000","last_unstale":"2024-05-09T05:53:29.213025+0000","last_undegraded":"2024-05-09T05:53:29.213025+0000","last_fullsized":"2024-05-09T05:53:29.213025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:33:12.831705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.698065+0000","last_change":"2024-05-09T05:53:28.241997+0000","last_active":"2024-05-09T05:53:29.698065+0000","last_peered":"2024-05-09T05:53:29.698065+0000","last_clean":"2024-05-09T05:53:29.698065+0000","last_became_active":"2024-05-09T05:53:28.240989+0000","last_became_peered":"2024-05-09T05:53:28.240989+0000","last_unstale":"2024-05-09T05:53:29.698065+0000","last_undegraded":"2024-05-09T05:53:29.698065+0000","last_fullsized":"2024-05-09T05:53:29.698065+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:24:16.820771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.213186+0000","last_change":"2024-05-09T05:53:24.139586+0000","last_active":"2024-05-09T05:53:29.213186+0000","last_peered":"2024-05-09T05:53:29.213186+0000","last_clean":"2024-05-09T05:53:29.213186+0000","last_became_active":"2024-05-09T05:53:24.138835+0000","last_became_peered":"2024-05-09T05:53:24.138835+0000","last_unstale":"2024-05-09T05:53:29.213186+0000","last_undegraded":"2024-05-09T05:53:29.213186+0000","last_fullsized":"2024-05-09T05:53:29.213186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:37:13.012588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.215708+0000","last_change":"2024-05-09T05:53:23.117121+0000","last_active":"2024-05-09T05:53:29.215708+0000","last_peered":"2024-05-09T05:53:29.215708+0000","last_clean":"2024-05-09T05:53:29.215708+0000","last_became_active":"2024-05-09T05:53:23.113294+0000","last_became_peered":"2024-05-09T05:53:23.113294+0000","last_unstale":"2024-05-09T05:53:29.215708+0000","last_undegraded":"2024-05-09T05:53:29.215708+0000","last_fullsized":"2024-05-09T05:53:29.215708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:53:41.591371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":117,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.210326+0000","last_change":"2024-05-09T05:53:12.484358+0000","last_active":"2024-05-09T05:53:29.210326+0000","last_peered":"2024-05-09T05:53:29.210326+0000","last_clean":"2024-05-09T05:53:29.210326+0000","last_became_active":"2024-05-09T05:53:12.481529+0000","last_became_peered":"2024-05-09T05:53:12.481529+0000","last_unstale":"2024-05-09T05:53:29.210326+0000","last_undegraded":"2024-05-09T05:53:29.210326+0000","last_fullsized":"2024-05-09T05:53:29.210326+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:10.902489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:10.902489+0000","last_clean_scrub_stamp":"2024-05-09T05:53:10.902489+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:28:50.650299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.215635+0000","last_change":"2024-05-09T05:53:28.190861+0000","last_active":"2024-05-09T05:53:29.215635+0000","last_peered":"2024-05-09T05:53:29.215635+0000","last_clean":"2024-05-09T05:53:29.215635+0000","last_became_active":"2024-05-09T05:53:28.190393+0000","last_became_peered":"2024-05-09T05:53:28.190393+0000","last_unstale":"2024-05-09T05:53:29.215635+0000","last_undegraded":"2024-05-09T05:53:29.215635+0000","last_fullsized":"2024-05-09T05:53:29.215635+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:05:37.653010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.215187+0000","last_change":"2024-05-09T05:53:24.143283+0000","last_active":"2024-05-09T05:53:29.215187+0000","last_peered":"2024-05-09T05:53:29.215187+0000","last_clean":"2024-05-09T05:53:29.215187+0000","last_became_active":"2024-05-09T05:53:24.139813+0000","last_became_peered":"2024-05-09T05:53:24.139813+0000","last_unstale":"2024-05-09T05:53:29.215187+0000","last_undegraded":"2024-05-09T05:53:29.215187+0000","last_fullsized":"2024-05-09T05:53:29.215187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:07:38.471778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.698418+0000","last_change":"2024-05-09T05:53:23.115534+0000","last_active":"2024-05-09T05:53:29.698418+0000","last_peered":"2024-05-09T05:53:29.698418+0000","last_clean":"2024-05-09T05:53:29.698418+0000","last_became_active":"2024-05-09T05:53:23.112260+0000","last_became_peered":"2024-05-09T05:53:23.112260+0000","last_unstale":"2024-05-09T05:53:29.698418+0000","last_undegraded":"2024-05-09T05:53:29.698418+0000","last_fullsized":"2024-05-09T05:53:29.698418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:46:53.520691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.330364+0000","last_change":"2024-05-09T05:53:28.195687+0000","last_active":"2024-05-09T05:53:29.330364+0000","last_peered":"2024-05-09T05:53:29.330364+0000","last_clean":"2024-05-09T05:53:29.330364+0000","last_became_active":"2024-05-09T05:53:28.195082+0000","last_became_peered":"2024-05-09T05:53:28.195082+0000","last_unstale":"2024-05-09T05:53:29.330364+0000","last_undegraded":"2024-05-09T05:53:29.330364+0000","last_fullsized":"2024-05-09T05:53:29.330364+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:45:56.633547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.519045+0000","last_change":"2024-05-09T05:53:24.130460+0000","last_active":"2024-05-09T05:53:29.519045+0000","last_peered":"2024-05-09T05:53:29.519045+0000","last_clean":"2024-05-09T05:53:29.519045+0000","last_became_active":"2024-05-09T05:53:24.129808+0000","last_became_peered":"2024-05-09T05:53:24.129808+0000","last_unstale":"2024-05-09T05:53:29.519045+0000","last_undegraded":"2024-05-09T05:53:29.519045+0000","last_fullsized":"2024-05-09T05:53:29.519045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:36:04.881676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.698264+0000","last_change":"2024-05-09T05:53:23.139063+0000","last_active":"2024-05-09T05:53:29.698264+0000","last_peered":"2024-05-09T05:53:29.698264+0000","last_clean":"2024-05-09T05:53:29.698264+0000","last_became_active":"2024-05-09T05:53:23.138303+0000","last_became_peered":"2024-05-09T05:53:23.138303+0000","last_unstale":"2024-05-09T05:53:29.698264+0000","last_undegraded":"2024-05-09T05:53:29.698264+0000","last_fullsized":"2024-05-09T05:53:29.698264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:18:20.172877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.696725+0000","last_change":"2024-05-09T05:53:28.214251+0000","last_active":"2024-05-09T05:53:29.696725+0000","last_peered":"2024-05-09T05:53:29.696725+0000","last_clean":"2024-05-09T05:53:29.696725+0000","last_became_active":"2024-05-09T05:53:28.206229+0000","last_became_peered":"2024-05-09T05:53:28.206229+0000","last_unstale":"2024-05-09T05:53:29.696725+0000","last_undegraded":"2024-05-09T05:53:29.696725+0000","last_fullsized":"2024-05-09T05:53:29.696725+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:12:26.761543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.519894+0000","last_change":"2024-05-09T05:53:24.135578+0000","last_active":"2024-05-09T05:53:29.519894+0000","last_peered":"2024-05-09T05:53:29.519894+0000","last_clean":"2024-05-09T05:53:29.519894+0000","last_became_active":"2024-05-09T05:53:24.135253+0000","last_became_peered":"2024-05-09T05:53:24.135253+0000","last_unstale":"2024-05-09T05:53:29.519894+0000","last_undegraded":"2024-05-09T05:53:29.519894+0000","last_fullsized":"2024-05-09T05:53:29.519894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:20:23.093397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.214436+0000","last_change":"2024-05-09T05:53:23.140175+0000","last_active":"2024-05-09T05:53:29.214436+0000","last_peered":"2024-05-09T05:53:29.214436+0000","last_clean":"2024-05-09T05:53:29.214436+0000","last_became_active":"2024-05-09T05:53:23.139516+0000","last_became_peered":"2024-05-09T05:53:23.139516+0000","last_unstale":"2024-05-09T05:53:29.214436+0000","last_undegraded":"2024-05-09T05:53:29.214436+0000","last_fullsized":"2024-05-09T05:53:29.214436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:48:42.473155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.212056+0000","last_change":"2024-05-09T05:53:28.199385+0000","last_active":"2024-05-09T05:53:29.212056+0000","last_peered":"2024-05-09T05:53:29.212056+0000","last_clean":"2024-05-09T05:53:29.212056+0000","last_became_active":"2024-05-09T05:53:28.198825+0000","last_became_peered":"2024-05-09T05:53:28.198825+0000","last_unstale":"2024-05-09T05:53:29.212056+0000","last_undegraded":"2024-05-09T05:53:29.212056+0000","last_fullsized":"2024-05-09T05:53:29.212056+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:48:22.224140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.330189+0000","last_change":"2024-05-09T05:53:24.133293+0000","last_active":"2024-05-09T05:53:29.330189+0000","last_peered":"2024-05-09T05:53:29.330189+0000","last_clean":"2024-05-09T05:53:29.330189+0000","last_became_active":"2024-05-09T05:53:24.131741+0000","last_became_peered":"2024-05-09T05:53:24.131741+0000","last_unstale":"2024-05-09T05:53:29.330189+0000","last_undegraded":"2024-05-09T05:53:29.330189+0000","last_fullsized":"2024-05-09T05:53:29.330189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:01:33.701742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.520045+0000","last_change":"2024-05-09T05:53:23.112592+0000","last_active":"2024-05-09T05:53:29.520045+0000","last_peered":"2024-05-09T05:53:29.520045+0000","last_clean":"2024-05-09T05:53:29.520045+0000","last_became_active":"2024-05-09T05:53:23.111968+0000","last_became_peered":"2024-05-09T05:53:23.111968+0000","last_unstale":"2024-05-09T05:53:29.520045+0000","last_undegraded":"2024-05-09T05:53:29.520045+0000","last_fullsized":"2024-05-09T05:53:29.520045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:32:54.694588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.210561+0000","last_change":"2024-05-09T05:53:28.227755+0000","last_active":"2024-05-09T05:53:29.210561+0000","last_peered":"2024-05-09T05:53:29.210561+0000","last_clean":"2024-05-09T05:53:29.210561+0000","last_became_active":"2024-05-09T05:53:28.227272+0000","last_became_peered":"2024-05-09T05:53:28.227272+0000","last_unstale":"2024-05-09T05:53:29.210561+0000","last_undegraded":"2024-05-09T05:53:29.210561+0000","last_fullsized":"2024-05-09T05:53:29.210561+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:13:32.020862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.212986+0000","last_change":"2024-05-09T05:53:24.144025+0000","last_active":"2024-05-09T05:53:29.212986+0000","last_peered":"2024-05-09T05:53:29.212986+0000","last_clean":"2024-05-09T05:53:29.212986+0000","last_became_active":"2024-05-09T05:53:24.143540+0000","last_became_peered":"2024-05-09T05:53:24.143540+0000","last_unstale":"2024-05-09T05:53:29.212986+0000","last_undegraded":"2024-05-09T05:53:29.212986+0000","last_fullsized":"2024-05-09T05:53:29.212986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:22:58.062541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"24'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.213687+0000","last_change":"2024-05-09T05:53:23.104452+0000","last_active":"2024-05-09T05:53:29.213687+0000","last_peered":"2024-05-09T05:53:29.213687+0000","last_clean":"2024-05-09T05:53:29.213687+0000","last_became_active":"2024-05-09T05:53:23.103471+0000","last_became_peered":"2024-05-09T05:53:23.103471+0000","last_unstale":"2024-05-09T05:53:29.213687+0000","last_undegraded":"2024-05-09T05:53:29.213687+0000","last_fullsized":"2024-05-09T05:53:29.213687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:33:30.508464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.698789+0000","last_change":"2024-05-09T05:53:28.241338+0000","last_active":"2024-05-09T05:53:29.698789+0000","last_peered":"2024-05-09T05:53:29.698789+0000","last_clean":"2024-05-09T05:53:29.698789+0000","last_became_active":"2024-05-09T05:53:28.239841+0000","last_became_peered":"2024-05-09T05:53:28.239841+0000","last_unstale":"2024-05-09T05:53:29.698789+0000","last_undegraded":"2024-05-09T05:53:29.698789+0000","last_fullsized":"2024-05-09T05:53:29.698789+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:44:47.854598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.210371+0000","last_change":"2024-05-09T05:53:24.149958+0000","last_active":"2024-05-09T05:53:29.210371+0000","last_peered":"2024-05-09T05:53:29.210371+0000","last_clean":"2024-05-09T05:53:29.210371+0000","last_became_active":"2024-05-09T05:53:24.149578+0000","last_became_peered":"2024-05-09T05:53:24.149578+0000","last_unstale":"2024-05-09T05:53:29.210371+0000","last_undegraded":"2024-05-09T05:53:29.210371+0000","last_fullsized":"2024-05-09T05:53:29.210371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:27:43.555218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.518385+0000","last_change":"2024-05-09T05:53:23.121266+0000","last_active":"2024-05-09T05:53:29.518385+0000","last_peered":"2024-05-09T05:53:29.518385+0000","last_clean":"2024-05-09T05:53:29.518385+0000","last_became_active":"2024-05-09T05:53:23.120857+0000","last_became_peered":"2024-05-09T05:53:23.120857+0000","last_unstale":"2024-05-09T05:53:29.518385+0000","last_undegraded":"2024-05-09T05:53:29.518385+0000","last_fullsized":"2024-05-09T05:53:29.518385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:03:30.185640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.698426+0000","last_change":"2024-05-09T05:53:28.240774+0000","last_active":"2024-05-09T05:53:29.698426+0000","last_peered":"2024-05-09T05:53:29.698426+0000","last_clean":"2024-05-09T05:53:29.698426+0000","last_became_active":"2024-05-09T05:53:28.240070+0000","last_became_peered":"2024-05-09T05:53:28.240070+0000","last_unstale":"2024-05-09T05:53:29.698426+0000","last_undegraded":"2024-05-09T05:53:29.698426+0000","last_fullsized":"2024-05-09T05:53:29.698426+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:25:24.019344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.214869+0000","last_change":"2024-05-09T05:53:24.132792+0000","last_active":"2024-05-09T05:53:29.214869+0000","last_peered":"2024-05-09T05:53:29.214869+0000","last_clean":"2024-05-09T05:53:29.214869+0000","last_became_active":"2024-05-09T05:53:24.132439+0000","last_became_peered":"2024-05-09T05:53:24.132439+0000","last_unstale":"2024-05-09T05:53:29.214869+0000","last_undegraded":"2024-05-09T05:53:29.214869+0000","last_fullsized":"2024-05-09T05:53:29.214869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:52:45.857475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.213818+0000","last_change":"2024-05-09T05:53:23.120680+0000","last_active":"2024-05-09T05:53:29.213818+0000","last_peered":"2024-05-09T05:53:29.213818+0000","last_clean":"2024-05-09T05:53:29.213818+0000","last_became_active":"2024-05-09T05:53:23.118358+0000","last_became_peered":"2024-05-09T05:53:23.118358+0000","last_unstale":"2024-05-09T05:53:29.213818+0000","last_undegraded":"2024-05-09T05:53:29.213818+0000","last_fullsized":"2024-05-09T05:53:29.213818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:52:52.360128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.697847+0000","last_change":"2024-05-09T05:53:28.222341+0000","last_active":"2024-05-09T05:53:29.697847+0000","last_peered":"2024-05-09T05:53:29.697847+0000","last_clean":"2024-05-09T05:53:29.697847+0000","last_became_active":"2024-05-09T05:53:28.219636+0000","last_became_peered":"2024-05-09T05:53:28.219636+0000","last_unstale":"2024-05-09T05:53:29.697847+0000","last_undegraded":"2024-05-09T05:53:29.697847+0000","last_fullsized":"2024-05-09T05:53:29.697847+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:29:03.459851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.696019+0000","last_change":"2024-05-09T05:53:24.143495+0000","last_active":"2024-05-09T05:53:29.696019+0000","last_peered":"2024-05-09T05:53:29.696019+0000","last_clean":"2024-05-09T05:53:29.696019+0000","last_became_active":"2024-05-09T05:53:24.143181+0000","last_became_peered":"2024-05-09T05:53:24.143181+0000","last_unstale":"2024-05-09T05:53:29.696019+0000","last_undegraded":"2024-05-09T05:53:29.696019+0000","last_fullsized":"2024-05-09T05:53:29.696019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:40:20.997659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"24'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.698981+0000","last_change":"2024-05-09T05:53:23.114815+0000","last_active":"2024-05-09T05:53:29.698981+0000","last_peered":"2024-05-09T05:53:29.698981+0000","last_clean":"2024-05-09T05:53:29.698981+0000","last_became_active":"2024-05-09T05:53:23.113524+0000","last_became_peered":"2024-05-09T05:53:23.113524+0000","last_unstale":"2024-05-09T05:53:29.698981+0000","last_undegraded":"2024-05-09T05:53:29.698981+0000","last_fullsized":"2024-05-09T05:53:29.698981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:35:45.537715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.216033+0000","last_change":"2024-05-09T05:53:28.226682+0000","last_active":"2024-05-09T05:53:29.216033+0000","last_peered":"2024-05-09T05:53:29.216033+0000","last_clean":"2024-05-09T05:53:29.216033+0000","last_became_active":"2024-05-09T05:53:28.226279+0000","last_became_peered":"2024-05-09T05:53:28.226279+0000","last_unstale":"2024-05-09T05:53:29.216033+0000","last_undegraded":"2024-05-09T05:53:29.216033+0000","last_fullsized":"2024-05-09T05:53:29.216033+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:15:55.146695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.519441+0000","last_change":"2024-05-09T05:53:24.135119+0000","last_active":"2024-05-09T05:53:29.519441+0000","last_peered":"2024-05-09T05:53:29.519441+0000","last_clean":"2024-05-09T05:53:29.519441+0000","last_became_active":"2024-05-09T05:53:24.134690+0000","last_became_peered":"2024-05-09T05:53:24.134690+0000","last_unstale":"2024-05-09T05:53:29.519441+0000","last_undegraded":"2024-05-09T05:53:29.519441+0000","last_fullsized":"2024-05-09T05:53:29.519441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:15:36.608441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:38.739048+0000","last_change":"2024-05-09T05:53:23.119626+0000","last_active":"2024-05-09T05:53:38.739048+0000","last_peered":"2024-05-09T05:53:38.739048+0000","last_clean":"2024-05-09T05:53:38.739048+0000","last_became_active":"2024-05-09T05:53:23.119173+0000","last_became_peered":"2024-05-09T05:53:23.119173+0000","last_unstale":"2024-05-09T05:53:38.739048+0000","last_undegraded":"2024-05-09T05:53:38.739048+0000","last_fullsized":"2024-05-09T05:53:38.739048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:24:03.188897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.213285+0000","last_change":"2024-05-09T05:53:28.223167+0000","last_active":"2024-05-09T05:53:29.213285+0000","last_peered":"2024-05-09T05:53:29.213285+0000","last_clean":"2024-05-09T05:53:29.213285+0000","last_became_active":"2024-05-09T05:53:28.221846+0000","last_became_peered":"2024-05-09T05:53:28.221846+0000","last_unstale":"2024-05-09T05:53:29.213285+0000","last_undegraded":"2024-05-09T05:53:29.213285+0000","last_fullsized":"2024-05-09T05:53:29.213285+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:47:12.366900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.214789+0000","last_change":"2024-05-09T05:53:24.133007+0000","last_active":"2024-05-09T05:53:29.214789+0000","last_peered":"2024-05-09T05:53:29.214789+0000","last_clean":"2024-05-09T05:53:29.214789+0000","last_became_active":"2024-05-09T05:53:24.132545+0000","last_became_peered":"2024-05-09T05:53:24.132545+0000","last_unstale":"2024-05-09T05:53:29.214789+0000","last_undegraded":"2024-05-09T05:53:29.214789+0000","last_fullsized":"2024-05-09T05:53:29.214789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:10:26.299015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"24'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.697142+0000","last_change":"2024-05-09T05:53:23.121124+0000","last_active":"2024-05-09T05:53:29.697142+0000","last_peered":"2024-05-09T05:53:29.697142+0000","last_clean":"2024-05-09T05:53:29.697142+0000","last_became_active":"2024-05-09T05:53:23.120303+0000","last_became_peered":"2024-05-09T05:53:23.120303+0000","last_unstale":"2024-05-09T05:53:29.697142+0000","last_undegraded":"2024-05-09T05:53:29.697142+0000","last_fullsized":"2024-05-09T05:53:29.697142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:36:49.445673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.329359+0000","last_change":"2024-05-09T05:53:28.188712+0000","last_active":"2024-05-09T05:53:29.329359+0000","last_peered":"2024-05-09T05:53:29.329359+0000","last_clean":"2024-05-09T05:53:29.329359+0000","last_became_active":"2024-05-09T05:53:28.184259+0000","last_became_peered":"2024-05-09T05:53:28.184259+0000","last_unstale":"2024-05-09T05:53:29.329359+0000","last_undegraded":"2024-05-09T05:53:29.329359+0000","last_fullsized":"2024-05-09T05:53:29.329359+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:56:39.668106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.698810+0000","last_change":"2024-05-09T05:53:24.146147+0000","last_active":"2024-05-09T05:53:29.698810+0000","last_peered":"2024-05-09T05:53:29.698810+0000","last_clean":"2024-05-09T05:53:29.698810+0000","last_became_active":"2024-05-09T05:53:24.145704+0000","last_became_peered":"2024-05-09T05:53:24.145704+0000","last_unstale":"2024-05-09T05:53:29.698810+0000","last_undegraded":"2024-05-09T05:53:29.698810+0000","last_fullsized":"2024-05-09T05:53:29.698810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:47:03.047479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.519380+0000","last_change":"2024-05-09T05:53:23.095689+0000","last_active":"2024-05-09T05:53:29.519380+0000","last_peered":"2024-05-09T05:53:29.519380+0000","last_clean":"2024-05-09T05:53:29.519380+0000","last_became_active":"2024-05-09T05:53:23.094889+0000","last_became_peered":"2024-05-09T05:53:23.094889+0000","last_unstale":"2024-05-09T05:53:29.519380+0000","last_undegraded":"2024-05-09T05:53:29.519380+0000","last_fullsized":"2024-05-09T05:53:29.519380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:25:35.069184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.694877+0000","last_change":"2024-05-09T05:53:28.223954+0000","last_active":"2024-05-09T05:53:29.694877+0000","last_peered":"2024-05-09T05:53:29.694877+0000","last_clean":"2024-05-09T05:53:29.694877+0000","last_became_active":"2024-05-09T05:53:28.222700+0000","last_became_peered":"2024-05-09T05:53:28.222700+0000","last_unstale":"2024-05-09T05:53:29.694877+0000","last_undegraded":"2024-05-09T05:53:29.694877+0000","last_fullsized":"2024-05-09T05:53:29.694877+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:17:17.864782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.330144+0000","last_change":"2024-05-09T05:53:24.140698+0000","last_active":"2024-05-09T05:53:29.330144+0000","last_peered":"2024-05-09T05:53:29.330144+0000","last_clean":"2024-05-09T05:53:29.330144+0000","last_became_active":"2024-05-09T05:53:24.139612+0000","last_became_peered":"2024-05-09T05:53:24.139612+0000","last_unstale":"2024-05-09T05:53:29.330144+0000","last_undegraded":"2024-05-09T05:53:29.330144+0000","last_fullsized":"2024-05-09T05:53:29.330144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:09:39.609750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.215436+0000","last_change":"2024-05-09T05:53:23.106167+0000","last_active":"2024-05-09T05:53:29.215436+0000","last_peered":"2024-05-09T05:53:29.215436+0000","last_clean":"2024-05-09T05:53:29.215436+0000","last_became_active":"2024-05-09T05:53:23.105346+0000","last_became_peered":"2024-05-09T05:53:23.105346+0000","last_unstale":"2024-05-09T05:53:29.215436+0000","last_undegraded":"2024-05-09T05:53:29.215436+0000","last_fullsized":"2024-05-09T05:53:29.215436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:06:46.109056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.213366+0000","last_change":"2024-05-09T05:53:28.194037+0000","last_active":"2024-05-09T05:53:29.213366+0000","last_peered":"2024-05-09T05:53:29.213366+0000","last_clean":"2024-05-09T05:53:29.213366+0000","last_became_active":"2024-05-09T05:53:28.192944+0000","last_became_peered":"2024-05-09T05:53:28.192944+0000","last_unstale":"2024-05-09T05:53:29.213366+0000","last_undegraded":"2024-05-09T05:53:29.213366+0000","last_fullsized":"2024-05-09T05:53:29.213366+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:28:47.664198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.214534+0000","last_change":"2024-05-09T05:53:28.226664+0000","last_active":"2024-05-09T05:53:29.214534+0000","last_peered":"2024-05-09T05:53:29.214534+0000","last_clean":"2024-05-09T05:53:29.214534+0000","last_became_active":"2024-05-09T05:53:28.222225+0000","last_became_peered":"2024-05-09T05:53:28.222225+0000","last_unstale":"2024-05-09T05:53:29.214534+0000","last_undegraded":"2024-05-09T05:53:29.214534+0000","last_fullsized":"2024-05-09T05:53:29.214534+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:24:23.614210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.213172+0000","last_change":"2024-05-09T05:53:24.128343+0000","last_active":"2024-05-09T05:53:29.213172+0000","last_peered":"2024-05-09T05:53:29.213172+0000","last_clean":"2024-05-09T05:53:29.213172+0000","last_became_active":"2024-05-09T05:53:24.127989+0000","last_became_peered":"2024-05-09T05:53:24.127989+0000","last_unstale":"2024-05-09T05:53:29.213172+0000","last_undegraded":"2024-05-09T05:53:29.213172+0000","last_fullsized":"2024-05-09T05:53:29.213172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:56:14.176175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.212772+0000","last_change":"2024-05-09T05:53:23.118882+0000","last_active":"2024-05-09T05:53:29.212772+0000","last_peered":"2024-05-09T05:53:29.212772+0000","last_clean":"2024-05-09T05:53:29.212772+0000","last_became_active":"2024-05-09T05:53:23.118119+0000","last_became_peered":"2024-05-09T05:53:23.118119+0000","last_unstale":"2024-05-09T05:53:29.212772+0000","last_undegraded":"2024-05-09T05:53:29.212772+0000","last_fullsized":"2024-05-09T05:53:29.212772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:06:48.203396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.215588+0000","last_change":"2024-05-09T05:53:28.235313+0000","last_active":"2024-05-09T05:53:29.215588+0000","last_peered":"2024-05-09T05:53:29.215588+0000","last_clean":"2024-05-09T05:53:29.215588+0000","last_became_active":"2024-05-09T05:53:28.234771+0000","last_became_peered":"2024-05-09T05:53:28.234771+0000","last_unstale":"2024-05-09T05:53:29.215588+0000","last_undegraded":"2024-05-09T05:53:29.215588+0000","last_fullsized":"2024-05-09T05:53:29.215588+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:38:46.942863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.697143+0000","last_change":"2024-05-09T05:53:24.141956+0000","last_active":"2024-05-09T05:53:29.697143+0000","last_peered":"2024-05-09T05:53:29.697143+0000","last_clean":"2024-05-09T05:53:29.697143+0000","last_became_active":"2024-05-09T05:53:24.139093+0000","last_became_peered":"2024-05-09T05:53:24.139093+0000","last_unstale":"2024-05-09T05:53:29.697143+0000","last_undegraded":"2024-05-09T05:53:29.697143+0000","last_fullsized":"2024-05-09T05:53:29.697143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:44:32.901168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.698890+0000","last_change":"2024-05-09T05:53:23.113865+0000","last_active":"2024-05-09T05:53:29.698890+0000","last_peered":"2024-05-09T05:53:29.698890+0000","last_clean":"2024-05-09T05:53:29.698890+0000","last_became_active":"2024-05-09T05:53:23.112020+0000","last_became_peered":"2024-05-09T05:53:23.112020+0000","last_unstale":"2024-05-09T05:53:29.698890+0000","last_undegraded":"2024-05-09T05:53:29.698890+0000","last_fullsized":"2024-05-09T05:53:29.698890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:37:04.425229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"24'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.213736+0000","last_change":"2024-05-09T05:53:23.127463+0000","last_active":"2024-05-09T05:53:29.213736+0000","last_peered":"2024-05-09T05:53:29.213736+0000","last_clean":"2024-05-09T05:53:29.213736+0000","last_became_active":"2024-05-09T05:53:23.126911+0000","last_became_peered":"2024-05-09T05:53:23.126911+0000","last_unstale":"2024-05-09T05:53:29.213736+0000","last_undegraded":"2024-05-09T05:53:29.213736+0000","last_fullsized":"2024-05-09T05:53:29.213736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:06:28.458926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.213862+0000","last_change":"2024-05-09T05:53:24.134391+0000","last_active":"2024-05-09T05:53:29.213862+0000","last_peered":"2024-05-09T05:53:29.213862+0000","last_clean":"2024-05-09T05:53:29.213862+0000","last_became_active":"2024-05-09T05:53:24.133994+0000","last_became_peered":"2024-05-09T05:53:24.133994+0000","last_unstale":"2024-05-09T05:53:29.213862+0000","last_undegraded":"2024-05-09T05:53:29.213862+0000","last_fullsized":"2024-05-09T05:53:29.213862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:30:32.872657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.213741+0000","last_change":"2024-05-09T05:53:28.223524+0000","last_active":"2024-05-09T05:53:29.213741+0000","last_peered":"2024-05-09T05:53:29.213741+0000","last_clean":"2024-05-09T05:53:29.213741+0000","last_became_active":"2024-05-09T05:53:28.222433+0000","last_became_peered":"2024-05-09T05:53:28.222433+0000","last_unstale":"2024-05-09T05:53:29.213741+0000","last_undegraded":"2024-05-09T05:53:29.213741+0000","last_fullsized":"2024-05-09T05:53:29.213741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:52:35.361812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"24'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.697023+0000","last_change":"2024-05-09T05:53:23.133700+0000","last_active":"2024-05-09T05:53:29.697023+0000","last_peered":"2024-05-09T05:53:29.697023+0000","last_clean":"2024-05-09T05:53:29.697023+0000","last_became_active":"2024-05-09T05:53:23.132946+0000","last_became_peered":"2024-05-09T05:53:23.132946+0000","last_unstale":"2024-05-09T05:53:29.697023+0000","last_undegraded":"2024-05-09T05:53:29.697023+0000","last_fullsized":"2024-05-09T05:53:29.697023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:39:49.829592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.210913+0000","last_change":"2024-05-09T05:53:24.138174+0000","last_active":"2024-05-09T05:53:29.210913+0000","last_peered":"2024-05-09T05:53:29.210913+0000","last_clean":"2024-05-09T05:53:29.210913+0000","last_became_active":"2024-05-09T05:53:24.137794+0000","last_became_peered":"2024-05-09T05:53:24.137794+0000","last_unstale":"2024-05-09T05:53:29.210913+0000","last_undegraded":"2024-05-09T05:53:29.210913+0000","last_fullsized":"2024-05-09T05:53:29.210913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:57:26.359258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.696516+0000","last_change":"2024-05-09T05:53:28.238375+0000","last_active":"2024-05-09T05:53:29.696516+0000","last_peered":"2024-05-09T05:53:29.696516+0000","last_clean":"2024-05-09T05:53:29.696516+0000","last_became_active":"2024-05-09T05:53:28.237414+0000","last_became_peered":"2024-05-09T05:53:28.237414+0000","last_unstale":"2024-05-09T05:53:29.696516+0000","last_undegraded":"2024-05-09T05:53:29.696516+0000","last_fullsized":"2024-05-09T05:53:29.696516+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:13:50.396951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.329027+0000","last_change":"2024-05-09T05:53:24.130839+0000","last_active":"2024-05-09T05:53:29.329027+0000","last_peered":"2024-05-09T05:53:29.329027+0000","last_clean":"2024-05-09T05:53:29.329027+0000","last_became_active":"2024-05-09T05:53:24.130201+0000","last_became_peered":"2024-05-09T05:53:24.130201+0000","last_unstale":"2024-05-09T05:53:29.329027+0000","last_undegraded":"2024-05-09T05:53:29.329027+0000","last_fullsized":"2024-05-09T05:53:29.329027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:26:03.973553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.696321+0000","last_change":"2024-05-09T05:53:24.138681+0000","last_active":"2024-05-09T05:53:29.696321+0000","last_peered":"2024-05-09T05:53:29.696321+0000","last_clean":"2024-05-09T05:53:29.696321+0000","last_became_active":"2024-05-09T05:53:24.138366+0000","last_became_peered":"2024-05-09T05:53:24.138366+0000","last_unstale":"2024-05-09T05:53:29.696321+0000","last_undegraded":"2024-05-09T05:53:29.696321+0000","last_fullsized":"2024-05-09T05:53:29.696321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:49.856205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.213330+0000","last_change":"2024-05-09T05:53:24.139915+0000","last_active":"2024-05-09T05:53:29.213330+0000","last_peered":"2024-05-09T05:53:29.213330+0000","last_clean":"2024-05-09T05:53:29.213330+0000","last_became_active":"2024-05-09T05:53:24.139058+0000","last_became_peered":"2024-05-09T05:53:24.139058+0000","last_unstale":"2024-05-09T05:53:29.213330+0000","last_undegraded":"2024-05-09T05:53:29.213330+0000","last_fullsized":"2024-05-09T05:53:29.213330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:06:00.768431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.696712+0000","last_change":"2024-05-09T05:53:24.149759+0000","last_active":"2024-05-09T05:53:29.696712+0000","last_peered":"2024-05-09T05:53:29.696712+0000","last_clean":"2024-05-09T05:53:29.696712+0000","last_became_active":"2024-05-09T05:53:24.142812+0000","last_became_peered":"2024-05-09T05:53:24.142812+0000","last_unstale":"2024-05-09T05:53:29.696712+0000","last_undegraded":"2024-05-09T05:53:29.696712+0000","last_fullsized":"2024-05-09T05:53:29.696712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:04.522514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.698128+0000","last_change":"2024-05-09T05:53:24.135373+0000","last_active":"2024-05-09T05:53:29.698128+0000","last_peered":"2024-05-09T05:53:29.698128+0000","last_clean":"2024-05-09T05:53:29.698128+0000","last_became_active":"2024-05-09T05:53:24.135043+0000","last_became_peered":"2024-05-09T05:53:24.135043+0000","last_unstale":"2024-05-09T05:53:29.698128+0000","last_undegraded":"2024-05-09T05:53:29.698128+0000","last_fullsized":"2024-05-09T05:53:29.698128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:20:03.245696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.696921+0000","last_change":"2024-05-09T05:53:24.134712+0000","last_active":"2024-05-09T05:53:29.696921+0000","last_peered":"2024-05-09T05:53:29.696921+0000","last_clean":"2024-05-09T05:53:29.696921+0000","last_became_active":"2024-05-09T05:53:24.132453+0000","last_became_peered":"2024-05-09T05:53:24.132453+0000","last_unstale":"2024-05-09T05:53:29.696921+0000","last_undegraded":"2024-05-09T05:53:29.696921+0000","last_fullsized":"2024-05-09T05:53:29.696921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:47:30.716995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.330002+0000","last_change":"2024-05-09T05:53:24.140714+0000","last_active":"2024-05-09T05:53:29.330002+0000","last_peered":"2024-05-09T05:53:29.330002+0000","last_clean":"2024-05-09T05:53:29.330002+0000","last_became_active":"2024-05-09T05:53:24.140045+0000","last_became_peered":"2024-05-09T05:53:24.140045+0000","last_unstale":"2024-05-09T05:53:29.330002+0000","last_undegraded":"2024-05-09T05:53:29.330002+0000","last_fullsized":"2024-05-09T05:53:29.330002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:36:06.166411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.697852+0000","last_change":"2024-05-09T05:53:24.151591+0000","last_active":"2024-05-09T05:53:29.697852+0000","last_peered":"2024-05-09T05:53:29.697852+0000","last_clean":"2024-05-09T05:53:29.697852+0000","last_became_active":"2024-05-09T05:53:24.151275+0000","last_became_peered":"2024-05-09T05:53:24.151275+0000","last_unstale":"2024-05-09T05:53:29.697852+0000","last_undegraded":"2024-05-09T05:53:29.697852+0000","last_fullsized":"2024-05-09T05:53:29.697852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:28:28.552732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.212703+0000","last_change":"2024-05-09T05:53:24.144315+0000","last_active":"2024-05-09T05:53:29.212703+0000","last_peered":"2024-05-09T05:53:29.212703+0000","last_clean":"2024-05-09T05:53:29.212703+0000","last_became_active":"2024-05-09T05:53:24.144005+0000","last_became_peered":"2024-05-09T05:53:24.144005+0000","last_unstale":"2024-05-09T05:53:29.212703+0000","last_undegraded":"2024-05-09T05:53:29.212703+0000","last_fullsized":"2024-05-09T05:53:29.212703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:06:37.312541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.697839+0000","last_change":"2024-05-09T05:53:24.149852+0000","last_active":"2024-05-09T05:53:29.697839+0000","last_peered":"2024-05-09T05:53:29.697839+0000","last_clean":"2024-05-09T05:53:29.697839+0000","last_became_active":"2024-05-09T05:53:24.146965+0000","last_became_peered":"2024-05-09T05:53:24.146965+0000","last_unstale":"2024-05-09T05:53:29.697839+0000","last_undegraded":"2024-05-09T05:53:29.697839+0000","last_fullsized":"2024-05-09T05:53:29.697839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:02:26.991425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.210907+0000","last_change":"2024-05-09T05:53:24.131735+0000","last_active":"2024-05-09T05:53:29.210907+0000","last_peered":"2024-05-09T05:53:29.210907+0000","last_clean":"2024-05-09T05:53:29.210907+0000","last_became_active":"2024-05-09T05:53:24.131417+0000","last_became_peered":"2024-05-09T05:53:24.131417+0000","last_unstale":"2024-05-09T05:53:29.210907+0000","last_undegraded":"2024-05-09T05:53:29.210907+0000","last_fullsized":"2024-05-09T05:53:29.210907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:59.750972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.213503+0000","last_change":"2024-05-09T05:53:24.140697+0000","last_active":"2024-05-09T05:53:29.213503+0000","last_peered":"2024-05-09T05:53:29.213503+0000","last_clean":"2024-05-09T05:53:29.213503+0000","last_became_active":"2024-05-09T05:53:24.140024+0000","last_became_peered":"2024-05-09T05:53:24.140024+0000","last_unstale":"2024-05-09T05:53:29.213503+0000","last_undegraded":"2024-05-09T05:53:29.213503+0000","last_fullsized":"2024-05-09T05:53:29.213503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:14:14.543827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.519088+0000","last_change":"2024-05-09T05:53:24.136878+0000","last_active":"2024-05-09T05:53:29.519088+0000","last_peered":"2024-05-09T05:53:29.519088+0000","last_clean":"2024-05-09T05:53:29.519088+0000","last_became_active":"2024-05-09T05:53:24.136572+0000","last_became_peered":"2024-05-09T05:53:24.136572+0000","last_unstale":"2024-05-09T05:53:29.519088+0000","last_undegraded":"2024-05-09T05:53:29.519088+0000","last_fullsized":"2024-05-09T05:53:29.519088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:46:47.509355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.216011+0000","last_change":"2024-05-09T05:53:24.147372+0000","last_active":"2024-05-09T05:53:29.216011+0000","last_peered":"2024-05-09T05:53:29.216011+0000","last_clean":"2024-05-09T05:53:29.216011+0000","last_became_active":"2024-05-09T05:53:24.144573+0000","last_became_peered":"2024-05-09T05:53:24.144573+0000","last_unstale":"2024-05-09T05:53:29.216011+0000","last_undegraded":"2024-05-09T05:53:29.216011+0000","last_fullsized":"2024-05-09T05:53:29.216011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:51:09.845748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.698543+0000","last_change":"2024-05-09T05:53:24.135964+0000","last_active":"2024-05-09T05:53:29.698543+0000","last_peered":"2024-05-09T05:53:29.698543+0000","last_clean":"2024-05-09T05:53:29.698543+0000","last_became_active":"2024-05-09T05:53:24.135625+0000","last_became_peered":"2024-05-09T05:53:24.135625+0000","last_unstale":"2024-05-09T05:53:29.698543+0000","last_undegraded":"2024-05-09T05:53:29.698543+0000","last_fullsized":"2024-05-09T05:53:29.698543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:52:02.026146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.216721+0000","last_change":"2024-05-09T05:53:24.133916+0000","last_active":"2024-05-09T05:53:29.216721+0000","last_peered":"2024-05-09T05:53:29.216721+0000","last_clean":"2024-05-09T05:53:29.216721+0000","last_became_active":"2024-05-09T05:53:24.133405+0000","last_became_peered":"2024-05-09T05:53:24.133405+0000","last_unstale":"2024-05-09T05:53:29.216721+0000","last_undegraded":"2024-05-09T05:53:29.216721+0000","last_fullsized":"2024-05-09T05:53:29.216721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:30:16.477715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.212403+0000","last_change":"2024-05-09T05:53:24.139697+0000","last_active":"2024-05-09T05:53:29.212403+0000","last_peered":"2024-05-09T05:53:29.212403+0000","last_clean":"2024-05-09T05:53:29.212403+0000","last_became_active":"2024-05-09T05:53:24.139374+0000","last_became_peered":"2024-05-09T05:53:24.139374+0000","last_unstale":"2024-05-09T05:53:29.212403+0000","last_undegraded":"2024-05-09T05:53:29.212403+0000","last_fullsized":"2024-05-09T05:53:29.212403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:26:28.502867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.697314+0000","last_change":"2024-05-09T05:53:24.147755+0000","last_active":"2024-05-09T05:53:29.697314+0000","last_peered":"2024-05-09T05:53:29.697314+0000","last_clean":"2024-05-09T05:53:29.697314+0000","last_became_active":"2024-05-09T05:53:24.145616+0000","last_became_peered":"2024-05-09T05:53:24.145616+0000","last_unstale":"2024-05-09T05:53:29.697314+0000","last_undegraded":"2024-05-09T05:53:29.697314+0000","last_fullsized":"2024-05-09T05:53:29.697314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:21:10.387393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.695743+0000","last_change":"2024-05-09T05:53:24.131741+0000","last_active":"2024-05-09T05:53:29.695743+0000","last_peered":"2024-05-09T05:53:29.695743+0000","last_clean":"2024-05-09T05:53:29.695743+0000","last_became_active":"2024-05-09T05:53:24.128870+0000","last_became_peered":"2024-05-09T05:53:24.128870+0000","last_unstale":"2024-05-09T05:53:29.695743+0000","last_undegraded":"2024-05-09T05:53:29.695743+0000","last_fullsized":"2024-05-09T05:53:29.695743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:28:25.103524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.696503+0000","last_change":"2024-05-09T05:53:24.133443+0000","last_active":"2024-05-09T05:53:29.696503+0000","last_peered":"2024-05-09T05:53:29.696503+0000","last_clean":"2024-05-09T05:53:29.696503+0000","last_became_active":"2024-05-09T05:53:24.132688+0000","last_became_peered":"2024-05-09T05:53:24.132688+0000","last_unstale":"2024-05-09T05:53:29.696503+0000","last_undegraded":"2024-05-09T05:53:29.696503+0000","last_fullsized":"2024-05-09T05:53:29.696503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:43:24.750805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.518884+0000","last_change":"2024-05-09T05:53:24.142600+0000","last_active":"2024-05-09T05:53:29.518884+0000","last_peered":"2024-05-09T05:53:29.518884+0000","last_clean":"2024-05-09T05:53:29.518884+0000","last_became_active":"2024-05-09T05:53:24.142280+0000","last_became_peered":"2024-05-09T05:53:24.142280+0000","last_unstale":"2024-05-09T05:53:29.518884+0000","last_undegraded":"2024-05-09T05:53:29.518884+0000","last_fullsized":"2024-05-09T05:53:29.518884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:20:58.962379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.519367+0000","last_change":"2024-05-09T05:53:24.144839+0000","last_active":"2024-05-09T05:53:29.519367+0000","last_peered":"2024-05-09T05:53:29.519367+0000","last_clean":"2024-05-09T05:53:29.519367+0000","last_became_active":"2024-05-09T05:53:24.144381+0000","last_became_peered":"2024-05-09T05:53:24.144381+0000","last_unstale":"2024-05-09T05:53:29.519367+0000","last_undegraded":"2024-05-09T05:53:29.519367+0000","last_fullsized":"2024-05-09T05:53:29.519367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:40:46.738053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.519277+0000","last_change":"2024-05-09T05:53:24.131521+0000","last_active":"2024-05-09T05:53:29.519277+0000","last_peered":"2024-05-09T05:53:29.519277+0000","last_clean":"2024-05-09T05:53:29.519277+0000","last_became_active":"2024-05-09T05:53:24.131218+0000","last_became_peered":"2024-05-09T05:53:24.131218+0000","last_unstale":"2024-05-09T05:53:29.519277+0000","last_undegraded":"2024-05-09T05:53:29.519277+0000","last_fullsized":"2024-05-09T05:53:29.519277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:25:59.410270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.215388+0000","last_change":"2024-05-09T05:53:24.139922+0000","last_active":"2024-05-09T05:53:29.215388+0000","last_peered":"2024-05-09T05:53:29.215388+0000","last_clean":"2024-05-09T05:53:29.215388+0000","last_became_active":"2024-05-09T05:53:24.139473+0000","last_became_peered":"2024-05-09T05:53:24.139473+0000","last_unstale":"2024-05-09T05:53:29.215388+0000","last_undegraded":"2024-05-09T05:53:29.215388+0000","last_fullsized":"2024-05-09T05:53:29.215388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:37:50.839899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.696349+0000","last_change":"2024-05-09T05:53:24.143338+0000","last_active":"2024-05-09T05:53:29.696349+0000","last_peered":"2024-05-09T05:53:29.696349+0000","last_clean":"2024-05-09T05:53:29.696349+0000","last_became_active":"2024-05-09T05:53:24.143053+0000","last_became_peered":"2024-05-09T05:53:24.143053+0000","last_unstale":"2024-05-09T05:53:29.696349+0000","last_undegraded":"2024-05-09T05:53:29.696349+0000","last_fullsized":"2024-05-09T05:53:29.696349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:22:16.337090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.518199+0000","last_change":"2024-05-09T05:53:24.145517+0000","last_active":"2024-05-09T05:53:29.518199+0000","last_peered":"2024-05-09T05:53:29.518199+0000","last_clean":"2024-05-09T05:53:29.518199+0000","last_became_active":"2024-05-09T05:53:24.145150+0000","last_became_peered":"2024-05-09T05:53:24.145150+0000","last_unstale":"2024-05-09T05:53:29.518199+0000","last_undegraded":"2024-05-09T05:53:29.518199+0000","last_fullsized":"2024-05-09T05:53:29.518199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:19:53.947349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.330681+0000","last_change":"2024-05-09T05:53:24.129669+0000","last_active":"2024-05-09T05:53:29.330681+0000","last_peered":"2024-05-09T05:53:29.330681+0000","last_clean":"2024-05-09T05:53:29.330681+0000","last_became_active":"2024-05-09T05:53:24.129339+0000","last_became_peered":"2024-05-09T05:53:24.129339+0000","last_unstale":"2024-05-09T05:53:29.330681+0000","last_undegraded":"2024-05-09T05:53:29.330681+0000","last_fullsized":"2024-05-09T05:53:29.330681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:05:51.845643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.518947+0000","last_change":"2024-05-09T05:53:24.138914+0000","last_active":"2024-05-09T05:53:29.518947+0000","last_peered":"2024-05-09T05:53:29.518947+0000","last_clean":"2024-05-09T05:53:29.518947+0000","last_became_active":"2024-05-09T05:53:24.138499+0000","last_became_peered":"2024-05-09T05:53:24.138499+0000","last_unstale":"2024-05-09T05:53:29.518947+0000","last_undegraded":"2024-05-09T05:53:29.518947+0000","last_fullsized":"2024-05-09T05:53:29.518947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:29:00.338046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.329427+0000","last_change":"2024-05-09T05:53:24.144296+0000","last_active":"2024-05-09T05:53:29.329427+0000","last_peered":"2024-05-09T05:53:29.329427+0000","last_clean":"2024-05-09T05:53:29.329427+0000","last_became_active":"2024-05-09T05:53:24.143890+0000","last_became_peered":"2024-05-09T05:53:24.143890+0000","last_unstale":"2024-05-09T05:53:29.329427+0000","last_undegraded":"2024-05-09T05:53:29.329427+0000","last_fullsized":"2024-05-09T05:53:29.329427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:34:56.860849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.697600+0000","last_change":"2024-05-09T05:53:24.152635+0000","last_active":"2024-05-09T05:53:29.697600+0000","last_peered":"2024-05-09T05:53:29.697600+0000","last_clean":"2024-05-09T05:53:29.697600+0000","last_became_active":"2024-05-09T05:53:24.151674+0000","last_became_peered":"2024-05-09T05:53:24.151674+0000","last_unstale":"2024-05-09T05:53:29.697600+0000","last_undegraded":"2024-05-09T05:53:29.697600+0000","last_fullsized":"2024-05-09T05:53:29.697600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:18:47.495857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.698463+0000","last_change":"2024-05-09T05:53:24.152746+0000","last_active":"2024-05-09T05:53:29.698463+0000","last_peered":"2024-05-09T05:53:29.698463+0000","last_clean":"2024-05-09T05:53:29.698463+0000","last_became_active":"2024-05-09T05:53:24.151418+0000","last_became_peered":"2024-05-09T05:53:24.151418+0000","last_unstale":"2024-05-09T05:53:29.698463+0000","last_undegraded":"2024-05-09T05:53:29.698463+0000","last_fullsized":"2024-05-09T05:53:29.698463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:27:19.121790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.519905+0000","last_change":"2024-05-09T05:53:24.140908+0000","last_active":"2024-05-09T05:53:29.519905+0000","last_peered":"2024-05-09T05:53:29.519905+0000","last_clean":"2024-05-09T05:53:29.519905+0000","last_became_active":"2024-05-09T05:53:24.140589+0000","last_became_peered":"2024-05-09T05:53:24.140589+0000","last_unstale":"2024-05-09T05:53:29.519905+0000","last_undegraded":"2024-05-09T05:53:29.519905+0000","last_fullsized":"2024-05-09T05:53:29.519905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:51:03.458547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":266240,"data_stored":101907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509451,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":258048,"data_stored":101783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509451,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":278528,"data_stored":106297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":270336,"data_stored":105625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":856064,"data_stored":692221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":101839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32020,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339820,"statfs":{"total":96636764160,"available":96603975680,"internally_reserved":0,"allocated":860160,"data_stored":692243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":102365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T05:53:52.103 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-09T05:53:52.104 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-09T05:53:52.104 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-05-09T05:53:52.104 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-05-09T05:53:52.104 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-05-09T05:53:52.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.303+0000 7f58da10e640 1 Processor -- start 2024-05-09T05:53:52.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.303+0000 7f58da10e640 1 -- start start 2024-05-09T05:53:52.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.303+0000 7f58da10e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58d40c77a0 0x7f58d41537d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:52.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.303+0000 7f58da10e640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58d40c72c0 con 0x7f58d4074740 2024-05-09T05:53:52.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.303+0000 7f58da10e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58d40c7bb0 con 0x7f58d4161d70 2024-05-09T05:53:52.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.303+0000 7f58da10e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f58d4074460 con 0x7f58d40c77a0 2024-05-09T05:53:52.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.303+0000 7f58d2ffd640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f58d4074740 0x7f58d4072e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34400/0 (socket says 172.21.15.72:34400) 2024-05-09T05:53:52.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.303+0000 7f58d2ffd640 1 -- 172.21.15.72:0/201958359 learned_addr learned my addr 172.21.15.72:0/201958359 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:53:52.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.303+0000 7f58d37fe640 1 --2- 172.21.15.72:0/201958359 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58d40c77a0 0x7f58d41537d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:52.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.303+0000 7f58d27fc640 1 -- 172.21.15.72:0/201958359 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 467144557 0 0) 0x7f58d40c72c0 con 0x7f58d4074740 2024-05-09T05:53:52.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.303+0000 7f58d27fc640 1 -- 172.21.15.72:0/201958359 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58bc003530 con 0x7f58d4074740 2024-05-09T05:53:52.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.303+0000 7f58d27fc640 1 -- 172.21.15.72:0/201958359 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3103163696 0 0) 0x7f58bc003530 con 0x7f58d4074740 2024-05-09T05:53:52.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.303+0000 7f58d27fc640 1 -- 172.21.15.72:0/201958359 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58d40c77a0 msgr2=0x7f58d41537d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:52.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.303+0000 7f58d27fc640 1 --2- 172.21.15.72:0/201958359 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58d40c77a0 0x7f58d41537d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:52.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.303+0000 7f58d27fc640 1 -- 172.21.15.72:0/201958359 >> v1:172.21.15.110:6789/0 conn(0x7f58d4161d70 legacy=0x7f58d4164190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:52.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.303+0000 7f58d27fc640 1 -- 172.21.15.72:0/201958359 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58d4073af0 con 0x7f58d4074740 2024-05-09T05:53:52.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.303+0000 7f58d27fc640 1 -- 172.21.15.72:0/201958359 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2749052815 0 0) 0x7f58c4001720 con 0x7f58d4074740 2024-05-09T05:53:52.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.303+0000 7f58d27fc640 1 -- 172.21.15.72:0/201958359 >> v1:172.21.15.72:6789/0 conn(0x7f58d4074740 legacy=0x7f58d4072e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:52.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.303+0000 7f58d27fc640 1 --2- 172.21.15.72:0/201958359 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58bc003a40 0x7f58bc003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:52.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.303+0000 7f58d27fc640 1 --2- 172.21.15.72:0/201958359 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58bc004810 0x7f58bc004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:52.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.303+0000 7f58d27fc640 1 --2- 172.21.15.72:0/201958359 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58d40c77a0 0x7f58bc0052e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:52.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.303+0000 7f58d27fc640 1 -- 172.21.15.72:0/201958359 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f58d4074460 con 0x7f58bc004810 2024-05-09T05:53:52.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.303+0000 7f58d27fc640 1 -- 172.21.15.72:0/201958359 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f58bc00bb90 con 0x7f58bc003a40 2024-05-09T05:53:52.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.303+0000 7f58d27fc640 1 -- 172.21.15.72:0/201958359 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f58bc00bd90 con 0x7f58d40c77a0 2024-05-09T05:53:52.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.303+0000 7f58d2ffd640 1 --2- 172.21.15.72:0/201958359 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58bc004810 0x7f58bc004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:52.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.303+0000 7f58d37fe640 1 --2- 172.21.15.72:0/201958359 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58bc003a40 0x7f58bc003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:52.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.303+0000 7f58d2ffd640 1 -- 172.21.15.72:0/201958359 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58d40c77a0 msgr2=0x7f58bc0052e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:52.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.303+0000 7f58d2ffd640 1 --2- 172.21.15.72:0/201958359 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58d40c77a0 0x7f58bc0052e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:52.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.303+0000 7f58d2ffd640 1 -- 172.21.15.72:0/201958359 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58bc003a40 msgr2=0x7f58bc003eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:52.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.303+0000 7f58d2ffd640 1 --2- 172.21.15.72:0/201958359 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58bc003a40 0x7f58bc003eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:52.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.303+0000 7f58d2ffd640 1 -- 172.21.15.72:0/201958359 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58bc003530 con 0x7f58bc004810 2024-05-09T05:53:52.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.307+0000 7f58d2ffd640 1 --2- 172.21.15.72:0/201958359 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58bc004810 0x7f58bc004c20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f58d40712d0 tx=0x7f58c401f270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4a80dd317aab4ac server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:52.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.307+0000 7f58d27fc640 1 -- 172.21.15.72:0/201958359 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c4007dc0 con 0x7f58bc004810 2024-05-09T05:53:52.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.307+0000 7f58d27fc640 1 -- 172.21.15.72:0/201958359 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58c4005ae0 con 0x7f58bc004810 2024-05-09T05:53:52.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.307+0000 7f58d27fc640 1 -- 172.21.15.72:0/201958359 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c4007070 con 0x7f58bc004810 2024-05-09T05:53:52.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.307+0000 7f58da10e640 1 -- 172.21.15.72:0/201958359 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58bc004810 msgr2=0x7f58bc004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:52.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.307+0000 7f58da10e640 1 --2- 172.21.15.72:0/201958359 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58bc004810 0x7f58bc004c20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f58d40712d0 tx=0x7f58c401f270 comp rx=0 tx=0).stop 2024-05-09T05:53:52.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.307+0000 7f58d3fff640 1 -- 172.21.15.72:0/201958359 reap_dead start 2024-05-09T05:53:52.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.307+0000 7f58da10e640 1 -- 172.21.15.72:0/201958359 shutdown_connections 2024-05-09T05:53:52.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.307+0000 7f58da10e640 1 -- 172.21.15.72:0/201958359 >> 172.21.15.72:0/201958359 conn(0x7f58d40cde90 msgr2=0x7f58d40ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:52.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.307+0000 7f58da10e640 1 -- 172.21.15.72:0/201958359 shutdown_connections 2024-05-09T05:53:52.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.307+0000 7f58da10e640 1 -- 172.21.15.72:0/201958359 wait complete. 2024-05-09T05:53:52.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.311+0000 7f58da10e640 1 Processor -- start 2024-05-09T05:53:52.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.311+0000 7f58da10e640 1 -- start start 2024-05-09T05:53:52.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.311+0000 7f58da10e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58bc004810 0x7f58d414dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:52.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.311+0000 7f58da10e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58d414b650 0x7f58d41f4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:52.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.311+0000 7f58da10e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58d41494c0 0x7f58d41528f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:52.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.311+0000 7f58da10e640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f58d4074b50 con 0x7f58d41494c0 2024-05-09T05:53:52.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.311+0000 7f58da10e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f58d40740b0 con 0x7f58bc004810 2024-05-09T05:53:52.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.311+0000 7f58da10e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f58d4072940 con 0x7f58d414b650 2024-05-09T05:53:52.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.311+0000 7f58d3fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58d41494c0 0x7f58d41528f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:52.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.311+0000 7f58d3fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58d41494c0 0x7f58d41528f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41974/0 (socket says 172.21.15.72:41974) 2024-05-09T05:53:52.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.311+0000 7f58d3fff640 1 -- 172.21.15.72:0/213258017 learned_addr learned my addr 172.21.15.72:0/213258017 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:52.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.311+0000 7f58d37fe640 1 --2- 172.21.15.72:0/213258017 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58bc004810 0x7f58d414dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:52.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.311+0000 7f58d2ffd640 1 --2- 172.21.15.72:0/213258017 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58d414b650 0x7f58d41f4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:52.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.311+0000 7f58d3fff640 1 -- 172.21.15.72:0/213258017 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58d414b650 msgr2=0x7f58d41f4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:52.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.311+0000 7f58d3fff640 1 --2- 172.21.15.72:0/213258017 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58d414b650 0x7f58d41f4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:52.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.311+0000 7f58d3fff640 1 -- 172.21.15.72:0/213258017 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58bc004810 msgr2=0x7f58d414dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:52.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.311+0000 7f58d3fff640 1 --2- 172.21.15.72:0/213258017 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58bc004810 0x7f58d414dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:52.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.311+0000 7f58d3fff640 1 -- 172.21.15.72:0/213258017 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58d414e530 con 0x7f58d41494c0 2024-05-09T05:53:52.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.311+0000 7f58d3fff640 1 --2- 172.21.15.72:0/213258017 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58d41494c0 0x7f58d41528f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f58d40cb660 tx=0x7f58cc00cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:52.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.311+0000 7f58bbfff640 1 -- 172.21.15.72:0/213258017 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58cc017070 con 0x7f58d41494c0 2024-05-09T05:53:52.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.311+0000 7f58bbfff640 1 -- 172.21.15.72:0/213258017 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58cc005d70 con 0x7f58d41494c0 2024-05-09T05:53:52.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.311+0000 7f58da10e640 1 -- 172.21.15.72:0/213258017 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58d41f5230 con 0x7f58d41494c0 2024-05-09T05:53:52.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.311+0000 7f58bbfff640 1 -- 172.21.15.72:0/213258017 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58cc00a850 con 0x7f58d41494c0 2024-05-09T05:53:52.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.311+0000 7f58da10e640 1 -- 172.21.15.72:0/213258017 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58d414a370 con 0x7f58d41494c0 2024-05-09T05:53:52.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.311+0000 7f58da10e640 1 -- 172.21.15.72:0/213258017 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58d406a520 con 0x7f58d41494c0 2024-05-09T05:53:52.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.315+0000 7f58bbfff640 1 -- 172.21.15.72:0/213258017 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f58cc00a9f0 con 0x7f58d41494c0 2024-05-09T05:53:52.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.315+0000 7f58bbfff640 1 --2- 172.21.15.72:0/213258017 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f58c006f400 0x7f58c0071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:52.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.315+0000 7f58bbfff640 1 -- 172.21.15.72:0/213258017 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f58cc08e6e0 con 0x7f58d41494c0 2024-05-09T05:53:52.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.315+0000 7f58d37fe640 1 --2- 172.21.15.72:0/213258017 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f58c006f400 0x7f58c0071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:52.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.315+0000 7f58d37fe640 1 --2- 172.21.15.72:0/213258017 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f58c006f400 0x7f58c0071910 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f58d40c41c0 tx=0x7f58c8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:52.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.319+0000 7f58bbfff640 1 -- 172.21.15.72:0/213258017 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f58cc05b210 con 0x7f58d41494c0 2024-05-09T05:53:52.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.519+0000 7f58da10e640 1 -- 172.21.15.72:0/213258017 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f58d4072c50 con 0x7f58d41494c0 2024-05-09T05:53:52.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.527+0000 7f58bbfff640 1 -- 172.21.15.72:0/213258017 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+179550 (secure 0 0 0) 0x7f58cc063290 con 0x7f58d41494c0 2024-05-09T05:53:52.519 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:53:52.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.531+0000 7f58da10e640 1 -- 172.21.15.72:0/213258017 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f58c006f400 msgr2=0x7f58c0071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:52.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.531+0000 7f58da10e640 1 --2- 172.21.15.72:0/213258017 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f58c006f400 0x7f58c0071910 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f58d40c41c0 tx=0x7f58c8008040 comp rx=0 tx=0).stop 2024-05-09T05:53:52.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.531+0000 7f58da10e640 1 -- 172.21.15.72:0/213258017 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58d41494c0 msgr2=0x7f58d41528f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:52.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.531+0000 7f58da10e640 1 --2- 172.21.15.72:0/213258017 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58d41494c0 0x7f58d41528f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f58d40cb660 tx=0x7f58cc00cb90 comp rx=0 tx=0).stop 2024-05-09T05:53:52.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.531+0000 7f58da10e640 1 -- 172.21.15.72:0/213258017 shutdown_connections 2024-05-09T05:53:52.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.531+0000 7f58da10e640 1 --2- 172.21.15.72:0/213258017 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f58c006f400 0x7f58c0071910 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:52.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.531+0000 7f58da10e640 1 --2- 172.21.15.72:0/213258017 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58d41494c0 0x7f58d41528f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:52.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.531+0000 7f58da10e640 1 --2- 172.21.15.72:0/213258017 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58d414b650 0x7f58d41f4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:52.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.531+0000 7f58da10e640 1 --2- 172.21.15.72:0/213258017 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58bc004810 0x7f58d414dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:52.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.531+0000 7f58da10e640 1 -- 172.21.15.72:0/213258017 >> 172.21.15.72:0/213258017 conn(0x7f58d40cde90 msgr2=0x7f58d4145fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:52.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.531+0000 7f58da10e640 1 -- 172.21.15.72:0/213258017 shutdown_connections 2024-05-09T05:53:52.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.531+0000 7f58da10e640 1 -- 172.21.15.72:0/213258017 wait complete. 2024-05-09T05:53:52.540 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":5,"flags":0,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1113420672},{"type":"v1","addr":"172.21.15.110:6833","nonce":1113420672}]},"active_addr":"172.21.15.110:6833/1113420672","active_change":"2024-05-09T05:53:04.445339+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4110,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.110:0","nonce":372768770}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.110:0","nonce":679822375}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.110:0","nonce":2259012900}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.110:0","nonce":2319515742}]}]} 2024-05-09T05:53:52.544 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-05-09T05:53:52.544 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-09T05:53:52.544 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T05:53:52.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.699+0000 7ff36e10c640 1 Processor -- start 2024-05-09T05:53:52.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.699+0000 7ff36e10c640 1 -- start start 2024-05-09T05:53:52.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.699+0000 7ff36e10c640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff368156b50 0x7ff368073ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:52.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.699+0000 7ff36e10c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff36815f480 0x7ff36815f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:52.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.699+0000 7ff36e10c640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3680cda30 con 0x7ff368074410 2024-05-09T05:53:52.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.699+0000 7ff36e10c640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7ff3680cc020 con 0x7ff368156b50 2024-05-09T05:53:52.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.699+0000 7ff36e10c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7ff36815dfe0 con 0x7ff36815f480 2024-05-09T05:53:52.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.699+0000 7ff3677fe640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff368156b50 0x7ff368073ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:52.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.699+0000 7ff3677fe640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff368156b50 0x7ff368073ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41990/0 (socket says 172.21.15.72:41990) 2024-05-09T05:53:52.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.699+0000 7ff3677fe640 1 -- 172.21.15.72:0/3024743130 learned_addr learned my addr 172.21.15.72:0/3024743130 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:52.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.699+0000 7ff367fff640 1 --2- 172.21.15.72:0/3024743130 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff36815f480 0x7ff36815f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:52.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.699+0000 7ff3677fe640 1 -- 172.21.15.72:0/3024743130 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff36815f480 msgr2=0x7ff36815f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:52.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.699+0000 7ff3677fe640 1 --2- 172.21.15.72:0/3024743130 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff36815f480 0x7ff36815f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:52.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.699+0000 7ff3677fe640 1 -- 172.21.15.72:0/3024743130 >> v1:172.21.15.110:6789/0 conn(0x7ff368074410 legacy=0x7ff3680cc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:52.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.699+0000 7ff3677fe640 1 -- 172.21.15.72:0/3024743130 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff36815cdd0 con 0x7ff368156b50 2024-05-09T05:53:52.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.703+0000 7ff3677fe640 1 --2- 172.21.15.72:0/3024743130 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff368156b50 0x7ff368073ed0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff358009870 tx=0x7ff35801c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e834faa03b96617 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:52.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.703+0000 7ff3667fc640 1 -- 172.21.15.72:0/3024743130 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3580b0070 con 0x7ff368156b50 2024-05-09T05:53:52.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.703+0000 7ff3667fc640 1 -- 172.21.15.72:0/3024743130 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3580ab600 con 0x7ff368156b50 2024-05-09T05:53:52.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.703+0000 7ff3667fc640 1 -- 172.21.15.72:0/3024743130 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3580ab9d0 con 0x7ff368156b50 2024-05-09T05:53:52.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.703+0000 7ff36e10c640 1 -- 172.21.15.72:0/3024743130 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff368156b50 msgr2=0x7ff368073ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:52.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.703+0000 7ff36e10c640 1 --2- 172.21.15.72:0/3024743130 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff368156b50 0x7ff368073ed0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff358009870 tx=0x7ff35801c380 comp rx=0 tx=0).stop 2024-05-09T05:53:52.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.703+0000 7ff36e10c640 1 -- 172.21.15.72:0/3024743130 shutdown_connections 2024-05-09T05:53:52.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.703+0000 7ff36e10c640 1 --2- 172.21.15.72:0/3024743130 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff36815f480 0x7ff36815f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:52.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.703+0000 7ff36e10c640 1 --2- 172.21.15.72:0/3024743130 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff368156b50 0x7ff368073ed0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:52.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.703+0000 7ff36e10c640 1 -- 172.21.15.72:0/3024743130 >> 172.21.15.72:0/3024743130 conn(0x7ff3680d1b70 msgr2=0x7ff3680d1f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:52.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.703+0000 7ff36e10c640 1 -- 172.21.15.72:0/3024743130 shutdown_connections 2024-05-09T05:53:52.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.703+0000 7ff36e10c640 1 -- 172.21.15.72:0/3024743130 wait complete. 2024-05-09T05:53:52.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.707+0000 7ff36e10c640 1 Processor -- start 2024-05-09T05:53:52.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.707+0000 7ff36e10c640 1 -- start start 2024-05-09T05:53:52.700 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.707+0000 7ff36e10c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff368074410 0x7ff3681f8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:52.700 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.707+0000 7ff36e10c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff368156b50 0x7ff36814d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:52.700 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.707+0000 7ff36e10c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff36815f480 0x7ff36814d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:52.700 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.707+0000 7ff36e10c640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff368074cf0 con 0x7ff368156b50 2024-05-09T05:53:52.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.707+0000 7ff36e10c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ff36815d950 con 0x7ff36815f480 2024-05-09T05:53:52.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.707+0000 7ff36e10c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7ff36815c9b0 con 0x7ff368074410 2024-05-09T05:53:52.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.707+0000 7ff366ffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff368156b50 0x7ff36814d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:52.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.707+0000 7ff366ffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff368156b50 0x7ff36814d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41994/0 (socket says 172.21.15.72:41994) 2024-05-09T05:53:52.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.707+0000 7ff366ffd640 1 -- 172.21.15.72:0/1647616767 learned_addr learned my addr 172.21.15.72:0/1647616767 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:52.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.707+0000 7ff3677fe640 1 --2- 172.21.15.72:0/1647616767 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff368074410 0x7ff3681f8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:52.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.707+0000 7ff367fff640 1 --2- 172.21.15.72:0/1647616767 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff36815f480 0x7ff36814d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:52.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.707+0000 7ff366ffd640 1 -- 172.21.15.72:0/1647616767 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff368074410 msgr2=0x7ff3681f8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:52.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.707+0000 7ff366ffd640 1 --2- 172.21.15.72:0/1647616767 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff368074410 0x7ff3681f8ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:52.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.707+0000 7ff366ffd640 1 -- 172.21.15.72:0/1647616767 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff36815f480 msgr2=0x7ff36814d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:52.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.707+0000 7ff366ffd640 1 --2- 172.21.15.72:0/1647616767 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff36815f480 0x7ff36814d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:52.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.707+0000 7ff366ffd640 1 -- 172.21.15.72:0/1647616767 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff368150170 con 0x7ff368156b50 2024-05-09T05:53:52.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.707+0000 7ff3677fe640 1 --2- 172.21.15.72:0/1647616767 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff368074410 0x7ff3681f8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:53:52.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.707+0000 7ff367fff640 1 --2- 172.21.15.72:0/1647616767 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff36815f480 0x7ff36814d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:53:52.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.707+0000 7ff366ffd640 1 --2- 172.21.15.72:0/1647616767 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff368156b50 0x7ff36814d4a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff35c00b410 tx=0x7ff35c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:52.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.707+0000 7ff34ffff640 1 -- 172.21.15.72:0/1647616767 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff35c015030 con 0x7ff368156b50 2024-05-09T05:53:52.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.707+0000 7ff34ffff640 1 -- 172.21.15.72:0/1647616767 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff35c004020 con 0x7ff368156b50 2024-05-09T05:53:52.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.707+0000 7ff36e10c640 1 -- 172.21.15.72:0/1647616767 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3681f93e0 con 0x7ff368156b50 2024-05-09T05:53:52.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.707+0000 7ff34ffff640 1 -- 172.21.15.72:0/1647616767 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff35c004450 con 0x7ff368156b50 2024-05-09T05:53:52.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.707+0000 7ff36e10c640 1 -- 172.21.15.72:0/1647616767 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3680cb220 con 0x7ff368156b50 2024-05-09T05:53:52.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.711+0000 7ff36e10c640 1 -- 172.21.15.72:0/1647616767 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff36806a520 con 0x7ff368156b50 2024-05-09T05:53:52.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.711+0000 7ff34ffff640 1 -- 172.21.15.72:0/1647616767 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff35c018070 con 0x7ff368156b50 2024-05-09T05:53:52.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.711+0000 7ff34ffff640 1 --2- 172.21.15.72:0/1647616767 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7ff35406f400 0x7ff354071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:52.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.711+0000 7ff34ffff640 1 -- 172.21.15.72:0/1647616767 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff35c08f1c0 con 0x7ff368156b50 2024-05-09T05:53:52.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.711+0000 7ff3677fe640 1 --2- 172.21.15.72:0/1647616767 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7ff35406f400 0x7ff354071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:52.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.711+0000 7ff3677fe640 1 --2- 172.21.15.72:0/1647616767 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7ff35406f400 0x7ff354071910 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff3580ad000 tx=0x7ff358008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:52.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.715+0000 7ff34ffff640 1 -- 172.21.15.72:0/1647616767 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7ff35c05bd70 con 0x7ff368156b50 2024-05-09T05:53:52.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.867+0000 7ff36e10c640 1 -- 172.21.15.72:0/1647616767 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff3680cdcb0 con 0x7ff368156b50 2024-05-09T05:53:52.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.867+0000 7ff34ffff640 1 -- 172.21.15.72:0/1647616767 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18494 (secure 0 0 0) 0x7ff35c05b670 con 0x7ff368156b50 2024-05-09T05:53:52.860 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:53:52.860 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"fsid":"44c88cb9-b39b-4787-a871-80ddf0ad6292","created":"2024-05-09T05:52:59.591187+0000","modified":"2024-05-09T05:53:28.584684+0000","last_up_change":"2024-05-09T05:53:10.902489+0000","last_in_change":"2024-05-09T05:53:02.200254+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T05:53:10.503537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T05:53:21.364958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T05:53:22.461477+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-09T05:53:26.171144+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e4af2aa1-ba5c-4411-a72a-a0e38e589a74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":331913921},{"type":"v1","addr":"172.21.15.72:6817","nonce":331913921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":331913921},{"type":"v1","addr":"172.21.15.72:6819","nonce":331913921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":331913921},{"type":"v1","addr":"172.21.15.72:6823","nonce":331913921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":331913921},{"type":"v1","addr":"172.21.15.72:6821","nonce":331913921}]},"public_addr":"172.21.15.72:6817/331913921","cluster_addr":"172.21.15.72:6819/331913921","heartbeat_back_addr":"172.21.15.72:6823/331913921","heartbeat_front_addr":"172.21.15.72:6821/331913921","state":["exists","up"]},{"osd":1,"uuid":"052504f5-a523-4922-bdc7-ce2890faa5ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2197151836},{"type":"v1","addr":"172.21.15.72:6801","nonce":2197151836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2197151836},{"type":"v1","addr":"172.21.15.72:6803","nonce":2197151836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2197151836},{"type":"v1","addr":"172.21.15.72:6811","nonce":2197151836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2197151836},{"type":"v1","addr":"172.21.15.72:6807","nonce":2197151836}]},"public_addr":"172.21.15.72:6801/2197151836","cluster_addr":"172.21.15.72:6803/2197151836","heartbeat_back_addr":"172.21.15.72:6811/2197151836","heartbeat_front_addr":"172.21.15.72:6807/2197151836","state":["exists","up"]},{"osd":2,"uuid":"28bc1c95-6d0d-4263-baad-314d86e6a670","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1273581990},{"type":"v1","addr":"172.21.15.72:6825","nonce":1273581990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":1273581990},{"type":"v1","addr":"172.21.15.72:6827","nonce":1273581990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1273581990},{"type":"v1","addr":"172.21.15.72:6831","nonce":1273581990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1273581990},{"type":"v1","addr":"172.21.15.72:6829","nonce":1273581990}]},"public_addr":"172.21.15.72:6825/1273581990","cluster_addr":"172.21.15.72:6827/1273581990","heartbeat_back_addr":"172.21.15.72:6831/1273581990","heartbeat_front_addr":"172.21.15.72:6829/1273581990","state":["exists","up"]},{"osd":3,"uuid":"edcc86cb-f178-4533-8069-de9d781531ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2180866263},{"type":"v1","addr":"172.21.15.72:6806","nonce":2180866263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2180866263},{"type":"v1","addr":"172.21.15.72:6810","nonce":2180866263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2180866263},{"type":"v1","addr":"172.21.15.72:6815","nonce":2180866263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2180866263},{"type":"v1","addr":"172.21.15.72:6813","nonce":2180866263}]},"public_addr":"172.21.15.72:6806/2180866263","cluster_addr":"172.21.15.72:6810/2180866263","heartbeat_back_addr":"172.21.15.72:6815/2180866263","heartbeat_front_addr":"172.21.15.72:6813/2180866263","state":["exists","up"]},{"osd":4,"uuid":"8d138128-4829-4109-87a1-25f339f3e953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3437318248},{"type":"v1","addr":"172.21.15.110:6817","nonce":3437318248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3437318248},{"type":"v1","addr":"172.21.15.110:6819","nonce":3437318248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3437318248},{"type":"v1","addr":"172.21.15.110:6823","nonce":3437318248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3437318248},{"type":"v1","addr":"172.21.15.110:6821","nonce":3437318248}]},"public_addr":"172.21.15.110:6817/3437318248","cluster_addr":"172.21.15.110:6819/3437318248","heartbeat_back_addr":"172.21.15.110:6823/3437318248","heartbeat_front_addr":"172.21.15.110:6821/3437318248","state":["exists","up"]},{"osd":5,"uuid":"99a4a914-0a0e-4d25-94ae-3e86b8b1aa4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":977576181},{"type":"v1","addr":"172.21.15.110:6825","nonce":977576181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":977576181},{"type":"v1","addr":"172.21.15.110:6827","nonce":977576181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":977576181},{"type":"v1","addr":"172.21.15.110:6831","nonce":977576181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":977576181},{"type":"v1","addr":"172.21.15.110:6829","nonce":977576181}]},"public_addr":"172.21.15.110:6825/977576181","cluster_addr":"172.21.15.110:6827/977576181","heartbeat_back_addr":"172.21.15.110:6831/977576181","heartbeat_front_addr":"172.21.15.110:6829/977576181","state":["exists","up"]},{"osd":6,"uuid":"6e04b295-afc9-4f80-80f7-3df1f5168608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":1817638786},{"type":"v1","addr":"172.21.15.110:6809","nonce":1817638786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":1817638786},{"type":"v1","addr":"172.21.15.110:6811","nonce":1817638786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":1817638786},{"type":"v1","addr":"172.21.15.110:6815","nonce":1817638786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":1817638786},{"type":"v1","addr":"172.21.15.110:6813","nonce":1817638786}]},"public_addr":"172.21.15.110:6809/1817638786","cluster_addr":"172.21.15.110:6811/1817638786","heartbeat_back_addr":"172.21.15.110:6815/1817638786","heartbeat_front_addr":"172.21.15.110:6813/1817638786","state":["exists","up"]},{"osd":7,"uuid":"835de5c9-1e2c-41d8-bd28-d7ffe5ad8fdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":214675920},{"type":"v1","addr":"172.21.15.110:6801","nonce":214675920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":214675920},{"type":"v1","addr":"172.21.15.110:6803","nonce":214675920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":214675920},{"type":"v1","addr":"172.21.15.110:6807","nonce":214675920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":214675920},{"type":"v1","addr":"172.21.15.110:6805","nonce":214675920}]},"public_addr":"172.21.15.110:6801/214675920","cluster_addr":"172.21.15.110:6803/214675920","heartbeat_back_addr":"172.21.15.110:6807/214675920","heartbeat_front_addr":"172.21.15.110:6805/214675920","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.849761+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.670554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.743789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:08.516367+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.665550+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.518775+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.786468+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.794984+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T05:53:52.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.871+0000 7ff36e10c640 1 -- 172.21.15.72:0/1647616767 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7ff35406f400 msgr2=0x7ff354071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:52.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.871+0000 7ff36e10c640 1 --2- 172.21.15.72:0/1647616767 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7ff35406f400 0x7ff354071910 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff3580ad000 tx=0x7ff358008040 comp rx=0 tx=0).stop 2024-05-09T05:53:52.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.871+0000 7ff36e10c640 1 -- 172.21.15.72:0/1647616767 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff368156b50 msgr2=0x7ff36814d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:52.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.871+0000 7ff36e10c640 1 --2- 172.21.15.72:0/1647616767 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff368156b50 0x7ff36814d4a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff35c00b410 tx=0x7ff35c00b8d0 comp rx=0 tx=0).stop 2024-05-09T05:53:52.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.871+0000 7ff36e10c640 1 -- 172.21.15.72:0/1647616767 shutdown_connections 2024-05-09T05:53:52.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.871+0000 7ff36e10c640 1 --2- 172.21.15.72:0/1647616767 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7ff35406f400 0x7ff354071910 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:52.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.871+0000 7ff36e10c640 1 --2- 172.21.15.72:0/1647616767 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff36815f480 0x7ff36814d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:52.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.871+0000 7ff36e10c640 1 --2- 172.21.15.72:0/1647616767 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff368156b50 0x7ff36814d4a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:52.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.871+0000 7ff36e10c640 1 --2- 172.21.15.72:0/1647616767 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff368074410 0x7ff3681f8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:52.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.871+0000 7ff36e10c640 1 -- 172.21.15.72:0/1647616767 >> 172.21.15.72:0/1647616767 conn(0x7ff3680d1b70 msgr2=0x7ff3680ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:52.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.871+0000 7ff36e10c640 1 -- 172.21.15.72:0/1647616767 shutdown_connections 2024-05-09T05:53:52.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:52.871+0000 7ff36e10c640 1 -- 172.21.15.72:0/1647616767 wait complete. 2024-05-09T05:53:52.880 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-09T05:53:52.880 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T05:53:53.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.035+0000 7ff9e26f0640 1 Processor -- start 2024-05-09T05:53:53.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.035+0000 7ff9e26f0640 1 -- start start 2024-05-09T05:53:53.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.039+0000 7ff9e26f0640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9dc1537d0 0x7ff9dc074740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.039+0000 7ff9e26f0640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff9dc161d70 0x7ff9dc164190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.039+0000 7ff9e26f0640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9dc0c72c0 con 0x7ff9dc0c77a0 2024-05-09T05:53:53.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.039+0000 7ff9e26f0640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7ff9dc074c80 con 0x7ff9dc161d70 2024-05-09T05:53:53.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.039+0000 7ff9e26f0640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7ff9dc0c7bb0 con 0x7ff9dc1537d0 2024-05-09T05:53:53.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.039+0000 7ff9db7fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9dc1537d0 0x7ff9dc074740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.039+0000 7ff9e0c8d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff9dc161d70 0x7ff9dc164190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.039+0000 7ff9e0c8d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff9dc161d70 0x7ff9dc164190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.72:42258/0 (socket says 172.21.15.72:42258) 2024-05-09T05:53:53.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.039+0000 7ff9dbfff640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7ff9dc0c77a0 0x7ff9dc072e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.72:51090/0 (socket says 172.21.15.72:51090) 2024-05-09T05:53:53.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.039+0000 7ff9e0c8d640 1 -- 172.21.15.72:0/2386664593 learned_addr learned my addr 172.21.15.72:0/2386664593 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:53.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.039+0000 7ff9db7fe640 1 -- 172.21.15.72:0/2386664593 >> v2:172.21.15.110:3300/0 conn(0x7ff9dc161d70 msgr2=0x7ff9dc164190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:53.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.039+0000 7ff9db7fe640 1 --2- 172.21.15.72:0/2386664593 >> v2:172.21.15.110:3300/0 conn(0x7ff9dc161d70 0x7ff9dc164190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.039+0000 7ff9db7fe640 1 -- 172.21.15.72:0/2386664593 >> v1:172.21.15.110:6789/0 conn(0x7ff9dc0c77a0 legacy=0x7ff9dc072e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.039+0000 7ff9db7fe640 1 -- 172.21.15.72:0/2386664593 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9dc153be0 con 0x7ff9dc1537d0 2024-05-09T05:53:53.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.043+0000 7ff9db7fe640 1 --2- 172.21.15.72:0/2386664593 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9dc1537d0 0x7ff9dc074740 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff9d00097c0 tx=0x7ff9d001c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=271ab2ed7747ec90 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:53.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.043+0000 7ff9daffd640 1 -- 172.21.15.72:0/2386664593 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d00a7070 con 0x7ff9dc1537d0 2024-05-09T05:53:53.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.043+0000 7ff9daffd640 1 -- 172.21.15.72:0/2386664593 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9d00b0070 con 0x7ff9dc1537d0 2024-05-09T05:53:53.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.043+0000 7ff9daffd640 1 -- 172.21.15.72:0/2386664593 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d00ab890 con 0x7ff9dc1537d0 2024-05-09T05:53:53.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.043+0000 7ff9e26f0640 1 -- 172.21.15.72:0/2386664593 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9dc1537d0 msgr2=0x7ff9dc074740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.043+0000 7ff9e26f0640 1 --2- 172.21.15.72:0/2386664593 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9dc1537d0 0x7ff9dc074740 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff9d00097c0 tx=0x7ff9d001c470 comp rx=0 tx=0).stop 2024-05-09T05:53:53.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.043+0000 7ff9e26f0640 1 -- 172.21.15.72:0/2386664593 shutdown_connections 2024-05-09T05:53:53.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.043+0000 7ff9e26f0640 1 --2- 172.21.15.72:0/2386664593 >> v2:172.21.15.110:3300/0 conn(0x7ff9dc161d70 0x7ff9dc164190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.043+0000 7ff9e26f0640 1 --2- 172.21.15.72:0/2386664593 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9dc1537d0 0x7ff9dc074740 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.043+0000 7ff9e26f0640 1 -- 172.21.15.72:0/2386664593 >> 172.21.15.72:0/2386664593 conn(0x7ff9dc0cde90 msgr2=0x7ff9dc0ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:53.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.043+0000 7ff9e26f0640 1 -- 172.21.15.72:0/2386664593 shutdown_connections 2024-05-09T05:53:53.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.043+0000 7ff9e26f0640 1 -- 172.21.15.72:0/2386664593 wait complete. 2024-05-09T05:53:53.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.043+0000 7ff9e26f0640 1 Processor -- start 2024-05-09T05:53:53.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.047+0000 7ff9e26f0640 1 -- start start 2024-05-09T05:53:53.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.047+0000 7ff9e26f0640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9dc0c77a0 0x7ff9dc140c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.047+0000 7ff9e26f0640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9dc1537d0 0x7ff9dc1411b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.047+0000 7ff9e26f0640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9dc161d70 0x7ff9dc13c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.047+0000 7ff9e26f0640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff9dc072940 con 0x7ff9dc0c77a0 2024-05-09T05:53:53.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.047+0000 7ff9e26f0640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ff9dc0740b0 con 0x7ff9dc161d70 2024-05-09T05:53:53.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.047+0000 7ff9e26f0640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7ff9dc0c4cb0 con 0x7ff9dc1537d0 2024-05-09T05:53:53.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.047+0000 7ff9dbfff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9dc0c77a0 0x7ff9dc140c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.047+0000 7ff9dbfff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9dc0c77a0 0x7ff9dc140c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41996/0 (socket says 172.21.15.72:41996) 2024-05-09T05:53:53.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.047+0000 7ff9dbfff640 1 -- 172.21.15.72:0/925915518 learned_addr learned my addr 172.21.15.72:0/925915518 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:53.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.047+0000 7ff9db7fe640 1 --2- 172.21.15.72:0/925915518 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9dc1537d0 0x7ff9dc1411b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.047+0000 7ff9e0c8d640 1 --2- 172.21.15.72:0/925915518 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9dc161d70 0x7ff9dc13c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.047+0000 7ff9dbfff640 1 -- 172.21.15.72:0/925915518 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9dc1537d0 msgr2=0x7ff9dc1411b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.047+0000 7ff9dbfff640 1 --2- 172.21.15.72:0/925915518 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9dc1537d0 0x7ff9dc1411b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.047+0000 7ff9dbfff640 1 -- 172.21.15.72:0/925915518 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9dc161d70 msgr2=0x7ff9dc13c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.047+0000 7ff9dbfff640 1 --2- 172.21.15.72:0/925915518 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9dc161d70 0x7ff9dc13c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.047+0000 7ff9dbfff640 1 -- 172.21.15.72:0/925915518 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9dc144ed0 con 0x7ff9dc0c77a0 2024-05-09T05:53:53.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.047+0000 7ff9dbfff640 1 --2- 172.21.15.72:0/925915518 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9dc0c77a0 0x7ff9dc140c70 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc00c430 tx=0x7ff9cc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:53.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.047+0000 7ff9d8ff9640 1 -- 172.21.15.72:0/925915518 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9cc0074e0 con 0x7ff9dc0c77a0 2024-05-09T05:53:53.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.047+0000 7ff9d8ff9640 1 -- 172.21.15.72:0/925915518 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9cc0047f0 con 0x7ff9dc0c77a0 2024-05-09T05:53:53.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.047+0000 7ff9e26f0640 1 -- 172.21.15.72:0/925915518 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9dc13e650 con 0x7ff9dc0c77a0 2024-05-09T05:53:53.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.047+0000 7ff9d8ff9640 1 -- 172.21.15.72:0/925915518 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9cc0076a0 con 0x7ff9dc0c77a0 2024-05-09T05:53:53.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.047+0000 7ff9e26f0640 1 -- 172.21.15.72:0/925915518 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9dc1453b0 con 0x7ff9dc0c77a0 2024-05-09T05:53:53.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.047+0000 7ff9e26f0640 1 -- 172.21.15.72:0/925915518 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9dc06a520 con 0x7ff9dc0c77a0 2024-05-09T05:53:53.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.051+0000 7ff9d8ff9640 1 -- 172.21.15.72:0/925915518 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff9cc01a020 con 0x7ff9dc0c77a0 2024-05-09T05:53:53.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.051+0000 7ff9d8ff9640 1 --2- 172.21.15.72:0/925915518 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7ff9c806f400 0x7ff9c8071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.051+0000 7ff9d8ff9640 1 -- 172.21.15.72:0/925915518 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff9cc08ec80 con 0x7ff9dc0c77a0 2024-05-09T05:53:53.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.051+0000 7ff9db7fe640 1 --2- 172.21.15.72:0/925915518 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7ff9c806f400 0x7ff9c8071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.051+0000 7ff9db7fe640 1 --2- 172.21.15.72:0/925915518 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7ff9c806f400 0x7ff9c8071910 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff9d00af000 tx=0x7ff9d00a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:53.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.055+0000 7ff9d8ff9640 1 -- 172.21.15.72:0/925915518 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7ff9cc05b950 con 0x7ff9dc0c77a0 2024-05-09T05:53:53.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.215+0000 7ff9e26f0640 1 -- 172.21.15.72:0/925915518 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff9dc072c50 con 0x7ff9dc0c77a0 2024-05-09T05:53:53.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.219+0000 7ff9d8ff9640 1 -- 172.21.15.72:0/925915518 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18494 (secure 0 0 0) 0x7ff9cc05b250 con 0x7ff9dc0c77a0 2024-05-09T05:53:53.210 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:53:53.211 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"fsid":"44c88cb9-b39b-4787-a871-80ddf0ad6292","created":"2024-05-09T05:52:59.591187+0000","modified":"2024-05-09T05:53:28.584684+0000","last_up_change":"2024-05-09T05:53:10.902489+0000","last_in_change":"2024-05-09T05:53:02.200254+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T05:53:10.503537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T05:53:21.364958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T05:53:22.461477+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-09T05:53:26.171144+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e4af2aa1-ba5c-4411-a72a-a0e38e589a74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":331913921},{"type":"v1","addr":"172.21.15.72:6817","nonce":331913921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":331913921},{"type":"v1","addr":"172.21.15.72:6819","nonce":331913921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":331913921},{"type":"v1","addr":"172.21.15.72:6823","nonce":331913921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":331913921},{"type":"v1","addr":"172.21.15.72:6821","nonce":331913921}]},"public_addr":"172.21.15.72:6817/331913921","cluster_addr":"172.21.15.72:6819/331913921","heartbeat_back_addr":"172.21.15.72:6823/331913921","heartbeat_front_addr":"172.21.15.72:6821/331913921","state":["exists","up"]},{"osd":1,"uuid":"052504f5-a523-4922-bdc7-ce2890faa5ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2197151836},{"type":"v1","addr":"172.21.15.72:6801","nonce":2197151836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2197151836},{"type":"v1","addr":"172.21.15.72:6803","nonce":2197151836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2197151836},{"type":"v1","addr":"172.21.15.72:6811","nonce":2197151836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2197151836},{"type":"v1","addr":"172.21.15.72:6807","nonce":2197151836}]},"public_addr":"172.21.15.72:6801/2197151836","cluster_addr":"172.21.15.72:6803/2197151836","heartbeat_back_addr":"172.21.15.72:6811/2197151836","heartbeat_front_addr":"172.21.15.72:6807/2197151836","state":["exists","up"]},{"osd":2,"uuid":"28bc1c95-6d0d-4263-baad-314d86e6a670","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1273581990},{"type":"v1","addr":"172.21.15.72:6825","nonce":1273581990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":1273581990},{"type":"v1","addr":"172.21.15.72:6827","nonce":1273581990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1273581990},{"type":"v1","addr":"172.21.15.72:6831","nonce":1273581990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1273581990},{"type":"v1","addr":"172.21.15.72:6829","nonce":1273581990}]},"public_addr":"172.21.15.72:6825/1273581990","cluster_addr":"172.21.15.72:6827/1273581990","heartbeat_back_addr":"172.21.15.72:6831/1273581990","heartbeat_front_addr":"172.21.15.72:6829/1273581990","state":["exists","up"]},{"osd":3,"uuid":"edcc86cb-f178-4533-8069-de9d781531ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2180866263},{"type":"v1","addr":"172.21.15.72:6806","nonce":2180866263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2180866263},{"type":"v1","addr":"172.21.15.72:6810","nonce":2180866263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2180866263},{"type":"v1","addr":"172.21.15.72:6815","nonce":2180866263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2180866263},{"type":"v1","addr":"172.21.15.72:6813","nonce":2180866263}]},"public_addr":"172.21.15.72:6806/2180866263","cluster_addr":"172.21.15.72:6810/2180866263","heartbeat_back_addr":"172.21.15.72:6815/2180866263","heartbeat_front_addr":"172.21.15.72:6813/2180866263","state":["exists","up"]},{"osd":4,"uuid":"8d138128-4829-4109-87a1-25f339f3e953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3437318248},{"type":"v1","addr":"172.21.15.110:6817","nonce":3437318248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3437318248},{"type":"v1","addr":"172.21.15.110:6819","nonce":3437318248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3437318248},{"type":"v1","addr":"172.21.15.110:6823","nonce":3437318248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3437318248},{"type":"v1","addr":"172.21.15.110:6821","nonce":3437318248}]},"public_addr":"172.21.15.110:6817/3437318248","cluster_addr":"172.21.15.110:6819/3437318248","heartbeat_back_addr":"172.21.15.110:6823/3437318248","heartbeat_front_addr":"172.21.15.110:6821/3437318248","state":["exists","up"]},{"osd":5,"uuid":"99a4a914-0a0e-4d25-94ae-3e86b8b1aa4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":977576181},{"type":"v1","addr":"172.21.15.110:6825","nonce":977576181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":977576181},{"type":"v1","addr":"172.21.15.110:6827","nonce":977576181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":977576181},{"type":"v1","addr":"172.21.15.110:6831","nonce":977576181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":977576181},{"type":"v1","addr":"172.21.15.110:6829","nonce":977576181}]},"public_addr":"172.21.15.110:6825/977576181","cluster_addr":"172.21.15.110:6827/977576181","heartbeat_back_addr":"172.21.15.110:6831/977576181","heartbeat_front_addr":"172.21.15.110:6829/977576181","state":["exists","up"]},{"osd":6,"uuid":"6e04b295-afc9-4f80-80f7-3df1f5168608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":1817638786},{"type":"v1","addr":"172.21.15.110:6809","nonce":1817638786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":1817638786},{"type":"v1","addr":"172.21.15.110:6811","nonce":1817638786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":1817638786},{"type":"v1","addr":"172.21.15.110:6815","nonce":1817638786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":1817638786},{"type":"v1","addr":"172.21.15.110:6813","nonce":1817638786}]},"public_addr":"172.21.15.110:6809/1817638786","cluster_addr":"172.21.15.110:6811/1817638786","heartbeat_back_addr":"172.21.15.110:6815/1817638786","heartbeat_front_addr":"172.21.15.110:6813/1817638786","state":["exists","up"]},{"osd":7,"uuid":"835de5c9-1e2c-41d8-bd28-d7ffe5ad8fdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":214675920},{"type":"v1","addr":"172.21.15.110:6801","nonce":214675920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":214675920},{"type":"v1","addr":"172.21.15.110:6803","nonce":214675920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":214675920},{"type":"v1","addr":"172.21.15.110:6807","nonce":214675920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":214675920},{"type":"v1","addr":"172.21.15.110:6805","nonce":214675920}]},"public_addr":"172.21.15.110:6801/214675920","cluster_addr":"172.21.15.110:6803/214675920","heartbeat_back_addr":"172.21.15.110:6807/214675920","heartbeat_front_addr":"172.21.15.110:6805/214675920","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.849761+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.670554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.743789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:08.516367+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.665550+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.518775+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.786468+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.794984+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T05:53:53.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.219+0000 7ff9e26f0640 1 -- 172.21.15.72:0/925915518 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7ff9c806f400 msgr2=0x7ff9c8071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.219+0000 7ff9e26f0640 1 --2- 172.21.15.72:0/925915518 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7ff9c806f400 0x7ff9c8071910 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff9d00af000 tx=0x7ff9d00a7000 comp rx=0 tx=0).stop 2024-05-09T05:53:53.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.219+0000 7ff9e26f0640 1 -- 172.21.15.72:0/925915518 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9dc0c77a0 msgr2=0x7ff9dc140c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.219+0000 7ff9e26f0640 1 --2- 172.21.15.72:0/925915518 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9dc0c77a0 0x7ff9dc140c70 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc00c430 tx=0x7ff9cc00c8f0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.223+0000 7ff9e26f0640 1 -- 172.21.15.72:0/925915518 shutdown_connections 2024-05-09T05:53:53.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.223+0000 7ff9e26f0640 1 --2- 172.21.15.72:0/925915518 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7ff9c806f400 0x7ff9c8071910 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.223+0000 7ff9e26f0640 1 --2- 172.21.15.72:0/925915518 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9dc161d70 0x7ff9dc13c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.223+0000 7ff9e26f0640 1 --2- 172.21.15.72:0/925915518 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9dc1537d0 0x7ff9dc1411b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.223+0000 7ff9e26f0640 1 --2- 172.21.15.72:0/925915518 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9dc0c77a0 0x7ff9dc140c70 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.223+0000 7ff9e26f0640 1 -- 172.21.15.72:0/925915518 >> 172.21.15.72:0/925915518 conn(0x7ff9dc0cde90 msgr2=0x7ff9dc0c8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:53.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.223+0000 7ff9e26f0640 1 -- 172.21.15.72:0/925915518 shutdown_connections 2024-05-09T05:53:53.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.223+0000 7ff9e26f0640 1 -- 172.21.15.72:0/925915518 wait complete. 2024-05-09T05:53:53.232 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-09T05:53:53.233 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-09T05:53:53.233 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-09T05:53:53.234 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-09T05:53:53.234 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-05-09T05:53:53.234 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-05-09T05:53:53.235 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-05-09T05:53:53.235 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-05-09T05:53:53.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.451+0000 7f79f3f67640 1 Processor -- start 2024-05-09T05:53:53.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.451+0000 7f79f3f67640 1 -- start start 2024-05-09T05:53:53.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.455+0000 7f79f3f67640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79ec0c9a10 0x7f79ec163d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.455+0000 7f79f3f67640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79ec15c8e0 con 0x7f79ec158f60 2024-05-09T05:53:53.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.455+0000 7f79f3f67640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79ec152be0 con 0x7f79ec158b50 2024-05-09T05:53:53.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.455+0000 7f79f3f67640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f79ec0c9e20 con 0x7f79ec0c9a10 2024-05-09T05:53:53.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.455+0000 7f79f1502640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f79ec158f60 0x7f79ec0c9300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34412/0 (socket says 172.21.15.72:34412) 2024-05-09T05:53:53.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.455+0000 7f79f1502640 1 -- 172.21.15.72:0/849702563 learned_addr learned my addr 172.21.15.72:0/849702563 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:53:53.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.455+0000 7f79f2504640 1 --2- 172.21.15.72:0/849702563 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79ec0c9a10 0x7f79ec163d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.455+0000 7f79f1d03640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f79ec158b50 0x7f79ec06f820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.72:51106/0 (socket says 172.21.15.72:51106) 2024-05-09T05:53:53.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.455+0000 7f79f0d01640 1 -- 172.21.15.72:0/849702563 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1330762385 0 0) 0x7f79ec15c8e0 con 0x7f79ec158f60 2024-05-09T05:53:53.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.455+0000 7f79f2504640 1 -- 172.21.15.72:0/849702563 >> v1:172.21.15.110:6789/0 conn(0x7f79ec158b50 legacy=0x7f79ec06f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.455+0000 7f79f2504640 1 -- 172.21.15.72:0/849702563 >> v1:172.21.15.72:6789/0 conn(0x7f79ec158f60 legacy=0x7f79ec0c9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.455+0000 7f79f2504640 1 -- 172.21.15.72:0/849702563 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79ec15bd60 con 0x7f79ec0c9a10 2024-05-09T05:53:53.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.459+0000 7f79f2504640 1 --2- 172.21.15.72:0/849702563 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79ec0c9a10 0x7f79ec163d40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f79e4009dc0 tx=0x7f79e401c9b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b21c1c9bdecd049 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:53.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.459+0000 7f79f0d01640 1 -- 172.21.15.72:0/849702563 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e40b2070 con 0x7f79ec0c9a10 2024-05-09T05:53:53.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.459+0000 7f79f0d01640 1 -- 172.21.15.72:0/849702563 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79e40a5960 con 0x7f79ec0c9a10 2024-05-09T05:53:53.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.459+0000 7f79f0d01640 1 -- 172.21.15.72:0/849702563 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e40a5d30 con 0x7f79ec0c9a10 2024-05-09T05:53:53.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.459+0000 7f79f3f67640 1 -- 172.21.15.72:0/849702563 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79ec0c9a10 msgr2=0x7f79ec163d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.459+0000 7f79f3f67640 1 --2- 172.21.15.72:0/849702563 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79ec0c9a10 0x7f79ec163d40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f79e4009dc0 tx=0x7f79e401c9b0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.459+0000 7f79f3f67640 1 -- 172.21.15.72:0/849702563 shutdown_connections 2024-05-09T05:53:53.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.459+0000 7f79f3f67640 1 --2- 172.21.15.72:0/849702563 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79ec0c9a10 0x7f79ec163d40 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.459+0000 7f79f3f67640 1 -- 172.21.15.72:0/849702563 >> 172.21.15.72:0/849702563 conn(0x7f79ec06d0e0 msgr2=0x7f79ec0cd560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:53.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.459+0000 7f79f3f67640 1 -- 172.21.15.72:0/849702563 shutdown_connections 2024-05-09T05:53:53.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.459+0000 7f79f3f67640 1 -- 172.21.15.72:0/849702563 wait complete. 2024-05-09T05:53:53.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.463+0000 7f79f3f67640 1 Processor -- start 2024-05-09T05:53:53.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.463+0000 7f79f3f67640 1 -- start start 2024-05-09T05:53:53.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.463+0000 7f4b42b32640 1 Processor -- start 2024-05-09T05:53:53.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.463+0000 7f4b42b32640 1 -- start start 2024-05-09T05:53:53.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.463+0000 7f8b387d8640 1 Processor -- start 2024-05-09T05:53:53.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.463+0000 7f8b387d8640 1 -- start start 2024-05-09T05:53:53.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.467+0000 7f79f3f67640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79ec0c9a10 0x7f79ec203870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.467+0000 7f79f3f67640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79ec158b50 0x7f79ec0c5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.467+0000 7f79f3f67640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79ec158f60 0x7f79ec1486b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.467+0000 7f79f3f67640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f79ec159370 con 0x7f79ec0c9a10 2024-05-09T05:53:53.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.467+0000 7f79f3f67640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f79ec158630 con 0x7f79ec158b50 2024-05-09T05:53:53.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.467+0000 7f79f3f67640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f79ec15ba00 con 0x7f79ec158f60 2024-05-09T05:53:53.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.467+0000 7f79f1d03640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79ec0c9a10 0x7f79ec203870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.467+0000 7f79f1d03640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79ec0c9a10 0x7f79ec203870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42006/0 (socket says 172.21.15.72:42006) 2024-05-09T05:53:53.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.467+0000 7f79f1502640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79ec158b50 0x7f79ec0c5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.467+0000 7f79f1d03640 1 -- 172.21.15.72:0/1328743815 learned_addr learned my addr 172.21.15.72:0/1328743815 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:53.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.467+0000 7f79f2504640 1 --2- 172.21.15.72:0/1328743815 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79ec158f60 0x7f79ec1486b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.467+0000 7f79f1d03640 1 -- 172.21.15.72:0/1328743815 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79ec158f60 msgr2=0x7f79ec1486b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.467+0000 7f79f1d03640 1 --2- 172.21.15.72:0/1328743815 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79ec158f60 0x7f79ec1486b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.467+0000 7f79f1d03640 1 -- 172.21.15.72:0/1328743815 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79ec158b50 msgr2=0x7f79ec0c5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.467+0000 7f79f1d03640 1 --2- 172.21.15.72:0/1328743815 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79ec158b50 0x7f79ec0c5a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.467+0000 7f79f1d03640 1 -- 172.21.15.72:0/1328743815 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79ec0c5f40 con 0x7f79ec0c9a10 2024-05-09T05:53:53.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.467+0000 7f79f1502640 1 --2- 172.21.15.72:0/1328743815 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79ec158b50 0x7f79ec0c5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T05:53:53.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.467+0000 7f79f2504640 1 --2- 172.21.15.72:0/1328743815 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79ec158f60 0x7f79ec1486b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T05:53:53.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.467+0000 7f79f1d03640 1 --2- 172.21.15.72:0/1328743815 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79ec0c9a10 0x7f79ec203870 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f79e800c430 tx=0x7f79e800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:53.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.467+0000 7f4b42b32640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b3c1549d0 0x7f4b3c074260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.467+0000 7f4b42b32640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b3c06f7b0 con 0x7f4b3c15b150 2024-05-09T05:53:53.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.467+0000 7f4b42b32640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b3c06fa50 con 0x7f4b3c06d7b0 2024-05-09T05:53:53.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.467+0000 7f4b42b32640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f4b3c06f580 con 0x7f4b3c1549d0 2024-05-09T05:53:53.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.467+0000 7f8b387d8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b300c4bf0 0x7f8b300ca620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.467+0000 7f8b387d8640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8b3015afa0 0x7f8b30164e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.467+0000 7f8b387d8640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b300cb990 con 0x7f8b3015ab90 2024-05-09T05:53:53.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.467+0000 7f8b387d8640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f8b300cc4d0 con 0x7f8b3015afa0 2024-05-09T05:53:53.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.467+0000 7f8b387d8640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f8b3015a700 con 0x7f8b300c4bf0 2024-05-09T05:53:53.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.467+0000 7f79e27fc640 1 -- 172.21.15.72:0/1328743815 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e80074e0 con 0x7f79ec0c9a10 2024-05-09T05:53:53.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.467+0000 7f79e27fc640 1 -- 172.21.15.72:0/1328743815 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79e8007680 con 0x7f79ec0c9a10 2024-05-09T05:53:53.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.467+0000 7f79e27fc640 1 -- 172.21.15.72:0/1328743815 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e8004a30 con 0x7f79ec0c9a10 2024-05-09T05:53:53.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.467+0000 7f79f3f67640 1 -- 172.21.15.72:0/1328743815 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79ec1578f0 con 0x7f79ec0c9a10 2024-05-09T05:53:53.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.467+0000 7f79f3f67640 1 -- 172.21.15.72:0/1328743815 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79ec157e90 con 0x7f79ec0c9a10 2024-05-09T05:53:53.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.467+0000 7f8a78f7c640 1 Processor -- start 2024-05-09T05:53:53.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.467+0000 7f8a78f7c640 1 -- start start 2024-05-09T05:53:53.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.467+0000 7f4b408ce640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b3c1549d0 0x7f4b3c074260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.467+0000 7f4b3bfff640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f4b3c06d7b0 0x7f4b3c15aa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.72:51118/0 (socket says 172.21.15.72:51118) 2024-05-09T05:53:53.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.467+0000 7f4b3bfff640 1 -- 172.21.15.72:0/1684173558 learned_addr learned my addr 172.21.15.72:0/1684173558 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:53:53.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.467+0000 7f8b36d75640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8b3015afa0 0x7f8b30164e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.467+0000 7f8b36d75640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8b3015afa0 0x7f8b30164e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42020/0 (socket says 172.21.15.72:42020) 2024-05-09T05:53:53.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.467+0000 7f8b36d75640 1 -- 172.21.15.72:0/1317882865 learned_addr learned my addr 172.21.15.72:0/1317882865 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:53.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.467+0000 7f8b36574640 1 --2- 172.21.15.72:0/1317882865 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b300c4bf0 0x7f8b300ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.467+0000 7f4b3b7fe640 1 -- 172.21.15.72:0/1684173558 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 758524215 0 0) 0x7f4b3c06f7b0 con 0x7f4b3c15b150 2024-05-09T05:53:53.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.467+0000 7f4b3b7fe640 1 -- 172.21.15.72:0/1684173558 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b24003530 con 0x7f4b3c15b150 2024-05-09T05:53:53.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.467+0000 7f4b3b7fe640 1 -- 172.21.15.72:0/1684173558 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3406416282 0 0) 0x7f4b3c06fa50 con 0x7f4b3c06d7b0 2024-05-09T05:53:53.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.467+0000 7f4b3b7fe640 1 -- 172.21.15.72:0/1684173558 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b3c06f7b0 con 0x7f4b3c06d7b0 2024-05-09T05:53:53.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.467+0000 7f4b408ce640 1 -- 172.21.15.72:0/1684173558 >> v1:172.21.15.110:6789/0 conn(0x7f4b3c06d7b0 legacy=0x7f4b3c15aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.467+0000 7f4b408ce640 1 -- 172.21.15.72:0/1684173558 >> v1:172.21.15.72:6789/0 conn(0x7f4b3c15b150 legacy=0x7f4b3c164e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.467+0000 7f4b408ce640 1 -- 172.21.15.72:0/1684173558 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b3c0c9cf0 con 0x7f4b3c1549d0 2024-05-09T05:53:53.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.467+0000 7f79f3f67640 1 -- 172.21.15.72:0/1328743815 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f79ec050880 con 0x7f79ec0c9a10 2024-05-09T05:53:53.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.471+0000 7f7e37785640 1 Processor -- start 2024-05-09T05:53:53.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.471+0000 7f7e37785640 1 -- start start 2024-05-09T05:53:53.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.467+0000 7f8a78f7c640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8a740c4ad0 0x7f8a740c54f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.471+0000 7f8a78f7c640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a7416cfe0 con 0x7f8a741719a0 2024-05-09T05:53:53.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.471+0000 7f8a78f7c640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a7416d560 con 0x7f8a740cabb0 2024-05-09T05:53:53.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.471+0000 7f8a78f7c640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f8a74166b70 con 0x7f8a740c4ad0 2024-05-09T05:53:53.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.467+0000 7f8b36d75640 1 -- 172.21.15.72:0/1317882865 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b300c4bf0 msgr2=0x7f8b300ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:53.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.467+0000 7f8b36d75640 1 --2- 172.21.15.72:0/1317882865 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b300c4bf0 0x7f8b300ca620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.467+0000 7f8b36d75640 1 -- 172.21.15.72:0/1317882865 >> v1:172.21.15.110:6789/0 conn(0x7f8b3015ab90 legacy=0x7f8b300c5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:53.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.467+0000 7f8b36d75640 1 -- 172.21.15.72:0/1317882865 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b300cbc30 con 0x7f8b3015afa0 2024-05-09T05:53:53.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.471+0000 7f8a73fff640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f8a741719a0 0x7f8a74173dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34432/0 (socket says 172.21.15.72:34432) 2024-05-09T05:53:53.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.471+0000 7f8a73fff640 1 -- 172.21.15.72:0/301762071 learned_addr learned my addr 172.21.15.72:0/301762071 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:53:53.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.471+0000 7f8ff759e640 1 Processor -- start 2024-05-09T05:53:53.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.471+0000 7f8ff759e640 1 -- start start 2024-05-09T05:53:53.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.471+0000 7f8a72ffd640 1 --2- 172.21.15.72:0/301762071 >> v2:172.21.15.72:3300/0 conn(0x7f8a740c4ad0 0x7f8a740c54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.471+0000 7f8a72ffd640 1 -- 172.21.15.72:0/301762071 >> v1:172.21.15.110:6789/0 conn(0x7f8a740cabb0 legacy=0x7f8a740cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.471+0000 7f8a72ffd640 1 -- 172.21.15.72:0/301762071 >> v1:172.21.15.72:6789/0 conn(0x7f8a741719a0 legacy=0x7f8a74173dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:53.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.471+0000 7f8a72ffd640 1 -- 172.21.15.72:0/301762071 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a7416d280 con 0x7f8a740c4ad0 2024-05-09T05:53:53.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.471+0000 7f7e37785640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7e300c3aa0 0x7f7e30160990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.471+0000 7f8b36d75640 1 --2- 172.21.15.72:0/1317882865 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b3015afa0 0x7f8b30164e50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8b30071c00 tx=0x7f8b2801f200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e70f6147a93d7450 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:53.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.471+0000 7f08b2c67640 1 Processor -- start 2024-05-09T05:53:53.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.471+0000 7f4b408ce640 1 --2- 172.21.15.72:0/1684173558 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b3c1549d0 0x7f4b3c074260 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c0097f0 tx=0x7f4b2c023100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3c14022d9b138b1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:53.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.471+0000 7f79e27fc640 1 -- 172.21.15.72:0/1328743815 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f79e801a020 con 0x7f79ec0c9a10 2024-05-09T05:53:53.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.471+0000 7f08b2c67640 1 -- start start 2024-05-09T05:53:53.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.471+0000 7f8ff759e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8ff00e4300 0x7f8ff00dd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.471+0000 7f8ff759e640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8ff00e62f0 0x7f8ff00e6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.471+0000 7f7e35d22640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f7e30169300 0x7f7e3016b720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34440/0 (socket says 172.21.15.72:34440) 2024-05-09T05:53:53.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.471+0000 7f8ff759e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ff00e4cf0 con 0x7f8ff000a2f0 2024-05-09T05:53:53.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.471+0000 7f8ff759e640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f8ff000adf0 con 0x7f8ff00e62f0 2024-05-09T05:53:53.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.471+0000 7f8ff759e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f8ff00e4f70 con 0x7f8ff00e4300 2024-05-09T05:53:53.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.471+0000 7f8b35572640 1 -- 172.21.15.72:0/1317882865 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b280b4070 con 0x7f8b3015afa0 2024-05-09T05:53:53.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.471+0000 7f8b35572640 1 -- 172.21.15.72:0/1317882865 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b280af400 con 0x7f8b3015afa0 2024-05-09T05:53:53.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.471+0000 7f8b35572640 1 -- 172.21.15.72:0/1317882865 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b280af7d0 con 0x7f8b3015afa0 2024-05-09T05:53:53.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.471+0000 7f4b3b7fe640 1 -- 172.21.15.72:0/1684173558 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c0b9070 con 0x7f4b3c1549d0 2024-05-09T05:53:53.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.471+0000 7f4b3b7fe640 1 -- 172.21.15.72:0/1684173558 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b2c0ace00 con 0x7f4b3c1549d0 2024-05-09T05:53:53.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.471+0000 7f4b3b7fe640 1 -- 172.21.15.72:0/1684173558 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c0b4640 con 0x7f4b3c1549d0 2024-05-09T05:53:53.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.471+0000 7f79e27fc640 1 --2- 172.21.15.72:0/1328743815 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f79d006f450 0x7f79d0071960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.471+0000 7f7e35d22640 1 -- 172.21.15.72:0/4202504164 learned_addr learned my addr 172.21.15.72:0/4202504164 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:53:53.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.471+0000 7f8ff6d9d640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f8ff000a2f0 0x7f8ff00e6df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.72:51152/0 (socket says 172.21.15.72:51152) 2024-05-09T05:53:53.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.471+0000 7f8ff6d9d640 1 -- 172.21.15.72:0/2738402462 learned_addr learned my addr 172.21.15.72:0/2738402462 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:53:53.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.471+0000 7f7e35521640 1 --2- 172.21.15.72:0/4202504164 >> v2:172.21.15.110:3300/0 conn(0x7f7e300c3aa0 0x7f7e30160990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.471+0000 7f8ff5d9b640 1 --2- 172.21.15.72:0/2738402462 >> v2:172.21.15.72:3300/0 conn(0x7f8ff00e62f0 0x7f8ff00e6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.471+0000 7f79e27fc640 1 -- 172.21.15.72:0/1328743815 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f79e808ed50 con 0x7f79ec0c9a10 2024-05-09T05:53:53.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.471+0000 7f7e37785640 1 -- 172.21.15.72:0/4202504164 --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e300c4080 con 0x7f7e30169300 2024-05-09T05:53:53.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.471+0000 7f79e27fc640 1 --2- 172.21.15.72:0/1328743815 >> [v2:172.21.15.72:6816/331913921,v1:172.21.15.72:6817/331913921] conn(0x7f79d0078c10 0x7f79d007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.471+0000 7f79e27fc640 1 -- 172.21.15.72:0/1328743815 --> [v2:172.21.15.72:6816/331913921,v1:172.21.15.72:6817/331913921] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f79d007b770 con 0x7f79d0078c10 2024-05-09T05:53:53.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.471+0000 7f79e27fc640 1 -- 172.21.15.72:0/1328743815 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f79e8091370 con 0x7f79ec0c9a10 2024-05-09T05:53:53.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.471+0000 7f8ff659c640 1 --2- 172.21.15.72:0/2738402462 >> v2:172.21.15.110:3300/0 conn(0x7f8ff00e4300 0x7f8ff00dd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.471+0000 7f7e37785640 1 -- 172.21.15.72:0/4202504164 --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e300c9cb0 con 0x7f7e3015adc0 2024-05-09T05:53:53.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.471+0000 7f8ff5d9b640 1 -- 172.21.15.72:0/2738402462 >> v2:172.21.15.110:3300/0 conn(0x7f8ff00e4300 msgr2=0x7f8ff00dd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:53.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.471+0000 7f8ff5d9b640 1 --2- 172.21.15.72:0/2738402462 >> v2:172.21.15.110:3300/0 conn(0x7f8ff00e4300 0x7f8ff00dd950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.471+0000 7f8ff5d9b640 1 -- 172.21.15.72:0/2738402462 >> v1:172.21.15.110:6789/0 conn(0x7f8ff000a2f0 legacy=0x7f8ff00e6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f7e37785640 1 -- 172.21.15.72:0/4202504164 --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f7e300c9a80 con 0x7f7e300c3aa0 2024-05-09T05:53:53.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f8a72ffd640 1 --2- 172.21.15.72:0/301762071 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a740c4ad0 0x7f8a740c54f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8a68009740 tx=0x7f8a6801c2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56991589de473751 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:53.478 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f7e27fff640 1 -- 172.21.15.72:0/4202504164 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1740452910 0 0) 0x7f7e300c4080 con 0x7f7e30169300 2024-05-09T05:53:53.478 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f8a727fc640 1 -- 172.21.15.72:0/301762071 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a680b0070 con 0x7f8a740c4ad0 2024-05-09T05:53:53.478 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f8a727fc640 1 -- 172.21.15.72:0/301762071 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a680ab600 con 0x7f8a740c4ad0 2024-05-09T05:53:53.478 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f8a727fc640 1 -- 172.21.15.72:0/301762071 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a680ab9d0 con 0x7f8a740c4ad0 2024-05-09T05:53:53.478 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f7e27fff640 1 -- 172.21.15.72:0/4202504164 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e1c003530 con 0x7f7e30169300 2024-05-09T05:53:53.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f4b42b32640 1 -- 172.21.15.72:0/1684173558 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b3c1549d0 msgr2=0x7f4b3c074260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f4b42b32640 1 --2- 172.21.15.72:0/1684173558 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b3c1549d0 0x7f4b3c074260 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c0097f0 tx=0x7f4b2c023100 comp rx=0 tx=0).stop 2024-05-09T05:53:53.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f4b42b32640 1 -- 172.21.15.72:0/1684173558 shutdown_connections 2024-05-09T05:53:53.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f4b42b32640 1 --2- 172.21.15.72:0/1684173558 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b3c1549d0 0x7f4b3c074260 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f4b42b32640 1 -- 172.21.15.72:0/1684173558 >> 172.21.15.72:0/1684173558 conn(0x7f4b3c06e9b0 msgr2=0x7f4b3c06edc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:53.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f8b387d8640 1 -- 172.21.15.72:0/1317882865 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b3015afa0 msgr2=0x7f8b30164e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f8b387d8640 1 --2- 172.21.15.72:0/1317882865 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b3015afa0 0x7f8b30164e50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8b30071c00 tx=0x7f8b2801f200 comp rx=0 tx=0).stop 2024-05-09T05:53:53.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f7e27fff640 1 -- 172.21.15.72:0/4202504164 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 456612848 0 0) 0x7f7e300c9cb0 con 0x7f7e3015adc0 2024-05-09T05:53:53.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f7e27fff640 1 -- 172.21.15.72:0/4202504164 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e300c4080 con 0x7f7e3015adc0 2024-05-09T05:53:53.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f79f2504640 1 --2- 172.21.15.72:0/1328743815 >> [v2:172.21.15.72:6816/331913921,v1:172.21.15.72:6817/331913921] conn(0x7f79d0078c10 0x7f79d007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f79f1502640 1 --2- 172.21.15.72:0/1328743815 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f79d006f450 0x7f79d0071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f08b2c67640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f08a40dda20 0x7f08a40457e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f08b2c67640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f08a40064b0 0x7f08a40ee040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f08b2c67640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08a40e7960 con 0x7f08a40060a0 2024-05-09T05:53:53.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f08b2c67640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f08a40dde30 con 0x7f08a40064b0 2024-05-09T05:53:53.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f08b2c67640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f08a40e7c20 con 0x7f08a40dda20 2024-05-09T05:53:53.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f8b387d8640 1 -- 172.21.15.72:0/1317882865 shutdown_connections 2024-05-09T05:53:53.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f8b387d8640 1 --2- 172.21.15.72:0/1317882865 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b3015afa0 0x7f8b30164e50 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f8b387d8640 1 --2- 172.21.15.72:0/1317882865 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b300c4bf0 0x7f8b300ca620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f8b387d8640 1 -- 172.21.15.72:0/1317882865 >> 172.21.15.72:0/1317882865 conn(0x7f8b30072080 msgr2=0x7f8b30072490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:53.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f4b42b32640 1 -- 172.21.15.72:0/1684173558 shutdown_connections 2024-05-09T05:53:53.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f8b387d8640 1 -- 172.21.15.72:0/1317882865 shutdown_connections 2024-05-09T05:53:53.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f08b1c65640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f08a40dda20 0x7f08a40457e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f08b1c65640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f08a40dda20 0x7f08a40457e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.72:37550/0 (socket says 172.21.15.72:37550) 2024-05-09T05:53:53.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f08b1c65640 1 -- 172.21.15.72:0/1680978141 learned_addr learned my addr 172.21.15.72:0/1680978141 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:53.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f08b2466640 1 --2- 172.21.15.72:0/1680978141 >> v2:172.21.15.72:3300/0 conn(0x7f08a40064b0 0x7f08a40ee040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f79f2504640 1 --2- 172.21.15.72:0/1328743815 >> [v2:172.21.15.72:6816/331913921,v1:172.21.15.72:6817/331913921] conn(0x7f79d0078c10 0x7f79d007b0a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:53.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f8a78f7c640 1 -- 172.21.15.72:0/301762071 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a740c4ad0 msgr2=0x7f8a740c54f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f8a78f7c640 1 --2- 172.21.15.72:0/301762071 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a740c4ad0 0x7f8a740c54f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8a68009740 tx=0x7f8a6801c2b0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f4b42b32640 1 -- 172.21.15.72:0/1684173558 wait complete. 2024-05-09T05:53:53.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f79f1502640 1 --2- 172.21.15.72:0/1328743815 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f79d006f450 0x7f79d0071960 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f79dc007bc0 tx=0x7f79dc007b10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:53.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f8ff5d9b640 1 -- 172.21.15.72:0/2738402462 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ff00e5250 con 0x7f8ff00e62f0 2024-05-09T05:53:53.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f8b387d8640 1 -- 172.21.15.72:0/1317882865 wait complete. 2024-05-09T05:53:53.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f8a78f7c640 1 -- 172.21.15.72:0/301762071 shutdown_connections 2024-05-09T05:53:53.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f8a78f7c640 1 --2- 172.21.15.72:0/301762071 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a740c4ad0 0x7f8a740c54f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f8a78f7c640 1 -- 172.21.15.72:0/301762071 >> 172.21.15.72:0/301762071 conn(0x7f8a7406cba0 msgr2=0x7f8a7406cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:53.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f8a78f7c640 1 -- 172.21.15.72:0/301762071 shutdown_connections 2024-05-09T05:53:53.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f7e27fff640 1 -- 172.21.15.72:0/4202504164 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1117430739 0 0) 0x7f7e1c003530 con 0x7f7e30169300 2024-05-09T05:53:53.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f7e27fff640 1 -- 172.21.15.72:0/4202504164 >> v2:172.21.15.110:3300/0 conn(0x7f7e300c3aa0 msgr2=0x7f7e30160990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:53.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f7e27fff640 1 --2- 172.21.15.72:0/4202504164 >> v2:172.21.15.110:3300/0 conn(0x7f7e300c3aa0 0x7f7e30160990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f7e27fff640 1 -- 172.21.15.72:0/4202504164 >> v1:172.21.15.110:6789/0 conn(0x7f7e3015adc0 legacy=0x7f7e3006c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f7e27fff640 1 -- 172.21.15.72:0/4202504164 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e300c9f70 con 0x7f7e30169300 2024-05-09T05:53:53.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f8a78f7c640 1 -- 172.21.15.72:0/301762071 wait complete. 2024-05-09T05:53:53.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f7e27fff640 1 -- 172.21.15.72:0/4202504164 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2749052815 0 0) 0x7f7e200016a0 con 0x7f7e30169300 2024-05-09T05:53:53.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f79e27fc640 1 -- 172.21.15.72:0/1328743815 <== osd.0 v2:172.21.15.72:6816/331913921 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f79d007b770 con 0x7f79d0078c10 2024-05-09T05:53:53.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f7e27fff640 1 -- 172.21.15.72:0/4202504164 >> v1:172.21.15.72:6789/0 conn(0x7f7e30169300 legacy=0x7f7e3016b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f7e27fff640 1 --2- 172.21.15.72:0/4202504164 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e1c003c40 0x7f7e1c004070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f7e27fff640 1 --2- 172.21.15.72:0/4202504164 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e1c004810 0x7f7e1c004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f8ff5d9b640 1 --2- 172.21.15.72:0/2738402462 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ff00e62f0 0x7f8ff00e6700 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0053140 tx=0x7f8fec01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8292d95363aa9c78 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:53.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f7e27fff640 1 --2- 172.21.15.72:0/4202504164 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e1c005320 0x7f7e1c00ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f7e27fff640 1 -- 172.21.15.72:0/4202504164 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7e1c00c260 con 0x7f7e1c005320 2024-05-09T05:53:53.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f7e27fff640 1 -- 172.21.15.72:0/4202504164 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f7e1c00c410 con 0x7f7e1c004810 2024-05-09T05:53:53.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f7e27fff640 1 -- 172.21.15.72:0/4202504164 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f7e1c00c610 con 0x7f7e1c003c40 2024-05-09T05:53:53.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f7e35521640 1 --2- 172.21.15.72:0/4202504164 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e1c003c40 0x7f7e1c004070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f7e35d22640 1 --2- 172.21.15.72:0/4202504164 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e1c005320 0x7f7e1c00ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f8ff559a640 1 -- 172.21.15.72:0/2738402462 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fec0b5070 con 0x7f8ff00e62f0 2024-05-09T05:53:53.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f8ff559a640 1 -- 172.21.15.72:0/2738402462 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fec0a8970 con 0x7f8ff00e62f0 2024-05-09T05:53:53.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f8ff559a640 1 -- 172.21.15.72:0/2738402462 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fec0a8d40 con 0x7f8ff00e62f0 2024-05-09T05:53:53.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f7e35d22640 1 -- 172.21.15.72:0/4202504164 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e1c003c40 msgr2=0x7f7e1c004070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:53.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f7e35d22640 1 --2- 172.21.15.72:0/4202504164 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e1c003c40 0x7f7e1c004070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f7e35d22640 1 -- 172.21.15.72:0/4202504164 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e1c004810 msgr2=0x7f7e1c004c20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T05:53:53.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f7e35d22640 1 --2- 172.21.15.72:0/4202504164 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e1c004810 0x7f7e1c004c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f7e35d22640 1 -- 172.21.15.72:0/4202504164 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e1c003530 con 0x7f7e1c005320 2024-05-09T05:53:53.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.479+0000 7f8b387d8640 1 Processor -- start 2024-05-09T05:53:53.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.479+0000 7f4b42b32640 1 Processor -- start 2024-05-09T05:53:53.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.479+0000 7f4b42b32640 1 -- start start 2024-05-09T05:53:53.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.479+0000 7f8b387d8640 1 -- start start 2024-05-09T05:53:53.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f08b1c65640 1 -- 172.21.15.72:0/1680978141 >> v2:172.21.15.72:3300/0 conn(0x7f08a40064b0 msgr2=0x7f08a40ee040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:53.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f08b1c65640 1 --2- 172.21.15.72:0/1680978141 >> v2:172.21.15.72:3300/0 conn(0x7f08a40064b0 0x7f08a40ee040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f08b1c65640 1 -- 172.21.15.72:0/1680978141 >> v1:172.21.15.110:6789/0 conn(0x7f08a40060a0 legacy=0x7f08a404b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:53.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f08b1c65640 1 -- 172.21.15.72:0/1680978141 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08a40e4620 con 0x7f08a40dda20 2024-05-09T05:53:53.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.475+0000 7f08b2466640 1 --2- 172.21.15.72:0/1680978141 >> v2:172.21.15.72:3300/0 conn(0x7f08a40064b0 0x7f08a40ee040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T05:53:53.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.479+0000 7f8ff759e640 1 -- 172.21.15.72:0/2738402462 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ff00e62f0 msgr2=0x7f8ff00e6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.479+0000 7f8ff759e640 1 --2- 172.21.15.72:0/2738402462 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ff00e62f0 0x7f8ff00e6700 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0053140 tx=0x7f8fec01ec70 comp rx=0 tx=0).stop 2024-05-09T05:53:53.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.479+0000 7f8ff759e640 1 -- 172.21.15.72:0/2738402462 shutdown_connections 2024-05-09T05:53:53.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.479+0000 7f8ff759e640 1 --2- 172.21.15.72:0/2738402462 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ff00e62f0 0x7f8ff00e6700 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.479+0000 7f8ff759e640 1 --2- 172.21.15.72:0/2738402462 >> v2:172.21.15.110:3300/0 conn(0x7f8ff00e4300 0x7f8ff00dd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.479+0000 7f8ff759e640 1 -- 172.21.15.72:0/2738402462 >> 172.21.15.72:0/2738402462 conn(0x7f8ff0058b40 msgr2=0x7f8ff0058f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:53.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.479+0000 7f8a78f7c640 1 Processor -- start 2024-05-09T05:53:53.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.479+0000 7f8ff759e640 1 -- 172.21.15.72:0/2738402462 shutdown_connections 2024-05-09T05:53:53.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.479+0000 7f8a78f7c640 1 -- start start 2024-05-09T05:53:53.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.479+0000 7f08b1c65640 1 --2- 172.21.15.72:0/1680978141 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f08a40dda20 0x7f08a40457e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f08a8009870 tx=0x7f08a801c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46ac97843f6da73f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:53.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.479+0000 7f4b42b32640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b3c06d7b0 0x7f4b3c1f7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.479+0000 7f8a78f7c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a740c4ad0 0x7f8a74209260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.479+0000 7f8a78f7c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a740cabb0 0x7f8a741677c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.479+0000 7f08b0c63640 1 -- 172.21.15.72:0/1680978141 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08a80b0070 con 0x7f08a40dda20 2024-05-09T05:53:53.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.479+0000 7f7e35d22640 1 -- 172.21.15.72:0/4202504164 reap_dead start 2024-05-09T05:53:53.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.479+0000 7f8a78f7c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8a741719a0 0x7f8a7415eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.479+0000 7f8a78f7c640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f8a740ce2b0 con 0x7f8a740c4ad0 2024-05-09T05:53:53.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.479+0000 7f8a78f7c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f8a740ca720 con 0x7f8a740cabb0 2024-05-09T05:53:53.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.479+0000 7f8a78f7c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f8a7408ecf0 con 0x7f8a741719a0 2024-05-09T05:53:53.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.479+0000 7f08b0c63640 1 -- 172.21.15.72:0/1680978141 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08a80ab600 con 0x7f08a40dda20 2024-05-09T05:53:53.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.479+0000 7f08b0c63640 1 -- 172.21.15.72:0/1680978141 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08a80ab9d0 con 0x7f08a40dda20 2024-05-09T05:53:53.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.479+0000 7f8b387d8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b300c4bf0 0x7f8b3014e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.479+0000 7f8b387d8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b3015ab90 0x7f8b3014fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.479+0000 7f8b387d8640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b3015afa0 0x7f8b30154f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.479+0000 7f8b387d8640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f8b30154b50 con 0x7f8b3015afa0 2024-05-09T05:53:53.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.479+0000 7f8b387d8640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f8b300cc1f0 con 0x7f8b300c4bf0 2024-05-09T05:53:53.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.479+0000 7f8b387d8640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f8b3015b3b0 con 0x7f8b3015ab90 2024-05-09T05:53:53.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.479+0000 7f8a737fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a740c4ad0 0x7f8a74209260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.479+0000 7f8a737fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a740c4ad0 0x7f8a74209260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42064/0 (socket says 172.21.15.72:42064) 2024-05-09T05:53:53.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.479+0000 7f8a737fe640 1 -- 172.21.15.72:0/2702841556 learned_addr learned my addr 172.21.15.72:0/2702841556 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:53.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.479+0000 7f8a73fff640 1 --2- 172.21.15.72:0/2702841556 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8a741719a0 0x7f8a7415eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.479+0000 7f7e35d22640 1 --2- 172.21.15.72:0/4202504164 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e1c005320 0x7f7e1c00ba50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7e300724f0 tx=0x7f7e2001ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99715ba65cad1a91 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:53.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.479+0000 7f8a72ffd640 1 --2- 172.21.15.72:0/2702841556 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a740cabb0 0x7f8a741677c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.479+0000 7f4b408ce640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b3c06d7b0 0x7f4b3c1f7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.479+0000 7f8b36574640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b300c4bf0 0x7f8b3014e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.479+0000 7f8a737fe640 1 -- 172.21.15.72:0/2702841556 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8a741719a0 msgr2=0x7f8a7415eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.479+0000 7f8a737fe640 1 --2- 172.21.15.72:0/2702841556 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8a741719a0 0x7f8a7415eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.479+0000 7f8a737fe640 1 -- 172.21.15.72:0/2702841556 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a740cabb0 msgr2=0x7f8a741677c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.479+0000 7f8a737fe640 1 --2- 172.21.15.72:0/2702841556 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a740cabb0 0x7f8a741677c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.479+0000 7f8a737fe640 1 -- 172.21.15.72:0/2702841556 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a74167d00 con 0x7f8a740c4ad0 2024-05-09T05:53:53.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.479+0000 7f8b35d73640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b3015ab90 0x7f8b3014fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.479+0000 7f8b35d73640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b3015ab90 0x7f8b3014fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.72:37604/0 (socket says 172.21.15.72:37604) 2024-05-09T05:53:53.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.479+0000 7f8b35d73640 1 -- 172.21.15.72:0/1191957740 learned_addr learned my addr 172.21.15.72:0/1191957740 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:53.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.479+0000 7f7e27fff640 1 -- 172.21.15.72:0/4202504164 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e20007bf0 con 0x7f7e1c005320 2024-05-09T05:53:53.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.479+0000 7f8b36d75640 1 --2- 172.21.15.72:0/1191957740 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b3015afa0 0x7f8b30154f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.479+0000 7f7e27fff640 1 -- 172.21.15.72:0/4202504164 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e200a9070 con 0x7f7e1c005320 2024-05-09T05:53:53.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.479+0000 7f7e27fff640 1 -- 172.21.15.72:0/4202504164 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e20005d60 con 0x7f7e1c005320 2024-05-09T05:53:53.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.479+0000 7f8a737fe640 1 --2- 172.21.15.72:0/2702841556 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a740c4ad0 0x7f8a74209260 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8a6400c5c0 tx=0x7f8a6400ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:53.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.479+0000 7f4b42b32640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b3c1549d0 0x7f4b3c157150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.479+0000 7f4b42b32640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b3c15b150 0x7f4b3c153370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.479+0000 7f4b42b32640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3c15a4d0 con 0x7f4b3c1549d0 2024-05-09T05:53:53.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.479+0000 7f4b42b32640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3c0ca2b0 con 0x7f4b3c15b150 2024-05-09T05:53:53.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.479+0000 7f4b42b32640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f4b3c06fe90 con 0x7f4b3c06d7b0 2024-05-09T05:53:53.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.483+0000 7f4b408ce640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b3c06d7b0 0x7f4b3c1f7400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.72:37580/0 (socket says 172.21.15.72:37580) 2024-05-09T05:53:53.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.483+0000 7f4b408ce640 1 -- 172.21.15.72:0/2987823096 learned_addr learned my addr 172.21.15.72:0/2987823096 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:53.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.479+0000 7f8ff759e640 1 -- 172.21.15.72:0/2738402462 wait complete. 2024-05-09T05:53:53.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.483+0000 7f8ff759e640 1 Processor -- start 2024-05-09T05:53:53.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.483+0000 7f4b3bfff640 1 --2- 172.21.15.72:0/2987823096 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b3c1549d0 0x7f4b3c157150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.483+0000 7f8b36d75640 1 -- 172.21.15.72:0/1191957740 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b3015ab90 msgr2=0x7f8b3014fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.483+0000 7f8b36d75640 1 --2- 172.21.15.72:0/1191957740 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b3015ab90 0x7f8b3014fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.483+0000 7f8b36d75640 1 -- 172.21.15.72:0/1191957740 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b300c4bf0 msgr2=0x7f8b3014e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.483+0000 7f8b36d75640 1 --2- 172.21.15.72:0/1191957740 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b300c4bf0 0x7f8b3014e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.483+0000 7f8b36d75640 1 -- 172.21.15.72:0/1191957740 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b301576b0 con 0x7f8b3015afa0 2024-05-09T05:53:53.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.483+0000 7f8b36d75640 1 --2- 172.21.15.72:0/1191957740 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b3015afa0 0x7f8b30154f50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8b30073e10 tx=0x7f8b2801bfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:53.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.483+0000 7f08b2c67640 1 -- 172.21.15.72:0/1680978141 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f08a40dda20 msgr2=0x7f08a40457e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.483+0000 7f08b2c67640 1 --2- 172.21.15.72:0/1680978141 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f08a40dda20 0x7f08a40457e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f08a8009870 tx=0x7f08a801c560 comp rx=0 tx=0).stop 2024-05-09T05:53:53.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.483+0000 7f08b2c67640 1 -- 172.21.15.72:0/1680978141 shutdown_connections 2024-05-09T05:53:53.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.483+0000 7f08b2c67640 1 --2- 172.21.15.72:0/1680978141 >> v2:172.21.15.72:3300/0 conn(0x7f08a40064b0 0x7f08a40ee040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.483+0000 7f08b2c67640 1 --2- 172.21.15.72:0/1680978141 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f08a40dda20 0x7f08a40457e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.483+0000 7f08b2c67640 1 -- 172.21.15.72:0/1680978141 >> 172.21.15.72:0/1680978141 conn(0x7f08a40503c0 msgr2=0x7f08a40507d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:53.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.483+0000 7f08b2c67640 1 -- 172.21.15.72:0/1680978141 shutdown_connections 2024-05-09T05:53:53.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.483+0000 7f4b3bfff640 1 -- 172.21.15.72:0/2987823096 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b3c06d7b0 msgr2=0x7f4b3c1f7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.483+0000 7f4b3bfff640 1 --2- 172.21.15.72:0/2987823096 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b3c06d7b0 0x7f4b3c1f7400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.483+0000 7f4b3bfff640 1 -- 172.21.15.72:0/2987823096 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b3c15b150 msgr2=0x7f4b3c153370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.483+0000 7f4b3bfff640 1 --2- 172.21.15.72:0/2987823096 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b3c15b150 0x7f4b3c153370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.483+0000 7f4b3bfff640 1 -- 172.21.15.72:0/2987823096 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b3c1560b0 con 0x7f4b3c1549d0 2024-05-09T05:53:53.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.483+0000 7f8b26ffd640 1 -- 172.21.15.72:0/1191957740 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b280b4040 con 0x7f8b3015afa0 2024-05-09T05:53:53.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.483+0000 7f7e37785640 1 -- 172.21.15.72:0/4202504164 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e1c005320 msgr2=0x7f7e1c00ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.483+0000 7f7e37785640 1 --2- 172.21.15.72:0/4202504164 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e1c005320 0x7f7e1c00ba50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7e300724f0 tx=0x7f7e2001ca40 comp rx=0 tx=0).stop 2024-05-09T05:53:53.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.483+0000 7f4b3bfff640 1 --2- 172.21.15.72:0/2987823096 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b3c1549d0 0x7f4b3c157150 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4b3000c390 tx=0x7f4b3000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:53.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.483+0000 7f4b397fa640 1 -- 172.21.15.72:0/2987823096 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b30017070 con 0x7f4b3c1549d0 2024-05-09T05:53:53.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.483+0000 7f8b387d8640 1 -- 172.21.15.72:0/1191957740 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b3014ee60 con 0x7f8b3015afa0 2024-05-09T05:53:53.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.483+0000 7f8b387d8640 1 -- 172.21.15.72:0/1191957740 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b300c5130 con 0x7f8b3015afa0 2024-05-09T05:53:53.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.483+0000 7f8b387d8640 1 -- 172.21.15.72:0/1191957740 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8b30200640 con 0x7f8b3015afa0 2024-05-09T05:53:53.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.483+0000 7f4b397fa640 1 -- 172.21.15.72:0/2987823096 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b30005cf0 con 0x7f4b3c1549d0 2024-05-09T05:53:53.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.483+0000 7f4b397fa640 1 -- 172.21.15.72:0/2987823096 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b30007310 con 0x7f4b3c1549d0 2024-05-09T05:53:53.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.483+0000 7f4b42b32640 1 -- 172.21.15.72:0/2987823096 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b3c156390 con 0x7f4b3c1549d0 2024-05-09T05:53:53.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.483+0000 7f4b42b32640 1 -- 172.21.15.72:0/2987823096 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b3c156950 con 0x7f4b3c1549d0 2024-05-09T05:53:53.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.483+0000 7f4b42b32640 1 -- 172.21.15.72:0/2987823096 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4b3c156d30 con 0x7f4b3c1549d0 2024-05-09T05:53:53.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.483+0000 7f8b26ffd640 1 -- 172.21.15.72:0/1191957740 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b280bf070 con 0x7f8b3015afa0 2024-05-09T05:53:53.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.483+0000 7f8ff759e640 1 -- start start 2024-05-09T05:53:53.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.483+0000 7f08b2c67640 1 -- 172.21.15.72:0/1680978141 wait complete. 2024-05-09T05:53:53.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.483+0000 7f8b26ffd640 1 -- 172.21.15.72:0/1191957740 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b280af400 con 0x7f8b3015afa0 2024-05-09T05:53:53.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.483+0000 7f8ff759e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8ff000a2f0 0x7f8ff017ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.483+0000 7f8b26ffd640 1 -- 172.21.15.72:0/1191957740 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f8b280afc80 con 0x7f8b3015afa0 2024-05-09T05:53:53.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.483+0000 7f08b2c67640 1 Processor -- start 2024-05-09T05:53:53.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.483+0000 7f8ff759e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8ff00e4300 0x7f8ff00d1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.483+0000 7f08b2c67640 1 -- start start 2024-05-09T05:53:53.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.483+0000 7f8ff759e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ff00e62f0 0x7f8ff00de1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.487+0000 7f8b26ffd640 1 --2- 172.21.15.72:0/1191957740 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f8b1406f5d0 0x7f8b14071ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.487+0000 7f8ff759e640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff00e5af0 con 0x7f8ff00e62f0 2024-05-09T05:53:53.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.487+0000 7f8ff759e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff00e5810 con 0x7f8ff00e4300 2024-05-09T05:53:53.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.487+0000 7f8ff759e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f8ff00e5dd0 con 0x7f8ff000a2f0 2024-05-09T05:53:53.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.487+0000 7f8b26ffd640 1 -- 172.21.15.72:0/1191957740 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8b2812cf10 con 0x7f8b3015afa0 2024-05-09T05:53:53.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.487+0000 7f8ff659c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8ff000a2f0 0x7f8ff017ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.487+0000 7f8ff5d9b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8ff00e4300 0x7f8ff00d1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.487+0000 7f8ff659c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8ff000a2f0 0x7f8ff017ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.72:37614/0 (socket says 172.21.15.72:37614) 2024-05-09T05:53:53.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.487+0000 7f8ff659c640 1 -- 172.21.15.72:0/2813085426 learned_addr learned my addr 172.21.15.72:0/2813085426 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:53.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.487+0000 7f8b26ffd640 1 --2- 172.21.15.72:0/1191957740 >> [v2:172.21.15.110:6808/1817638786,v1:172.21.15.110:6809/1817638786] conn(0x7f8b14078d10 0x7f8b1407b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.487+0000 7f8b26ffd640 1 -- 172.21.15.72:0/1191957740 --> [v2:172.21.15.110:6808/1817638786,v1:172.21.15.110:6809/1817638786] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8b280c7ec0 con 0x7f8b14078d10 2024-05-09T05:53:53.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.487+0000 7f8ff6d9d640 1 --2- 172.21.15.72:0/2813085426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ff00e62f0 0x7f8ff00de1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.487+0000 7f8b36574640 1 --2- 172.21.15.72:0/1191957740 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f8b1406f5d0 0x7f8b14071ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.487+0000 7f8b35d73640 1 --2- 172.21.15.72:0/1191957740 >> [v2:172.21.15.110:6808/1817638786,v1:172.21.15.110:6809/1817638786] conn(0x7f8b14078d10 0x7f8b1407b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.487+0000 7f8a5bfff640 1 -- 172.21.15.72:0/2702841556 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a64017070 con 0x7f8a740c4ad0 2024-05-09T05:53:53.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.487+0000 7f8ff6d9d640 1 -- 172.21.15.72:0/2813085426 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8ff000a2f0 msgr2=0x7f8ff017ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.487+0000 7f8ff6d9d640 1 --2- 172.21.15.72:0/2813085426 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8ff000a2f0 0x7f8ff017ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.487+0000 7f8ff6d9d640 1 -- 172.21.15.72:0/2813085426 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8ff00e4300 msgr2=0x7f8ff00d1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.487+0000 7f8ff6d9d640 1 --2- 172.21.15.72:0/2813085426 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8ff00e4300 0x7f8ff00d1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.487+0000 7f8ff6d9d640 1 -- 172.21.15.72:0/2813085426 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ff017a4b0 con 0x7f8ff00e62f0 2024-05-09T05:53:53.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.487+0000 7f8a78f7c640 1 -- 172.21.15.72:0/2702841556 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a7416bc90 con 0x7f8a740c4ad0 2024-05-09T05:53:53.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.487+0000 7f8a78f7c640 1 -- 172.21.15.72:0/2702841556 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a7416c230 con 0x7f8a740c4ad0 2024-05-09T05:53:53.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.487+0000 7f8a5bfff640 1 -- 172.21.15.72:0/2702841556 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a64003600 con 0x7f8a740c4ad0 2024-05-09T05:53:53.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.487+0000 7f8ff6d9d640 1 --2- 172.21.15.72:0/2813085426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ff00e62f0 0x7f8ff00de1c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8fe800c3c0 tx=0x7f8fe800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:53.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.487+0000 7f8b36574640 1 --2- 172.21.15.72:0/1191957740 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f8b1406f5d0 0x7f8b14071ae0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8b20009990 tx=0x7f8b20008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:53.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.487+0000 7f8b35d73640 1 --2- 172.21.15.72:0/1191957740 >> [v2:172.21.15.110:6808/1817638786,v1:172.21.15.110:6809/1817638786] conn(0x7f8b14078d10 0x7f8b1407b1a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:53.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.487+0000 7f8b35d73640 1 -- 172.21.15.72:0/1191957740 >> [v2:172.21.15.110:6808/1817638786,v1:172.21.15.110:6809/1817638786] conn(0x7f8b14078d10 msgr2=0x7f8b1407b1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-05-09T05:53:53.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.487+0000 7f8b35d73640 1 -- 172.21.15.72:0/1191957740 >> [v2:172.21.15.110:6808/1817638786,v1:172.21.15.110:6809/1817638786] conn(0x7f8b14078d10 msgr2=0x7f8b1407b1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-09T05:53:53.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.487+0000 7f8b35d73640 1 --2- 172.21.15.72:0/1191957740 >> [v2:172.21.15.110:6808/1817638786,v1:172.21.15.110:6809/1817638786] conn(0x7f8b14078d10 0x7f8b1407b1a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-09T05:53:53.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.487+0000 7f8b35d73640 1 --2- 172.21.15.72:0/1191957740 >> [v2:172.21.15.110:6808/1817638786,v1:172.21.15.110:6809/1817638786] conn(0x7f8b14078d10 0x7f8b1407b1a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.487+0000 7f8b26ffd640 1 -- 172.21.15.72:0/1191957740 >> [v2:172.21.15.110:6808/1817638786,v1:172.21.15.110:6809/1817638786] conn(0x7f8b14078d10 msgr2=0x7f8b1407b1a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-09T05:53:53.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.487+0000 7f8b26ffd640 1 --2- 172.21.15.72:0/1191957740 >> [v2:172.21.15.110:6808/1817638786,v1:172.21.15.110:6809/1817638786] conn(0x7f8b14078d10 0x7f8b1407b1a0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.487+0000 7f8b26ffd640 1 --2- 172.21.15.72:0/1191957740 >> [v2:172.21.15.110:6808/1817638786,v1:172.21.15.110:6809/1817638786] conn(0x7f8b1407d270 0x7f8b1407f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.487+0000 7f8b26ffd640 1 -- 172.21.15.72:0/1191957740 --> [v2:172.21.15.110:6808/1817638786,v1:172.21.15.110:6809/1817638786] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8b280acec0 con 0x7f8b1407d270 2024-05-09T05:53:53.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.487+0000 7f8b26ffd640 1 -- 172.21.15.72:0/1191957740 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=26}) -- 0x7f8b1407fd70 con 0x7f8b3015afa0 2024-05-09T05:53:53.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.487+0000 7f8b35d73640 1 --2- 172.21.15.72:0/1191957740 >> [v2:172.21.15.110:6808/1817638786,v1:172.21.15.110:6809/1817638786] conn(0x7f8b1407d270 0x7f8b1407f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.487+0000 7f8a5bfff640 1 -- 172.21.15.72:0/2702841556 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a640054a0 con 0x7f8a740c4ad0 2024-05-09T05:53:53.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.487+0000 7f08b2c67640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f08a40060a0 0x7f08a41866d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.487+0000 7f08b2c67640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08a40064b0 0x7f08a40cfb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.487+0000 7f8a78f7c640 1 -- 172.21.15.72:0/2702841556 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8a54001040 con 0x7f8a740c4ad0 2024-05-09T05:53:53.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.487+0000 7f08b1464640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08a40064b0 0x7f08a40cfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.487+0000 7f08b1464640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08a40064b0 0x7f08a40cfb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42086/0 (socket says 172.21.15.72:42086) 2024-05-09T05:53:53.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.487+0000 7f08b1c65640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f08a40060a0 0x7f08a41866d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.487+0000 7f08b2c67640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f08a40dda20 0x7f08a4182fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.487+0000 7f08b1c65640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f08a40060a0 0x7f08a41866d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.72:37620/0 (socket says 172.21.15.72:37620) 2024-05-09T05:53:53.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.487+0000 7f08b1464640 1 -- 172.21.15.72:0/1432323667 learned_addr learned my addr 172.21.15.72:0/1432323667 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:53.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.487+0000 7f4b397fa640 1 -- 172.21.15.72:0/2987823096 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f4b3001a070 con 0x7f4b3c1549d0 2024-05-09T05:53:53.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.487+0000 7f4b397fa640 1 --2- 172.21.15.72:0/2987823096 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f4b2806f4d0 0x7f4b280719e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.487+0000 7f4b397fa640 1 -- 172.21.15.72:0/2987823096 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4b3008efb0 con 0x7f4b3c1549d0 2024-05-09T05:53:53.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.487+0000 7f4b397fa640 1 --2- 172.21.15.72:0/2987823096 >> [v2:172.21.15.110:6824/977576181,v1:172.21.15.110:6825/977576181] conn(0x7f4b28078c90 0x7f4b2807b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.487+0000 7f4b397fa640 1 -- 172.21.15.72:0/2987823096 --> [v2:172.21.15.110:6824/977576181,v1:172.21.15.110:6825/977576181] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4b2807b7f0 con 0x7f4b28078c90 2024-05-09T05:53:53.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.487+0000 7f4b397fa640 1 -- 172.21.15.72:0/2987823096 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4b3008f3a0 con 0x7f4b3c1549d0 2024-05-09T05:53:53.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.487+0000 7f8b35d73640 1 --2- 172.21.15.72:0/1191957740 >> [v2:172.21.15.110:6808/1817638786,v1:172.21.15.110:6809/1817638786] conn(0x7f8b1407d270 0x7f8b1407f6b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:53.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.487+0000 7fd0df37d640 1 Processor -- start 2024-05-09T05:53:53.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.487+0000 7fd0df37d640 1 -- start start 2024-05-09T05:53:53.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.487+0000 7f08b2c67640 1 -- 172.21.15.72:0/1432323667 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f08a40e7670 con 0x7f08a40064b0 2024-05-09T05:53:53.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.487+0000 7f08b2c67640 1 -- 172.21.15.72:0/1432323667 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f08a40e4100 con 0x7f08a40dda20 2024-05-09T05:53:53.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.487+0000 7f08b2c67640 1 -- 172.21.15.72:0/1432323667 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f08a404ca60 con 0x7f08a40060a0 2024-05-09T05:53:53.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.487+0000 7f08b2466640 1 --2- 172.21.15.72:0/1432323667 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f08a40dda20 0x7f08a4182fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.487+0000 7f4b408ce640 1 --2- 172.21.15.72:0/2987823096 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f4b2806f4d0 0x7f4b280719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.487+0000 7f08b1464640 1 -- 172.21.15.72:0/1432323667 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f08a40060a0 msgr2=0x7f08a41866d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.487+0000 7f08b1464640 1 --2- 172.21.15.72:0/1432323667 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f08a40060a0 0x7f08a41866d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.487+0000 7f08b1464640 1 -- 172.21.15.72:0/1432323667 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f08a40dda20 msgr2=0x7f08a4182fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.487+0000 7f08b1464640 1 --2- 172.21.15.72:0/1432323667 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f08a40dda20 0x7f08a4182fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.487+0000 7f08b1464640 1 -- 172.21.15.72:0/1432323667 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08a40e1530 con 0x7f08a40064b0 2024-05-09T05:53:53.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.487+0000 7f08b1464640 1 --2- 172.21.15.72:0/1432323667 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08a40064b0 0x7f08a40cfb80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f08ac07d5a0 tx=0x7f08ac06a070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:53.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.491+0000 7f8b26ffd640 1 -- 172.21.15.72:0/1191957740 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8b280f5a90 con 0x7f8b3015afa0 2024-05-09T05:53:53.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.491+0000 7f08a27fc640 1 -- 172.21.15.72:0/1432323667 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08ac06d920 con 0x7f08a40064b0 2024-05-09T05:53:53.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.491+0000 7f08a27fc640 1 -- 172.21.15.72:0/1432323667 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08ac093030 con 0x7f08a40064b0 2024-05-09T05:53:53.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.491+0000 7f08a27fc640 1 -- 172.21.15.72:0/1432323667 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08ac06dd00 con 0x7f08a40064b0 2024-05-09T05:53:53.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.491+0000 7f08b2c67640 1 -- 172.21.15.72:0/1432323667 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08a4186c10 con 0x7f08a40064b0 2024-05-09T05:53:53.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.491+0000 7f08b2c67640 1 -- 172.21.15.72:0/1432323667 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08a40e3310 con 0x7f08a40064b0 2024-05-09T05:53:53.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.491+0000 7fd0df37d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd0d004b5e0 0x7fd0d004b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.491+0000 7fd0df37d640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd0d00e5a60 0x7fd0d00e7e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.491+0000 7fd0df37d640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0d0033970 con 0x7fd0d00d72e0 2024-05-09T05:53:53.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.491+0000 7fd0df37d640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fd0d0033690 con 0x7fd0d00e5a60 2024-05-09T05:53:53.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.491+0000 7fd0df37d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fd0d00ddc80 con 0x7fd0d004b5e0 2024-05-09T05:53:53.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.491+0000 7f088ffff640 1 -- 172.21.15.72:0/1432323667 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0888001040 con 0x7f08a40064b0 2024-05-09T05:53:53.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.491+0000 7f8fe6ffd640 1 -- 172.21.15.72:0/2813085426 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe8017070 con 0x7f8ff00e62f0 2024-05-09T05:53:53.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.491+0000 7f8a5bfff640 1 -- 172.21.15.72:0/2702841556 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f8a6401a070 con 0x7f8a740c4ad0 2024-05-09T05:53:53.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.491+0000 7f8a5bfff640 1 --2- 172.21.15.72:0/2702841556 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f8a6006f500 0x7f8a60071a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.491+0000 7f8a5bfff640 1 -- 172.21.15.72:0/2702841556 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8a6408f0f0 con 0x7f8a740c4ad0 2024-05-09T05:53:53.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.491+0000 7f8a5bfff640 1 --2- 172.21.15.72:0/2702841556 >> [v2:172.21.15.110:6816/3437318248,v1:172.21.15.110:6817/3437318248] conn(0x7f8a60078cc0 0x7f8a6007b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.491+0000 7f8a5bfff640 1 -- 172.21.15.72:0/2702841556 --> [v2:172.21.15.110:6816/3437318248,v1:172.21.15.110:6817/3437318248] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8a64003600 con 0x7f8a60078cc0 2024-05-09T05:53:53.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.491+0000 7fd0ddb7a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd0d004b5e0 0x7fd0d004b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.491+0000 7f8a5bfff640 1 -- 172.21.15.72:0/2702841556 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8a6408f4e0 con 0x7f8a740c4ad0 2024-05-09T05:53:53.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.491+0000 7fd0ddb7a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd0d004b5e0 0x7fd0d004b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.72:37628/0 (socket says 172.21.15.72:37628) 2024-05-09T05:53:53.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.491+0000 7f7e37785640 1 -- 172.21.15.72:0/4202504164 shutdown_connections 2024-05-09T05:53:53.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.491+0000 7f7e37785640 1 --2- 172.21.15.72:0/4202504164 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e1c005320 0x7f7e1c00ba50 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.491+0000 7f7e37785640 1 -- 172.21.15.72:0/4202504164 >> 172.21.15.72:0/4202504164 conn(0x7f7e3006e8e0 msgr2=0x7f7e300cdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:53.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.491+0000 7f7e37785640 1 -- 172.21.15.72:0/4202504164 shutdown_connections 2024-05-09T05:53:53.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.491+0000 7fd0ddb7a640 1 -- 172.21.15.72:0/1781906878 learned_addr learned my addr 172.21.15.72:0/1781906878 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:53.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.491+0000 7f7e37785640 1 -- 172.21.15.72:0/4202504164 wait complete. 2024-05-09T05:53:53.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.491+0000 7f8a72ffd640 1 --2- 172.21.15.72:0/2702841556 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f8a6006f500 0x7f8a60071a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.487+0000 7f4b410cf640 1 --2- 172.21.15.72:0/2987823096 >> [v2:172.21.15.110:6824/977576181,v1:172.21.15.110:6825/977576181] conn(0x7f4b28078c90 0x7f4b2807b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.491+0000 7f4b410cf640 1 --2- 172.21.15.72:0/2987823096 >> [v2:172.21.15.110:6824/977576181,v1:172.21.15.110:6825/977576181] conn(0x7f4b28078c90 0x7f4b2807b120 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:53.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.491+0000 7f4b408ce640 1 --2- 172.21.15.72:0/2987823096 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f4b2806f4d0 0x7f4b280719e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c01fd10 tx=0x7f4b2c0ae070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:53.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.491+0000 7f8a73fff640 1 --2- 172.21.15.72:0/2702841556 >> [v2:172.21.15.110:6816/3437318248,v1:172.21.15.110:6817/3437318248] conn(0x7f8a60078cc0 0x7f8a6007b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.491+0000 7f8ff759e640 1 -- 172.21.15.72:0/2813085426 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ff017b180 con 0x7f8ff00e62f0 2024-05-09T05:53:53.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.491+0000 7f8ff759e640 1 -- 172.21.15.72:0/2813085426 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ff00502a0 con 0x7f8ff00e62f0 2024-05-09T05:53:53.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.491+0000 7fd0ddb7a640 1 -- 172.21.15.72:0/1781906878 >> v2:172.21.15.72:3300/0 conn(0x7fd0d00e5a60 msgr2=0x7fd0d00e7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:53.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.491+0000 7fd0ddb7a640 1 --2- 172.21.15.72:0/1781906878 >> v2:172.21.15.72:3300/0 conn(0x7fd0d00e5a60 0x7fd0d00e7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.491+0000 7fd0ddb7a640 1 -- 172.21.15.72:0/1781906878 >> v1:172.21.15.110:6789/0 conn(0x7fd0d00d72e0 legacy=0x7fd0d00063a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T05:53:53.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.491+0000 7fd0ddb7a640 1 -- 172.21.15.72:0/1781906878 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0d004ade0 con 0x7fd0d004b5e0 2024-05-09T05:53:53.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.491+0000 7f8a72ffd640 1 --2- 172.21.15.72:0/2702841556 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f8a6006f500 0x7f8a60071a10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8a680ad000 tx=0x7f8a680a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:53.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.491+0000 7f4b397fa640 1 -- 172.21.15.72:0/2987823096 <== osd.5 v2:172.21.15.110:6824/977576181 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4b2807b7f0 con 0x7f4b28078c90 2024-05-09T05:53:53.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.491+0000 7f7e37785640 1 Processor -- start 2024-05-09T05:53:53.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.491+0000 7f08a27fc640 1 -- 172.21.15.72:0/1432323667 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f08ac076e00 con 0x7f08a40064b0 2024-05-09T05:53:53.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.491+0000 7f08a27fc640 1 --2- 172.21.15.72:0/1432323667 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f089006f400 0x7f0890071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.491+0000 7f8fe4ff9640 1 -- 172.21.15.72:0/2813085426 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8fdc001040 con 0x7f8ff00e62f0 2024-05-09T05:53:53.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.491+0000 7f8fe6ffd640 1 -- 172.21.15.72:0/2813085426 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fe8005d10 con 0x7f8ff00e62f0 2024-05-09T05:53:53.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.491+0000 7f8fe6ffd640 1 -- 172.21.15.72:0/2813085426 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe8007310 con 0x7f8ff00e62f0 2024-05-09T05:53:53.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.491+0000 7f08a27fc640 1 -- 172.21.15.72:0/1432323667 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f08ac10bd20 con 0x7f08a40064b0 2024-05-09T05:53:53.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.491+0000 7f08a27fc640 1 --2- 172.21.15.72:0/1432323667 >> [v2:172.21.15.72:6824/1273581990,v1:172.21.15.72:6825/1273581990] conn(0x7f0890078ac0 0x7f089007af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.491+0000 7f08a27fc640 1 -- 172.21.15.72:0/1432323667 --> [v2:172.21.15.72:6824/1273581990,v1:172.21.15.72:6825/1273581990] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f089007b620 con 0x7f0890078ac0 2024-05-09T05:53:53.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.495+0000 7f08b1c65640 1 --2- 172.21.15.72:0/1432323667 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f089006f400 0x7f0890071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.495+0000 7f08b2466640 1 --2- 172.21.15.72:0/1432323667 >> [v2:172.21.15.72:6824/1273581990,v1:172.21.15.72:6825/1273581990] conn(0x7f0890078ac0 0x7f089007af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.495+0000 7f08b2466640 1 --2- 172.21.15.72:0/1432323667 >> [v2:172.21.15.72:6824/1273581990,v1:172.21.15.72:6825/1273581990] conn(0x7f0890078ac0 0x7f089007af50 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:53.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.495+0000 7fd0ddb7a640 1 --2- 172.21.15.72:0/1781906878 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd0d004b5e0 0x7fd0d004b9f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd0d4009870 tx=0x7fd0d401ed70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91f461c6beaf79c8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:53.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.495+0000 7fd0dd379640 1 -- 172.21.15.72:0/1781906878 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d40b5070 con 0x7fd0d004b5e0 2024-05-09T05:53:53.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.495+0000 7f08a27fc640 1 -- 172.21.15.72:0/1432323667 <== osd.2 v2:172.21.15.72:6824/1273581990 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f089007b620 con 0x7f0890078ac0 2024-05-09T05:53:53.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.495+0000 7fd0dd379640 1 -- 172.21.15.72:0/1781906878 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0d40a89f0 con 0x7fd0d004b5e0 2024-05-09T05:53:53.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.495+0000 7fd0dd379640 1 -- 172.21.15.72:0/1781906878 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d40a8dc0 con 0x7fd0d004b5e0 2024-05-09T05:53:53.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.495+0000 7fd0df37d640 1 -- 172.21.15.72:0/1781906878 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd0d004b5e0 msgr2=0x7fd0d004b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.495+0000 7fd0df37d640 1 --2- 172.21.15.72:0/1781906878 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd0d004b5e0 0x7fd0d004b9f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd0d4009870 tx=0x7fd0d401ed70 comp rx=0 tx=0).stop 2024-05-09T05:53:53.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.495+0000 7fd0df37d640 1 -- 172.21.15.72:0/1781906878 shutdown_connections 2024-05-09T05:53:53.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.495+0000 7fd0df37d640 1 --2- 172.21.15.72:0/1781906878 >> v2:172.21.15.72:3300/0 conn(0x7fd0d00e5a60 0x7fd0d00e7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.495+0000 7fd0df37d640 1 --2- 172.21.15.72:0/1781906878 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd0d004b5e0 0x7fd0d004b9f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.495+0000 7fd0df37d640 1 -- 172.21.15.72:0/1781906878 >> 172.21.15.72:0/1781906878 conn(0x7fd0d00503c0 msgr2=0x7fd0d00507d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:53.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.495+0000 7fd0df37d640 1 -- 172.21.15.72:0/1781906878 shutdown_connections 2024-05-09T05:53:53.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.495+0000 7fd0df37d640 1 -- 172.21.15.72:0/1781906878 wait complete. 2024-05-09T05:53:53.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.499+0000 7f8a73fff640 1 --2- 172.21.15.72:0/2702841556 >> [v2:172.21.15.110:6816/3437318248,v1:172.21.15.110:6817/3437318248] conn(0x7f8a60078cc0 0x7f8a6007b150 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:53.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.495+0000 7f7e37785640 1 -- start start 2024-05-09T05:53:53.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.499+0000 7f7e37785640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e1c005320 0x7f7e301627f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.499+0000 7f7e37785640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e30203410 0x7f7e301f2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.491+0000 7f8b26ffd640 1 -- 172.21.15.72:0/1191957740 <== osd.6 v2:172.21.15.110:6808/1817638786 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8b280acec0 con 0x7f8b1407d270 2024-05-09T05:53:53.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.499+0000 7f7e34d20640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e30203410 0x7f7e301f2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.499+0000 7f7e34d20640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e30203410 0x7f7e301f2ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42100/0 (socket says 172.21.15.72:42100) 2024-05-09T05:53:53.542 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.499+0000 7f08a27fc640 1 -- 172.21.15.72:0/1432323667 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f08ac0d4970 con 0x7f08a40064b0 2024-05-09T05:53:53.542 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.499+0000 7f7e35521640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e1c005320 0x7f7e301627f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.499+0000 7f7e35521640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e1c005320 0x7f7e301627f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.72:42348/0 (socket says 172.21.15.72:42348) 2024-05-09T05:53:53.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.499+0000 7f7e34d20640 1 -- 172.21.15.72:0/148425532 learned_addr learned my addr 172.21.15.72:0/148425532 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:53.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.499+0000 7f7e37785640 1 --2- 172.21.15.72:0/148425532 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e30157a70 0x7f7e301643c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.499+0000 7f7e37785640 1 -- 172.21.15.72:0/148425532 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7e300c4600 con 0x7f7e30203410 2024-05-09T05:53:53.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.499+0000 7fd0df37d640 1 Processor -- start 2024-05-09T05:53:53.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.499+0000 7f7e37785640 1 -- 172.21.15.72:0/148425532 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f7e300736f0 con 0x7f7e1c005320 2024-05-09T05:53:53.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.499+0000 7fd0df37d640 1 -- start start 2024-05-09T05:53:53.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.499+0000 7f7e37785640 1 -- 172.21.15.72:0/148425532 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f7e300ca250 con 0x7f7e30157a70 2024-05-09T05:53:53.545 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.499+0000 7f08b1c65640 1 --2- 172.21.15.72:0/1432323667 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f089006f400 0x7f0890071910 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f08a80ad000 tx=0x7f08a80a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:53.546 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.499+0000 7f7e34d20640 1 -- 172.21.15.72:0/148425532 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e30157a70 msgr2=0x7f7e301643c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.546 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.499+0000 7f7e34d20640 1 --2- 172.21.15.72:0/148425532 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e30157a70 0x7f7e301643c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.546 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.499+0000 7f7e34d20640 1 -- 172.21.15.72:0/148425532 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e1c005320 msgr2=0x7f7e301627f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.546 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.499+0000 7f7e34d20640 1 --2- 172.21.15.72:0/148425532 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e1c005320 0x7f7e301627f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.546 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.499+0000 7f7e34d20640 1 -- 172.21.15.72:0/148425532 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e300c7dd0 con 0x7f7e30203410 2024-05-09T05:53:53.546 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.499+0000 7f7e34d20640 1 --2- 172.21.15.72:0/148425532 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e30203410 0x7f7e301f2ac0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c00c4b0 tx=0x7f7e2c00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:53.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.499+0000 7fd0df37d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd0d004b5e0 0x7fd0d00d1290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.499+0000 7fd0df37d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd0d00d72e0 0x7fd0d00d3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.499+0000 7f7e25ffb640 1 -- 172.21.15.72:0/148425532 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e2c017070 con 0x7f7e30203410 2024-05-09T05:53:53.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.499+0000 7f7e25ffb640 1 -- 172.21.15.72:0/148425532 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e2c003600 con 0x7f7e30203410 2024-05-09T05:53:53.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.499+0000 7f7e25ffb640 1 -- 172.21.15.72:0/148425532 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e2c0054a0 con 0x7f7e30203410 2024-05-09T05:53:53.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.499+0000 7f7e37785640 1 -- 172.21.15.72:0/148425532 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e30162d30 con 0x7f7e30203410 2024-05-09T05:53:53.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.503+0000 7f7e25ffb640 1 -- 172.21.15.72:0/148425532 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f7e2c01a070 con 0x7f7e30203410 2024-05-09T05:53:53.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.503+0000 7f7e25ffb640 1 --2- 172.21.15.72:0/148425532 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f7e1406f430 0x7f7e14071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.503+0000 7f7e37785640 1 -- 172.21.15.72:0/148425532 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e30202930 con 0x7f7e30203410 2024-05-09T05:53:53.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.503+0000 7f7e35521640 1 --2- 172.21.15.72:0/148425532 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f7e1406f430 0x7f7e14071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.503+0000 7f8fe6ffd640 1 -- 172.21.15.72:0/2813085426 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f8fe801a070 con 0x7f8ff00e62f0 2024-05-09T05:53:53.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.503+0000 7f8fe6ffd640 1 --2- 172.21.15.72:0/2813085426 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f8fd806f4d0 0x7f8fd80719e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.503+0000 7f8fe6ffd640 1 -- 172.21.15.72:0/2813085426 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8fe808ee20 con 0x7f8ff00e62f0 2024-05-09T05:53:53.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.499+0000 7f8a5bfff640 1 -- 172.21.15.72:0/2702841556 <== osd.4 v2:172.21.15.110:6816/3437318248 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8a64003600 con 0x7f8a60078cc0 2024-05-09T05:53:53.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.499+0000 7fd0df37d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0d00e5a60 0x7fd0d00d0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.499+0000 7fd0df37d640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fd0d00ddf60 con 0x7fd0d00e5a60 2024-05-09T05:53:53.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.499+0000 7fd0df37d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fd0d004bf30 con 0x7fd0d004b5e0 2024-05-09T05:53:53.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.499+0000 7fd0df37d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fd0d004c1f0 con 0x7fd0d00d72e0 2024-05-09T05:53:53.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.499+0000 7fd0deb7c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0d00e5a60 0x7fd0d00d0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.499+0000 7fd0deb7c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0d00e5a60 0x7fd0d00d0060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42106/0 (socket says 172.21.15.72:42106) 2024-05-09T05:53:53.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.499+0000 7fd0deb7c640 1 -- 172.21.15.72:0/1841174410 learned_addr learned my addr 172.21.15.72:0/1841174410 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:53.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.499+0000 7fd0de37b640 1 --2- 172.21.15.72:0/1841174410 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd0d004b5e0 0x7fd0d00d1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.499+0000 7fd0ddb7a640 1 --2- 172.21.15.72:0/1841174410 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd0d00d72e0 0x7fd0d00d3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.503+0000 7f7e25ffb640 1 -- 172.21.15.72:0/148425532 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f7e2c08c7d0 con 0x7f7e30203410 2024-05-09T05:53:53.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.503+0000 7f7e37785640 1 -- 172.21.15.72:0/148425532 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7e3006a520 con 0x7f7e30203410 2024-05-09T05:53:53.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.503+0000 7f7e25ffb640 1 --2- 172.21.15.72:0/148425532 >> [v2:172.21.15.72:6800/2197151836,v1:172.21.15.72:6801/2197151836] conn(0x7f7e14078b00 0x7f7e1407af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.503+0000 7f7e25ffb640 1 -- 172.21.15.72:0/148425532 --> [v2:172.21.15.72:6800/2197151836,v1:172.21.15.72:6801/2197151836] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7e1407b660 con 0x7f7e14078b00 2024-05-09T05:53:53.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.503+0000 7f7e25ffb640 1 -- 172.21.15.72:0/148425532 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7e2c056b50 con 0x7f7e30203410 2024-05-09T05:53:53.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.503+0000 7f8fe6ffd640 1 --2- 172.21.15.72:0/2813085426 >> [v2:172.21.15.72:6804/2180866263,v1:172.21.15.72:6806/2180866263] conn(0x7f8fd8078c90 0x7f8fd807b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.503+0000 7f8fe6ffd640 1 -- 172.21.15.72:0/2813085426 --> [v2:172.21.15.72:6804/2180866263,v1:172.21.15.72:6806/2180866263] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8fd807b7f0 con 0x7f8fd8078c90 2024-05-09T05:53:53.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.503+0000 7f8fe6ffd640 1 -- 172.21.15.72:0/2813085426 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8fe808f210 con 0x7f8ff00e62f0 2024-05-09T05:53:53.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.503+0000 7f8ff659c640 1 --2- 172.21.15.72:0/2813085426 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f8fd806f4d0 0x7f8fd80719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.503+0000 7f8ff5d9b640 1 --2- 172.21.15.72:0/2813085426 >> [v2:172.21.15.72:6804/2180866263,v1:172.21.15.72:6806/2180866263] conn(0x7f8fd8078c90 0x7f8fd807b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.499+0000 7fd0deb7c640 1 -- 172.21.15.72:0/1841174410 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd0d00d72e0 msgr2=0x7fd0d00d3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.499+0000 7fd0deb7c640 1 --2- 172.21.15.72:0/1841174410 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd0d00d72e0 0x7fd0d00d3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.499+0000 7fd0deb7c640 1 -- 172.21.15.72:0/1841174410 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd0d004b5e0 msgr2=0x7fd0d00d1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.499+0000 7fd0deb7c640 1 --2- 172.21.15.72:0/1841174410 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd0d004b5e0 0x7fd0d00d1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.499+0000 7fd0deb7c640 1 -- 172.21.15.72:0/1841174410 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0d00d17d0 con 0x7fd0d00e5a60 2024-05-09T05:53:53.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.499+0000 7fd0deb7c640 1 --2- 172.21.15.72:0/1841174410 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0d00e5a60 0x7fd0d00d0060 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd0d802e1d0 tx=0x7fd0d806a070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:53.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.499+0000 7fd0ceffd640 1 -- 172.21.15.72:0/1841174410 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d806d920 con 0x7fd0d00e5a60 2024-05-09T05:53:53.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.499+0000 7fd0ceffd640 1 -- 172.21.15.72:0/1841174410 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0d806dae0 con 0x7fd0d00e5a60 2024-05-09T05:53:53.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.499+0000 7fd0ceffd640 1 -- 172.21.15.72:0/1841174410 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d8076e00 con 0x7fd0d00e5a60 2024-05-09T05:53:53.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.503+0000 7fd0df37d640 1 -- 172.21.15.72:0/1841174410 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0d004a080 con 0x7fd0d00e5a60 2024-05-09T05:53:53.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.503+0000 7fd0df37d640 1 -- 172.21.15.72:0/1841174410 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0d0174e10 con 0x7fd0d00e5a60 2024-05-09T05:53:53.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.503+0000 7fd0df37d640 1 -- 172.21.15.72:0/1841174410 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd0d0005580 con 0x7fd0d00e5a60 2024-05-09T05:53:53.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.503+0000 7fd0ceffd640 1 -- 172.21.15.72:0/1841174410 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fd0d8076fa0 con 0x7fd0d00e5a60 2024-05-09T05:53:53.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.503+0000 7f7e35d22640 1 --2- 172.21.15.72:0/148425532 >> [v2:172.21.15.72:6800/2197151836,v1:172.21.15.72:6801/2197151836] conn(0x7f7e14078b00 0x7f7e1407af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.503+0000 7f8ff5d9b640 1 --2- 172.21.15.72:0/2813085426 >> [v2:172.21.15.72:6804/2180866263,v1:172.21.15.72:6806/2180866263] conn(0x7f8fd8078c90 0x7f8fd807b120 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:53.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.507+0000 7f7e35521640 1 --2- 172.21.15.72:0/148425532 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f7e1406f430 0x7f7e14071940 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7e280095e0 tx=0x7f7e28009740 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:53.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.507+0000 7f7e35d22640 1 --2- 172.21.15.72:0/148425532 >> [v2:172.21.15.72:6800/2197151836,v1:172.21.15.72:6801/2197151836] conn(0x7f7e14078b00 0x7f7e1407af90 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:53.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.507+0000 7f8ff659c640 1 --2- 172.21.15.72:0/2813085426 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f8fd806f4d0 0x7f8fd80719e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8ff80514b0 tx=0x7f8ff8070040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:53.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.507+0000 7fd0ceffd640 1 --2- 172.21.15.72:0/1841174410 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fd0bc06f400 0x7fd0bc071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.507+0000 7fd0ceffd640 1 -- 172.21.15.72:0/1841174410 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd0d810cb30 con 0x7fd0d00e5a60 2024-05-09T05:53:53.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.507+0000 7fd0ceffd640 1 --2- 172.21.15.72:0/1841174410 >> [v2:172.21.15.110:6800/214675920,v1:172.21.15.110:6801/214675920] conn(0x7fd0bc078b40 0x7fd0bc07afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.507+0000 7fd0ceffd640 1 -- 172.21.15.72:0/1841174410 --> [v2:172.21.15.110:6800/214675920,v1:172.21.15.110:6801/214675920] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd0bc07b6a0 con 0x7fd0bc078b40 2024-05-09T05:53:53.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.507+0000 7fd0ceffd640 1 -- 172.21.15.72:0/1841174410 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd0d810cfc0 con 0x7fd0d00e5a60 2024-05-09T05:53:53.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.507+0000 7f8fe6ffd640 1 -- 172.21.15.72:0/2813085426 <== osd.3 v2:172.21.15.72:6804/2180866263 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8fd807b7f0 con 0x7f8fd8078c90 2024-05-09T05:53:53.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.507+0000 7fd0ddb7a640 1 --2- 172.21.15.72:0/1841174410 >> [v2:172.21.15.110:6800/214675920,v1:172.21.15.110:6801/214675920] conn(0x7fd0bc078b40 0x7fd0bc07afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.507+0000 7fd0de37b640 1 --2- 172.21.15.72:0/1841174410 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fd0bc06f400 0x7fd0bc071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.507+0000 7fd0ddb7a640 1 --2- 172.21.15.72:0/1841174410 >> [v2:172.21.15.110:6800/214675920,v1:172.21.15.110:6801/214675920] conn(0x7fd0bc078b40 0x7fd0bc07afd0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:53.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.507+0000 7f7e25ffb640 1 -- 172.21.15.72:0/148425532 <== osd.1 v2:172.21.15.72:6800/2197151836 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7e1407b660 con 0x7f7e14078b00 2024-05-09T05:53:53.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.507+0000 7fd0de37b640 1 --2- 172.21.15.72:0/1841174410 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fd0bc06f400 0x7fd0bc071910 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd0d000e4b0 tx=0x7fd0c8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:53.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.507+0000 7fd0ceffd640 1 -- 172.21.15.72:0/1841174410 <== osd.7 v2:172.21.15.110:6800/214675920 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd0bc07b6a0 con 0x7fd0bc078b40 2024-05-09T05:53:53.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.511+0000 7f79f3f67640 1 -- 172.21.15.72:0/1328743815 --> [v2:172.21.15.72:6816/331913921,v1:172.21.15.72:6817/331913921] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f79ec0c6110 con 0x7f79d0078c10 2024-05-09T05:53:53.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.515+0000 7f79e27fc640 1 -- 172.21.15.72:0/1328743815 <== osd.0 v2:172.21.15.72:6816/331913921 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f79ec0c6110 con 0x7f79d0078c10 2024-05-09T05:53:53.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.519+0000 7f8a78f7c640 1 -- 172.21.15.72:0/2702841556 --> [v2:172.21.15.110:6816/3437318248,v1:172.21.15.110:6817/3437318248] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8a54002d60 con 0x7f8a60078cc0 2024-05-09T05:53:53.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.519+0000 7f79f3f67640 1 -- 172.21.15.72:0/1328743815 >> [v2:172.21.15.72:6816/331913921,v1:172.21.15.72:6817/331913921] conn(0x7f79d0078c10 msgr2=0x7f79d007b0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.519+0000 7f79f3f67640 1 --2- 172.21.15.72:0/1328743815 >> [v2:172.21.15.72:6816/331913921,v1:172.21.15.72:6817/331913921] conn(0x7f79d0078c10 0x7f79d007b0a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.519+0000 7f79f3f67640 1 -- 172.21.15.72:0/1328743815 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f79d006f450 msgr2=0x7f79d0071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.519+0000 7f79f3f67640 1 --2- 172.21.15.72:0/1328743815 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f79d006f450 0x7f79d0071960 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f79dc007bc0 tx=0x7f79dc007b10 comp rx=0 tx=0).stop 2024-05-09T05:53:53.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.519+0000 7f79f3f67640 1 -- 172.21.15.72:0/1328743815 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79ec0c9a10 msgr2=0x7f79ec203870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.519+0000 7f79f3f67640 1 --2- 172.21.15.72:0/1328743815 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79ec0c9a10 0x7f79ec203870 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f79e800c430 tx=0x7f79e800c8f0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.519+0000 7f79f2504640 1 -- 172.21.15.72:0/1328743815 reap_dead start 2024-05-09T05:53:53.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.519+0000 7f79f3f67640 1 -- 172.21.15.72:0/1328743815 shutdown_connections 2024-05-09T05:53:53.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.519+0000 7f79f3f67640 1 -- 172.21.15.72:0/1328743815 >> 172.21.15.72:0/1328743815 conn(0x7f79ec06d0e0 msgr2=0x7f79ec072de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:53.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.519+0000 7f79f3f67640 1 -- 172.21.15.72:0/1328743815 shutdown_connections 2024-05-09T05:53:53.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.519+0000 7f8a5bfff640 1 -- 172.21.15.72:0/2702841556 <== osd.4 v2:172.21.15.110:6816/3437318248 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8a54002d60 con 0x7f8a60078cc0 2024-05-09T05:53:53.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.519+0000 7f79f3f67640 1 -- 172.21.15.72:0/1328743815 wait complete. 2024-05-09T05:53:53.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.519+0000 7f8a78f7c640 1 -- 172.21.15.72:0/2702841556 >> [v2:172.21.15.110:6816/3437318248,v1:172.21.15.110:6817/3437318248] conn(0x7f8a60078cc0 msgr2=0x7f8a6007b150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.519+0000 7f8a78f7c640 1 --2- 172.21.15.72:0/2702841556 >> [v2:172.21.15.110:6816/3437318248,v1:172.21.15.110:6817/3437318248] conn(0x7f8a60078cc0 0x7f8a6007b150 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.519+0000 7f8a78f7c640 1 -- 172.21.15.72:0/2702841556 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f8a6006f500 msgr2=0x7f8a60071a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.519+0000 7f8a78f7c640 1 --2- 172.21.15.72:0/2702841556 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f8a6006f500 0x7f8a60071a10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8a680ad000 tx=0x7f8a680a6000 comp rx=0 tx=0).stop 2024-05-09T05:53:53.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.519+0000 7f8a78f7c640 1 -- 172.21.15.72:0/2702841556 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a740c4ad0 msgr2=0x7f8a74209260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.519+0000 7f8a78f7c640 1 --2- 172.21.15.72:0/2702841556 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a740c4ad0 0x7f8a74209260 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8a6400c5c0 tx=0x7f8a6400ca80 comp rx=0 tx=0).stop 2024-05-09T05:53:53.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.519+0000 7f8a73fff640 1 -- 172.21.15.72:0/2702841556 reap_dead start 2024-05-09T05:53:53.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.519+0000 7f8a78f7c640 1 -- 172.21.15.72:0/2702841556 shutdown_connections 2024-05-09T05:53:53.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.519+0000 7f8a78f7c640 1 -- 172.21.15.72:0/2702841556 >> 172.21.15.72:0/2702841556 conn(0x7f8a7406cba0 msgr2=0x7f8a74074500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:53.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.519+0000 7f8a78f7c640 1 -- 172.21.15.72:0/2702841556 shutdown_connections 2024-05-09T05:53:53.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.519+0000 7f8a78f7c640 1 -- 172.21.15.72:0/2702841556 wait complete. 2024-05-09T05:53:53.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.519+0000 7f8b387d8640 1 -- 172.21.15.72:0/1191957740 --> [v2:172.21.15.110:6808/1817638786,v1:172.21.15.110:6809/1817638786] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8b3006a520 con 0x7f8b1407d270 2024-05-09T05:53:53.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.519+0000 7f8b26ffd640 1 -- 172.21.15.72:0/1191957740 <== osd.6 v2:172.21.15.110:6808/1817638786 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8b3006a520 con 0x7f8b1407d270 2024-05-09T05:53:53.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.523+0000 7f8b387d8640 1 -- 172.21.15.72:0/1191957740 >> [v2:172.21.15.110:6808/1817638786,v1:172.21.15.110:6809/1817638786] conn(0x7f8b1407d270 msgr2=0x7f8b1407f6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.523+0000 7f8b387d8640 1 --2- 172.21.15.72:0/1191957740 >> [v2:172.21.15.110:6808/1817638786,v1:172.21.15.110:6809/1817638786] conn(0x7f8b1407d270 0x7f8b1407f6b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.523+0000 7f8b387d8640 1 -- 172.21.15.72:0/1191957740 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f8b1406f5d0 msgr2=0x7f8b14071ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.523+0000 7f8b387d8640 1 --2- 172.21.15.72:0/1191957740 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f8b1406f5d0 0x7f8b14071ae0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8b20009990 tx=0x7f8b20008040 comp rx=0 tx=0).stop 2024-05-09T05:53:53.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.523+0000 7f8b387d8640 1 -- 172.21.15.72:0/1191957740 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b3015afa0 msgr2=0x7f8b30154f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.523+0000 7f8b387d8640 1 --2- 172.21.15.72:0/1191957740 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b3015afa0 0x7f8b30154f50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8b30073e10 tx=0x7f8b2801bfa0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.523+0000 7f8b36d75640 1 -- 172.21.15.72:0/1191957740 reap_dead start 2024-05-09T05:53:53.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.523+0000 7f8b387d8640 1 -- 172.21.15.72:0/1191957740 shutdown_connections 2024-05-09T05:53:53.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.523+0000 7f8b387d8640 1 -- 172.21.15.72:0/1191957740 >> 172.21.15.72:0/1191957740 conn(0x7f8b30072080 msgr2=0x7f8b300b5370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:53.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.523+0000 7f8b387d8640 1 -- 172.21.15.72:0/1191957740 shutdown_connections 2024-05-09T05:53:53.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.523+0000 7f8b387d8640 1 -- 172.21.15.72:0/1191957740 wait complete. 2024-05-09T05:53:53.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.523+0000 7f4b42b32640 1 -- 172.21.15.72:0/2987823096 --> [v2:172.21.15.110:6824/977576181,v1:172.21.15.110:6825/977576181] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4b3c06a520 con 0x7f4b28078c90 2024-05-09T05:53:53.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.523+0000 7f4b397fa640 1 -- 172.21.15.72:0/2987823096 <== osd.5 v2:172.21.15.110:6824/977576181 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4b3c06a520 con 0x7f4b28078c90 2024-05-09T05:53:53.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.527+0000 7f4b42b32640 1 -- 172.21.15.72:0/2987823096 >> [v2:172.21.15.110:6824/977576181,v1:172.21.15.110:6825/977576181] conn(0x7f4b28078c90 msgr2=0x7f4b2807b120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.527+0000 7f4b42b32640 1 --2- 172.21.15.72:0/2987823096 >> [v2:172.21.15.110:6824/977576181,v1:172.21.15.110:6825/977576181] conn(0x7f4b28078c90 0x7f4b2807b120 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.527+0000 7f4b42b32640 1 -- 172.21.15.72:0/2987823096 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f4b2806f4d0 msgr2=0x7f4b280719e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.527+0000 7f4b42b32640 1 --2- 172.21.15.72:0/2987823096 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f4b2806f4d0 0x7f4b280719e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c01fd10 tx=0x7f4b2c0ae070 comp rx=0 tx=0).stop 2024-05-09T05:53:53.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.527+0000 7f4b42b32640 1 -- 172.21.15.72:0/2987823096 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b3c1549d0 msgr2=0x7f4b3c157150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.527+0000 7f4b42b32640 1 --2- 172.21.15.72:0/2987823096 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b3c1549d0 0x7f4b3c157150 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4b3000c390 tx=0x7f4b3000c850 comp rx=0 tx=0).stop 2024-05-09T05:53:53.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.527+0000 7f4b410cf640 1 -- 172.21.15.72:0/2987823096 reap_dead start 2024-05-09T05:53:53.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.527+0000 7f4b42b32640 1 -- 172.21.15.72:0/2987823096 shutdown_connections 2024-05-09T05:53:53.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.527+0000 7f4b42b32640 1 -- 172.21.15.72:0/2987823096 >> 172.21.15.72:0/2987823096 conn(0x7f4b3c06e9b0 msgr2=0x7f4b3c0c86e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:53.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.527+0000 7f4b42b32640 1 -- 172.21.15.72:0/2987823096 shutdown_connections 2024-05-09T05:53:53.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.527+0000 7f4b42b32640 1 -- 172.21.15.72:0/2987823096 wait complete. 2024-05-09T05:53:53.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.527+0000 7f088ffff640 1 -- 172.21.15.72:0/1432323667 --> [v2:172.21.15.72:6824/1273581990,v1:172.21.15.72:6825/1273581990] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0888002de0 con 0x7f0890078ac0 2024-05-09T05:53:53.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.527+0000 7f08a27fc640 1 -- 172.21.15.72:0/1432323667 <== osd.2 v2:172.21.15.72:6824/1273581990 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0888002de0 con 0x7f0890078ac0 2024-05-09T05:53:53.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.531+0000 7f8fe4ff9640 1 -- 172.21.15.72:0/2813085426 --> [v2:172.21.15.72:6804/2180866263,v1:172.21.15.72:6806/2180866263] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8fdc002de0 con 0x7f8fd8078c90 2024-05-09T05:53:53.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.535+0000 7f8fe6ffd640 1 -- 172.21.15.72:0/2813085426 <== osd.3 v2:172.21.15.72:6804/2180866263 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8fdc002de0 con 0x7f8fd8078c90 2024-05-09T05:53:53.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.535+0000 7f088ffff640 1 -- 172.21.15.72:0/1432323667 >> [v2:172.21.15.72:6824/1273581990,v1:172.21.15.72:6825/1273581990] conn(0x7f0890078ac0 msgr2=0x7f089007af50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.535+0000 7f8fe4ff9640 1 -- 172.21.15.72:0/2813085426 >> [v2:172.21.15.72:6804/2180866263,v1:172.21.15.72:6806/2180866263] conn(0x7f8fd8078c90 msgr2=0x7f8fd807b120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.535+0000 7f8fe4ff9640 1 --2- 172.21.15.72:0/2813085426 >> [v2:172.21.15.72:6804/2180866263,v1:172.21.15.72:6806/2180866263] conn(0x7f8fd8078c90 0x7f8fd807b120 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.535+0000 7f088ffff640 1 --2- 172.21.15.72:0/1432323667 >> [v2:172.21.15.72:6824/1273581990,v1:172.21.15.72:6825/1273581990] conn(0x7f0890078ac0 0x7f089007af50 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.535+0000 7f8fe4ff9640 1 -- 172.21.15.72:0/2813085426 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f8fd806f4d0 msgr2=0x7f8fd80719e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.535+0000 7f8fe4ff9640 1 --2- 172.21.15.72:0/2813085426 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f8fd806f4d0 0x7f8fd80719e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8ff80514b0 tx=0x7f8ff8070040 comp rx=0 tx=0).stop 2024-05-09T05:53:53.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.535+0000 7f8fe4ff9640 1 -- 172.21.15.72:0/2813085426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ff00e62f0 msgr2=0x7f8ff00de1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.535+0000 7f8fe4ff9640 1 --2- 172.21.15.72:0/2813085426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ff00e62f0 0x7f8ff00de1c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8fe800c3c0 tx=0x7f8fe800c880 comp rx=0 tx=0).stop 2024-05-09T05:53:53.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.535+0000 7f8ff6d9d640 1 -- 172.21.15.72:0/2813085426 reap_dead start 2024-05-09T05:53:53.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.535+0000 7f8fe4ff9640 1 -- 172.21.15.72:0/2813085426 shutdown_connections 2024-05-09T05:53:53.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.535+0000 7f8fe4ff9640 1 -- 172.21.15.72:0/2813085426 >> 172.21.15.72:0/2813085426 conn(0x7f8ff0058b40 msgr2=0x7f8ff00e16f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:53.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.535+0000 7f8fe4ff9640 1 -- 172.21.15.72:0/2813085426 shutdown_connections 2024-05-09T05:53:53.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.535+0000 7f088ffff640 1 -- 172.21.15.72:0/1432323667 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f089006f400 msgr2=0x7f0890071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.535+0000 7f8fe4ff9640 1 -- 172.21.15.72:0/2813085426 wait complete. 2024-05-09T05:53:53.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.535+0000 7f088ffff640 1 --2- 172.21.15.72:0/1432323667 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f089006f400 0x7f0890071910 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f08a80ad000 tx=0x7f08a80a6000 comp rx=0 tx=0).stop 2024-05-09T05:53:53.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.535+0000 7f088ffff640 1 -- 172.21.15.72:0/1432323667 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08a40064b0 msgr2=0x7f08a40cfb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.535+0000 7f088ffff640 1 --2- 172.21.15.72:0/1432323667 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08a40064b0 0x7f08a40cfb80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f08ac07d5a0 tx=0x7f08ac06a070 comp rx=0 tx=0).stop 2024-05-09T05:53:53.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.535+0000 7f08b2466640 1 -- 172.21.15.72:0/1432323667 reap_dead start 2024-05-09T05:53:53.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.535+0000 7f088ffff640 1 -- 172.21.15.72:0/1432323667 shutdown_connections 2024-05-09T05:53:53.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.535+0000 7f088ffff640 1 -- 172.21.15.72:0/1432323667 >> 172.21.15.72:0/1432323667 conn(0x7f08a40503c0 msgr2=0x7f08a40db8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:53.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.535+0000 7f088ffff640 1 -- 172.21.15.72:0/1432323667 shutdown_connections 2024-05-09T05:53:53.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.535+0000 7f088ffff640 1 -- 172.21.15.72:0/1432323667 wait complete. 2024-05-09T05:53:53.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.539+0000 7fd0df37d640 1 -- 172.21.15.72:0/1841174410 --> [v2:172.21.15.110:6800/214675920,v1:172.21.15.110:6801/214675920] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd0d0049e30 con 0x7fd0bc078b40 2024-05-09T05:53:53.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.539+0000 7fd0ceffd640 1 -- 172.21.15.72:0/1841174410 <== osd.7 v2:172.21.15.110:6800/214675920 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd0d0049e30 con 0x7fd0bc078b40 2024-05-09T05:53:53.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.539+0000 7fd0df37d640 1 -- 172.21.15.72:0/1841174410 >> [v2:172.21.15.110:6800/214675920,v1:172.21.15.110:6801/214675920] conn(0x7fd0bc078b40 msgr2=0x7fd0bc07afd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.539+0000 7fd0df37d640 1 --2- 172.21.15.72:0/1841174410 >> [v2:172.21.15.110:6800/214675920,v1:172.21.15.110:6801/214675920] conn(0x7fd0bc078b40 0x7fd0bc07afd0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.539+0000 7fd0df37d640 1 -- 172.21.15.72:0/1841174410 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fd0bc06f400 msgr2=0x7fd0bc071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.539+0000 7fd0df37d640 1 --2- 172.21.15.72:0/1841174410 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fd0bc06f400 0x7fd0bc071910 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd0d000e4b0 tx=0x7fd0c8008040 comp rx=0 tx=0).stop 2024-05-09T05:53:53.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.539+0000 7fd0df37d640 1 -- 172.21.15.72:0/1841174410 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0d00e5a60 msgr2=0x7fd0d00d0060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.539+0000 7fd0df37d640 1 --2- 172.21.15.72:0/1841174410 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0d00e5a60 0x7fd0d00d0060 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd0d802e1d0 tx=0x7fd0d806a070 comp rx=0 tx=0).stop 2024-05-09T05:53:53.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.539+0000 7fd0deb7c640 1 -- 172.21.15.72:0/1841174410 reap_dead start 2024-05-09T05:53:53.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.539+0000 7fd0df37d640 1 -- 172.21.15.72:0/1841174410 shutdown_connections 2024-05-09T05:53:53.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.539+0000 7fd0df37d640 1 -- 172.21.15.72:0/1841174410 >> 172.21.15.72:0/1841174410 conn(0x7fd0d00503c0 msgr2=0x7fd0d004eb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:53.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.539+0000 7fd0df37d640 1 -- 172.21.15.72:0/1841174410 shutdown_connections 2024-05-09T05:53:53.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.539+0000 7fd0df37d640 1 -- 172.21.15.72:0/1841174410 wait complete. 2024-05-09T05:53:53.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.543+0000 7f7e37785640 1 -- 172.21.15.72:0/148425532 --> [v2:172.21.15.72:6800/2197151836,v1:172.21.15.72:6801/2197151836] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7e300b39f0 con 0x7f7e14078b00 2024-05-09T05:53:53.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.543+0000 7f7e25ffb640 1 -- 172.21.15.72:0/148425532 <== osd.1 v2:172.21.15.72:6800/2197151836 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7e300b39f0 con 0x7f7e14078b00 2024-05-09T05:53:53.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.543+0000 7f7e137fe640 1 -- 172.21.15.72:0/148425532 >> [v2:172.21.15.72:6800/2197151836,v1:172.21.15.72:6801/2197151836] conn(0x7f7e14078b00 msgr2=0x7f7e1407af90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.543+0000 7f7e137fe640 1 --2- 172.21.15.72:0/148425532 >> [v2:172.21.15.72:6800/2197151836,v1:172.21.15.72:6801/2197151836] conn(0x7f7e14078b00 0x7f7e1407af90 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.547+0000 7f7e137fe640 1 -- 172.21.15.72:0/148425532 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f7e1406f430 msgr2=0x7f7e14071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.547+0000 7f7e137fe640 1 --2- 172.21.15.72:0/148425532 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f7e1406f430 0x7f7e14071940 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7e280095e0 tx=0x7f7e28009740 comp rx=0 tx=0).stop 2024-05-09T05:53:53.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.547+0000 7f7e137fe640 1 -- 172.21.15.72:0/148425532 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e30203410 msgr2=0x7f7e301f2ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.547+0000 7f7e137fe640 1 --2- 172.21.15.72:0/148425532 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e30203410 0x7f7e301f2ac0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c00c4b0 tx=0x7f7e2c00c970 comp rx=0 tx=0).stop 2024-05-09T05:53:53.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.547+0000 7f7e35d22640 1 -- 172.21.15.72:0/148425532 reap_dead start 2024-05-09T05:53:53.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.547+0000 7f7e137fe640 1 -- 172.21.15.72:0/148425532 shutdown_connections 2024-05-09T05:53:53.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.547+0000 7f7e137fe640 1 -- 172.21.15.72:0/148425532 >> 172.21.15.72:0/148425532 conn(0x7f7e3006e8e0 msgr2=0x7f7e300c8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:53.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.547+0000 7f7e137fe640 1 -- 172.21.15.72:0/148425532 shutdown_connections 2024-05-09T05:53:53.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.547+0000 7f7e137fe640 1 -- 172.21.15.72:0/148425532 wait complete. 2024-05-09T05:53:53.575 INFO:teuthology.orchestra.run.smithi072.stdout:64424509453 2024-05-09T05:53:53.575 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-09T05:53:53.576 INFO:teuthology.orchestra.run.smithi072.stdout:64424509452 2024-05-09T05:53:53.576 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-09T05:53:53.577 INFO:teuthology.orchestra.run.smithi072.stdout:64424509453 2024-05-09T05:53:53.577 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-09T05:53:53.578 INFO:teuthology.orchestra.run.smithi072.stdout:55834574858 2024-05-09T05:53:53.578 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-09T05:53:53.579 INFO:teuthology.orchestra.run.smithi072.stdout:55834574859 2024-05-09T05:53:53.579 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-09T05:53:53.580 INFO:teuthology.orchestra.run.smithi072.stdout:64424509450 2024-05-09T05:53:53.580 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-09T05:53:53.581 INFO:teuthology.orchestra.run.smithi072.stdout:64424509450 2024-05-09T05:53:53.581 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-09T05:53:53.582 INFO:teuthology.orchestra.run.smithi072.stdout:64424509452 2024-05-09T05:53:53.582 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-09T05:53:53.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.843+0000 7fc553aeb640 1 Processor -- start 2024-05-09T05:53:53.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.843+0000 7fc553aeb640 1 -- start start 2024-05-09T05:53:53.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.847+0000 7fc553aeb640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc54c158b50 0x7fc54c158f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.847+0000 7fc553aeb640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc54c0c9a10 0x7fc54c06fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.847+0000 7fc553aeb640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc54c15c8e0 con 0x7fc54c06f820 2024-05-09T05:53:53.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.847+0000 7fc553aeb640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fc54c0c9e20 con 0x7fc54c158b50 2024-05-09T05:53:53.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.847+0000 7fc553aeb640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fc54c0c4c90 con 0x7fc54c0c9a10 2024-05-09T05:53:53.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.847+0000 7fc551086640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc54c06f820 0x7fc54c0c9300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34456/0 (socket says 172.21.15.72:34456) 2024-05-09T05:53:53.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.847+0000 7fc551086640 1 -- 172.21.15.72:0/4026318973 learned_addr learned my addr 172.21.15.72:0/4026318973 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:53:53.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.847+0000 7fc552088640 1 --2- 172.21.15.72:0/4026318973 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc54c0c9a10 0x7fc54c06fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.847+0000 7fc551887640 1 --2- 172.21.15.72:0/4026318973 >> v2:172.21.15.110:3300/0 conn(0x7fc54c158b50 0x7fc54c158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.847+0000 7fc550885640 1 -- 172.21.15.72:0/4026318973 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 183197739 0 0) 0x7fc54c15c8e0 con 0x7fc54c06f820 2024-05-09T05:53:53.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.847+0000 7fc550885640 1 -- 172.21.15.72:0/4026318973 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc538003530 con 0x7fc54c06f820 2024-05-09T05:53:53.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.847+0000 7fa0570f1640 1 Processor -- start 2024-05-09T05:53:53.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.847+0000 7fa0570f1640 1 -- start start 2024-05-09T05:53:53.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.847+0000 7f422eaa9640 1 Processor -- start 2024-05-09T05:53:53.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.847+0000 7fc552088640 1 -- 172.21.15.72:0/4026318973 >> v2:172.21.15.110:3300/0 conn(0x7fc54c158b50 msgr2=0x7fc54c158f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:53.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.847+0000 7fc552088640 1 --2- 172.21.15.72:0/4026318973 >> v2:172.21.15.110:3300/0 conn(0x7fc54c158b50 0x7fc54c158f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.847+0000 7fc552088640 1 -- 172.21.15.72:0/4026318973 >> v1:172.21.15.72:6789/0 conn(0x7fc54c06f820 legacy=0x7fc54c0c9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.847+0000 7fc552088640 1 -- 172.21.15.72:0/4026318973 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc54c152be0 con 0x7fc54c0c9a10 2024-05-09T05:53:53.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.847+0000 7f422eaa9640 1 -- start start 2024-05-09T05:53:53.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.847+0000 7f6d18964640 1 Processor -- start 2024-05-09T05:53:53.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.847+0000 7f6d18964640 1 -- start start 2024-05-09T05:53:53.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.851+0000 7f6d18964640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6d140c7750 0x7f6d1415d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.851+0000 7f6d18964640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d140c65f0 0x7f6d14159110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.851+0000 7f6d18964640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d140c58f0 con 0x7f6d14159650 2024-05-09T05:53:53.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.851+0000 7f6d18964640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f6d1415a0d0 con 0x7f6d140c7750 2024-05-09T05:53:53.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.851+0000 7f6d18964640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f6d14159b30 con 0x7f6d140c65f0 2024-05-09T05:53:53.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.851+0000 7fa0570f1640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa048036040 0x7fa048045360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.851+0000 7f6d1259c640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6d140c7750 0x7f6d1415d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.851+0000 7f6d1259c640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6d140c7750 0x7f6d1415d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42116/0 (socket says 172.21.15.72:42116) 2024-05-09T05:53:53.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.851+0000 7f6d1259c640 1 -- 172.21.15.72:0/2147589026 learned_addr learned my addr 172.21.15.72:0/2147589026 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:53.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.851+0000 7fa0570f1640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa048036450 con 0x7fa048046780 2024-05-09T05:53:53.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.851+0000 7fa0570f1640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0480db8e0 con 0x7fa048006930 2024-05-09T05:53:53.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.851+0000 7fa0570f1640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fa0480dc740 con 0x7fa048036040 2024-05-09T05:53:53.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.851+0000 7f422eaa9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42280c6c90 0x7f422815c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.851+0000 7f422eaa9640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42280c5910 con 0x7f422806f820 2024-05-09T05:53:53.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.851+0000 7f422eaa9640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42280c5bf0 con 0x7f4228156520 2024-05-09T05:53:53.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.851+0000 7f422eaa9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f4228156930 con 0x7f42280c6c90 2024-05-09T05:53:53.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.851+0000 7fa0560ef640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa048036040 0x7fa048045360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.851+0000 7fa0560ef640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa048036040 0x7fa048045360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.72:42384/0 (socket says 172.21.15.72:42384) 2024-05-09T05:53:53.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.851+0000 7fa0560ef640 1 -- 172.21.15.72:0/739354755 learned_addr learned my addr 172.21.15.72:0/739354755 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:53.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.851+0000 7f6d11d9b640 1 --2- 172.21.15.72:0/2147589026 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d140c65f0 0x7f6d14159110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.851+0000 7f6d1259c640 1 -- 172.21.15.72:0/2147589026 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d140c65f0 msgr2=0x7f6d14159110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:53.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.851+0000 7f6d1259c640 1 --2- 172.21.15.72:0/2147589026 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d140c65f0 0x7f6d14159110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.851+0000 7f6d1259c640 1 -- 172.21.15.72:0/2147589026 >> v1:172.21.15.72:6789/0 conn(0x7f6d14159650 legacy=0x7f6d140c9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:53.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.851+0000 7f6d1259c640 1 -- 172.21.15.72:0/2147589026 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d14159df0 con 0x7f6d140c7750 2024-05-09T05:53:53.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.851+0000 7f422c845640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42280c6c90 0x7f422815c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.851+0000 7f422c845640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42280c6c90 0x7f422815c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.72:37690/0 (socket says 172.21.15.72:37690) 2024-05-09T05:53:53.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.851+0000 7f422c845640 1 -- 172.21.15.72:0/3151297327 learned_addr learned my addr 172.21.15.72:0/3151297327 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:53.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.851+0000 7f0d9b807640 1 Processor -- start 2024-05-09T05:53:53.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.851+0000 7f0d9b807640 1 -- start start 2024-05-09T05:53:53.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.851+0000 7f42277fe640 1 -- 172.21.15.72:0/3151297327 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3158935880 0 0) 0x7f42280c5910 con 0x7f422806f820 2024-05-09T05:53:53.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.851+0000 7f42277fe640 1 -- 172.21.15.72:0/3151297327 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4210003530 con 0x7f422806f820 2024-05-09T05:53:53.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.851+0000 7f422c845640 1 -- 172.21.15.72:0/3151297327 >> v1:172.21.15.110:6789/0 conn(0x7f4228156520 legacy=0x7f42280c7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:53.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.851+0000 7f422c845640 1 -- 172.21.15.72:0/3151297327 >> v1:172.21.15.72:6789/0 conn(0x7f422806f820 legacy=0x7f4228166db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.851+0000 7f422c845640 1 -- 172.21.15.72:0/3151297327 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42280c5ed0 con 0x7f42280c6c90 2024-05-09T05:53:53.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.851+0000 7fc552088640 1 --2- 172.21.15.72:0/4026318973 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc54c0c9a10 0x7fc54c06fc30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc54800ba50 tx=0x7fc54801e950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=281422f863b7f1be server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:53.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.851+0000 7fa0550ed640 1 -- 172.21.15.72:0/739354755 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 437235947 0 0) 0x7fa048036450 con 0x7fa048046780 2024-05-09T05:53:53.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.851+0000 7fa0560ef640 1 -- 172.21.15.72:0/739354755 >> v1:172.21.15.110:6789/0 conn(0x7fa048006930 legacy=0x7fa048046070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:53.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.851+0000 7fa0560ef640 1 -- 172.21.15.72:0/739354755 >> v1:172.21.15.72:6789/0 conn(0x7fa048046780 legacy=0x7fa0480e6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.851+0000 7fa0560ef640 1 -- 172.21.15.72:0/739354755 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0480dbbc0 con 0x7fa048036040 2024-05-09T05:53:53.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.851+0000 7f5394924640 1 Processor -- start 2024-05-09T05:53:53.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.851+0000 7f5394924640 1 -- start start 2024-05-09T05:53:53.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.851+0000 7fc550885640 1 -- 172.21.15.72:0/4026318973 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5480ad070 con 0x7fc54c0c9a10 2024-05-09T05:53:53.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.851+0000 7fc550885640 1 -- 172.21.15.72:0/4026318973 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5480a7820 con 0x7fc54c0c9a10 2024-05-09T05:53:53.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.851+0000 7fc550885640 1 -- 172.21.15.72:0/4026318973 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5480a7bf0 con 0x7fc54c0c9a10 2024-05-09T05:53:53.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.851+0000 7f77752a9640 1 Processor -- start 2024-05-09T05:53:53.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7f0d9b807640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d8c0e12a0 0x7f0d8c052580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7f0d9b807640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0d8c052ac0 0x7f0d8c0e7c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7f0d9b807640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d8c0e16b0 con 0x7f0d8c0367b0 2024-05-09T05:53:53.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7f0d9b807640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f0d8c04d920 con 0x7f0d8c052ac0 2024-05-09T05:53:53.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7f0d9b807640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f0d8c04dc00 con 0x7f0d8c0e12a0 2024-05-09T05:53:53.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7fc553aeb640 1 -- 172.21.15.72:0/4026318973 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc54c0c9a10 msgr2=0x7fc54c06fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7fc553aeb640 1 --2- 172.21.15.72:0/4026318973 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc54c0c9a10 0x7fc54c06fc30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc54800ba50 tx=0x7fc54801e950 comp rx=0 tx=0).stop 2024-05-09T05:53:53.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7fc553aeb640 1 -- 172.21.15.72:0/4026318973 shutdown_connections 2024-05-09T05:53:53.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7fc553aeb640 1 --2- 172.21.15.72:0/4026318973 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc54c0c9a10 0x7fc54c06fc30 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7fc553aeb640 1 --2- 172.21.15.72:0/4026318973 >> v2:172.21.15.110:3300/0 conn(0x7fc54c158b50 0x7fc54c158f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7fc553aeb640 1 -- 172.21.15.72:0/4026318973 >> 172.21.15.72:0/4026318973 conn(0x7fc54c06d0e0 msgr2=0x7fc54c0cd560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:53.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7fc553aeb640 1 -- 172.21.15.72:0/4026318973 shutdown_connections 2024-05-09T05:53:53.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7fc553aeb640 1 -- 172.21.15.72:0/4026318973 wait complete. 2024-05-09T05:53:53.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.851+0000 7f77752a9640 1 -- start start 2024-05-09T05:53:53.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7f6d1259c640 1 --2- 172.21.15.72:0/2147589026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d140c7750 0x7f6d1415d310 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6d04009870 tx=0x7f6d0401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37d7e06b1c3e5c82 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:53.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7f0d995a3640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f0d8c0367b0 0x7f0d8c04f960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.72:51198/0 (socket says 172.21.15.72:51198) 2024-05-09T05:53:53.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7f0d995a3640 1 -- 172.21.15.72:0/1294161194 learned_addr learned my addr 172.21.15.72:0/1294161194 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:53:53.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7f5394924640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5390153500 0x7f539015c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7f5394924640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5390073e50 0x7f539006dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7f5394924640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5390153910 con 0x7f5390073a40 2024-05-09T05:53:53.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7f5394924640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f53900c9ca0 con 0x7f5390153500 2024-05-09T05:53:53.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7f5394924640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f53900748d0 con 0x7f5390073e50 2024-05-09T05:53:53.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7fa0560ef640 1 --2- 172.21.15.72:0/739354755 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa048036040 0x7fa048045360 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa04c009870 tx=0x7fa04c01d7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f9dacc812ff5003 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:53.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7f6d1159a640 1 -- 172.21.15.72:0/2147589026 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d040b0070 con 0x7f6d140c7750 2024-05-09T05:53:53.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7f0d98da2640 1 --2- 172.21.15.72:0/1294161194 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d8c0e12a0 0x7f0d8c052580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7f538e59c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5390153500 0x7f539015c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7f0d99da4640 1 --2- 172.21.15.72:0/1294161194 >> v2:172.21.15.110:3300/0 conn(0x7f0d8c052ac0 0x7f0d8c0e7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7f422c845640 1 --2- 172.21.15.72:0/3151297327 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42280c6c90 0x7f422815c430 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4220009e80 tx=0x7f422001ca20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=368c8294ab70b953 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:53.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7f538dd9b640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f5390073a40 0x7f539006d8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.72:51204/0 (socket says 172.21.15.72:51204) 2024-05-09T05:53:53.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7f538dd9b640 1 -- 172.21.15.72:0/322537750 learned_addr learned my addr 172.21.15.72:0/322537750 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:53:53.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7f538ed9d640 1 --2- 172.21.15.72:0/322537750 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5390073e50 0x7f539006dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7f77752a9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f777015a7a0 0x7f77700c9000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7f77752a9640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f77700c9540 0x7f777006f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7f77752a9640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f777006fd60 0x7f7770163e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7f77752a9640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f77700c7a30 con 0x7f777006fd60 2024-05-09T05:53:53.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7f77752a9640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f77700c54c0 con 0x7f77700c9540 2024-05-09T05:53:53.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7f77752a9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f77701616e0 con 0x7f777015a7a0 2024-05-09T05:53:53.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7f42277fe640 1 -- 172.21.15.72:0/3151297327 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42200a58a0 con 0x7f42280c6c90 2024-05-09T05:53:53.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7f42277fe640 1 -- 172.21.15.72:0/3151297327 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42200a5a40 con 0x7f42280c6c90 2024-05-09T05:53:53.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7f42277fe640 1 -- 172.21.15.72:0/3151297327 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42200a5e10 con 0x7f42280c6c90 2024-05-09T05:53:53.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7f0d8bfff640 1 -- 172.21.15.72:0/1294161194 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3785056485 0 0) 0x7f0d8c0e16b0 con 0x7f0d8c0367b0 2024-05-09T05:53:53.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7f0d8bfff640 1 -- 172.21.15.72:0/1294161194 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d80003530 con 0x7f0d8c0367b0 2024-05-09T05:53:53.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7f538e59c640 1 -- 172.21.15.72:0/322537750 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5390073e50 msgr2=0x7f539006dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:53.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7f538e59c640 1 --2- 172.21.15.72:0/322537750 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5390073e50 0x7f539006dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7f538e59c640 1 -- 172.21.15.72:0/322537750 >> v1:172.21.15.110:6789/0 conn(0x7f5390073a40 legacy=0x7f539006d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7f6d1159a640 1 -- 172.21.15.72:0/2147589026 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d040ab600 con 0x7f6d140c7750 2024-05-09T05:53:53.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7f6d18964640 1 -- 172.21.15.72:0/2147589026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d140c7750 msgr2=0x7f6d1415d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7f538e59c640 1 -- 172.21.15.72:0/322537750 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5390074bb0 con 0x7f5390153500 2024-05-09T05:53:53.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7f6d1159a640 1 -- 172.21.15.72:0/2147589026 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d040b0070 con 0x7f6d140c7750 2024-05-09T05:53:53.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7f6d18964640 1 --2- 172.21.15.72:0/2147589026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d140c7750 0x7f6d1415d310 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6d04009870 tx=0x7f6d0401c4d0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7f6d18964640 1 -- 172.21.15.72:0/2147589026 shutdown_connections 2024-05-09T05:53:53.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7f6d18964640 1 --2- 172.21.15.72:0/2147589026 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d140c65f0 0x7f6d14159110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7f6d18964640 1 --2- 172.21.15.72:0/2147589026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d140c7750 0x7f6d1415d310 secure :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6d04009870 tx=0x7f6d0401c4d0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7f6d18964640 1 -- 172.21.15.72:0/2147589026 >> 172.21.15.72:0/2147589026 conn(0x7f6d1406d0e0 msgr2=0x7f6d140cd560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:53.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7f0d99da4640 1 -- 172.21.15.72:0/1294161194 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d8c0e12a0 msgr2=0x7f0d8c052580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:53.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7f0d99da4640 1 --2- 172.21.15.72:0/1294161194 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d8c0e12a0 0x7f0d8c052580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7f0d99da4640 1 -- 172.21.15.72:0/1294161194 >> v1:172.21.15.110:6789/0 conn(0x7f0d8c0367b0 legacy=0x7f0d8c04f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7f0d99da4640 1 -- 172.21.15.72:0/1294161194 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d8c04ee80 con 0x7f0d8c052ac0 2024-05-09T05:53:53.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7f776effd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f777015a7a0 0x7f77700c9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7f776effd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f777015a7a0 0x7f77700c9000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.72:37718/0 (socket says 172.21.15.72:37718) 2024-05-09T05:53:53.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7f776effd640 1 -- 172.21.15.72:0/2058416698 learned_addr learned my addr 172.21.15.72:0/2058416698 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:53.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7f7767fff640 1 --2- 172.21.15.72:0/2058416698 >> v2:172.21.15.110:3300/0 conn(0x7f77700c9540 0x7f777006f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7f7767fff640 1 -- 172.21.15.72:0/2058416698 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f777015a7a0 msgr2=0x7f77700c9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:53.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7f7767fff640 1 --2- 172.21.15.72:0/2058416698 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f777015a7a0 0x7f77700c9000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7f7767fff640 1 -- 172.21.15.72:0/2058416698 >> v2:172.21.15.72:3300/0 conn(0x7f777006fd60 msgr2=0x7f7770163e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:53.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7f7767fff640 1 --2- 172.21.15.72:0/2058416698 >> v2:172.21.15.72:3300/0 conn(0x7f777006fd60 0x7f7770163e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7f6d18964640 1 -- 172.21.15.72:0/2147589026 shutdown_connections 2024-05-09T05:53:53.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7f7767fff640 1 -- 172.21.15.72:0/2058416698 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77700c7f60 con 0x7f77700c9540 2024-05-09T05:53:53.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7f422eaa9640 1 -- 172.21.15.72:0/3151297327 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42280c6c90 msgr2=0x7f422815c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7f422eaa9640 1 --2- 172.21.15.72:0/3151297327 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42280c6c90 0x7f422815c430 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4220009e80 tx=0x7f422001ca20 comp rx=0 tx=0).stop 2024-05-09T05:53:53.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7f422eaa9640 1 -- 172.21.15.72:0/3151297327 shutdown_connections 2024-05-09T05:53:53.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7f422eaa9640 1 --2- 172.21.15.72:0/3151297327 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42280c6c90 0x7f422815c430 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7f422eaa9640 1 -- 172.21.15.72:0/3151297327 >> 172.21.15.72:0/3151297327 conn(0x7f422806d0e0 msgr2=0x7f42280cd560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:53.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7fc553aeb640 1 Processor -- start 2024-05-09T05:53:53.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7fa0550ed640 1 -- 172.21.15.72:0/739354755 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa04c0a76e0 con 0x7fa048036040 2024-05-09T05:53:53.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7fa0550ed640 1 -- 172.21.15.72:0/739354755 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa04c0a7880 con 0x7fa048036040 2024-05-09T05:53:53.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7fa0550ed640 1 -- 172.21.15.72:0/739354755 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa04c0a7c50 con 0x7fa048036040 2024-05-09T05:53:53.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7fc553aeb640 1 -- start start 2024-05-09T05:53:53.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.855+0000 7f6d18964640 1 -- 172.21.15.72:0/2147589026 wait complete. 2024-05-09T05:53:53.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.859+0000 7fa0570f1640 1 -- 172.21.15.72:0/739354755 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa048036040 msgr2=0x7fa048045360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.859+0000 7fa0570f1640 1 --2- 172.21.15.72:0/739354755 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa048036040 0x7fa048045360 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa04c009870 tx=0x7fa04c01d7b0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.859+0000 7f422eaa9640 1 -- 172.21.15.72:0/3151297327 shutdown_connections 2024-05-09T05:53:53.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.859+0000 7f422eaa9640 1 -- 172.21.15.72:0/3151297327 wait complete. 2024-05-09T05:53:53.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.859+0000 7fa0570f1640 1 -- 172.21.15.72:0/739354755 shutdown_connections 2024-05-09T05:53:53.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.859+0000 7fa0570f1640 1 --2- 172.21.15.72:0/739354755 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa048036040 0x7fa048045360 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.859+0000 7fa0570f1640 1 -- 172.21.15.72:0/739354755 >> 172.21.15.72:0/739354755 conn(0x7fa0480503c0 msgr2=0x7fa0480507d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:53.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.859+0000 7fa0570f1640 1 -- 172.21.15.72:0/739354755 shutdown_connections 2024-05-09T05:53:53.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.859+0000 7f0d99da4640 1 --2- 172.21.15.72:0/1294161194 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d8c052ac0 0x7f0d8c0e7c20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0d9406ba60 tx=0x7f0d9409c750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=515fc0ed05686593 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:53.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.859+0000 7f538e59c640 1 --2- 172.21.15.72:0/322537750 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5390153500 0x7f539015c800 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f538000ba60 tx=0x7f538001eae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de5baf91315ba922 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:53.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.859+0000 7f0d8bfff640 1 -- 172.21.15.72:0/1294161194 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d94133070 con 0x7f0d8c052ac0 2024-05-09T05:53:53.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.859+0000 7f0d8bfff640 1 -- 172.21.15.72:0/1294161194 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d9412a070 con 0x7f0d8c052ac0 2024-05-09T05:53:53.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.859+0000 7fc553aeb640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc54c06f820 0x7fc54c157da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.859+0000 7fc553aeb640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc54c0c9a10 0x7fc54c145e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.859+0000 7f6d18964640 1 Processor -- start 2024-05-09T05:53:53.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.859+0000 7fc551086640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc54c0c9a10 0x7fc54c145e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.859+0000 7fc551887640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc54c06f820 0x7fc54c157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.859+0000 7fc551086640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc54c0c9a10 0x7fc54c145e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42130/0 (socket says 172.21.15.72:42130) 2024-05-09T05:53:53.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.859+0000 7fc551887640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc54c06f820 0x7fc54c157da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.72:37724/0 (socket says 172.21.15.72:37724) 2024-05-09T05:53:53.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.859+0000 7fc551086640 1 -- 172.21.15.72:0/3836214167 learned_addr learned my addr 172.21.15.72:0/3836214167 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:53.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.859+0000 7fc553aeb640 1 --2- 172.21.15.72:0/3836214167 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc54c158b50 0x7fc54c156300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.859+0000 7fc553aeb640 1 -- 172.21.15.72:0/3836214167 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fc54c158630 con 0x7fc54c0c9a10 2024-05-09T05:53:53.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.859+0000 7fc553aeb640 1 -- 172.21.15.72:0/3836214167 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fc54c15c600 con 0x7fc54c158b50 2024-05-09T05:53:53.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.859+0000 7fc553aeb640 1 -- 172.21.15.72:0/3836214167 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fc54c15ba00 con 0x7fc54c06f820 2024-05-09T05:53:53.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.859+0000 7f0d9b807640 1 -- 172.21.15.72:0/1294161194 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d8c052ac0 msgr2=0x7f0d8c0e7c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.859+0000 7f0d9b807640 1 --2- 172.21.15.72:0/1294161194 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d8c052ac0 0x7f0d8c0e7c20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0d9406ba60 tx=0x7f0d9409c750 comp rx=0 tx=0).stop 2024-05-09T05:53:53.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.859+0000 7f422eaa9640 1 Processor -- start 2024-05-09T05:53:53.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.859+0000 7f6d18964640 1 -- start start 2024-05-09T05:53:53.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.859+0000 7f0d9b807640 1 -- 172.21.15.72:0/1294161194 shutdown_connections 2024-05-09T05:53:53.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.859+0000 7f0d9b807640 1 --2- 172.21.15.72:0/1294161194 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d8c052ac0 0x7f0d8c0e7c20 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.859+0000 7f0d9b807640 1 --2- 172.21.15.72:0/1294161194 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d8c0e12a0 0x7f0d8c052580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.859+0000 7f0d9b807640 1 -- 172.21.15.72:0/1294161194 >> 172.21.15.72:0/1294161194 conn(0x7f0d8c00e2f0 msgr2=0x7f0d8c00e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:53.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.859+0000 7f422eaa9640 1 -- start start 2024-05-09T05:53:53.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.859+0000 7f538d59a640 1 -- 172.21.15.72:0/322537750 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53800b4070 con 0x7f5390153500 2024-05-09T05:53:53.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.859+0000 7fc552088640 1 --2- 172.21.15.72:0/3836214167 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc54c158b50 0x7fc54c156300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.859+0000 7fc551086640 1 -- 172.21.15.72:0/3836214167 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc54c06f820 msgr2=0x7fc54c157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.859+0000 7fc551086640 1 --2- 172.21.15.72:0/3836214167 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc54c06f820 0x7fc54c157da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.859+0000 7fc551086640 1 -- 172.21.15.72:0/3836214167 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc54c158b50 msgr2=0x7fc54c156300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.859+0000 7fc551086640 1 --2- 172.21.15.72:0/3836214167 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc54c158b50 0x7fc54c156300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.859+0000 7fc551086640 1 -- 172.21.15.72:0/3836214167 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc54c156ef0 con 0x7fc54c0c9a10 2024-05-09T05:53:53.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.859+0000 7fa0570f1640 1 -- 172.21.15.72:0/739354755 wait complete. 2024-05-09T05:53:53.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.859+0000 7fa0570f1640 1 Processor -- start 2024-05-09T05:53:53.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.859+0000 7fc551086640 1 --2- 172.21.15.72:0/3836214167 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc54c0c9a10 0x7fc54c145e80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc53c00d5f0 tx=0x7fc53c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:53.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.859+0000 7fc5427fc640 1 -- 172.21.15.72:0/3836214167 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc53c007050 con 0x7fc54c0c9a10 2024-05-09T05:53:53.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.859+0000 7fc553aeb640 1 -- 172.21.15.72:0/3836214167 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc54c15abc0 con 0x7fc54c0c9a10 2024-05-09T05:53:53.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7f422eaa9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f422806f820 0x7f4228149780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7f6d18964640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d140c65f0 0x7f6d14164c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7f6d18964640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d14159650 0x7f6d1414e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7f422eaa9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42280c6c90 0x7f42280cc040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7f422eaa9640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4228156520 0x7f422814cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7f422eaa9640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f42280c4a60 con 0x7f4228156520 2024-05-09T05:53:53.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7f422eaa9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f42280c79a0 con 0x7f42280c6c90 2024-05-09T05:53:53.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7f422eaa9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f42280c9c80 con 0x7f422806f820 2024-05-09T05:53:53.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7f6d18964640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d1414fca0 0x7f6d1414ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.859+0000 7f7767fff640 1 --2- 172.21.15.72:0/2058416698 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77700c9540 0x7f777006f820 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f77701618f0 tx=0x7f775801ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=431fd980b382ec18 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:53.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.859+0000 7fa0570f1640 1 -- start start 2024-05-09T05:53:53.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7f6d18964640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f6d140c9780 con 0x7f6d14159650 2024-05-09T05:53:53.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.859+0000 7f538d59a640 1 -- 172.21.15.72:0/322537750 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53800a79a0 con 0x7f5390153500 2024-05-09T05:53:53.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.859+0000 7f538d59a640 1 -- 172.21.15.72:0/322537750 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53800a7d70 con 0x7f5390153500 2024-05-09T05:53:53.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7f5394924640 1 -- 172.21.15.72:0/322537750 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5390153500 msgr2=0x7f539015c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7f5394924640 1 --2- 172.21.15.72:0/322537750 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5390153500 0x7f539015c800 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f538000ba60 tx=0x7f538001eae0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7f5394924640 1 -- 172.21.15.72:0/322537750 shutdown_connections 2024-05-09T05:53:53.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7f5394924640 1 --2- 172.21.15.72:0/322537750 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5390073e50 0x7f539006dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7f5394924640 1 --2- 172.21.15.72:0/322537750 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5390153500 0x7f539015c800 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7f5394924640 1 -- 172.21.15.72:0/322537750 >> 172.21.15.72:0/322537750 conn(0x7f53900cebf0 msgr2=0x7f53900cf030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:53.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7f6d18964640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f6d140c6a00 con 0x7f6d1414fca0 2024-05-09T05:53:53.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7f6d18964640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f6d140c9900 con 0x7f6d140c65f0 2024-05-09T05:53:53.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7f776e7fc640 1 -- 172.21.15.72:0/2058416698 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77580b5070 con 0x7f77700c9540 2024-05-09T05:53:53.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7f776e7fc640 1 -- 172.21.15.72:0/2058416698 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77580a8910 con 0x7f77700c9540 2024-05-09T05:53:53.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7f776e7fc640 1 -- 172.21.15.72:0/2058416698 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77580a8ce0 con 0x7f77700c9540 2024-05-09T05:53:53.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7f422c845640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f422806f820 0x7f4228149780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7f422c845640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f422806f820 0x7f4228149780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.72:37738/0 (socket says 172.21.15.72:37738) 2024-05-09T05:53:53.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7f422c845640 1 -- 172.21.15.72:0/3267841925 learned_addr learned my addr 172.21.15.72:0/3267841925 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:53.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7fc553aeb640 1 -- 172.21.15.72:0/3836214167 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc54c157190 con 0x7fc54c0c9a10 2024-05-09T05:53:53.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7f0d9b807640 1 -- 172.21.15.72:0/1294161194 shutdown_connections 2024-05-09T05:53:53.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7fc5427fc640 1 -- 172.21.15.72:0/3836214167 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc53c00f850 con 0x7fc54c0c9a10 2024-05-09T05:53:53.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7fc5427fc640 1 -- 172.21.15.72:0/3836214167 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc53c00fc00 con 0x7fc54c0c9a10 2024-05-09T05:53:53.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7f4227fff640 1 --2- 172.21.15.72:0/3267841925 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42280c6c90 0x7f42280cc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7f422d046640 1 --2- 172.21.15.72:0/3267841925 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4228156520 0x7f422814cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7f6d11d9b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d14159650 0x7f6d1414e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7f6d11d9b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d14159650 0x7f6d1414e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42140/0 (socket says 172.21.15.72:42140) 2024-05-09T05:53:53.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7f6d11d9b640 1 -- 172.21.15.72:0/3530485321 learned_addr learned my addr 172.21.15.72:0/3530485321 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:53.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7f6d12d9d640 1 --2- 172.21.15.72:0/3530485321 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d1414fca0 0x7f6d1414ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7f422c845640 1 -- 172.21.15.72:0/3267841925 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42280c6c90 msgr2=0x7f42280cc040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7f422c845640 1 --2- 172.21.15.72:0/3267841925 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42280c6c90 0x7f42280cc040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7f422c845640 1 -- 172.21.15.72:0/3267841925 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4228156520 msgr2=0x7f422814cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7f422c845640 1 --2- 172.21.15.72:0/3267841925 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4228156520 0x7f422814cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7f422c845640 1 -- 172.21.15.72:0/3267841925 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4228149cc0 con 0x7f422806f820 2024-05-09T05:53:53.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7f6d11d9b640 1 -- 172.21.15.72:0/3530485321 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d140c65f0 msgr2=0x7f6d14164c50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-09T05:53:53.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7f6d11d9b640 1 --2- 172.21.15.72:0/3530485321 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d140c65f0 0x7f6d14164c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7f6d11d9b640 1 -- 172.21.15.72:0/3530485321 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d1414fca0 msgr2=0x7f6d1414ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7f6d11d9b640 1 --2- 172.21.15.72:0/3530485321 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d1414fca0 0x7f6d1414ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7f6d11d9b640 1 -- 172.21.15.72:0/3530485321 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d141f5c60 con 0x7f6d14159650 2024-05-09T05:53:53.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7f422c845640 1 --2- 172.21.15.72:0/3267841925 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f422806f820 0x7f4228149780 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f422001b0d0 tx=0x7f42200197c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:53.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7f77752a9640 1 -- 172.21.15.72:0/2058416698 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77700c9540 msgr2=0x7f777006f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7f77752a9640 1 --2- 172.21.15.72:0/2058416698 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77700c9540 0x7f777006f820 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f77701618f0 tx=0x7f775801ec50 comp rx=0 tx=0).stop 2024-05-09T05:53:53.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7fc553aeb640 1 -- 172.21.15.72:0/3836214167 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5340052a0 con 0x7fc54c0c9a10 2024-05-09T05:53:53.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7f77752a9640 1 -- 172.21.15.72:0/2058416698 shutdown_connections 2024-05-09T05:53:53.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7f77752a9640 1 --2- 172.21.15.72:0/2058416698 >> v2:172.21.15.72:3300/0 conn(0x7f777006fd60 0x7f7770163e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7f77752a9640 1 --2- 172.21.15.72:0/2058416698 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77700c9540 0x7f777006f820 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7f6d11d9b640 1 --2- 172.21.15.72:0/3530485321 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d14159650 0x7f6d1414e740 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6d0800c5d0 tx=0x7f6d0800ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:53.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7f77752a9640 1 --2- 172.21.15.72:0/2058416698 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f777015a7a0 0x7f77700c9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7f77752a9640 1 -- 172.21.15.72:0/2058416698 >> 172.21.15.72:0/2058416698 conn(0x7f777006d0e0 msgr2=0x7f77700cd560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:53.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7f77752a9640 1 -- 172.21.15.72:0/2058416698 shutdown_connections 2024-05-09T05:53:53.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7f77752a9640 1 -- 172.21.15.72:0/2058416698 wait complete. 2024-05-09T05:53:53.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7f42257fa640 1 -- 172.21.15.72:0/3267841925 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42200a58a0 con 0x7f422806f820 2024-05-09T05:53:53.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7f42257fa640 1 -- 172.21.15.72:0/3267841925 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4220007c70 con 0x7f422806f820 2024-05-09T05:53:53.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7f42257fa640 1 -- 172.21.15.72:0/3267841925 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4220009510 con 0x7f422806f820 2024-05-09T05:53:53.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7f422eaa9640 1 -- 172.21.15.72:0/3267841925 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f422814a210 con 0x7f422806f820 2024-05-09T05:53:53.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7f422eaa9640 1 -- 172.21.15.72:0/3267841925 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4228152be0 con 0x7f422806f820 2024-05-09T05:53:53.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7f6d02ffd640 1 -- 172.21.15.72:0/3530485321 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d08015070 con 0x7f6d14159650 2024-05-09T05:53:53.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7f6d02ffd640 1 -- 172.21.15.72:0/3530485321 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d08004220 con 0x7f6d14159650 2024-05-09T05:53:53.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7f6d18964640 1 -- 172.21.15.72:0/3530485321 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d14154f90 con 0x7f6d14159650 2024-05-09T05:53:53.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7fa0570f1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa048006930 0x7fa048049ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7f6d02ffd640 1 -- 172.21.15.72:0/3530485321 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d08003620 con 0x7f6d14159650 2024-05-09T05:53:53.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7fa0570f1640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa048036040 0x7fa0480cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7f6d18964640 1 -- 172.21.15.72:0/3530485321 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d141f61c0 con 0x7f6d14159650 2024-05-09T05:53:53.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7fa0570f1640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa048046780 0x7fa0480ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7fa0560ef640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa048006930 0x7fa048049ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7fa0570f1640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fa0480335d0 con 0x7fa048036040 2024-05-09T05:53:53.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7fa0570f1640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fa048007150 con 0x7fa048006930 2024-05-09T05:53:53.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7fa0570f1640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fa048033750 con 0x7fa048046780 2024-05-09T05:53:53.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7fa0560ef640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa048006930 0x7fa048049ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.72:42448/0 (socket says 172.21.15.72:42448) 2024-05-09T05:53:53.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7fa0560ef640 1 -- 172.21.15.72:0/718489883 learned_addr learned my addr 172.21.15.72:0/718489883 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:53.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7fa0568f0640 1 --2- 172.21.15.72:0/718489883 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa048046780 0x7fa0480ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7fa0560ef640 1 -- 172.21.15.72:0/718489883 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa048046780 msgr2=0x7fa0480ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7fa0560ef640 1 --2- 172.21.15.72:0/718489883 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa048046780 0x7fa0480ce0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7fa0560ef640 1 -- 172.21.15.72:0/718489883 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa048036040 msgr2=0x7fa0480cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7fa0560ef640 1 --2- 172.21.15.72:0/718489883 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa048036040 0x7fa0480cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7fa0560ef640 1 -- 172.21.15.72:0/718489883 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0480d2340 con 0x7fa048006930 2024-05-09T05:53:53.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7f0d9b807640 1 -- 172.21.15.72:0/1294161194 wait complete. 2024-05-09T05:53:53.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7f0d9b807640 1 Processor -- start 2024-05-09T05:53:53.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.867+0000 7f77752a9640 1 Processor -- start 2024-05-09T05:53:53.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.867+0000 7f77752a9640 1 -- start start 2024-05-09T05:53:53.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.867+0000 7f422eaa9640 1 -- 172.21.15.72:0/3267841925 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42080052a0 con 0x7f422806f820 2024-05-09T05:53:53.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.863+0000 7fc5427fc640 1 -- 172.21.15.72:0/3836214167 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fc53c010420 con 0x7fc54c0c9a10 2024-05-09T05:53:53.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.867+0000 7fc5427fc640 1 --2- 172.21.15.72:0/3836214167 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fc53006f480 0x7fc530071990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.867+0000 7fa0560ef640 1 --2- 172.21.15.72:0/718489883 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa048006930 0x7fa048049ae0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa04c01b3e0 tx=0x7fa04c01a550 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:53.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.867+0000 7f6d00ff9640 1 -- 172.21.15.72:0/3530485321 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cec0052a0 con 0x7f6d14159650 2024-05-09T05:53:53.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.867+0000 7fc551887640 1 --2- 172.21.15.72:0/3836214167 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fc53006f480 0x7fc530071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.867+0000 7f42257fa640 1 -- 172.21.15.72:0/3267841925 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f42200c0020 con 0x7f422806f820 2024-05-09T05:53:53.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.867+0000 7fa046ffd640 1 -- 172.21.15.72:0/718489883 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa04c0be070 con 0x7fa048006930 2024-05-09T05:53:53.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.867+0000 7fa046ffd640 1 -- 172.21.15.72:0/718489883 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa04c0af8b0 con 0x7fa048006930 2024-05-09T05:53:53.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.867+0000 7fa046ffd640 1 -- 172.21.15.72:0/718489883 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa04c0afc80 con 0x7fa048006930 2024-05-09T05:53:53.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.867+0000 7fa0570f1640 1 -- 172.21.15.72:0/718489883 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0480d25e0 con 0x7fa048006930 2024-05-09T05:53:53.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.867+0000 7f0d9b807640 1 -- start start 2024-05-09T05:53:53.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.867+0000 7f0d9b807640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d8c0367b0 0x7f0d8c0df4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.867+0000 7f0d9b807640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d8c0e12a0 0x7f0d8c04bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.867+0000 7f0d9b807640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d8c0dece0 0x7f0d8c047770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.867+0000 7f0d9b807640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f0d8c04e590 con 0x7f0d8c0e12a0 2024-05-09T05:53:53.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.867+0000 7f0d9b807640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f0d8c04f440 con 0x7f0d8c0dece0 2024-05-09T05:53:53.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.867+0000 7f0d9b807640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f0d8c04e060 con 0x7f0d8c0367b0 2024-05-09T05:53:53.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.867+0000 7fa0570f1640 1 -- 172.21.15.72:0/718489883 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0480d0240 con 0x7fa048006930 2024-05-09T05:53:53.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.867+0000 7f0d99da4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d8c0dece0 0x7f0d8c047770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.867+0000 7f0d99da4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d8c0dece0 0x7f0d8c047770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.72:42468/0 (socket says 172.21.15.72:42468) 2024-05-09T05:53:53.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.867+0000 7f0d99da4640 1 -- 172.21.15.72:0/304534050 learned_addr learned my addr 172.21.15.72:0/304534050 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:53.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.867+0000 7f42257fa640 1 --2- 172.21.15.72:0/3267841925 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f421406f400 0x7f4214071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.867+0000 7f42257fa640 1 -- 172.21.15.72:0/3267841925 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f422012ae10 con 0x7f422806f820 2024-05-09T05:53:53.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.867+0000 7f4227fff640 1 --2- 172.21.15.72:0/3267841925 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f421406f400 0x7f4214071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.867+0000 7f0d99da4640 1 -- 172.21.15.72:0/304534050 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d8c0367b0 msgr2=0x7f0d8c0df4f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-09T05:53:53.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.867+0000 7f0d99da4640 1 --2- 172.21.15.72:0/304534050 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d8c0367b0 0x7f0d8c0df4f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.867+0000 7f0d99da4640 1 -- 172.21.15.72:0/304534050 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d8c0e12a0 msgr2=0x7f0d8c04bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.867+0000 7f0d99da4640 1 --2- 172.21.15.72:0/304534050 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d8c0e12a0 0x7f0d8c04bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.867+0000 7f0d99da4640 1 -- 172.21.15.72:0/304534050 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d8c175030 con 0x7f0d8c0dece0 2024-05-09T05:53:53.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.867+0000 7fa0570f1640 1 -- 172.21.15.72:0/718489883 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa048005580 con 0x7fa048006930 2024-05-09T05:53:53.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.867+0000 7f6d02ffd640 1 -- 172.21.15.72:0/3530485321 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f6d080037c0 con 0x7f6d14159650 2024-05-09T05:53:53.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.867+0000 7fc551887640 1 --2- 172.21.15.72:0/3836214167 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fc53006f480 0x7fc530071990 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc544011340 tx=0x7fc54400b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:53.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.867+0000 7f77752a9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f777006fd60 0x7f777015f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.867+0000 7f77752a9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77700c9540 0x7f777015d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.867+0000 7f77752a9640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f777015a7a0 0x7f7770154690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.867+0000 7f77752a9640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f77700c8800 con 0x7f777015a7a0 2024-05-09T05:53:53.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.867+0000 7f77752a9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f77700c8520 con 0x7f77700c9540 2024-05-09T05:53:53.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.867+0000 7f77752a9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f77700c8ae0 con 0x7f777006fd60 2024-05-09T05:53:53.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.867+0000 7f776effd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f777006fd60 0x7f777015f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.867+0000 7f7767fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77700c9540 0x7f777015d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.867+0000 7f776effd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f777006fd60 0x7f777015f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.72:37750/0 (socket says 172.21.15.72:37750) 2024-05-09T05:53:53.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.867+0000 7f776effd640 1 -- 172.21.15.72:0/2130879024 learned_addr learned my addr 172.21.15.72:0/2130879024 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:53.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.867+0000 7f7767fff640 1 -- 172.21.15.72:0/2130879024 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f777006fd60 msgr2=0x7f777015f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.867+0000 7f7767fff640 1 --2- 172.21.15.72:0/2130879024 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f777006fd60 0x7f777015f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.867+0000 7f7767fff640 1 -- 172.21.15.72:0/2130879024 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f777015a7a0 msgr2=0x7f7770154690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.867+0000 7f7767fff640 1 --2- 172.21.15.72:0/2130879024 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f777015a7a0 0x7f7770154690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.867+0000 7f7767fff640 1 -- 172.21.15.72:0/2130879024 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f777015cfa0 con 0x7f77700c9540 2024-05-09T05:53:53.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.867+0000 7f7767fff640 1 --2- 172.21.15.72:0/2130879024 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77700c9540 0x7f777015d950 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f77700c7440 tx=0x7f775801b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:53.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.867+0000 7f77677fe640 1 -- 172.21.15.72:0/2130879024 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77580b0850 con 0x7f77700c9540 2024-05-09T05:53:53.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.867+0000 7f77752a9640 1 -- 172.21.15.72:0/2130879024 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f777015d280 con 0x7f77700c9540 2024-05-09T05:53:53.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.867+0000 7f77752a9640 1 -- 172.21.15.72:0/2130879024 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77701f7030 con 0x7f77700c9540 2024-05-09T05:53:53.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.871+0000 7f77677fe640 1 -- 172.21.15.72:0/2130879024 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77580c6040 con 0x7f77700c9540 2024-05-09T05:53:53.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.871+0000 7f77677fe640 1 -- 172.21.15.72:0/2130879024 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77580b0bf0 con 0x7f77700c9540 2024-05-09T05:53:53.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.871+0000 7f0d99da4640 1 --2- 172.21.15.72:0/304534050 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d8c0dece0 0x7f0d8c047770 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0d9402e1d0 tx=0x7f0d9409afe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:53.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.871+0000 7f4227fff640 1 --2- 172.21.15.72:0/3267841925 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f421406f400 0x7f4214071910 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f42280c74e0 tx=0x7f421c0090e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:53.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.871+0000 7f5394924640 1 -- 172.21.15.72:0/322537750 shutdown_connections 2024-05-09T05:53:53.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.871+0000 7f5394924640 1 -- 172.21.15.72:0/322537750 wait complete. 2024-05-09T05:53:53.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.871+0000 7f6d02ffd640 1 --2- 172.21.15.72:0/3530485321 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f6cf406f430 0x7f6cf4071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.871+0000 7f6d02ffd640 1 -- 172.21.15.72:0/3530485321 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6d0808f690 con 0x7f6d14159650 2024-05-09T05:53:53.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.871+0000 7f0d89ffb640 1 -- 172.21.15.72:0/304534050 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d94133040 con 0x7f0d8c0dece0 2024-05-09T05:53:53.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.871+0000 7f0d89ffb640 1 -- 172.21.15.72:0/304534050 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d9413c070 con 0x7f0d8c0dece0 2024-05-09T05:53:53.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.871+0000 7f77752a9640 1 -- 172.21.15.72:0/2130879024 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7770050880 con 0x7f77700c9540 2024-05-09T05:53:53.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.871+0000 7f0d9b807640 1 -- 172.21.15.72:0/304534050 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d8c175310 con 0x7f0d8c0dece0 2024-05-09T05:53:53.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.871+0000 7f0d89ffb640 1 -- 172.21.15.72:0/304534050 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d94137840 con 0x7f0d8c0dece0 2024-05-09T05:53:53.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.871+0000 7f0d9b807640 1 -- 172.21.15.72:0/304534050 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d8c0dfac0 con 0x7f0d8c0dece0 2024-05-09T05:53:53.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.871+0000 7f6d1259c640 1 --2- 172.21.15.72:0/3530485321 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f6cf406f430 0x7f6cf4071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.871+0000 7f0d9b807640 1 -- 172.21.15.72:0/304534050 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d8c182c60 con 0x7f0d8c0dece0 2024-05-09T05:53:53.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.871+0000 7f6d1259c640 1 --2- 172.21.15.72:0/3530485321 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f6cf406f430 0x7f6cf4071940 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6d14070da0 tx=0x7f6d040a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:53.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.871+0000 7f5394924640 1 Processor -- start 2024-05-09T05:53:53.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.871+0000 7fa046ffd640 1 -- 172.21.15.72:0/718489883 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fa04c0c1070 con 0x7fa048006930 2024-05-09T05:53:53.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.871+0000 7fa046ffd640 1 --2- 172.21.15.72:0/718489883 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fa03406f500 0x7fa034071a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.871+0000 7fa046ffd640 1 -- 172.21.15.72:0/718489883 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa04c129ec0 con 0x7fa048006930 2024-05-09T05:53:53.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.871+0000 7f5394924640 1 -- start start 2024-05-09T05:53:53.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.871+0000 7fc5427fc640 1 -- 172.21.15.72:0/3836214167 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc53c019df0 con 0x7fc54c0c9a10 2024-05-09T05:53:53.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.875+0000 7f5394924640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5390073a40 0x7f539014c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.875+0000 7f5394924640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5390073e50 0x7f53901f57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.906 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.875+0000 7f5394924640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5390153500 0x7f53900cd740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.906 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.875+0000 7f5394924640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f53900caf30 con 0x7f5390073a40 2024-05-09T05:53:53.906 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.871+0000 7fa0558ee640 1 --2- 172.21.15.72:0/718489883 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fa03406f500 0x7fa034071a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.906 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.875+0000 7fa0558ee640 1 --2- 172.21.15.72:0/718489883 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fa03406f500 0x7fa034071a10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa0480db560 tx=0x7fa040006bd0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:53.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.875+0000 7f5394924640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f5390074260 con 0x7f5390073e50 2024-05-09T05:53:53.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.875+0000 7f538e59c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5390073a40 0x7f539014c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.875+0000 7f538e59c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5390073a40 0x7f539014c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42176/0 (socket says 172.21.15.72:42176) 2024-05-09T05:53:53.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.875+0000 7f538e59c640 1 -- 172.21.15.72:0/2094181270 learned_addr learned my addr 172.21.15.72:0/2094181270 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:53.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.875+0000 7f5394924640 1 -- 172.21.15.72:0/2094181270 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f539014ca60 con 0x7f5390153500 2024-05-09T05:53:53.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.875+0000 7f538dd9b640 1 --2- 172.21.15.72:0/2094181270 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5390073e50 0x7f53901f57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.875+0000 7f538ed9d640 1 --2- 172.21.15.72:0/2094181270 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5390153500 0x7f53900cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.875+0000 7f6549faa640 1 Processor -- start 2024-05-09T05:53:53.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.875+0000 7f6549faa640 1 -- start start 2024-05-09T05:53:53.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.875+0000 7f538e59c640 1 -- 172.21.15.72:0/2094181270 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5390153500 msgr2=0x7f53900cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.875+0000 7f538e59c640 1 --2- 172.21.15.72:0/2094181270 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5390153500 0x7f53900cd740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.875+0000 7f538e59c640 1 -- 172.21.15.72:0/2094181270 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5390073e50 msgr2=0x7f53901f57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.875+0000 7f538e59c640 1 --2- 172.21.15.72:0/2094181270 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5390073e50 0x7f53901f57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.875+0000 7f538e59c640 1 -- 172.21.15.72:0/2094181270 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f539014c590 con 0x7f5390073a40 2024-05-09T05:53:53.910 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.875+0000 7f77677fe640 1 -- 172.21.15.72:0/2130879024 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f77580d2060 con 0x7f77700c9540 2024-05-09T05:53:53.910 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.875+0000 7f77677fe640 1 --2- 172.21.15.72:0/2130879024 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f775006f400 0x7f7750071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.910 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.875+0000 7f77677fe640 1 -- 172.21.15.72:0/2130879024 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f775813d190 con 0x7f77700c9540 2024-05-09T05:53:53.910 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.875+0000 7f538e59c640 1 --2- 172.21.15.72:0/2094181270 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5390073a40 0x7f539014c050 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f538001d190 tx=0x7f538001b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:53.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.875+0000 7f776effd640 1 --2- 172.21.15.72:0/2130879024 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f775006f400 0x7f7750071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.875+0000 7f776effd640 1 --2- 172.21.15.72:0/2130879024 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f775006f400 0x7f7750071910 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7760009b00 tx=0x7f7760008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:53.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.875+0000 7f6549faa640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f653c049350 0x7f653c04dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.875+0000 7f6549faa640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f653c04e220 0x7f653c000e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.875+0000 7f6549faa640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f653c04eb20 con 0x7f653c0483f0 2024-05-09T05:53:53.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.875+0000 7f6549faa640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f653c047990 con 0x7f653c04e220 2024-05-09T05:53:53.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.875+0000 7f6542ffd640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f653c0483f0 0x7f653c0dda30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34494/0 (socket says 172.21.15.72:34494) 2024-05-09T05:53:53.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.875+0000 7f6549faa640 1 -- 172.21.15.72:0/871773318 --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f653c002380 con 0x7f653c049350 2024-05-09T05:53:53.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.875+0000 7f6542ffd640 1 -- 172.21.15.72:0/871773318 learned_addr learned my addr 172.21.15.72:0/871773318 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:53:53.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.875+0000 7f65437fe640 1 --2- 172.21.15.72:0/871773318 >> v2:172.21.15.72:3300/0 conn(0x7f653c04e220 0x7f653c000e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.913 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.875+0000 7f65427fc640 1 --2- 172.21.15.72:0/871773318 >> v2:172.21.15.110:3300/0 conn(0x7f653c049350 0x7f653c04dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.913 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.875+0000 7f65437fe640 1 -- 172.21.15.72:0/871773318 >> v2:172.21.15.110:3300/0 conn(0x7f653c049350 msgr2=0x7f653c04dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:53.913 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.875+0000 7f65437fe640 1 --2- 172.21.15.72:0/871773318 >> v2:172.21.15.110:3300/0 conn(0x7f653c049350 0x7f653c04dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.913 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.875+0000 7f65437fe640 1 -- 172.21.15.72:0/871773318 >> v1:172.21.15.72:6789/0 conn(0x7f653c0483f0 legacy=0x7f653c0dda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.913 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.875+0000 7f65437fe640 1 -- 172.21.15.72:0/871773318 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f653c047fb0 con 0x7f653c04e220 2024-05-09T05:53:53.913 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.875+0000 7f65427fc640 1 --2- 172.21.15.72:0/871773318 >> v2:172.21.15.110:3300/0 conn(0x7f653c049350 0x7f653c04dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:53:53.913 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.879+0000 7f6d02ffd640 1 -- 172.21.15.72:0/3530485321 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f6d141f5c60 con 0x7f6d14159650 2024-05-09T05:53:53.913 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.883+0000 7f65437fe640 1 --2- 172.21.15.72:0/871773318 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f653c04e220 0x7f653c000e30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f653c034d80 tx=0x7f653801ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fccf79573f370c3 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:53.913 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.883+0000 7f6541ffb640 1 -- 172.21.15.72:0/871773318 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65380b5070 con 0x7f653c04e220 2024-05-09T05:53:53.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.883+0000 7f6541ffb640 1 -- 172.21.15.72:0/871773318 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65380a8970 con 0x7f653c04e220 2024-05-09T05:53:53.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.883+0000 7f6541ffb640 1 -- 172.21.15.72:0/871773318 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65380a8d40 con 0x7f653c04e220 2024-05-09T05:53:53.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.883+0000 7f537effd640 1 -- 172.21.15.72:0/2094181270 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53800bd070 con 0x7f5390073a40 2024-05-09T05:53:53.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.883+0000 7f537effd640 1 -- 172.21.15.72:0/2094181270 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53800af700 con 0x7f5390073a40 2024-05-09T05:53:53.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.883+0000 7f537effd640 1 -- 172.21.15.72:0/2094181270 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53800b4040 con 0x7f5390073a40 2024-05-09T05:53:53.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.883+0000 7f5394924640 1 -- 172.21.15.72:0/2094181270 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5390140050 con 0x7f5390073a40 2024-05-09T05:53:53.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.883+0000 7fc5427fc640 1 -- 172.21.15.72:0/3836214167 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fc53c014030 con 0x7fc54c0c9a10 2024-05-09T05:53:53.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.883+0000 7f5394924640 1 -- 172.21.15.72:0/2094181270 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53901f2490 con 0x7f5390073a40 2024-05-09T05:53:53.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.883+0000 7f42257fa640 1 -- 172.21.15.72:0/3267841925 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f4220016640 con 0x7f422806f820 2024-05-09T05:53:53.916 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.883+0000 7f6549faa640 1 -- 172.21.15.72:0/871773318 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f653c04e220 msgr2=0x7f653c000e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.916 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.883+0000 7f6549faa640 1 --2- 172.21.15.72:0/871773318 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f653c04e220 0x7f653c000e30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f653c034d80 tx=0x7f653801ec70 comp rx=0 tx=0).stop 2024-05-09T05:53:53.916 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.883+0000 7f5394924640 1 -- 172.21.15.72:0/2094181270 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5390050880 con 0x7f5390073a40 2024-05-09T05:53:53.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.883+0000 7f6549faa640 1 -- 172.21.15.72:0/871773318 shutdown_connections 2024-05-09T05:53:53.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.883+0000 7f6549faa640 1 --2- 172.21.15.72:0/871773318 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f653c04e220 0x7f653c000e30 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.883+0000 7f6549faa640 1 --2- 172.21.15.72:0/871773318 >> v2:172.21.15.110:3300/0 conn(0x7f653c049350 0x7f653c04dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.883+0000 7f6549faa640 1 -- 172.21.15.72:0/871773318 >> 172.21.15.72:0/871773318 conn(0x7f653c052570 msgr2=0x7f653c052980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:53.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.887+0000 7f6549faa640 1 -- 172.21.15.72:0/871773318 shutdown_connections 2024-05-09T05:53:53.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.887+0000 7f6549faa640 1 -- 172.21.15.72:0/871773318 wait complete. 2024-05-09T05:53:53.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.887+0000 7f537effd640 1 -- 172.21.15.72:0/2094181270 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f53800afad0 con 0x7f5390073a40 2024-05-09T05:53:53.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.887+0000 7f537effd640 1 --2- 172.21.15.72:0/2094181270 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f537006f400 0x7f5370071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.887+0000 7f537effd640 1 -- 172.21.15.72:0/2094181270 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5380129160 con 0x7f5390073a40 2024-05-09T05:53:53.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.887+0000 7f538dd9b640 1 --2- 172.21.15.72:0/2094181270 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f537006f400 0x7f5370071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.887+0000 7fa046ffd640 1 -- 172.21.15.72:0/718489883 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fa04c0c8080 con 0x7fa048006930 2024-05-09T05:53:53.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.887+0000 7f538dd9b640 1 --2- 172.21.15.72:0/2094181270 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f537006f400 0x7f5370071910 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5390145fe0 tx=0x7f5384009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:53.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.891+0000 7f6549faa640 1 Processor -- start 2024-05-09T05:53:53.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.891+0000 7f6549faa640 1 -- start start 2024-05-09T05:53:53.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.891+0000 7f0d89ffb640 1 -- 172.21.15.72:0/304534050 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f0d9412c070 con 0x7f0d8c0dece0 2024-05-09T05:53:53.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.891+0000 7f0d89ffb640 1 --2- 172.21.15.72:0/304534050 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f0d8006f8d0 0x7f0d80071de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.891+0000 7f0d995a3640 1 --2- 172.21.15.72:0/304534050 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f0d8006f8d0 0x7f0d80071de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.891+0000 7f537effd640 1 -- 172.21.15.72:0/2094181270 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f5380018760 con 0x7f5390073a40 2024-05-09T05:53:53.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.891+0000 7f6549faa640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f653c0483f0 0x7f653c0ce5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.891+0000 7f6549faa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f653c049350 0x7f653c0c9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.891+0000 7f6549faa640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f653c04e220 0x7f653c0d0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.891+0000 7f6542ffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f653c0483f0 0x7f653c0ce5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.891+0000 7f6542ffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f653c0483f0 0x7f653c0ce5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42198/0 (socket says 172.21.15.72:42198) 2024-05-09T05:53:53.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.891+0000 7f6542ffd640 1 -- 172.21.15.72:0/2159410719 learned_addr learned my addr 172.21.15.72:0/2159410719 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:53.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.891+0000 7f6549faa640 1 -- 172.21.15.72:0/2159410719 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f653c0dd510 con 0x7f653c0483f0 2024-05-09T05:53:53.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.891+0000 7f6549faa640 1 -- 172.21.15.72:0/2159410719 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f653c0dd230 con 0x7f653c04e220 2024-05-09T05:53:53.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.891+0000 7f6549faa640 1 -- 172.21.15.72:0/2159410719 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f653c035120 con 0x7f653c049350 2024-05-09T05:53:53.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.891+0000 7f0d995a3640 1 --2- 172.21.15.72:0/304534050 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f0d8006f8d0 0x7f0d80071de0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0d90001520 tx=0x7f0d90007ca0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:53.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.891+0000 7f65437fe640 1 --2- 172.21.15.72:0/2159410719 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f653c04e220 0x7f653c0d0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.891+0000 7f65427fc640 1 --2- 172.21.15.72:0/2159410719 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f653c049350 0x7f653c0c9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.891+0000 7f6542ffd640 1 -- 172.21.15.72:0/2159410719 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f653c049350 msgr2=0x7f653c0c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.891+0000 7f6542ffd640 1 --2- 172.21.15.72:0/2159410719 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f653c049350 0x7f653c0c9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.891+0000 7f6542ffd640 1 -- 172.21.15.72:0/2159410719 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f653c04e220 msgr2=0x7f653c0d0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:53.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.891+0000 7f6542ffd640 1 --2- 172.21.15.72:0/2159410719 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f653c04e220 0x7f653c0d0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:53.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.891+0000 7f6542ffd640 1 -- 172.21.15.72:0/2159410719 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f653c009e50 con 0x7f653c0483f0 2024-05-09T05:53:53.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.891+0000 7f65427fc640 1 --2- 172.21.15.72:0/2159410719 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f653c049350 0x7f653c0c9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:53:53.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.895+0000 7f6542ffd640 1 --2- 172.21.15.72:0/2159410719 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f653c0483f0 0x7f653c0ce5d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f65440516d0 tx=0x7f654406b030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:53.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.899+0000 7f652ffff640 1 -- 172.21.15.72:0/2159410719 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65440753c0 con 0x7f653c0483f0 2024-05-09T05:53:53.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.899+0000 7f6549faa640 1 -- 172.21.15.72:0/2159410719 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f653c171d10 con 0x7f653c0483f0 2024-05-09T05:53:53.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.899+0000 7f6549faa640 1 -- 172.21.15.72:0/2159410719 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f653c1722d0 con 0x7f653c0483f0 2024-05-09T05:53:53.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.899+0000 7f652ffff640 1 -- 172.21.15.72:0/2159410719 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65440755c0 con 0x7f653c0483f0 2024-05-09T05:53:53.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.899+0000 7f6549faa640 1 -- 172.21.15.72:0/2159410719 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f653c0daa40 con 0x7f653c0483f0 2024-05-09T05:53:53.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.899+0000 7f652ffff640 1 -- 172.21.15.72:0/2159410719 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f654406c9e0 con 0x7f653c0483f0 2024-05-09T05:53:53.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.899+0000 7f652ffff640 1 -- 172.21.15.72:0/2159410719 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f654406cc00 con 0x7f653c0483f0 2024-05-09T05:53:53.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.899+0000 7f652ffff640 1 --2- 172.21.15.72:0/2159410719 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f652806f480 0x7f6528071990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:53.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.903+0000 7f652ffff640 1 -- 172.21.15.72:0/2159410719 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6544110060 con 0x7f653c0483f0 2024-05-09T05:53:53.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.903+0000 7f65427fc640 1 --2- 172.21.15.72:0/2159410719 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f652806f480 0x7f6528071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:53.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.903+0000 7f65427fc640 1 --2- 172.21.15.72:0/2159410719 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f652806f480 0x7f6528071990 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f653c0ca7d0 tx=0x7f6530008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:53.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.903+0000 7f0d89ffb640 1 -- 172.21.15.72:0/304534050 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f0d9412de70 con 0x7f0d8c0dece0 2024-05-09T05:53:53.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.903+0000 7f77677fe640 1 -- 172.21.15.72:0/2130879024 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f77580187b0 con 0x7f77700c9540 2024-05-09T05:53:53.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.911+0000 7f652ffff640 1 -- 172.21.15.72:0/2159410719 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f65440c8f50 con 0x7f653c0483f0 2024-05-09T05:53:53.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:53.915+0000 7f0d89ffb640 1 -- 172.21.15.72:0/304534050 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f0d94096380 con 0x7f0d8c0dece0 2024-05-09T05:53:54.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.183+0000 7fc553aeb640 1 -- 172.21.15.72:0/3836214167 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fc534005590 con 0x7fc54c0c9a10 2024-05-09T05:53:54.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.183+0000 7fc5427fc640 1 -- 172.21.15.72:0/3836214167 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc53c05c530 con 0x7fc54c0c9a10 2024-05-09T05:53:54.179 INFO:teuthology.orchestra.run.smithi072.stdout:64424509449 2024-05-09T05:53:54.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.187+0000 7fc52ffff640 1 -- 172.21.15.72:0/3836214167 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fc53006f480 msgr2=0x7fc530071990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:54.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.187+0000 7fc52ffff640 1 --2- 172.21.15.72:0/3836214167 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fc53006f480 0x7fc530071990 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc544011340 tx=0x7fc54400b040 comp rx=0 tx=0).stop 2024-05-09T05:53:54.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.187+0000 7fc52ffff640 1 -- 172.21.15.72:0/3836214167 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc54c0c9a10 msgr2=0x7fc54c145e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:54.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.187+0000 7fc52ffff640 1 --2- 172.21.15.72:0/3836214167 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc54c0c9a10 0x7fc54c145e80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc53c00d5f0 tx=0x7fc53c00dab0 comp rx=0 tx=0).stop 2024-05-09T05:53:54.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.187+0000 7fc52ffff640 1 -- 172.21.15.72:0/3836214167 shutdown_connections 2024-05-09T05:53:54.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.187+0000 7fc52ffff640 1 --2- 172.21.15.72:0/3836214167 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fc53006f480 0x7fc530071990 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:54.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.187+0000 7fc52ffff640 1 --2- 172.21.15.72:0/3836214167 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc54c158b50 0x7fc54c156300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:54.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.187+0000 7fc52ffff640 1 --2- 172.21.15.72:0/3836214167 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc54c0c9a10 0x7fc54c145e80 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:54.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.187+0000 7fc52ffff640 1 --2- 172.21.15.72:0/3836214167 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc54c06f820 0x7fc54c157da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:54.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.187+0000 7fc52ffff640 1 -- 172.21.15.72:0/3836214167 >> 172.21.15.72:0/3836214167 conn(0x7fc54c06d0e0 msgr2=0x7fc54c148ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:54.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.187+0000 7fc52ffff640 1 -- 172.21.15.72:0/3836214167 shutdown_connections 2024-05-09T05:53:54.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.187+0000 7fc52ffff640 1 -- 172.21.15.72:0/3836214167 wait complete. 2024-05-09T05:53:54.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.195+0000 7f422eaa9640 1 -- 172.21.15.72:0/3267841925 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f4208005860 con 0x7f422806f820 2024-05-09T05:53:54.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.195+0000 7f42257fa640 1 -- 172.21.15.72:0/3267841925 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f42200f7600 con 0x7f422806f820 2024-05-09T05:53:54.188 INFO:teuthology.orchestra.run.smithi072.stdout:64424509452 2024-05-09T05:53:54.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.199+0000 7f420effd640 1 -- 172.21.15.72:0/3267841925 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f421406f400 msgr2=0x7f4214071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:54.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.199+0000 7f420effd640 1 --2- 172.21.15.72:0/3267841925 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f421406f400 0x7f4214071910 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f42280c74e0 tx=0x7f421c0090e0 comp rx=0 tx=0).stop 2024-05-09T05:53:54.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.199+0000 7f420effd640 1 -- 172.21.15.72:0/3267841925 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f422806f820 msgr2=0x7f4228149780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:54.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.199+0000 7f420effd640 1 --2- 172.21.15.72:0/3267841925 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f422806f820 0x7f4228149780 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f422001b0d0 tx=0x7f42200197c0 comp rx=0 tx=0).stop 2024-05-09T05:53:54.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.199+0000 7f420effd640 1 -- 172.21.15.72:0/3267841925 shutdown_connections 2024-05-09T05:53:54.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.199+0000 7f420effd640 1 --2- 172.21.15.72:0/3267841925 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f421406f400 0x7f4214071910 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:54.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.199+0000 7f420effd640 1 --2- 172.21.15.72:0/3267841925 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4228156520 0x7f422814cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:54.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.199+0000 7f420effd640 1 --2- 172.21.15.72:0/3267841925 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42280c6c90 0x7f42280cc040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:54.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.199+0000 7f420effd640 1 --2- 172.21.15.72:0/3267841925 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f422806f820 0x7f4228149780 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:54.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.199+0000 7f420effd640 1 -- 172.21.15.72:0/3267841925 >> 172.21.15.72:0/3267841925 conn(0x7f422806d0e0 msgr2=0x7f4228075d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:54.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.199+0000 7f420effd640 1 -- 172.21.15.72:0/3267841925 shutdown_connections 2024-05-09T05:53:54.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.199+0000 7f420effd640 1 -- 172.21.15.72:0/3267841925 wait complete. 2024-05-09T05:53:54.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.203+0000 7f6d00ff9640 1 -- 172.21.15.72:0/3530485321 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f6cec005860 con 0x7f6d14159650 2024-05-09T05:53:54.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.203+0000 7f6d02ffd640 1 -- 172.21.15.72:0/3530485321 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6d080642a0 con 0x7f6d14159650 2024-05-09T05:53:54.195 INFO:teuthology.orchestra.run.smithi072.stdout:55834574857 2024-05-09T05:53:54.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.207+0000 7f6d18964640 1 -- 172.21.15.72:0/3530485321 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f6cf406f430 msgr2=0x7f6cf4071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:54.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.207+0000 7f6d18964640 1 --2- 172.21.15.72:0/3530485321 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f6cf406f430 0x7f6cf4071940 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6d14070da0 tx=0x7f6d040a6000 comp rx=0 tx=0).stop 2024-05-09T05:53:54.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.207+0000 7f6d18964640 1 -- 172.21.15.72:0/3530485321 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d14159650 msgr2=0x7f6d1414e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:54.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.207+0000 7f6d18964640 1 --2- 172.21.15.72:0/3530485321 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d14159650 0x7f6d1414e740 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6d0800c5d0 tx=0x7f6d0800ca90 comp rx=0 tx=0).stop 2024-05-09T05:53:54.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.207+0000 7f6d18964640 1 -- 172.21.15.72:0/3530485321 shutdown_connections 2024-05-09T05:53:54.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.207+0000 7f6d18964640 1 --2- 172.21.15.72:0/3530485321 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f6cf406f430 0x7f6cf4071940 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:54.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.207+0000 7f6d18964640 1 --2- 172.21.15.72:0/3530485321 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d1414fca0 0x7f6d1414ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:54.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.207+0000 7f6d18964640 1 --2- 172.21.15.72:0/3530485321 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d14159650 0x7f6d1414e740 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:54.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.207+0000 7f6d18964640 1 --2- 172.21.15.72:0/3530485321 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d140c65f0 0x7f6d14164c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:54.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.207+0000 7f6d18964640 1 -- 172.21.15.72:0/3530485321 >> 172.21.15.72:0/3530485321 conn(0x7f6d1406d0e0 msgr2=0x7f6d140764a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:54.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.207+0000 7f6d18964640 1 -- 172.21.15.72:0/3530485321 shutdown_connections 2024-05-09T05:53:54.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.207+0000 7f6d18964640 1 -- 172.21.15.72:0/3530485321 wait complete. 2024-05-09T05:53:54.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.207+0000 7fa0570f1640 1 -- 172.21.15.72:0/718489883 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fa048005b30 con 0x7fa048006930 2024-05-09T05:53:54.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.207+0000 7fa046ffd640 1 -- 172.21.15.72:0/718489883 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa04c0173a0 con 0x7fa048006930 2024-05-09T05:53:54.203 INFO:teuthology.orchestra.run.smithi072.stdout:64424509452 2024-05-09T05:53:54.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.219+0000 7f77752a9640 1 -- 172.21.15.72:0/2130879024 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f77700c9a60 con 0x7f77700c9540 2024-05-09T05:53:54.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.219+0000 7fa044ef9640 1 -- 172.21.15.72:0/718489883 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fa03406f500 msgr2=0x7fa034071a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:54.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.219+0000 7fa044ef9640 1 --2- 172.21.15.72:0/718489883 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fa03406f500 0x7fa034071a10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa0480db560 tx=0x7fa040006bd0 comp rx=0 tx=0).stop 2024-05-09T05:53:54.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.219+0000 7fa044ef9640 1 -- 172.21.15.72:0/718489883 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa048006930 msgr2=0x7fa048049ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:54.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.219+0000 7fa044ef9640 1 --2- 172.21.15.72:0/718489883 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa048006930 0x7fa048049ae0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa04c01b3e0 tx=0x7fa04c01a550 comp rx=0 tx=0).stop 2024-05-09T05:53:54.211 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.2 2024-05-09T05:53:54.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.219+0000 7fa044ef9640 1 -- 172.21.15.72:0/718489883 shutdown_connections 2024-05-09T05:53:54.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.219+0000 7fa044ef9640 1 --2- 172.21.15.72:0/718489883 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fa03406f500 0x7fa034071a10 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:54.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.219+0000 7fa044ef9640 1 --2- 172.21.15.72:0/718489883 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa048046780 0x7fa0480ce0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:54.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.219+0000 7fa044ef9640 1 --2- 172.21.15.72:0/718489883 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa048036040 0x7fa0480cdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:54.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.219+0000 7fa044ef9640 1 --2- 172.21.15.72:0/718489883 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa048006930 0x7fa048049ae0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:54.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.219+0000 7fa044ef9640 1 -- 172.21.15.72:0/718489883 >> 172.21.15.72:0/718489883 conn(0x7fa0480503c0 msgr2=0x7fa04804eeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:54.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.219+0000 7fa044ef9640 1 -- 172.21.15.72:0/718489883 shutdown_connections 2024-05-09T05:53:54.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.219+0000 7fa044ef9640 1 -- 172.21.15.72:0/718489883 wait complete. 2024-05-09T05:53:54.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.219+0000 7f77677fe640 1 -- 172.21.15.72:0/2130879024 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7758109d30 con 0x7f77700c9540 2024-05-09T05:53:54.213 INFO:teuthology.orchestra.run.smithi072.stdout:64424509451 2024-05-09T05:53:54.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.223+0000 7f5394924640 1 -- 172.21.15.72:0/2094181270 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f539014b280 con 0x7f5390073a40 2024-05-09T05:53:54.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.223+0000 7f537effd640 1 -- 172.21.15.72:0/2094181270 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f53800f5740 con 0x7f5390073a40 2024-05-09T05:53:54.214 INFO:teuthology.orchestra.run.smithi072.stdout:64424509449 2024-05-09T05:53:54.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.223+0000 7f77752a9640 1 -- 172.21.15.72:0/2130879024 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f775006f400 msgr2=0x7f7750071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:54.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.223+0000 7f77752a9640 1 --2- 172.21.15.72:0/2130879024 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f775006f400 0x7f7750071910 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7760009b00 tx=0x7f7760008040 comp rx=0 tx=0).stop 2024-05-09T05:53:54.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.223+0000 7f77752a9640 1 -- 172.21.15.72:0/2130879024 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77700c9540 msgr2=0x7f777015d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:54.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.223+0000 7f77752a9640 1 --2- 172.21.15.72:0/2130879024 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77700c9540 0x7f777015d950 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f77700c7440 tx=0x7f775801b9f0 comp rx=0 tx=0).stop 2024-05-09T05:53:54.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.223+0000 7f77752a9640 1 -- 172.21.15.72:0/2130879024 shutdown_connections 2024-05-09T05:53:54.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.223+0000 7f77752a9640 1 --2- 172.21.15.72:0/2130879024 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f775006f400 0x7f7750071910 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:54.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.223+0000 7f77752a9640 1 --2- 172.21.15.72:0/2130879024 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f777015a7a0 0x7f7770154690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:54.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.223+0000 7f77752a9640 1 --2- 172.21.15.72:0/2130879024 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77700c9540 0x7f777015d950 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:54.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.223+0000 7f77752a9640 1 --2- 172.21.15.72:0/2130879024 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f777006fd60 0x7f777015f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:54.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.223+0000 7f77752a9640 1 -- 172.21.15.72:0/2130879024 >> 172.21.15.72:0/2130879024 conn(0x7f777006d0e0 msgr2=0x7f7770072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:54.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.223+0000 7f77752a9640 1 -- 172.21.15.72:0/2130879024 shutdown_connections 2024-05-09T05:53:54.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.223+0000 7f77752a9640 1 -- 172.21.15.72:0/2130879024 wait complete. 2024-05-09T05:53:54.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.227+0000 7f5394924640 1 -- 172.21.15.72:0/2094181270 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f537006f400 msgr2=0x7f5370071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:54.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.227+0000 7f5394924640 1 --2- 172.21.15.72:0/2094181270 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f537006f400 0x7f5370071910 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5390145fe0 tx=0x7f5384009040 comp rx=0 tx=0).stop 2024-05-09T05:53:54.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.227+0000 7f5394924640 1 -- 172.21.15.72:0/2094181270 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5390073a40 msgr2=0x7f539014c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:54.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.227+0000 7f5394924640 1 --2- 172.21.15.72:0/2094181270 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5390073a40 0x7f539014c050 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f538001d190 tx=0x7f538001b880 comp rx=0 tx=0).stop 2024-05-09T05:53:54.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.227+0000 7f5394924640 1 -- 172.21.15.72:0/2094181270 shutdown_connections 2024-05-09T05:53:54.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.227+0000 7f5394924640 1 --2- 172.21.15.72:0/2094181270 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f537006f400 0x7f5370071910 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:54.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.227+0000 7f5394924640 1 --2- 172.21.15.72:0/2094181270 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5390153500 0x7f53900cd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:54.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.227+0000 7f5394924640 1 --2- 172.21.15.72:0/2094181270 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5390073e50 0x7f53901f57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:54.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.227+0000 7f5394924640 1 --2- 172.21.15.72:0/2094181270 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5390073a40 0x7f539014c050 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:54.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.227+0000 7f5394924640 1 -- 172.21.15.72:0/2094181270 >> 172.21.15.72:0/2094181270 conn(0x7f53900cebf0 msgr2=0x7f5390156e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:54.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.227+0000 7f5394924640 1 -- 172.21.15.72:0/2094181270 shutdown_connections 2024-05-09T05:53:54.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.227+0000 7f5394924640 1 -- 172.21.15.72:0/2094181270 wait complete. 2024-05-09T05:53:54.223 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509453 got 64424509452 for osd.4 2024-05-09T05:53:54.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.231+0000 7f6549faa640 1 -- 172.21.15.72:0/2159410719 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f653c04e870 con 0x7f653c0483f0 2024-05-09T05:53:54.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.231+0000 7f652ffff640 1 -- 172.21.15.72:0/2159410719 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f65440d8430 con 0x7f653c0483f0 2024-05-09T05:53:54.224 INFO:teuthology.orchestra.run.smithi072.stdout:55834574858 2024-05-09T05:53:54.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.235+0000 7f6549faa640 1 -- 172.21.15.72:0/2159410719 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f652806f480 msgr2=0x7f6528071990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:54.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.235+0000 7f6549faa640 1 --2- 172.21.15.72:0/2159410719 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f652806f480 0x7f6528071990 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f653c0ca7d0 tx=0x7f6530008040 comp rx=0 tx=0).stop 2024-05-09T05:53:54.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.235+0000 7f6549faa640 1 -- 172.21.15.72:0/2159410719 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f653c0483f0 msgr2=0x7f653c0ce5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:54.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.235+0000 7f6549faa640 1 --2- 172.21.15.72:0/2159410719 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f653c0483f0 0x7f653c0ce5d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f65440516d0 tx=0x7f654406b030 comp rx=0 tx=0).stop 2024-05-09T05:53:54.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.239+0000 7f6549faa640 1 -- 172.21.15.72:0/2159410719 shutdown_connections 2024-05-09T05:53:54.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.239+0000 7f6549faa640 1 --2- 172.21.15.72:0/2159410719 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f652806f480 0x7f6528071990 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:54.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.239+0000 7f6549faa640 1 --2- 172.21.15.72:0/2159410719 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f653c04e220 0x7f653c0d0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:54.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.239+0000 7f6549faa640 1 --2- 172.21.15.72:0/2159410719 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f653c049350 0x7f653c0c9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:54.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.239+0000 7f6549faa640 1 --2- 172.21.15.72:0/2159410719 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f653c0483f0 0x7f653c0ce5d0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:54.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.239+0000 7f6549faa640 1 -- 172.21.15.72:0/2159410719 >> 172.21.15.72:0/2159410719 conn(0x7f653c052570 msgr2=0x7f653c04da70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:54.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.239+0000 7f6549faa640 1 -- 172.21.15.72:0/2159410719 shutdown_connections 2024-05-09T05:53:54.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.239+0000 7f6549faa640 1 -- 172.21.15.72:0/2159410719 wait complete. 2024-05-09T05:53:54.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.239+0000 7f0d9b807640 1 -- 172.21.15.72:0/304534050 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f0d8c0059d0 con 0x7f0d8c0dece0 2024-05-09T05:53:54.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.239+0000 7f0d89ffb640 1 -- 172.21.15.72:0/304534050 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0d941779c0 con 0x7f0d8c0dece0 2024-05-09T05:53:54.231 INFO:teuthology.orchestra.run.smithi072.stdout:64424509451 2024-05-09T05:53:54.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.243+0000 7f0d9b807640 1 -- 172.21.15.72:0/304534050 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f0d8006f8d0 msgr2=0x7f0d80071de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:54.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.243+0000 7f0d9b807640 1 --2- 172.21.15.72:0/304534050 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f0d8006f8d0 0x7f0d80071de0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0d90001520 tx=0x7f0d90007ca0 comp rx=0 tx=0).stop 2024-05-09T05:53:54.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.243+0000 7f0d9b807640 1 -- 172.21.15.72:0/304534050 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d8c0dece0 msgr2=0x7f0d8c047770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:54.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.243+0000 7f0d9b807640 1 --2- 172.21.15.72:0/304534050 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d8c0dece0 0x7f0d8c047770 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0d9402e1d0 tx=0x7f0d9409afe0 comp rx=0 tx=0).stop 2024-05-09T05:53:54.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.243+0000 7f0d9b807640 1 -- 172.21.15.72:0/304534050 shutdown_connections 2024-05-09T05:53:54.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.243+0000 7f0d9b807640 1 --2- 172.21.15.72:0/304534050 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f0d8006f8d0 0x7f0d80071de0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:54.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.243+0000 7f0d9b807640 1 --2- 172.21.15.72:0/304534050 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d8c0dece0 0x7f0d8c047770 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:54.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.243+0000 7f0d9b807640 1 --2- 172.21.15.72:0/304534050 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d8c0e12a0 0x7f0d8c04bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:54.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.243+0000 7f0d9b807640 1 --2- 172.21.15.72:0/304534050 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d8c0367b0 0x7f0d8c0df4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:54.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.243+0000 7f0d9b807640 1 -- 172.21.15.72:0/304534050 >> 172.21.15.72:0/304534050 conn(0x7f0d8c00e2f0 msgr2=0x7f0d8c005be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:54.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.243+0000 7f0d9b807640 1 -- 172.21.15.72:0/304534050 shutdown_connections 2024-05-09T05:53:54.236 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.5 2024-05-09T05:53:54.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:54.243+0000 7f0d9b807640 1 -- 172.21.15.72:0/304534050 wait complete. 2024-05-09T05:53:54.246 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509453 got 64424509452 for osd.6 2024-05-09T05:53:54.252 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509451 for osd.0 2024-05-09T05:53:54.253 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.7 2024-05-09T05:53:54.258 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509451 for osd.1 2024-05-09T05:53:54.259 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.3 2024-05-09T05:53:54.865 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T05:53:54.867 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T05:53:55.213 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-09T05:53:55.224 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-09T05:53:55.237 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-09T05:53:55.247 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-09T05:53:55.252 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-09T05:53:55.254 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-09T05:53:55.258 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-09T05:53:55.260 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-09T05:53:55.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.443+0000 7f06e63db640 1 Processor -- start 2024-05-09T05:53:55.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.443+0000 7f06e63db640 1 -- start start 2024-05-09T05:53:55.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.447+0000 7f06e63db640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f06e0158b50 0x7f06e0158f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:55.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.447+0000 7f06e63db640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06e006f820 0x7f06e006fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:55.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.447+0000 7f06e63db640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06e015c8e0 con 0x7f06e00c9300 2024-05-09T05:53:55.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.447+0000 7f06e63db640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f06e00c9e20 con 0x7f06e0158b50 2024-05-09T05:53:55.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.447+0000 7f06e63db640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f06e00c4c90 con 0x7f06e006f820 2024-05-09T05:53:55.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.447+0000 7f06dffff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f06e0158b50 0x7f06e0158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:55.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.447+0000 7f06dffff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f06e0158b50 0x7f06e0158f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.72:42516/0 (socket says 172.21.15.72:42516) 2024-05-09T05:53:55.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.447+0000 7f06dffff640 1 -- 172.21.15.72:0/2080155309 learned_addr learned my addr 172.21.15.72:0/2080155309 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:55.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.447+0000 7f06e4978640 1 --1- 172.21.15.72:0/2080155309 >> v1:172.21.15.110:6789/0 conn(0x7f06e00c9300 0x7f06e00c9710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.72:51218/0 (socket says 172.21.15.72:51218) 2024-05-09T05:53:55.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.447+0000 7f06df7fe640 1 --2- 172.21.15.72:0/2080155309 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06e006f820 0x7f06e006fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:55.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.447+0000 7f06dffff640 1 -- 172.21.15.72:0/2080155309 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06e006f820 msgr2=0x7f06e006fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:55.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.447+0000 7f06dffff640 1 --2- 172.21.15.72:0/2080155309 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06e006f820 0x7f06e006fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.447+0000 7f06dffff640 1 -- 172.21.15.72:0/2080155309 >> v1:172.21.15.110:6789/0 conn(0x7f06e00c9300 legacy=0x7f06e00c9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:55.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.447+0000 7f06dffff640 1 -- 172.21.15.72:0/2080155309 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06e0152be0 con 0x7f06e0158b50 2024-05-09T05:53:55.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.451+0000 7f06dffff640 1 --2- 172.21.15.72:0/2080155309 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06e0158b50 0x7f06e0158f60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f06d0009870 tx=0x7f06d001c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1e822e816f98254 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:55.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.451+0000 7f06deffd640 1 -- 172.21.15.72:0/2080155309 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d00b0070 con 0x7f06e0158b50 2024-05-09T05:53:55.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.451+0000 7f06deffd640 1 -- 172.21.15.72:0/2080155309 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06d0004230 con 0x7f06e0158b50 2024-05-09T05:53:55.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.451+0000 7f06deffd640 1 -- 172.21.15.72:0/2080155309 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d0003620 con 0x7f06e0158b50 2024-05-09T05:53:55.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.451+0000 7f06e63db640 1 -- 172.21.15.72:0/2080155309 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06e0158b50 msgr2=0x7f06e0158f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:55.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.451+0000 7f06e63db640 1 --2- 172.21.15.72:0/2080155309 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06e0158b50 0x7f06e0158f60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f06d0009870 tx=0x7f06d001c3f0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.451+0000 7f06e63db640 1 -- 172.21.15.72:0/2080155309 shutdown_connections 2024-05-09T05:53:55.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.451+0000 7f06e63db640 1 --2- 172.21.15.72:0/2080155309 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06e006f820 0x7f06e006fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.451+0000 7f06e63db640 1 --2- 172.21.15.72:0/2080155309 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06e0158b50 0x7f06e0158f60 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.451+0000 7f06e63db640 1 -- 172.21.15.72:0/2080155309 >> 172.21.15.72:0/2080155309 conn(0x7f06e006d0e0 msgr2=0x7f06e00cd560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:55.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.451+0000 7f06e63db640 1 -- 172.21.15.72:0/2080155309 shutdown_connections 2024-05-09T05:53:55.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.451+0000 7f06e63db640 1 -- 172.21.15.72:0/2080155309 wait complete. 2024-05-09T05:53:55.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.455+0000 7f06e63db640 1 Processor -- start 2024-05-09T05:53:55.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.455+0000 7f06e63db640 1 -- start start 2024-05-09T05:53:55.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.459+0000 7f06e63db640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06e006f820 0x7f06e01fb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:55.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.459+0000 7f06e63db640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06e00c9300 0x7f06e01f79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:55.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.459+0000 7f06e63db640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06e0158b50 0x7f06e01454d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:55.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.459+0000 7f06dffff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06e006f820 0x7f06e01fb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:55.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.459+0000 7f06dffff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06e006f820 0x7f06e01fb2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42208/0 (socket says 172.21.15.72:42208) 2024-05-09T05:53:55.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.459+0000 7f06df7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06e00c9300 0x7f06e01f79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:55.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.459+0000 7f06df7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06e00c9300 0x7f06e01f79f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.72:42520/0 (socket says 172.21.15.72:42520) 2024-05-09T05:53:55.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.459+0000 7f06df7fe640 1 -- 172.21.15.72:0/297585554 learned_addr learned my addr 172.21.15.72:0/297585554 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:55.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.459+0000 7f06e63db640 1 -- 172.21.15.72:0/297585554 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f06e015c320 con 0x7f06e006f820 2024-05-09T05:53:55.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.459+0000 7f06e63db640 1 -- 172.21.15.72:0/297585554 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f06e015c040 con 0x7f06e00c9300 2024-05-09T05:53:55.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.459+0000 7f06e63db640 1 -- 172.21.15.72:0/297585554 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f06e015c600 con 0x7f06e0158b50 2024-05-09T05:53:55.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.459+0000 7f06e4978640 1 --2- 172.21.15.72:0/297585554 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06e0158b50 0x7f06e01454d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:55.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.459+0000 7f06dffff640 1 -- 172.21.15.72:0/297585554 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06e0158b50 msgr2=0x7f06e01454d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:55.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.459+0000 7f06dffff640 1 --2- 172.21.15.72:0/297585554 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06e0158b50 0x7f06e01454d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.459+0000 7f06dffff640 1 -- 172.21.15.72:0/297585554 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06e00c9300 msgr2=0x7f06e01f79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:55.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.459+0000 7f06dffff640 1 --2- 172.21.15.72:0/297585554 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06e00c9300 0x7f06e01f79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.459+0000 7f06dffff640 1 -- 172.21.15.72:0/297585554 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06e01f7f30 con 0x7f06e006f820 2024-05-09T05:53:55.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.459+0000 7f06dffff640 1 --2- 172.21.15.72:0/297585554 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06e006f820 0x7f06e01fb2b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f06d0004000 tx=0x7f06d0019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:55.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.459+0000 7f06dcff9640 1 -- 172.21.15.72:0/297585554 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d00b0050 con 0x7f06e006f820 2024-05-09T05:53:55.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.459+0000 7f06e63db640 1 -- 172.21.15.72:0/297585554 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06e00c6c90 con 0x7f06e006f820 2024-05-09T05:53:55.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.459+0000 7f06e63db640 1 -- 172.21.15.72:0/297585554 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06e00c66d0 con 0x7f06e006f820 2024-05-09T05:53:55.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.459+0000 7f06dcff9640 1 -- 172.21.15.72:0/297585554 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06d00bb070 con 0x7f06e006f820 2024-05-09T05:53:55.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.463+0000 7f06dcff9640 1 -- 172.21.15.72:0/297585554 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d00ab890 con 0x7f06e006f820 2024-05-09T05:53:55.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.463+0000 7f06e63db640 1 -- 172.21.15.72:0/297585554 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06c00052a0 con 0x7f06e006f820 2024-05-09T05:53:55.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.463+0000 7f06dcff9640 1 -- 172.21.15.72:0/297585554 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f06d00aba30 con 0x7f06e006f820 2024-05-09T05:53:55.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.463+0000 7f06dcff9640 1 --2- 172.21.15.72:0/297585554 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f06cc06f400 0x7f06cc071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:55.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.463+0000 7f06dcff9640 1 -- 172.21.15.72:0/297585554 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f06d0129870 con 0x7f06e006f820 2024-05-09T05:53:55.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.463+0000 7f06df7fe640 1 --2- 172.21.15.72:0/297585554 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f06cc06f400 0x7f06cc071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:55.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.463+0000 7f06df7fe640 1 --2- 172.21.15.72:0/297585554 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f06cc06f400 0x7f06cc071910 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f06e0142200 tx=0x7f06d4009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:55.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.471+0000 7f06dcff9640 1 -- 172.21.15.72:0/297585554 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f06d0016070 con 0x7f06e006f820 2024-05-09T05:53:55.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.491+0000 7fee34bff640 1 Processor -- start 2024-05-09T05:53:55.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.491+0000 7fee34bff640 1 -- start start 2024-05-09T05:53:55.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.491+0000 7fb647cd3640 1 Processor -- start 2024-05-09T05:53:55.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.491+0000 7fee34bff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fee300ce880 0x7fee300cec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:55.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.491+0000 7fee34bff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fee300b5060 0x7fee300b5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:55.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.491+0000 7fee34bff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fee300cc270 0x7fee300cc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:55.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.491+0000 7fee34bff640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fee300c8a40 con 0x7fee300b5060 2024-05-09T05:53:55.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.491+0000 7fee2effd640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fee300b5060 0x7fee300b5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:55.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.491+0000 7fee2effd640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fee300b5060 0x7fee300b5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42214/0 (socket says 172.21.15.72:42214) 2024-05-09T05:53:55.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.491+0000 7fee2effd640 1 -- 172.21.15.72:0/3573477963 learned_addr learned my addr 172.21.15.72:0/3573477963 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:55.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.491+0000 7fee34bff640 1 -- 172.21.15.72:0/3573477963 --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fee300c6be0 con 0x7fee300ce880 2024-05-09T05:53:55.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.491+0000 7fee2ffff640 1 --2- 172.21.15.72:0/3573477963 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fee300cc270 0x7fee300cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:55.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.491+0000 7fee34bff640 1 -- 172.21.15.72:0/3573477963 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fee300b59b0 con 0x7fee300cc270 2024-05-09T05:53:55.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.495+0000 7fee2f7fe640 1 --2- 172.21.15.72:0/3573477963 >> v2:172.21.15.110:3300/0 conn(0x7fee300ce880 0x7fee300cec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:55.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.495+0000 7f2fceca3640 1 Processor -- start 2024-05-09T05:53:55.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.495+0000 7f2fceca3640 1 -- start start 2024-05-09T05:53:55.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.491+0000 7fb647cd3640 1 -- start start 2024-05-09T05:53:55.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.495+0000 7fb647cd3640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb64015ac00 0x7fb640068700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:55.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.495+0000 7fb647cd3640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb640068c40 0x7fb64016b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:55.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.495+0000 7fb647cd3640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6400737e0 con 0x7fb6400733d0 2024-05-09T05:53:55.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.495+0000 7fb647cd3640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fb64006ceb0 con 0x7fb640068c40 2024-05-09T05:53:55.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.495+0000 7fb647cd3640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fb640069050 con 0x7fb64015ac00 2024-05-09T05:53:55.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.495+0000 7fb645a6f640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fb6400733d0 0x7fb64006c7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34510/0 (socket says 172.21.15.72:34510) 2024-05-09T05:53:55.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.495+0000 7fb645a6f640 1 -- 172.21.15.72:0/1146127828 learned_addr learned my addr 172.21.15.72:0/1146127828 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:53:55.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.495+0000 7fee2effd640 1 -- 172.21.15.72:0/3573477963 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fee300cc270 msgr2=0x7fee300cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:55.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.495+0000 7fee2effd640 1 --2- 172.21.15.72:0/3573477963 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fee300cc270 0x7fee300cc680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.495+0000 7fee2effd640 1 -- 172.21.15.72:0/3573477963 >> v2:172.21.15.110:3300/0 conn(0x7fee300ce880 msgr2=0x7fee300cec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:55.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.495+0000 7fee2effd640 1 --2- 172.21.15.72:0/3573477963 >> v2:172.21.15.110:3300/0 conn(0x7fee300ce880 0x7fee300cec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.495+0000 7fee2effd640 1 -- 172.21.15.72:0/3573477963 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee300ce0b0 con 0x7fee300b5060 2024-05-09T05:53:55.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.495+0000 7fee2f7fe640 1 --2- 172.21.15.72:0/3573477963 >> v2:172.21.15.110:3300/0 conn(0x7fee300ce880 0x7fee300cec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:53:55.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.495+0000 7fee2ffff640 1 --2- 172.21.15.72:0/3573477963 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fee300cc270 0x7fee300cc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T05:53:55.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.495+0000 7fb646270640 1 --2- 172.21.15.72:0/1146127828 >> v2:172.21.15.110:3300/0 conn(0x7fb640068c40 0x7fb64016b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:55.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.495+0000 7fb64526e640 1 --2- 172.21.15.72:0/1146127828 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb64015ac00 0x7fb640068700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:55.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.495+0000 7fb644a6d640 1 -- 172.21.15.72:0/1146127828 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3092162165 0 0) 0x7fb6380014a0 con 0x7fb6400733d0 2024-05-09T05:53:55.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.495+0000 7fb644a6d640 1 -- 172.21.15.72:0/1146127828 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb62c003530 con 0x7fb6400733d0 2024-05-09T05:53:55.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.495+0000 7f7d2bfff640 1 Processor -- start 2024-05-09T05:53:55.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.495+0000 7f7d2bfff640 1 -- start start 2024-05-09T05:53:55.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.495+0000 7fb295e5c640 1 Processor -- start 2024-05-09T05:53:55.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.495+0000 7fee2effd640 1 --2- 172.21.15.72:0/3573477963 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee300b5060 0x7fee300b5470 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fee30075700 tx=0x7fee2401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5411db3ff05c7d55 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:55.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.495+0000 7fb646270640 1 -- 172.21.15.72:0/1146127828 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb64015ac00 msgr2=0x7fb640068700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:55.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.495+0000 7fb646270640 1 --2- 172.21.15.72:0/1146127828 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb64015ac00 0x7fb640068700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.490 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.495+0000 7fb646270640 1 -- 172.21.15.72:0/1146127828 >> v1:172.21.15.72:6789/0 conn(0x7fb6400733d0 legacy=0x7fb64006c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:55.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.495+0000 7fb646270640 1 -- 172.21.15.72:0/1146127828 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6400755e0 con 0x7fb640068c40 2024-05-09T05:53:55.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.495+0000 7fb64526e640 1 --2- 172.21.15.72:0/1146127828 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb64015ac00 0x7fb640068700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T05:53:55.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7fb295e5c640 1 -- start start 2024-05-09T05:53:55.491 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7fee2e7fc640 1 -- 172.21.15.72:0/3573477963 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee240b0070 con 0x7fee300b5060 2024-05-09T05:53:55.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7fee2e7fc640 1 -- 172.21.15.72:0/3573477963 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee240ab600 con 0x7fee300b5060 2024-05-09T05:53:55.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7fee2e7fc640 1 -- 172.21.15.72:0/3573477963 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee240ab9d0 con 0x7fee300b5060 2024-05-09T05:53:55.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.495+0000 7f6463faa640 1 Processor -- start 2024-05-09T05:53:55.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7fb646270640 1 --2- 172.21.15.72:0/1146127828 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb640068c40 0x7fb64016b2f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb63c0097c0 tx=0x7fb63c01c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be3c6deee9bbe469 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:55.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7f6463faa640 1 -- start start 2024-05-09T05:53:55.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7fb644a6d640 1 -- 172.21.15.72:0/1146127828 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb63c0ab610 con 0x7fb640068c40 2024-05-09T05:53:55.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.495+0000 7f2fceca3640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2fc00064f0 0x7f2fc00475f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:55.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.495+0000 7f2fceca3640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2fc004bf80 0x7f2fc004c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:55.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.495+0000 7f2fceca3640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fc0045950 con 0x7f2fc0046690 2024-05-09T05:53:55.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.495+0000 7f2fceca3640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f2fc0045c30 con 0x7f2fc004bf80 2024-05-09T05:53:55.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.495+0000 7f2fceca3640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f2fc00db840 con 0x7f2fc00064f0 2024-05-09T05:53:55.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.495+0000 7f2fcca3f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2fc00064f0 0x7f2fc00475f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:55.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7f2fcd240640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2fc004bf80 0x7f2fc004c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:55.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7f2fc7fff640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f2fc0046690 0x7f2fc00dbcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.72:51234/0 (socket says 172.21.15.72:51234) 2024-05-09T05:53:55.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7f2fc7fff640 1 -- 172.21.15.72:0/3892061291 learned_addr learned my addr 172.21.15.72:0/3892061291 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:53:55.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7f2fcd240640 1 -- 172.21.15.72:0/3892061291 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2fc00064f0 msgr2=0x7f2fc00475f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:55.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7f7d2bfff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d2c1531a0 0x7f7d2c0c9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:55.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7f7d2bfff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7d2c0ca350 0x7f7d2c163a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:55.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7f7d2bfff640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d2c06e360 con 0x7f7d2c0732d0 2024-05-09T05:53:55.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7f7d2bfff640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f7d2c1535b0 con 0x7f7d2c0ca350 2024-05-09T05:53:55.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7f7d2bfff640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f7d2c0c9980 con 0x7f7d2c1531a0 2024-05-09T05:53:55.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7f2fcd240640 1 --2- 172.21.15.72:0/3892061291 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2fc00064f0 0x7f2fc00475f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7fb295e5c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb2900c8f60 0x7fb2900c6490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:55.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7f2fcd240640 1 -- 172.21.15.72:0/3892061291 >> v1:172.21.15.110:6789/0 conn(0x7f2fc0046690 legacy=0x7f2fc00dbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:55.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7fb295e5c640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb2900c69d0 0x7fb290162db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:55.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7fb644a6d640 1 -- 172.21.15.72:0/1146127828 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb63c0b0070 con 0x7fb640068c40 2024-05-09T05:53:55.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7fb644a6d640 1 -- 172.21.15.72:0/1146127828 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb63c0ab9b0 con 0x7fb640068c40 2024-05-09T05:53:55.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7fb647cd3640 1 -- 172.21.15.72:0/1146127828 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb640068c40 msgr2=0x7fb64016b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:55.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7fb647cd3640 1 --2- 172.21.15.72:0/1146127828 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb640068c40 0x7fb64016b2f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb63c0097c0 tx=0x7fb63c01c410 comp rx=0 tx=0).stop 2024-05-09T05:53:55.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7f7d2b7fe640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7d2c0ca350 0x7f7d2c163a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:55.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7f7d2b7fe640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7d2c0ca350 0x7f7d2c163a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.72:42558/0 (socket says 172.21.15.72:42558) 2024-05-09T05:53:55.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7f7d2b7fe640 1 -- 172.21.15.72:0/4268172871 learned_addr learned my addr 172.21.15.72:0/4268172871 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:55.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7fb647cd3640 1 -- 172.21.15.72:0/1146127828 shutdown_connections 2024-05-09T05:53:55.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7fb647cd3640 1 --2- 172.21.15.72:0/1146127828 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb640068c40 0x7fb64016b2f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7fb647cd3640 1 --2- 172.21.15.72:0/1146127828 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb64015ac00 0x7fb640068700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7fb647cd3640 1 -- 172.21.15.72:0/1146127828 >> 172.21.15.72:0/1146127828 conn(0x7fb6400ce960 msgr2=0x7fb6400ced70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:55.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7f2fc77fe640 1 -- 172.21.15.72:0/3892061291 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4009835843 0 0) 0x7f2fc0045950 con 0x7f2fc0046690 2024-05-09T05:53:55.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7f2fcd240640 1 -- 172.21.15.72:0/3892061291 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fc00db4d0 con 0x7f2fc004bf80 2024-05-09T05:53:55.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7fb294e5a640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fb2901528a0 0x7fb2900cdb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.72:51252/0 (socket says 172.21.15.72:51252) 2024-05-09T05:53:55.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7fb294e5a640 1 -- 172.21.15.72:0/3554343676 learned_addr learned my addr 172.21.15.72:0/3554343676 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:53:55.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7f6463faa640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f645c1569c0 0x7f645c0ca620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:55.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7f6461545640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f645c06e1c0 0x7f645c15c8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34512/0 (socket says 172.21.15.72:34512) 2024-05-09T05:53:55.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7f6461d46640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f645c1569c0 0x7f645c0ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:55.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7f6461d46640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f645c1569c0 0x7f645c0ca620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.72:42546/0 (socket says 172.21.15.72:42546) 2024-05-09T05:53:55.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7f6461545640 1 -- 172.21.15.72:0/820102583 learned_addr learned my addr 172.21.15.72:0/820102583 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:53:55.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7f6463faa640 1 -- 172.21.15.72:0/820102583 --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f645c072c80 con 0x7f645c06e1c0 2024-05-09T05:53:55.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7f6463faa640 1 -- 172.21.15.72:0/820102583 --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f645c0cada0 con 0x7f645c15cfd0 2024-05-09T05:53:55.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7f6463faa640 1 -- 172.21.15.72:0/820102583 --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f645c0cab60 con 0x7f645c1569c0 2024-05-09T05:53:55.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7fb29565b640 1 --2- 172.21.15.72:0/3554343676 >> v2:172.21.15.72:3300/0 conn(0x7fb2900c69d0 0x7fb290162db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:55.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7fb28ffff640 1 --2- 172.21.15.72:0/3554343676 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb2900c8f60 0x7fb2900c6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:55.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7fb295e5c640 1 -- 172.21.15.72:0/3554343676 --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2900c9370 con 0x7fb2901528a0 2024-05-09T05:53:55.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7fb647cd3640 1 -- 172.21.15.72:0/1146127828 shutdown_connections 2024-05-09T05:53:55.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7fee34bff640 1 -- 172.21.15.72:0/3573477963 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee300b5060 msgr2=0x7fee300b5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:55.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7fee34bff640 1 --2- 172.21.15.72:0/3573477963 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee300b5060 0x7fee300b5470 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fee30075700 tx=0x7fee2401c520 comp rx=0 tx=0).stop 2024-05-09T05:53:55.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7fee34bff640 1 -- 172.21.15.72:0/3573477963 shutdown_connections 2024-05-09T05:53:55.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7fee34bff640 1 --2- 172.21.15.72:0/3573477963 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fee300cc270 0x7fee300cc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7fee34bff640 1 --2- 172.21.15.72:0/3573477963 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee300b5060 0x7fee300b5470 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7fee34bff640 1 --2- 172.21.15.72:0/3573477963 >> v2:172.21.15.110:3300/0 conn(0x7fee300ce880 0x7fee300cec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7fee34bff640 1 -- 172.21.15.72:0/3573477963 >> 172.21.15.72:0/3573477963 conn(0x7fee3006e7b0 msgr2=0x7fee3006ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:55.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7fee34bff640 1 -- 172.21.15.72:0/3573477963 shutdown_connections 2024-05-09T05:53:55.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7fb295e5c640 1 -- 172.21.15.72:0/3554343676 --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fb2900c7a90 con 0x7fb2900c69d0 2024-05-09T05:53:55.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7fb295e5c640 1 -- 172.21.15.72:0/3554343676 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fb2900c53f0 con 0x7fb2900c8f60 2024-05-09T05:53:55.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7f7d2a7fc640 1 --2- 172.21.15.72:0/4268172871 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d2c1531a0 0x7f7d2c0c9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:55.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7fb647cd3640 1 -- 172.21.15.72:0/1146127828 wait complete. 2024-05-09T05:53:55.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7f6460d44640 1 -- 172.21.15.72:0/820102583 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 127536135 0 0) 0x7f645c072c80 con 0x7f645c06e1c0 2024-05-09T05:53:55.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7f6460d44640 1 -- 172.21.15.72:0/820102583 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6448003530 con 0x7f645c06e1c0 2024-05-09T05:53:55.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7f6460d44640 1 -- 172.21.15.72:0/820102583 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3111168703 0 0) 0x7f645c0cada0 con 0x7f645c15cfd0 2024-05-09T05:53:55.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7f6460d44640 1 -- 172.21.15.72:0/820102583 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f645c072c80 con 0x7f645c15cfd0 2024-05-09T05:53:55.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7f6460d44640 1 -- 172.21.15.72:0/820102583 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1443813598 0 0) 0x7f6448003530 con 0x7f645c06e1c0 2024-05-09T05:53:55.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7f6460d44640 1 -- 172.21.15.72:0/820102583 >> v2:172.21.15.110:3300/0 conn(0x7f645c1569c0 msgr2=0x7f645c0ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:55.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7f6460d44640 1 --2- 172.21.15.72:0/820102583 >> v2:172.21.15.110:3300/0 conn(0x7f645c1569c0 0x7f645c0ca620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7f6460d44640 1 -- 172.21.15.72:0/820102583 >> v1:172.21.15.110:6789/0 conn(0x7f645c15cfd0 legacy=0x7f645c166f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:55.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7f6460d44640 1 -- 172.21.15.72:0/820102583 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f645c15fc00 con 0x7f645c06e1c0 2024-05-09T05:53:55.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7f6460d44640 1 -- 172.21.15.72:0/820102583 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2749052815 0 0) 0x7f644c001700 con 0x7f645c06e1c0 2024-05-09T05:53:55.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7f6460d44640 1 -- 172.21.15.72:0/820102583 >> v1:172.21.15.72:6789/0 conn(0x7f645c06e1c0 legacy=0x7f645c15c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:55.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7f6460d44640 1 --2- 172.21.15.72:0/820102583 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6448003ba0 0x7f6448003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:55.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7f6460d44640 1 --2- 172.21.15.72:0/820102583 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6448004810 0x7f6448004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:55.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7f6460d44640 1 --2- 172.21.15.72:0/820102583 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64480051b0 0x7f644800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:55.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7f6460d44640 1 -- 172.21.15.72:0/820102583 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f645c0cab60 con 0x7f6448004810 2024-05-09T05:53:55.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7f6460d44640 1 -- 172.21.15.72:0/820102583 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f644800c070 con 0x7f6448003ba0 2024-05-09T05:53:55.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7f6460d44640 1 -- 172.21.15.72:0/820102583 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f644800c270 con 0x7f64480051b0 2024-05-09T05:53:55.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.503+0000 7f6461545640 1 --2- 172.21.15.72:0/820102583 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6448004810 0x7f6448004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:55.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.499+0000 7fee34bff640 1 -- 172.21.15.72:0/3573477963 wait complete. 2024-05-09T05:53:55.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.503+0000 7fee34bff640 1 Processor -- start 2024-05-09T05:53:55.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.503+0000 7f6462547640 1 --2- 172.21.15.72:0/820102583 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64480051b0 0x7f644800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:55.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.503+0000 7f6461545640 1 -- 172.21.15.72:0/820102583 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64480051b0 msgr2=0x7f644800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:55.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.503+0000 7f6461545640 1 --2- 172.21.15.72:0/820102583 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64480051b0 0x7f644800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.503+0000 7f6461545640 1 -- 172.21.15.72:0/820102583 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6448003ba0 msgr2=0x7f6448003fd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T05:53:55.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.503+0000 7f6461545640 1 --2- 172.21.15.72:0/820102583 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6448003ba0 0x7f6448003fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.503+0000 7f6461545640 1 -- 172.21.15.72:0/820102583 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f645c15fc00 con 0x7f6448004810 2024-05-09T05:53:55.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.503+0000 7f6462547640 1 -- 172.21.15.72:0/820102583 reap_dead start 2024-05-09T05:53:55.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.503+0000 7fb647cd3640 1 Processor -- start 2024-05-09T05:53:55.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.503+0000 7fee34bff640 1 -- start start 2024-05-09T05:53:55.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.503+0000 7fee34bff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fee300b5060 0x7fee301ffef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:55.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.503+0000 7fee34bff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee300cc270 0x7fee30072c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:55.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.503+0000 7fb647cd3640 1 -- start start 2024-05-09T05:53:55.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.503+0000 7fee34bff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fee300ce880 0x7fee300ca6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:55.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.503+0000 7fee34bff640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fee300b48a0 con 0x7fee300cc270 2024-05-09T05:53:55.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.503+0000 7fee34bff640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fee300ccfd0 con 0x7fee300b5060 2024-05-09T05:53:55.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.503+0000 7fee34bff640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fee300b4a20 con 0x7fee300ce880 2024-05-09T05:53:55.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.503+0000 7fee2f7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fee300b5060 0x7fee301ffef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:55.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.503+0000 7fee2f7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fee300b5060 0x7fee301ffef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.72:42574/0 (socket says 172.21.15.72:42574) 2024-05-09T05:53:55.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.503+0000 7fee2f7fe640 1 -- 172.21.15.72:0/3815004838 learned_addr learned my addr 172.21.15.72:0/3815004838 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:55.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.503+0000 7f7d2b7fe640 1 -- 172.21.15.72:0/4268172871 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d2c1531a0 msgr2=0x7f7d2c0c9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:55.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.503+0000 7f7d2b7fe640 1 --2- 172.21.15.72:0/4268172871 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d2c1531a0 0x7f7d2c0c9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.503+0000 7f7d2b7fe640 1 -- 172.21.15.72:0/4268172871 >> v1:172.21.15.110:6789/0 conn(0x7f7d2c0732d0 legacy=0x7f7d2c06d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:55.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.503+0000 7f7d2b7fe640 1 -- 172.21.15.72:0/4268172871 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d2c159c90 con 0x7f7d2c0ca350 2024-05-09T05:53:55.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.503+0000 7fee2ffff640 1 --2- 172.21.15.72:0/3815004838 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fee300ce880 0x7fee300ca6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:55.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.503+0000 7fb29565b640 1 -- 172.21.15.72:0/3554343676 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb2900c8f60 msgr2=0x7fb2900c6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:55.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.503+0000 7fb29565b640 1 --2- 172.21.15.72:0/3554343676 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb2900c8f60 0x7fb2900c6490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.503+0000 7fb29565b640 1 -- 172.21.15.72:0/3554343676 >> v1:172.21.15.110:6789/0 conn(0x7fb2901528a0 legacy=0x7fb2900cdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:55.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.503+0000 7fb28f7fe640 1 -- 172.21.15.72:0/3554343676 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1025825653 0 0) 0x7fb284001120 con 0x7fb2901528a0 2024-05-09T05:53:55.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.503+0000 7fb29565b640 1 -- 172.21.15.72:0/3554343676 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2900c56b0 con 0x7fb2900c69d0 2024-05-09T05:53:55.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.503+0000 7f7d2b7fe640 1 --2- 172.21.15.72:0/4268172871 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d2c0ca350 0x7f7d2c163a10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7d24009e50 tx=0x7f7d2401f250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f497a8344f06ee9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:55.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.503+0000 7fee2effd640 1 --2- 172.21.15.72:0/3815004838 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee300cc270 0x7fee30072c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:55.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.503+0000 7fb29565b640 1 --2- 172.21.15.72:0/3554343676 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2900c69d0 0x7fb290162db0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb288009d90 tx=0x7fb288020da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff774e66659ef54f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:55.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7fb28f7fe640 1 -- 172.21.15.72:0/3554343676 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2880b6070 con 0x7fb2900c69d0 2024-05-09T05:53:55.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7fb28f7fe640 1 -- 172.21.15.72:0/3554343676 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2880a9d80 con 0x7fb2900c69d0 2024-05-09T05:53:55.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7fb28f7fe640 1 -- 172.21.15.72:0/3554343676 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2880b1660 con 0x7fb2900c69d0 2024-05-09T05:53:55.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7fee2f7fe640 1 -- 172.21.15.72:0/3815004838 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fee300ce880 msgr2=0x7fee300ca6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:55.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7fee2f7fe640 1 --2- 172.21.15.72:0/3815004838 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fee300ce880 0x7fee300ca6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7fee2f7fe640 1 -- 172.21.15.72:0/3815004838 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee300cc270 msgr2=0x7fee30072c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:55.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7fee2f7fe640 1 --2- 172.21.15.72:0/3815004838 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee300cc270 0x7fee30072c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7fee2f7fe640 1 -- 172.21.15.72:0/3815004838 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee30157fc0 con 0x7fee300b5060 2024-05-09T05:53:55.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7f7d29ffb640 1 -- 172.21.15.72:0/4268172871 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d240b4070 con 0x7f7d2c0ca350 2024-05-09T05:53:55.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.503+0000 7f2fcd240640 1 --2- 172.21.15.72:0/3892061291 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2fc004bf80 0x7f2fc004c390 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2fc806ba60 tx=0x7f2fc809c730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93c7dbb5fd3607bd server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:55.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7f2fc77fe640 1 -- 172.21.15.72:0/3892061291 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fc8133070 con 0x7f2fc004bf80 2024-05-09T05:53:55.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7f7d29ffb640 1 -- 172.21.15.72:0/4268172871 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d240af400 con 0x7f7d2c0ca350 2024-05-09T05:53:55.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7f7d29ffb640 1 -- 172.21.15.72:0/4268172871 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d240af810 con 0x7f7d2c0ca350 2024-05-09T05:53:55.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7f2fc77fe640 1 -- 172.21.15.72:0/3892061291 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fc812e680 con 0x7f2fc004bf80 2024-05-09T05:53:55.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7f2fc77fe640 1 -- 172.21.15.72:0/3892061291 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fc812eab0 con 0x7f2fc004bf80 2024-05-09T05:53:55.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7fb647cd3640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb640068c40 0x7fb64014f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:55.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7fb647cd3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb6400733d0 0x7fb640148d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:55.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7f6461545640 1 --2- 172.21.15.72:0/820102583 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6448004810 0x7f6448004c20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f644c00c210 tx=0x7f644c01f360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fa366d9c2deb1b7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:55.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7fee2f7fe640 1 --2- 172.21.15.72:0/3815004838 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fee300b5060 0x7fee301ffef0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fee2000c7f0 tx=0x7fee2000cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:55.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7fb647cd3640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb64015ac00 0x7fb6400cce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:55.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7fb647cd3640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fb6400ca910 con 0x7fb64015ac00 2024-05-09T05:53:55.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7fb645a6f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb640068c40 0x7fb64014f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:55.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7fb64526e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb6400733d0 0x7fb640148d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:55.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7fb646270640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb64015ac00 0x7fb6400cce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:55.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7fb645a6f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb640068c40 0x7fb64014f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.72:37862/0 (socket says 172.21.15.72:37862) 2024-05-09T05:53:55.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7fb645a6f640 1 -- 172.21.15.72:0/1043285486 learned_addr learned my addr 172.21.15.72:0/1043285486 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:55.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7fee17fff640 1 -- 172.21.15.72:0/3815004838 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee20015070 con 0x7fee300b5060 2024-05-09T05:53:55.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7fee17fff640 1 -- 172.21.15.72:0/3815004838 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee20007820 con 0x7fee300b5060 2024-05-09T05:53:55.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7fb647cd3640 1 -- 172.21.15.72:0/1043285486 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fb6400ca630 con 0x7fb6400733d0 2024-05-09T05:53:55.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7fb647cd3640 1 -- 172.21.15.72:0/1043285486 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fb64015b010 con 0x7fb640068c40 2024-05-09T05:53:55.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7f6460d44640 1 -- 172.21.15.72:0/820102583 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f644c007cf0 con 0x7f6448004810 2024-05-09T05:53:55.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7f6460d44640 1 -- 172.21.15.72:0/820102583 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f644c005ae0 con 0x7f6448004810 2024-05-09T05:53:55.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7f6460d44640 1 -- 172.21.15.72:0/820102583 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f644c007070 con 0x7f6448004810 2024-05-09T05:53:55.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7f0b8054e640 1 Processor -- start 2024-05-09T05:53:55.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7f0b8054e640 1 -- start start 2024-05-09T05:53:55.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7fb295e5c640 1 -- 172.21.15.72:0/3554343676 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2900c69d0 msgr2=0x7fb290162db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:55.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7fb295e5c640 1 --2- 172.21.15.72:0/3554343676 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2900c69d0 0x7fb290162db0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb288009d90 tx=0x7fb288020da0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7f7d2bfff640 1 -- 172.21.15.72:0/4268172871 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d2c0ca350 msgr2=0x7f7d2c163a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:55.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7f7d2bfff640 1 --2- 172.21.15.72:0/4268172871 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d2c0ca350 0x7f7d2c163a10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7d24009e50 tx=0x7f7d2401f250 comp rx=0 tx=0).stop 2024-05-09T05:53:55.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7f7d2bfff640 1 -- 172.21.15.72:0/4268172871 shutdown_connections 2024-05-09T05:53:55.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7f7d2bfff640 1 --2- 172.21.15.72:0/4268172871 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d2c0ca350 0x7f7d2c163a10 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7f7d2bfff640 1 --2- 172.21.15.72:0/4268172871 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d2c1531a0 0x7f7d2c0c9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7f7d2bfff640 1 -- 172.21.15.72:0/4268172871 >> 172.21.15.72:0/4268172871 conn(0x7f7d2c070a00 msgr2=0x7f7d2c070e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:55.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7fb295e5c640 1 -- 172.21.15.72:0/3554343676 shutdown_connections 2024-05-09T05:53:55.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7fb295e5c640 1 --2- 172.21.15.72:0/3554343676 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2900c69d0 0x7fb290162db0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7fb295e5c640 1 --2- 172.21.15.72:0/3554343676 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb2900c8f60 0x7fb2900c6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7fb295e5c640 1 -- 172.21.15.72:0/3554343676 >> 172.21.15.72:0/3554343676 conn(0x7fb29006cba0 msgr2=0x7fb29006cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:55.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7fb295e5c640 1 -- 172.21.15.72:0/3554343676 shutdown_connections 2024-05-09T05:53:55.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7fb295e5c640 1 -- 172.21.15.72:0/3554343676 wait complete. 2024-05-09T05:53:55.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7fb646270640 1 -- 172.21.15.72:0/1043285486 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb640068c40 msgr2=0x7fb64014f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:55.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7fb646270640 1 --2- 172.21.15.72:0/1043285486 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb640068c40 0x7fb64014f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7fb646270640 1 -- 172.21.15.72:0/1043285486 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb6400733d0 msgr2=0x7fb640148d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:55.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7fb646270640 1 --2- 172.21.15.72:0/1043285486 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb6400733d0 0x7fb640148d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7fee34bff640 1 -- 172.21.15.72:0/3815004838 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee301549f0 con 0x7fee300b5060 2024-05-09T05:53:55.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7fee34bff640 1 -- 172.21.15.72:0/3815004838 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee302068f0 con 0x7fee300b5060 2024-05-09T05:53:55.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7fb646270640 1 -- 172.21.15.72:0/1043285486 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6401492a0 con 0x7fb64015ac00 2024-05-09T05:53:55.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7fee17fff640 1 -- 172.21.15.72:0/3815004838 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee20007c10 con 0x7fee300b5060 2024-05-09T05:53:55.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7fb646270640 1 --2- 172.21.15.72:0/1043285486 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb64015ac00 0x7fb6400cce00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb63c0ac000 tx=0x7fb63c0191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:55.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7fee34bff640 1 -- 172.21.15.72:0/3815004838 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee30050880 con 0x7fee300b5060 2024-05-09T05:53:55.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7fb6327fc640 1 -- 172.21.15.72:0/1043285486 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb63c0c1070 con 0x7fb64015ac00 2024-05-09T05:53:55.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7f7d2bfff640 1 -- 172.21.15.72:0/4268172871 shutdown_connections 2024-05-09T05:53:55.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7fb647cd3640 1 -- 172.21.15.72:0/1043285486 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6401482c0 con 0x7fb64015ac00 2024-05-09T05:53:55.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7fb6327fc640 1 -- 172.21.15.72:0/1043285486 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb63c003820 con 0x7fb64015ac00 2024-05-09T05:53:55.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7f7d2bfff640 1 -- 172.21.15.72:0/4268172871 wait complete. 2024-05-09T05:53:55.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7f6463faa640 1 -- 172.21.15.72:0/820102583 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6448004810 msgr2=0x7f6448004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:55.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7f6463faa640 1 --2- 172.21.15.72:0/820102583 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6448004810 0x7f6448004c20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f644c00c210 tx=0x7f644c01f360 comp rx=0 tx=0).stop 2024-05-09T05:53:55.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7f0b8054e640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0b781538d0 0x7f0b78159a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:55.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7f0b8054e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0b78159f70 0x7f0b78163dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:55.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7f0b8054e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b780c5ea0 con 0x7f0b780c89e0 2024-05-09T05:53:55.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7f0b8054e640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f0b780c7ed0 con 0x7f0b781538d0 2024-05-09T05:53:55.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7f0b8054e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f0b78159530 con 0x7f0b78159f70 2024-05-09T05:53:55.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7f0b7dae9640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0b781538d0 0x7f0b78159a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:55.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7f0b7dae9640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0b781538d0 0x7f0b78159a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42264/0 (socket says 172.21.15.72:42264) 2024-05-09T05:53:55.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.507+0000 7f0b7dae9640 1 -- 172.21.15.72:0/111936060 learned_addr learned my addr 172.21.15.72:0/111936060 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:55.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.511+0000 7f2fceca3640 1 -- 172.21.15.72:0/3892061291 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2fc004bf80 msgr2=0x7f2fc004c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:55.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.511+0000 7f2fceca3640 1 --2- 172.21.15.72:0/3892061291 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2fc004bf80 0x7f2fc004c390 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2fc806ba60 tx=0x7f2fc809c730 comp rx=0 tx=0).stop 2024-05-09T05:53:55.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.511+0000 7f0b7eaeb640 1 --2- 172.21.15.72:0/111936060 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0b78159f70 0x7f0b78163dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:55.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.511+0000 7f6463faa640 1 -- 172.21.15.72:0/820102583 shutdown_connections 2024-05-09T05:53:55.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.511+0000 7f6463faa640 1 --2- 172.21.15.72:0/820102583 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6448004810 0x7f6448004c20 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.511+0000 7f6463faa640 1 -- 172.21.15.72:0/820102583 >> 172.21.15.72:0/820102583 conn(0x7f645c072080 msgr2=0x7f645c072490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:55.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.511+0000 7f2fceca3640 1 -- 172.21.15.72:0/3892061291 shutdown_connections 2024-05-09T05:53:55.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.511+0000 7f2fceca3640 1 --2- 172.21.15.72:0/3892061291 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2fc004bf80 0x7f2fc004c390 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.511+0000 7f2fceca3640 1 --2- 172.21.15.72:0/3892061291 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2fc00064f0 0x7f2fc00475f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.511+0000 7f2fceca3640 1 -- 172.21.15.72:0/3892061291 >> 172.21.15.72:0/3892061291 conn(0x7f2fc0050810 msgr2=0x7f2fc0050c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:55.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.511+0000 7f2fceca3640 1 -- 172.21.15.72:0/3892061291 shutdown_connections 2024-05-09T05:53:55.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.511+0000 7f2fceca3640 1 -- 172.21.15.72:0/3892061291 wait complete. 2024-05-09T05:53:55.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.511+0000 7fb647cd3640 1 -- 172.21.15.72:0/1043285486 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb640148560 con 0x7fb64015ac00 2024-05-09T05:53:55.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.511+0000 7fb295e5c640 1 Processor -- start 2024-05-09T05:53:55.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.511+0000 7fb295e5c640 1 -- start start 2024-05-09T05:53:55.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.511+0000 7f7d2bfff640 1 Processor -- start 2024-05-09T05:53:55.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.511+0000 7f7d2bfff640 1 -- start start 2024-05-09T05:53:55.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.511+0000 7fb6327fc640 1 -- 172.21.15.72:0/1043285486 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb63c003bd0 con 0x7fb64015ac00 2024-05-09T05:53:55.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.511+0000 7fb6327fc640 1 -- 172.21.15.72:0/1043285486 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fb63c0c4070 con 0x7fb64015ac00 2024-05-09T05:53:55.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.511+0000 7fb6327fc640 1 --2- 172.21.15.72:0/1043285486 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fb62406f460 0x7fb624071970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:55.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.511+0000 7fb6327fc640 1 -- 172.21.15.72:0/1043285486 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb63c12e060 con 0x7fb64015ac00 2024-05-09T05:53:55.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.511+0000 7fee17fff640 1 -- 172.21.15.72:0/3815004838 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fee20018070 con 0x7fee300b5060 2024-05-09T05:53:55.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.511+0000 7fee17fff640 1 --2- 172.21.15.72:0/3815004838 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fee1c06f400 0x7fee1c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:55.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.511+0000 7f0b7dae9640 1 -- 172.21.15.72:0/111936060 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0b78159f70 msgr2=0x7f0b78163dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:55.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.511+0000 7f0b7dae9640 1 --2- 172.21.15.72:0/111936060 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0b78159f70 0x7f0b78163dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.511+0000 7f0b7dae9640 1 -- 172.21.15.72:0/111936060 >> v1:172.21.15.110:6789/0 conn(0x7f0b780c89e0 legacy=0x7f0b7806d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:55.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.511+0000 7f0b7dae9640 1 -- 172.21.15.72:0/111936060 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b78153ce0 con 0x7f0b781538d0 2024-05-09T05:53:55.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.511+0000 7fee17fff640 1 -- 172.21.15.72:0/3815004838 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fee2008f770 con 0x7fee300b5060 2024-05-09T05:53:55.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.511+0000 7fb645a6f640 1 --2- 172.21.15.72:0/1043285486 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fb62406f460 0x7fb624071970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:55.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.511+0000 7fee2effd640 1 --2- 172.21.15.72:0/3815004838 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fee1c06f400 0x7fee1c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:55.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.511+0000 7f6463faa640 1 -- 172.21.15.72:0/820102583 shutdown_connections 2024-05-09T05:53:55.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.511+0000 7fee2effd640 1 --2- 172.21.15.72:0/3815004838 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fee1c06f400 0x7fee1c071910 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fee240ad000 tx=0x7fee240a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:55.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.511+0000 7f2fceca3640 1 Processor -- start 2024-05-09T05:53:55.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.511+0000 7f7d2bfff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d2c0732d0 0x7f7d2c1e3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:55.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.511+0000 7fb645a6f640 1 --2- 172.21.15.72:0/1043285486 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fb62406f460 0x7fb624071970 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb638005c10 tx=0x7fb638009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:55.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.511+0000 7f2fceca3640 1 -- start start 2024-05-09T05:53:55.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.511+0000 7f7d2bfff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d2c0ca350 0x7f7d2c1e1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:55.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.511+0000 7fb295e5c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb2900c69d0 0x7fb2901f5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:55.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.515+0000 7f7d2affd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d2c0732d0 0x7f7d2c1e3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:55.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.515+0000 7f7d2a7fc640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d2c0ca350 0x7f7d2c1e1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:55.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.515+0000 7f7d2affd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d2c0732d0 0x7f7d2c1e3500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.72:42592/0 (socket says 172.21.15.72:42592) 2024-05-09T05:53:55.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.515+0000 7fb295e5c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2900c8f60 0x7fb2901408f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:55.542 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.515+0000 7f7d2a7fc640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d2c0ca350 0x7f7d2c1e1fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42266/0 (socket says 172.21.15.72:42266) 2024-05-09T05:53:55.542 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.515+0000 7f7d2bfff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d2c1531a0 0x7f7d2c1482b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:55.542 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.515+0000 7f7d2affd640 1 -- 172.21.15.72:0/2858756903 learned_addr learned my addr 172.21.15.72:0/2858756903 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:55.542 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.515+0000 7fb295e5c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2901528a0 0x7fb2901475b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:55.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.515+0000 7f7d2bfff640 1 -- 172.21.15.72:0/2858756903 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7d2c0c9330 con 0x7f7d2c0ca350 2024-05-09T05:53:55.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.515+0000 7f7d2bfff640 1 -- 172.21.15.72:0/2858756903 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f7d2c0c9050 con 0x7f7d2c0732d0 2024-05-09T05:53:55.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.515+0000 7f7d2bfff640 1 -- 172.21.15.72:0/2858756903 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f7d2c0c9610 con 0x7f7d2c1531a0 2024-05-09T05:53:55.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.515+0000 7f7d2b7fe640 1 --2- 172.21.15.72:0/2858756903 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d2c1531a0 0x7f7d2c1482b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:55.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.515+0000 7fb647cd3640 1 -- 172.21.15.72:0/1043285486 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6280052a0 con 0x7fb64015ac00 2024-05-09T05:53:55.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.515+0000 7fb294e5a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb2900c69d0 0x7fb2901f5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:55.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.515+0000 7fb294e5a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb2900c69d0 0x7fb2901f5b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.72:37882/0 (socket says 172.21.15.72:37882) 2024-05-09T05:53:55.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.515+0000 7fb28ffff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2900c8f60 0x7fb2901408f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:55.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.515+0000 7fb28ffff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2900c8f60 0x7fb2901408f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42280/0 (socket says 172.21.15.72:42280) 2024-05-09T05:53:55.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.515+0000 7f0b7dae9640 1 --2- 172.21.15.72:0/111936060 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b781538d0 0x7f0b78159a30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0b78072940 tx=0x7f0b6801ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d862da14a22f3785 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:55.545 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.515+0000 7f6463faa640 1 -- 172.21.15.72:0/820102583 wait complete. 2024-05-09T05:53:55.545 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.515+0000 7fb294e5a640 1 -- 172.21.15.72:0/2494901325 learned_addr learned my addr 172.21.15.72:0/2494901325 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:55.545 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.515+0000 7fb295e5c640 1 -- 172.21.15.72:0/2494901325 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fb2900ce250 con 0x7fb2900c8f60 2024-05-09T05:53:55.545 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.515+0000 7fb295e5c640 1 -- 172.21.15.72:0/2494901325 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fb2900c9790 con 0x7fb2901528a0 2024-05-09T05:53:55.546 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.515+0000 7fb295e5c640 1 -- 172.21.15.72:0/2494901325 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fb2900ce3d0 con 0x7fb2900c69d0 2024-05-09T05:53:55.546 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.515+0000 7fb29565b640 1 --2- 172.21.15.72:0/2494901325 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2901528a0 0x7fb2901475b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:55.546 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.515+0000 7f2fceca3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2fc00064f0 0x7f2fc00d2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:55.546 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.515+0000 7f2fceca3640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fc0046690 0x7f2fc00d9300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:55.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.515+0000 7f2fceca3640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2fc004bf80 0x7f2fc00d9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:55.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.515+0000 7f2fceca3640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc00d5960 con 0x7f2fc0046690 2024-05-09T05:53:55.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.515+0000 7f2fceca3640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc00d57e0 con 0x7f2fc00064f0 2024-05-09T05:53:55.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.515+0000 7f2fceca3640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f2fc00dfc10 con 0x7f2fc004bf80 2024-05-09T05:53:55.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.515+0000 7f2fc7fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fc0046690 0x7f2fc00d9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:55.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.515+0000 7f2fc7fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fc0046690 0x7f2fc00d9300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42292/0 (socket says 172.21.15.72:42292) 2024-05-09T05:53:55.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.515+0000 7f2fc7fff640 1 -- 172.21.15.72:0/1072957397 learned_addr learned my addr 172.21.15.72:0/1072957397 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:55.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.515+0000 7f2fcd240640 1 --2- 172.21.15.72:0/1072957397 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2fc004bf80 0x7f2fc00d9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:55.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.515+0000 7f2fcca3f640 1 --2- 172.21.15.72:0/1072957397 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2fc00064f0 0x7f2fc00d2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:55.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.515+0000 7f2fc7fff640 1 -- 172.21.15.72:0/1072957397 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2fc004bf80 msgr2=0x7f2fc00d9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:55.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.515+0000 7f2fc7fff640 1 --2- 172.21.15.72:0/1072957397 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2fc004bf80 0x7f2fc00d9840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.515+0000 7f2fc7fff640 1 -- 172.21.15.72:0/1072957397 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2fc00064f0 msgr2=0x7f2fc00d2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:55.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.515+0000 7f2fc7fff640 1 --2- 172.21.15.72:0/1072957397 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2fc00064f0 0x7f2fc00d2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.515+0000 7f2fc7fff640 1 -- 172.21.15.72:0/1072957397 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fc00d3490 con 0x7f2fc0046690 2024-05-09T05:53:55.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.515+0000 7f2fc7fff640 1 --2- 172.21.15.72:0/1072957397 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fc0046690 0x7f2fc00d9300 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2fb400c3f0 tx=0x7f2fb400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:55.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.515+0000 7fb28ffff640 1 -- 172.21.15.72:0/2494901325 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb2900c69d0 msgr2=0x7fb2901f5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:55.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.515+0000 7fb28ffff640 1 --2- 172.21.15.72:0/2494901325 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb2900c69d0 0x7fb2901f5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.515+0000 7fb28ffff640 1 -- 172.21.15.72:0/2494901325 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2901528a0 msgr2=0x7fb2901475b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:55.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.515+0000 7fb28ffff640 1 --2- 172.21.15.72:0/2494901325 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2901528a0 0x7fb2901475b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.515+0000 7fb28ffff640 1 -- 172.21.15.72:0/2494901325 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2901457a0 con 0x7fb2900c8f60 2024-05-09T05:53:55.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.515+0000 7fb294e5a640 1 --2- 172.21.15.72:0/2494901325 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb2900c69d0 0x7fb2901f5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:53:55.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.515+0000 7fb28ffff640 1 --2- 172.21.15.72:0/2494901325 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2900c8f60 0x7fb2901408f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb27c00d600 tx=0x7fb27c00dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:55.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.515+0000 7f7d2affd640 1 -- 172.21.15.72:0/2858756903 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d2c1531a0 msgr2=0x7f7d2c1482b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:55.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.515+0000 7f7d2affd640 1 --2- 172.21.15.72:0/2858756903 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d2c1531a0 0x7f7d2c1482b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.515+0000 7f7d2affd640 1 -- 172.21.15.72:0/2858756903 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d2c0ca350 msgr2=0x7f7d2c1e1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:55.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.515+0000 7f7d2affd640 1 --2- 172.21.15.72:0/2858756903 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d2c0ca350 0x7f7d2c1e1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.515+0000 7f7d2affd640 1 -- 172.21.15.72:0/2858756903 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d2c1e24f0 con 0x7f7d2c0732d0 2024-05-09T05:53:55.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.515+0000 7f7d2affd640 1 --2- 172.21.15.72:0/2858756903 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d2c0732d0 0x7f7d2c1e3500 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c00c480 tx=0x7f7d1c00c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:55.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.515+0000 7f6463faa640 1 Processor -- start 2024-05-09T05:53:55.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.515+0000 7f6463faa640 1 -- start start 2024-05-09T05:53:55.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.519+0000 7f6463faa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6448004810 0x7f645c1e7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:55.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.519+0000 7f6463faa640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f645c1e6b10 0x7f645c153c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:55.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.519+0000 7f6463faa640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f645c1f2a70 0x7f645c1f2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:55.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.519+0000 7f6463faa640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f645c156dd0 con 0x7f645c1f2a70 2024-05-09T05:53:55.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.519+0000 7f6463faa640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f645c160ad0 con 0x7f645c1e6b10 2024-05-09T05:53:55.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.519+0000 7f6463faa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f645c1601a0 con 0x7f6448004810 2024-05-09T05:53:55.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.519+0000 7f6461d46640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6448004810 0x7f645c1e7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:55.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.519+0000 7f6462547640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f645c1f2a70 0x7f645c1f2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:55.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.519+0000 7f6462547640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f645c1f2a70 0x7f645c1f2e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42294/0 (socket says 172.21.15.72:42294) 2024-05-09T05:53:55.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.519+0000 7f6461d46640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6448004810 0x7f645c1e7d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.72:37902/0 (socket says 172.21.15.72:37902) 2024-05-09T05:53:55.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.519+0000 7f6462547640 1 -- 172.21.15.72:0/3517201966 learned_addr learned my addr 172.21.15.72:0/3517201966 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:55.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.519+0000 7f6461545640 1 --2- 172.21.15.72:0/3517201966 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f645c1e6b10 0x7f645c153c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:55.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.519+0000 7f6462547640 1 -- 172.21.15.72:0/3517201966 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6448004810 msgr2=0x7f645c1e7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:55.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.519+0000 7f6462547640 1 --2- 172.21.15.72:0/3517201966 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6448004810 0x7f645c1e7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.519+0000 7f6462547640 1 -- 172.21.15.72:0/3517201966 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f645c1e6b10 msgr2=0x7f645c153c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:55.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.519+0000 7f6462547640 1 --2- 172.21.15.72:0/3517201966 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f645c1e6b10 0x7f645c153c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.519+0000 7f6462547640 1 -- 172.21.15.72:0/3517201966 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f645c1f2410 con 0x7f645c1f2a70 2024-05-09T05:53:55.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.519+0000 7f6462547640 1 --2- 172.21.15.72:0/3517201966 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f645c1f2a70 0x7f645c1f2e80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f645c0d0ce0 tx=0x7f645400ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:55.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.519+0000 7fb6327fc640 1 -- 172.21.15.72:0/1043285486 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fb63c0a8050 con 0x7fb64015ac00 2024-05-09T05:53:55.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.519+0000 7f0b7d2e8640 1 -- 172.21.15.72:0/111936060 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b680b4070 con 0x7f0b781538d0 2024-05-09T05:53:55.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.519+0000 7f0b7d2e8640 1 -- 172.21.15.72:0/111936060 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b680a7b10 con 0x7f0b781538d0 2024-05-09T05:53:55.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.519+0000 7f0b7d2e8640 1 -- 172.21.15.72:0/111936060 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b680af440 con 0x7f0b781538d0 2024-05-09T05:53:55.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.519+0000 7f2fc57fa640 1 -- 172.21.15.72:0/1072957397 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb40074e0 con 0x7f2fc0046690 2024-05-09T05:53:55.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.519+0000 7f2fceca3640 1 -- 172.21.15.72:0/1072957397 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fc0165960 con 0x7f2fc0046690 2024-05-09T05:53:55.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.519+0000 7f2fceca3640 1 -- 172.21.15.72:0/1072957397 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fc0165f20 con 0x7f2fc0046690 2024-05-09T05:53:55.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.519+0000 7f2fc57fa640 1 -- 172.21.15.72:0/1072957397 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fb4007680 con 0x7f2fc0046690 2024-05-09T05:53:55.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.519+0000 7f2fc57fa640 1 -- 172.21.15.72:0/1072957397 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb40049f0 con 0x7f2fc0046690 2024-05-09T05:53:55.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.519+0000 7f64527fc640 1 -- 172.21.15.72:0/3517201966 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6454019070 con 0x7f645c1f2a70 2024-05-09T05:53:55.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.519+0000 7f6463faa640 1 -- 172.21.15.72:0/3517201966 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f645c0cff60 con 0x7f645c1f2a70 2024-05-09T05:53:55.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.519+0000 7f6463faa640 1 -- 172.21.15.72:0/3517201966 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f645c1e7260 con 0x7f645c1f2a70 2024-05-09T05:53:55.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.519+0000 7fb28d7fa640 1 -- 172.21.15.72:0/2494901325 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb27c0125f0 con 0x7fb2900c8f60 2024-05-09T05:53:55.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.519+0000 7fb295e5c640 1 -- 172.21.15.72:0/2494901325 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2901f1db0 con 0x7fb2900c8f60 2024-05-09T05:53:55.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.519+0000 7fb295e5c640 1 -- 172.21.15.72:0/2494901325 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb290145f70 con 0x7fb2900c8f60 2024-05-09T05:53:55.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.519+0000 7fb28d7fa640 1 -- 172.21.15.72:0/2494901325 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb27c019070 con 0x7fb2900c8f60 2024-05-09T05:53:55.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.519+0000 7fb28d7fa640 1 -- 172.21.15.72:0/2494901325 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb27c012990 con 0x7fb2900c8f60 2024-05-09T05:53:55.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.523+0000 7f6463faa640 1 -- 172.21.15.72:0/3517201966 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f645c06a520 con 0x7f645c1f2a70 2024-05-09T05:53:55.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.523+0000 7fb295e5c640 1 -- 172.21.15.72:0/2494901325 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2700052a0 con 0x7fb2900c8f60 2024-05-09T05:53:55.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.523+0000 7f2fc57fa640 1 -- 172.21.15.72:0/1072957397 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f2fb4011070 con 0x7f2fc0046690 2024-05-09T05:53:55.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.523+0000 7f2fc57fa640 1 --2- 172.21.15.72:0/1072957397 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f2fac06f400 0x7f2fac071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:55.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.523+0000 7fb28d7fa640 1 -- 172.21.15.72:0/2494901325 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fb27c012b30 con 0x7fb2900c8f60 2024-05-09T05:53:55.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.523+0000 7f2fcca3f640 1 --2- 172.21.15.72:0/1072957397 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f2fac06f400 0x7f2fac071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:55.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.523+0000 7f2fc57fa640 1 -- 172.21.15.72:0/1072957397 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f2fb4015e10 con 0x7f2fc0046690 2024-05-09T05:53:55.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.523+0000 7fb28d7fa640 1 --2- 172.21.15.72:0/2494901325 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fb27406f400 0x7fb274071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:55.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.523+0000 7fee17fff640 1 -- 172.21.15.72:0/3815004838 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fee2005bdf0 con 0x7fee300b5060 2024-05-09T05:53:55.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.523+0000 7fb28d7fa640 1 -- 172.21.15.72:0/2494901325 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb27c090360 con 0x7fb2900c8f60 2024-05-09T05:53:55.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.523+0000 7f0b8054e640 1 -- 172.21.15.72:0/111936060 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b781538d0 msgr2=0x7f0b78159a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:55.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.523+0000 7f0b8054e640 1 --2- 172.21.15.72:0/111936060 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b781538d0 0x7f0b78159a30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0b78072940 tx=0x7f0b6801ebe0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.523+0000 7f0b8054e640 1 -- 172.21.15.72:0/111936060 shutdown_connections 2024-05-09T05:53:55.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.523+0000 7f0b8054e640 1 --2- 172.21.15.72:0/111936060 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0b78159f70 0x7f0b78163dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.523+0000 7f0b8054e640 1 --2- 172.21.15.72:0/111936060 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b781538d0 0x7f0b78159a30 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.523+0000 7f0b8054e640 1 -- 172.21.15.72:0/111936060 >> 172.21.15.72:0/111936060 conn(0x7f0b780cb3c0 msgr2=0x7f0b780cb7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:55.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.523+0000 7f0b8054e640 1 -- 172.21.15.72:0/111936060 shutdown_connections 2024-05-09T05:53:55.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.523+0000 7f0b8054e640 1 -- 172.21.15.72:0/111936060 wait complete. 2024-05-09T05:53:55.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.523+0000 7f0b8054e640 1 Processor -- start 2024-05-09T05:53:55.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.523+0000 7f0b8054e640 1 -- start start 2024-05-09T05:53:55.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.523+0000 7f0b8054e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b780c89e0 0x7f0b78146fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:55.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.523+0000 7f0b8054e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0b781538d0 0x7f0b7814b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:55.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.523+0000 7f0b8054e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0b78159f70 0x7f0b78152920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:55.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.527+0000 7f0b8054e640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f0b7815a380 con 0x7f0b780c89e0 2024-05-09T05:53:55.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.527+0000 7f0b8054e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f0b78073730 con 0x7f0b781538d0 2024-05-09T05:53:55.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.527+0000 7f0b8054e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f0b780c5970 con 0x7f0b78159f70 2024-05-09T05:53:55.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.527+0000 7f0b7e2ea640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b780c89e0 0x7f0b78146fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:55.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.527+0000 7f0b7dae9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0b781538d0 0x7f0b7814b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:55.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.527+0000 7f0b7e2ea640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b780c89e0 0x7f0b78146fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42306/0 (socket says 172.21.15.72:42306) 2024-05-09T05:53:55.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.527+0000 7f0b7e2ea640 1 -- 172.21.15.72:0/4135918754 learned_addr learned my addr 172.21.15.72:0/4135918754 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:55.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.523+0000 7f7d137fe640 1 -- 172.21.15.72:0/2858756903 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d1c0052d0 con 0x7f7d2c0732d0 2024-05-09T05:53:55.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.527+0000 7f7d137fe640 1 -- 172.21.15.72:0/2858756903 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d1c005470 con 0x7f7d2c0732d0 2024-05-09T05:53:55.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.527+0000 7f7d137fe640 1 -- 172.21.15.72:0/2858756903 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d1c012830 con 0x7f7d2c0732d0 2024-05-09T05:53:55.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.527+0000 7f2fceca3640 1 -- 172.21.15.72:0/1072957397 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fa80052a0 con 0x7f2fc0046690 2024-05-09T05:53:55.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.527+0000 7fb294e5a640 1 --2- 172.21.15.72:0/2494901325 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fb27406f400 0x7fb274071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:55.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.527+0000 7f2fcca3f640 1 --2- 172.21.15.72:0/1072957397 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f2fac06f400 0x7f2fac071910 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc009930 tx=0x7f2fbc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:55.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.527+0000 7fb294e5a640 1 --2- 172.21.15.72:0/2494901325 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fb27406f400 0x7fb274071910 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb284000f70 tx=0x7fb284004d10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:55.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.527+0000 7f0b7e2ea640 1 -- 172.21.15.72:0/4135918754 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0b78159f70 msgr2=0x7f0b78152920 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-09T05:53:55.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.527+0000 7f0b7e2ea640 1 --2- 172.21.15.72:0/4135918754 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0b78159f70 0x7f0b78152920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.527+0000 7f0b7e2ea640 1 -- 172.21.15.72:0/4135918754 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0b781538d0 msgr2=0x7f0b7814b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:55.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.527+0000 7f0b7e2ea640 1 --2- 172.21.15.72:0/4135918754 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0b781538d0 0x7f0b7814b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.527+0000 7f0b7e2ea640 1 -- 172.21.15.72:0/4135918754 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b781474f0 con 0x7f0b780c89e0 2024-05-09T05:53:55.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.527+0000 7f0b7dae9640 1 --2- 172.21.15.72:0/4135918754 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0b781538d0 0x7f0b7814b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T05:53:55.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.527+0000 7f0b7e2ea640 1 --2- 172.21.15.72:0/4135918754 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b780c89e0 0x7f0b78146fb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0b7000ba80 tx=0x7f0b7000bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:55.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.531+0000 7f7d2bfff640 1 -- 172.21.15.72:0/2858756903 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d2c1f82c0 con 0x7f7d2c0732d0 2024-05-09T05:53:55.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.531+0000 7f64527fc640 1 -- 172.21.15.72:0/3517201966 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6454006d70 con 0x7f645c1f2a70 2024-05-09T05:53:55.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.531+0000 7f64527fc640 1 -- 172.21.15.72:0/3517201966 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6454003b80 con 0x7f645c1f2a70 2024-05-09T05:53:55.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.531+0000 7f64527fc640 1 -- 172.21.15.72:0/3517201966 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f645401c070 con 0x7f645c1f2a70 2024-05-09T05:53:55.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.531+0000 7f7d2bfff640 1 -- 172.21.15.72:0/2858756903 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d2c14c290 con 0x7f7d2c0732d0 2024-05-09T05:53:55.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.531+0000 7f64527fc640 1 --2- 172.21.15.72:0/3517201966 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f644006f430 0x7f6440071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:55.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.531+0000 7f64527fc640 1 -- 172.21.15.72:0/3517201966 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f645408eb90 con 0x7f645c1f2a70 2024-05-09T05:53:55.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.531+0000 7f6461d46640 1 --2- 172.21.15.72:0/3517201966 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f644006f430 0x7f6440071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:55.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.531+0000 7f7d2bfff640 1 -- 172.21.15.72:0/2858756903 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d2c050880 con 0x7f7d2c0732d0 2024-05-09T05:53:55.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.531+0000 7f6461d46640 1 --2- 172.21.15.72:0/3517201966 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f644006f430 0x7f6440071940 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f64580090e0 tx=0x7f6458009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:55.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.531+0000 7f7d137fe640 1 -- 172.21.15.72:0/2858756903 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f7d1c0129d0 con 0x7f7d2c0732d0 2024-05-09T05:53:55.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.535+0000 7f7d137fe640 1 --2- 172.21.15.72:0/2858756903 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f7d1806f480 0x7f7d18071990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:55.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.535+0000 7f7d137fe640 1 -- 172.21.15.72:0/2858756903 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f7d1c08fb00 con 0x7f7d2c0732d0 2024-05-09T05:53:55.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.535+0000 7f7d2a7fc640 1 --2- 172.21.15.72:0/2858756903 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f7d1806f480 0x7f7d18071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:55.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.535+0000 7f7d2a7fc640 1 --2- 172.21.15.72:0/2858756903 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f7d1806f480 0x7f7d18071990 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7d2000b240 tx=0x7f7d2000b3a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:55.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.535+0000 7fb28d7fa640 1 -- 172.21.15.72:0/2494901325 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fb27c05cfb0 con 0x7fb2900c8f60 2024-05-09T05:53:55.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.547+0000 7f7d137fe640 1 -- 172.21.15.72:0/2858756903 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f7d2c06e360 con 0x7f7d2c0732d0 2024-05-09T05:53:55.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.547+0000 7f64527fc640 1 -- 172.21.15.72:0/3517201966 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f645405b1f0 con 0x7f645c1f2a70 2024-05-09T05:53:55.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.547+0000 7f0b6effd640 1 -- 172.21.15.72:0/4135918754 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b7000cc00 con 0x7f0b780c89e0 2024-05-09T05:53:55.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.547+0000 7f0b8054e640 1 -- 172.21.15.72:0/4135918754 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b78154540 con 0x7f0b780c89e0 2024-05-09T05:53:55.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.547+0000 7f0b8054e640 1 -- 172.21.15.72:0/4135918754 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b78154ac0 con 0x7f0b780c89e0 2024-05-09T05:53:55.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.547+0000 7f0b8054e640 1 -- 172.21.15.72:0/4135918754 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b7806a520 con 0x7f0b780c89e0 2024-05-09T05:53:55.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.555+0000 7f2fc57fa640 1 -- 172.21.15.72:0/1072957397 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f2fb405bc30 con 0x7f2fc0046690 2024-05-09T05:53:55.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.555+0000 7f0b6effd640 1 -- 172.21.15.72:0/4135918754 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b7000cda0 con 0x7f0b780c89e0 2024-05-09T05:53:55.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.559+0000 7f0b6effd640 1 -- 172.21.15.72:0/4135918754 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b70022060 con 0x7f0b780c89e0 2024-05-09T05:53:55.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.559+0000 7f0b6effd640 1 -- 172.21.15.72:0/4135918754 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f0b70006d10 con 0x7f0b780c89e0 2024-05-09T05:53:55.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.563+0000 7f0b6effd640 1 --2- 172.21.15.72:0/4135918754 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f0b5c06f430 0x7f0b5c071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:55.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.563+0000 7f0b6effd640 1 -- 172.21.15.72:0/4135918754 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f0b7008dc30 con 0x7f0b780c89e0 2024-05-09T05:53:55.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.563+0000 7f0b7dae9640 1 --2- 172.21.15.72:0/4135918754 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f0b5c06f430 0x7f0b5c071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:55.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.563+0000 7f0b7dae9640 1 --2- 172.21.15.72:0/4135918754 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f0b5c06f430 0x7f0b5c071940 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0b680b1000 tx=0x7f0b680a9070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:55.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.571+0000 7f0b6effd640 1 -- 172.21.15.72:0/4135918754 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f0b7005bf20 con 0x7f0b780c89e0 2024-05-09T05:53:55.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.791+0000 7f06e63db640 1 -- 172.21.15.72:0/297585554 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f06c0005590 con 0x7f06e006f820 2024-05-09T05:53:55.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.791+0000 7f06dcff9640 1 -- 172.21.15.72:0/297585554 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f06d00f5d30 con 0x7f06e006f820 2024-05-09T05:53:55.784 INFO:teuthology.orchestra.run.smithi072.stdout:64424509450 2024-05-09T05:53:55.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.795+0000 7f06c67fc640 1 -- 172.21.15.72:0/297585554 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f06cc06f400 msgr2=0x7f06cc071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:55.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.795+0000 7f06c67fc640 1 --2- 172.21.15.72:0/297585554 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f06cc06f400 0x7f06cc071910 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f06e0142200 tx=0x7f06d4009190 comp rx=0 tx=0).stop 2024-05-09T05:53:55.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.795+0000 7f06c67fc640 1 -- 172.21.15.72:0/297585554 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06e006f820 msgr2=0x7f06e01fb2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:55.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.795+0000 7f06c67fc640 1 --2- 172.21.15.72:0/297585554 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06e006f820 0x7f06e01fb2b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f06d0004000 tx=0x7f06d0019190 comp rx=0 tx=0).stop 2024-05-09T05:53:55.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.795+0000 7f06c67fc640 1 -- 172.21.15.72:0/297585554 shutdown_connections 2024-05-09T05:53:55.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.795+0000 7f06c67fc640 1 --2- 172.21.15.72:0/297585554 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f06cc06f400 0x7f06cc071910 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.795+0000 7f06c67fc640 1 --2- 172.21.15.72:0/297585554 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06e0158b50 0x7f06e01454d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.795+0000 7f06c67fc640 1 --2- 172.21.15.72:0/297585554 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06e00c9300 0x7f06e01f79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.795+0000 7f06c67fc640 1 --2- 172.21.15.72:0/297585554 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06e006f820 0x7f06e01fb2b0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.795+0000 7f06c67fc640 1 -- 172.21.15.72:0/297585554 >> 172.21.15.72:0/297585554 conn(0x7f06e006d0e0 msgr2=0x7f06e00c9710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:55.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.795+0000 7f06c67fc640 1 -- 172.21.15.72:0/297585554 shutdown_connections 2024-05-09T05:53:55.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.795+0000 7f06c67fc640 1 -- 172.21.15.72:0/297585554 wait complete. 2024-05-09T05:53:55.813 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.2 2024-05-09T05:53:55.813 DEBUG:teuthology.parallel:result is None 2024-05-09T05:53:55.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.831+0000 7fb647cd3640 1 -- 172.21.15.72:0/1043285486 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fb628005860 con 0x7fb64015ac00 2024-05-09T05:53:55.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.831+0000 7fb6327fc640 1 -- 172.21.15.72:0/1043285486 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb63c016090 con 0x7fb64015ac00 2024-05-09T05:53:55.824 INFO:teuthology.orchestra.run.smithi072.stdout:64424509453 2024-05-09T05:53:55.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.835+0000 7fb647cd3640 1 -- 172.21.15.72:0/1043285486 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fb62406f460 msgr2=0x7fb624071970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:55.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.835+0000 7fb647cd3640 1 --2- 172.21.15.72:0/1043285486 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fb62406f460 0x7fb624071970 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb638005c10 tx=0x7fb638009040 comp rx=0 tx=0).stop 2024-05-09T05:53:55.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.835+0000 7fb647cd3640 1 -- 172.21.15.72:0/1043285486 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb64015ac00 msgr2=0x7fb6400cce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:55.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.835+0000 7fb647cd3640 1 --2- 172.21.15.72:0/1043285486 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb64015ac00 0x7fb6400cce00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb63c0ac000 tx=0x7fb63c0191b0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.835+0000 7fb647cd3640 1 -- 172.21.15.72:0/1043285486 shutdown_connections 2024-05-09T05:53:55.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.835+0000 7fb647cd3640 1 --2- 172.21.15.72:0/1043285486 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fb62406f460 0x7fb624071970 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.835+0000 7fb647cd3640 1 --2- 172.21.15.72:0/1043285486 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb64015ac00 0x7fb6400cce00 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.835+0000 7fb647cd3640 1 --2- 172.21.15.72:0/1043285486 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb6400733d0 0x7fb640148d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.835+0000 7fb647cd3640 1 --2- 172.21.15.72:0/1043285486 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb640068c40 0x7fb64014f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.835+0000 7fb647cd3640 1 -- 172.21.15.72:0/1043285486 >> 172.21.15.72:0/1043285486 conn(0x7fb6400ce960 msgr2=0x7fb6400cdfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:55.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.835+0000 7fb647cd3640 1 -- 172.21.15.72:0/1043285486 shutdown_connections 2024-05-09T05:53:55.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.835+0000 7fb647cd3640 1 -- 172.21.15.72:0/1043285486 wait complete. 2024-05-09T05:53:55.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.847+0000 7fee34bff640 1 -- 172.21.15.72:0/3815004838 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fee301588a0 con 0x7fee300b5060 2024-05-09T05:53:55.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.847+0000 7fee17fff640 1 -- 172.21.15.72:0/3815004838 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fee200600f0 con 0x7fee300b5060 2024-05-09T05:53:55.840 INFO:teuthology.orchestra.run.smithi072.stdout:55834574858 2024-05-09T05:53:55.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.851+0000 7fee34bff640 1 -- 172.21.15.72:0/3815004838 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fee1c06f400 msgr2=0x7fee1c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:55.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.851+0000 7fee34bff640 1 --2- 172.21.15.72:0/3815004838 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fee1c06f400 0x7fee1c071910 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fee240ad000 tx=0x7fee240a6000 comp rx=0 tx=0).stop 2024-05-09T05:53:55.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.851+0000 7fee34bff640 1 -- 172.21.15.72:0/3815004838 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fee300b5060 msgr2=0x7fee301ffef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:55.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.851+0000 7fee34bff640 1 --2- 172.21.15.72:0/3815004838 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fee300b5060 0x7fee301ffef0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fee2000c7f0 tx=0x7fee2000cbf0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.851+0000 7fee34bff640 1 -- 172.21.15.72:0/3815004838 shutdown_connections 2024-05-09T05:53:55.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.851+0000 7fee34bff640 1 --2- 172.21.15.72:0/3815004838 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fee1c06f400 0x7fee1c071910 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.851+0000 7fee34bff640 1 --2- 172.21.15.72:0/3815004838 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fee300ce880 0x7fee300ca6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.851+0000 7fee34bff640 1 --2- 172.21.15.72:0/3815004838 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee300cc270 0x7fee30072c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.851+0000 7fee34bff640 1 --2- 172.21.15.72:0/3815004838 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fee300b5060 0x7fee301ffef0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.851+0000 7fee34bff640 1 -- 172.21.15.72:0/3815004838 >> 172.21.15.72:0/3815004838 conn(0x7fee3006e7b0 msgr2=0x7fee301578b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:55.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.851+0000 7fee34bff640 1 -- 172.21.15.72:0/3815004838 shutdown_connections 2024-05-09T05:53:55.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.851+0000 7fee34bff640 1 -- 172.21.15.72:0/3815004838 wait complete. 2024-05-09T05:53:55.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.859+0000 7f0b8054e640 1 -- 172.21.15.72:0/4135918754 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f0b780ca650 con 0x7f0b780c89e0 2024-05-09T05:53:55.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.859+0000 7f0b6effd640 1 -- 172.21.15.72:0/4135918754 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0b70060220 con 0x7f0b780c89e0 2024-05-09T05:53:55.852 INFO:teuthology.orchestra.run.smithi072.stdout:64424509452 2024-05-09T05:53:55.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.863+0000 7f0b8054e640 1 -- 172.21.15.72:0/4135918754 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f0b5c06f430 msgr2=0x7f0b5c071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:55.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.863+0000 7fb295e5c640 1 -- 172.21.15.72:0/2494901325 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fb270005860 con 0x7fb2900c8f60 2024-05-09T05:53:55.855 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509453 got 64424509453 for osd.6 2024-05-09T05:53:55.856 DEBUG:teuthology.parallel:result is None 2024-05-09T05:53:55.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.863+0000 7f0b8054e640 1 --2- 172.21.15.72:0/4135918754 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f0b5c06f430 0x7f0b5c071940 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0b680b1000 tx=0x7f0b680a9070 comp rx=0 tx=0).stop 2024-05-09T05:53:55.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.863+0000 7f0b8054e640 1 -- 172.21.15.72:0/4135918754 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b780c89e0 msgr2=0x7f0b78146fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:55.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.863+0000 7f0b8054e640 1 --2- 172.21.15.72:0/4135918754 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b780c89e0 0x7f0b78146fb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0b7000ba80 tx=0x7f0b7000bf40 comp rx=0 tx=0).stop 2024-05-09T05:53:55.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.863+0000 7fb28d7fa640 1 -- 172.21.15.72:0/2494901325 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb27c05c8b0 con 0x7fb2900c8f60 2024-05-09T05:53:55.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.863+0000 7f0b8054e640 1 -- 172.21.15.72:0/4135918754 shutdown_connections 2024-05-09T05:53:55.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.863+0000 7f0b8054e640 1 --2- 172.21.15.72:0/4135918754 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f0b5c06f430 0x7f0b5c071940 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.863+0000 7f0b8054e640 1 --2- 172.21.15.72:0/4135918754 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0b78159f70 0x7f0b78152920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.863+0000 7f0b8054e640 1 --2- 172.21.15.72:0/4135918754 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0b781538d0 0x7f0b7814b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.863+0000 7f0b8054e640 1 --2- 172.21.15.72:0/4135918754 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b780c89e0 0x7f0b78146fb0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.863+0000 7f0b8054e640 1 -- 172.21.15.72:0/4135918754 >> 172.21.15.72:0/4135918754 conn(0x7f0b780cb3c0 msgr2=0x7f0b7806d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:55.858 INFO:teuthology.orchestra.run.smithi072.stdout:55834574860 2024-05-09T05:53:55.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.863+0000 7f0b8054e640 1 -- 172.21.15.72:0/4135918754 shutdown_connections 2024-05-09T05:53:55.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.863+0000 7f0b8054e640 1 -- 172.21.15.72:0/4135918754 wait complete. 2024-05-09T05:53:55.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.867+0000 7fb295e5c640 1 -- 172.21.15.72:0/2494901325 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fb27406f400 msgr2=0x7fb274071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:55.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.867+0000 7fb295e5c640 1 --2- 172.21.15.72:0/2494901325 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fb27406f400 0x7fb274071910 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb284000f70 tx=0x7fb284004d10 comp rx=0 tx=0).stop 2024-05-09T05:53:55.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.867+0000 7fb295e5c640 1 -- 172.21.15.72:0/2494901325 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2900c8f60 msgr2=0x7fb2901408f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:55.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.867+0000 7fb295e5c640 1 --2- 172.21.15.72:0/2494901325 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2900c8f60 0x7fb2901408f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb27c00d600 tx=0x7fb27c00dac0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.867+0000 7fb295e5c640 1 -- 172.21.15.72:0/2494901325 shutdown_connections 2024-05-09T05:53:55.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.867+0000 7fb295e5c640 1 --2- 172.21.15.72:0/2494901325 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fb27406f400 0x7fb274071910 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.867+0000 7fb295e5c640 1 --2- 172.21.15.72:0/2494901325 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2901528a0 0x7fb2901475b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.867+0000 7fb295e5c640 1 --2- 172.21.15.72:0/2494901325 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2900c8f60 0x7fb2901408f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.867+0000 7fb295e5c640 1 --2- 172.21.15.72:0/2494901325 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb2900c69d0 0x7fb2901f5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.867+0000 7fb295e5c640 1 -- 172.21.15.72:0/2494901325 >> 172.21.15.72:0/2494901325 conn(0x7fb29006cba0 msgr2=0x7fb290072e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:55.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.867+0000 7fb295e5c640 1 -- 172.21.15.72:0/2494901325 shutdown_connections 2024-05-09T05:53:55.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.867+0000 7fb295e5c640 1 -- 172.21.15.72:0/2494901325 wait complete. 2024-05-09T05:53:55.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.867+0000 7f7d2bfff640 1 -- 172.21.15.72:0/2858756903 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f7d2c0754e0 con 0x7f7d2c0732d0 2024-05-09T05:53:55.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.867+0000 7f7d137fe640 1 -- 172.21.15.72:0/2858756903 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7d1c05c8b0 con 0x7f7d2c0732d0 2024-05-09T05:53:55.860 INFO:teuthology.orchestra.run.smithi072.stdout:64424509453 2024-05-09T05:53:55.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.871+0000 7f6463faa640 1 -- 172.21.15.72:0/3517201966 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f645c06f1d0 con 0x7f645c1f2a70 2024-05-09T05:53:55.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.871+0000 7f64527fc640 1 -- 172.21.15.72:0/3517201966 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f645405f4f0 con 0x7f645c1f2a70 2024-05-09T05:53:55.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.871+0000 7f7d2bfff640 1 -- 172.21.15.72:0/2858756903 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f7d1806f480 msgr2=0x7f7d18071990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:55.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.871+0000 7f7d2bfff640 1 --2- 172.21.15.72:0/2858756903 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f7d1806f480 0x7f7d18071990 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7d2000b240 tx=0x7f7d2000b3a0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.871+0000 7f7d2bfff640 1 -- 172.21.15.72:0/2858756903 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d2c0732d0 msgr2=0x7f7d2c1e3500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:55.863 INFO:teuthology.orchestra.run.smithi072.stdout:64424509452 2024-05-09T05:53:55.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.871+0000 7f7d2bfff640 1 --2- 172.21.15.72:0/2858756903 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d2c0732d0 0x7f7d2c1e3500 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c00c480 tx=0x7f7d1c00c940 comp rx=0 tx=0).stop 2024-05-09T05:53:55.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.871+0000 7f7d2bfff640 1 -- 172.21.15.72:0/2858756903 shutdown_connections 2024-05-09T05:53:55.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.871+0000 7f7d2bfff640 1 --2- 172.21.15.72:0/2858756903 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f7d1806f480 0x7f7d18071990 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.871+0000 7f7d2bfff640 1 --2- 172.21.15.72:0/2858756903 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d2c1531a0 0x7f7d2c1482b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.871+0000 7f7d2bfff640 1 --2- 172.21.15.72:0/2858756903 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d2c0ca350 0x7f7d2c1e1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.871+0000 7f7d2bfff640 1 --2- 172.21.15.72:0/2858756903 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d2c0732d0 0x7f7d2c1e3500 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.871+0000 7f7d2bfff640 1 -- 172.21.15.72:0/2858756903 >> 172.21.15.72:0/2858756903 conn(0x7f7d2c070a00 msgr2=0x7f7d2c06c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:55.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.871+0000 7f7d2bfff640 1 -- 172.21.15.72:0/2858756903 shutdown_connections 2024-05-09T05:53:55.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.871+0000 7f7d2bfff640 1 -- 172.21.15.72:0/2858756903 wait complete. 2024-05-09T05:53:55.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.875+0000 7f6463faa640 1 -- 172.21.15.72:0/3517201966 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f644006f430 msgr2=0x7f6440071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:55.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.875+0000 7f6463faa640 1 --2- 172.21.15.72:0/3517201966 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f644006f430 0x7f6440071940 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f64580090e0 tx=0x7f6458009190 comp rx=0 tx=0).stop 2024-05-09T05:53:55.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.875+0000 7f6463faa640 1 -- 172.21.15.72:0/3517201966 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f645c1f2a70 msgr2=0x7f645c1f2e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:55.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.875+0000 7f6463faa640 1 --2- 172.21.15.72:0/3517201966 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f645c1f2a70 0x7f645c1f2e80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f645c0d0ce0 tx=0x7f645400ff70 comp rx=0 tx=0).stop 2024-05-09T05:53:55.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.875+0000 7f6463faa640 1 -- 172.21.15.72:0/3517201966 shutdown_connections 2024-05-09T05:53:55.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.875+0000 7f6463faa640 1 --2- 172.21.15.72:0/3517201966 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f644006f430 0x7f6440071940 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.875+0000 7f6463faa640 1 --2- 172.21.15.72:0/3517201966 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f645c1f2a70 0x7f645c1f2e80 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.875+0000 7f6463faa640 1 --2- 172.21.15.72:0/3517201966 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f645c1e6b10 0x7f645c153c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.875+0000 7f6463faa640 1 --2- 172.21.15.72:0/3517201966 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6448004810 0x7f645c1e7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.875+0000 7f6463faa640 1 -- 172.21.15.72:0/3517201966 >> 172.21.15.72:0/3517201966 conn(0x7f645c072080 msgr2=0x7f645c0ca310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:55.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.875+0000 7f6463faa640 1 -- 172.21.15.72:0/3517201966 shutdown_connections 2024-05-09T05:53:55.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.875+0000 7f6463faa640 1 -- 172.21.15.72:0/3517201966 wait complete. 2024-05-09T05:53:55.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.879+0000 7f2fceca3640 1 -- 172.21.15.72:0/1072957397 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f2fa8005860 con 0x7f2fc0046690 2024-05-09T05:53:55.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.883+0000 7f2fc57fa640 1 -- 172.21.15.72:0/1072957397 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2fb405b530 con 0x7f2fc0046690 2024-05-09T05:53:55.872 INFO:teuthology.orchestra.run.smithi072.stdout:64424509450 2024-05-09T05:53:55.873 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.5 2024-05-09T05:53:55.874 DEBUG:teuthology.parallel:result is None 2024-05-09T05:53:55.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.883+0000 7f2fceca3640 1 -- 172.21.15.72:0/1072957397 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f2fac06f400 msgr2=0x7f2fac071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:55.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.883+0000 7f2fceca3640 1 --2- 172.21.15.72:0/1072957397 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f2fac06f400 0x7f2fac071910 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc009930 tx=0x7f2fbc008040 comp rx=0 tx=0).stop 2024-05-09T05:53:55.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.883+0000 7f2fceca3640 1 -- 172.21.15.72:0/1072957397 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fc0046690 msgr2=0x7f2fc00d9300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:55.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.883+0000 7f2fceca3640 1 --2- 172.21.15.72:0/1072957397 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fc0046690 0x7f2fc00d9300 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2fb400c3f0 tx=0x7f2fb400c8b0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.883+0000 7f2fceca3640 1 -- 172.21.15.72:0/1072957397 shutdown_connections 2024-05-09T05:53:55.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.883+0000 7f2fceca3640 1 --2- 172.21.15.72:0/1072957397 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f2fac06f400 0x7f2fac071910 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.883+0000 7f2fceca3640 1 --2- 172.21.15.72:0/1072957397 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2fc004bf80 0x7f2fc00d9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.883+0000 7f2fceca3640 1 --2- 172.21.15.72:0/1072957397 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fc0046690 0x7f2fc00d9300 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.883+0000 7f2fceca3640 1 --2- 172.21.15.72:0/1072957397 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2fc00064f0 0x7f2fc00d2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:55.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.883+0000 7f2fceca3640 1 -- 172.21.15.72:0/1072957397 >> 172.21.15.72:0/1072957397 conn(0x7f2fc0050810 msgr2=0x7f2fc004e5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:55.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.883+0000 7f2fceca3640 1 -- 172.21.15.72:0/1072957397 shutdown_connections 2024-05-09T05:53:55.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:55.883+0000 7f2fceca3640 1 -- 172.21.15.72:0/1072957397 wait complete. 2024-05-09T05:53:55.884 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574860 for osd.3 2024-05-09T05:53:55.884 DEBUG:teuthology.parallel:result is None 2024-05-09T05:53:55.892 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509452 for osd.0 2024-05-09T05:53:55.892 DEBUG:teuthology.parallel:result is None 2024-05-09T05:53:55.893 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509453 got 64424509453 for osd.4 2024-05-09T05:53:55.893 DEBUG:teuthology.parallel:result is None 2024-05-09T05:53:55.898 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.7 2024-05-09T05:53:55.899 DEBUG:teuthology.parallel:result is None 2024-05-09T05:53:55.899 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509452 for osd.1 2024-05-09T05:53:55.899 DEBUG:teuthology.parallel:result is None 2024-05-09T05:53:55.899 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-09T05:53:55.899 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T05:53:56.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.083+0000 7f40e8ace640 1 Processor -- start 2024-05-09T05:53:56.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.087+0000 7f40e8ace640 1 -- start start 2024-05-09T05:53:56.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.087+0000 7f40e8ace640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40e415da90 0x7f40e40c7570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:56.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.087+0000 7f40e8ace640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f40e415dea0 0x7f40e40745b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:56.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.087+0000 7f40e8ace640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40e415a4f0 con 0x7f40e4074af0 2024-05-09T05:53:56.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.087+0000 7f40e8ace640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f40e41513f0 con 0x7f40e415dea0 2024-05-09T05:53:56.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.087+0000 7f40e8ace640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f40e40c84f0 con 0x7f40e415da90 2024-05-09T05:53:56.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.087+0000 7f40e2d9d640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f40e4074af0 0x7f40e406fc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34518/0 (socket says 172.21.15.72:34518) 2024-05-09T05:53:56.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.087+0000 7f40e2d9d640 1 -- 172.21.15.72:0/244454433 learned_addr learned my addr 172.21.15.72:0/244454433 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:53:56.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.087+0000 7f40e1d9b640 1 --2- 172.21.15.72:0/244454433 >> v2:172.21.15.72:3300/0 conn(0x7f40e415dea0 0x7f40e40745b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:56.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.087+0000 7f40e259c640 1 --2- 172.21.15.72:0/244454433 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40e415da90 0x7f40e40c7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:56.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.087+0000 7f40e159a640 1 -- 172.21.15.72:0/244454433 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2536825272 0 0) 0x7f40e415a4f0 con 0x7f40e4074af0 2024-05-09T05:53:56.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.087+0000 7f40e159a640 1 -- 172.21.15.72:0/244454433 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f40cc003530 con 0x7f40e4074af0 2024-05-09T05:53:56.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.087+0000 7f40e1d9b640 1 -- 172.21.15.72:0/244454433 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40e415da90 msgr2=0x7f40e40c7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:56.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.087+0000 7f40e1d9b640 1 --2- 172.21.15.72:0/244454433 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40e415da90 0x7f40e40c7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:56.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.087+0000 7f40e1d9b640 1 -- 172.21.15.72:0/244454433 >> v1:172.21.15.72:6789/0 conn(0x7f40e4074af0 legacy=0x7f40e406fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:56.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.087+0000 7f40e1d9b640 1 -- 172.21.15.72:0/244454433 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40e40c87d0 con 0x7f40e415dea0 2024-05-09T05:53:56.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.091+0000 7f40e1d9b640 1 --2- 172.21.15.72:0/244454433 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40e415dea0 0x7f40e40745b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f40d80097c0 tx=0x7f40d801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36b113746c24f893 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:56.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.091+0000 7f40e159a640 1 -- 172.21.15.72:0/244454433 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d80b0070 con 0x7f40e415dea0 2024-05-09T05:53:56.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.091+0000 7f40e159a640 1 -- 172.21.15.72:0/244454433 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40d80a4e50 con 0x7f40e415dea0 2024-05-09T05:53:56.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.091+0000 7f40e159a640 1 -- 172.21.15.72:0/244454433 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d80ab820 con 0x7f40e415dea0 2024-05-09T05:53:56.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.091+0000 7f40e8ace640 1 -- 172.21.15.72:0/244454433 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40e415dea0 msgr2=0x7f40e40745b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:56.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.091+0000 7f40e8ace640 1 --2- 172.21.15.72:0/244454433 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40e415dea0 0x7f40e40745b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f40d80097c0 tx=0x7f40d801c4a0 comp rx=0 tx=0).stop 2024-05-09T05:53:56.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.091+0000 7f40e8ace640 1 -- 172.21.15.72:0/244454433 shutdown_connections 2024-05-09T05:53:56.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.091+0000 7f40e8ace640 1 --2- 172.21.15.72:0/244454433 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40e415dea0 0x7f40e40745b0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:56.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.091+0000 7f40e8ace640 1 --2- 172.21.15.72:0/244454433 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40e415da90 0x7f40e40c7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:56.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.091+0000 7f40e8ace640 1 -- 172.21.15.72:0/244454433 >> 172.21.15.72:0/244454433 conn(0x7f40e40cde90 msgr2=0x7f40e40ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:56.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.091+0000 7f40e8ace640 1 -- 172.21.15.72:0/244454433 shutdown_connections 2024-05-09T05:53:56.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.091+0000 7f40e8ace640 1 -- 172.21.15.72:0/244454433 wait complete. 2024-05-09T05:53:56.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.091+0000 7f40e8ace640 1 Processor -- start 2024-05-09T05:53:56.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.091+0000 7f40e8ace640 1 -- start start 2024-05-09T05:53:56.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.091+0000 7f40e8ace640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40e4074af0 0x7f40e4158f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:56.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.091+0000 7f40e8ace640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40e415da90 0x7f40e41f9670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:56.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.091+0000 7f40e8ace640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f40e415dea0 0x7f40e41f9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:56.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.091+0000 7f40e8ace640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f40e40c81b0 con 0x7f40e4074af0 2024-05-09T05:53:56.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.091+0000 7f40e8ace640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f40e40c70e0 con 0x7f40e415dea0 2024-05-09T05:53:56.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.091+0000 7f40e8ace640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f40e4154ab0 con 0x7f40e415da90 2024-05-09T05:53:56.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.095+0000 7f40e259c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40e4074af0 0x7f40e4158f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:56.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.095+0000 7f40e259c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40e4074af0 0x7f40e4158f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42330/0 (socket says 172.21.15.72:42330) 2024-05-09T05:53:56.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.095+0000 7f40e259c640 1 -- 172.21.15.72:0/113636119 learned_addr learned my addr 172.21.15.72:0/113636119 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:56.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.095+0000 7f40e2d9d640 1 --2- 172.21.15.72:0/113636119 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f40e415dea0 0x7f40e41f9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:56.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.095+0000 7f40e1d9b640 1 --2- 172.21.15.72:0/113636119 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40e415da90 0x7f40e41f9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:56.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.095+0000 7f40e259c640 1 -- 172.21.15.72:0/113636119 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40e415da90 msgr2=0x7f40e41f9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:56.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.095+0000 7f40e259c640 1 --2- 172.21.15.72:0/113636119 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40e415da90 0x7f40e41f9670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:56.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.095+0000 7f40e259c640 1 -- 172.21.15.72:0/113636119 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f40e415dea0 msgr2=0x7f40e41f9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:56.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.095+0000 7f40e259c640 1 --2- 172.21.15.72:0/113636119 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f40e415dea0 0x7f40e41f9bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:56.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.095+0000 7f40e259c640 1 -- 172.21.15.72:0/113636119 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40e4146df0 con 0x7f40e4074af0 2024-05-09T05:53:56.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.095+0000 7f40e2d9d640 1 --2- 172.21.15.72:0/113636119 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f40e415dea0 0x7f40e41f9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:53:56.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.095+0000 7f40e259c640 1 --2- 172.21.15.72:0/113636119 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40e4074af0 0x7f40e4158f20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f40d400e870 tx=0x7f40d400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:56.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.095+0000 7f40d2ffd640 1 -- 172.21.15.72:0/113636119 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d4017070 con 0x7f40e4074af0 2024-05-09T05:53:56.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.095+0000 7f40d2ffd640 1 -- 172.21.15.72:0/113636119 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40d400c940 con 0x7f40e4074af0 2024-05-09T05:53:56.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.095+0000 7f40e8ace640 1 -- 172.21.15.72:0/113636119 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40e40ccee0 con 0x7f40e4074af0 2024-05-09T05:53:56.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.095+0000 7f40d2ffd640 1 -- 172.21.15.72:0/113636119 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d400cd10 con 0x7f40e4074af0 2024-05-09T05:53:56.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.095+0000 7f40e8ace640 1 -- 172.21.15.72:0/113636119 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40e40cd480 con 0x7f40e4074af0 2024-05-09T05:53:56.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.095+0000 7f40e8ace640 1 -- 172.21.15.72:0/113636119 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40e406a520 con 0x7f40e4074af0 2024-05-09T05:53:56.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.095+0000 7f40d2ffd640 1 -- 172.21.15.72:0/113636119 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f40d401a070 con 0x7f40e4074af0 2024-05-09T05:53:56.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.095+0000 7f40d2ffd640 1 --2- 172.21.15.72:0/113636119 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f40c406f400 0x7f40c4071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:56.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.095+0000 7f40d2ffd640 1 -- 172.21.15.72:0/113636119 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f40d408f850 con 0x7f40e4074af0 2024-05-09T05:53:56.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.095+0000 7f40e1d9b640 1 --2- 172.21.15.72:0/113636119 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f40c406f400 0x7f40c4071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:56.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.095+0000 7f40e1d9b640 1 --2- 172.21.15.72:0/113636119 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f40c406f400 0x7f40c4071910 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f40d80ad000 tx=0x7f40d8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:56.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.099+0000 7f40d2ffd640 1 -- 172.21.15.72:0/113636119 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f40d405c400 con 0x7f40e4074af0 2024-05-09T05:53:56.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.251+0000 7f40e8ace640 1 -- 172.21.15.72:0/113636119 --> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f40e4165c60 con 0x7f40c406f400 2024-05-09T05:53:56.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.279+0000 7f40d2ffd640 1 -- 172.21.15.72:0/113636119 <== mgr.4102 v2:172.21.15.110:6832/1113420672 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332549 (secure 0 0 0) 0x7f40e4165c60 con 0x7f40c406f400 2024-05-09T05:53:56.270 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:53:56.272 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2024-05-09T05:53:56.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.279+0000 7f40e8ace640 1 -- 172.21.15.72:0/113636119 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f40c406f400 msgr2=0x7f40c4071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:56.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.279+0000 7f40e8ace640 1 --2- 172.21.15.72:0/113636119 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f40c406f400 0x7f40c4071910 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f40d80ad000 tx=0x7f40d8008040 comp rx=0 tx=0).stop 2024-05-09T05:53:56.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.279+0000 7f40e8ace640 1 -- 172.21.15.72:0/113636119 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40e4074af0 msgr2=0x7f40e4158f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:56.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.279+0000 7f40e8ace640 1 --2- 172.21.15.72:0/113636119 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40e4074af0 0x7f40e4158f20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f40d400e870 tx=0x7f40d400ec70 comp rx=0 tx=0).stop 2024-05-09T05:53:56.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.279+0000 7f40e8ace640 1 -- 172.21.15.72:0/113636119 shutdown_connections 2024-05-09T05:53:56.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.279+0000 7f40e8ace640 1 --2- 172.21.15.72:0/113636119 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f40c406f400 0x7f40c4071910 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:56.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.279+0000 7f40e8ace640 1 --2- 172.21.15.72:0/113636119 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f40e415dea0 0x7f40e41f9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:56.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.279+0000 7f40e8ace640 1 --2- 172.21.15.72:0/113636119 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40e415da90 0x7f40e41f9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:56.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.279+0000 7f40e8ace640 1 --2- 172.21.15.72:0/113636119 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40e4074af0 0x7f40e4158f20 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:56.273 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.279+0000 7f40e8ace640 1 -- 172.21.15.72:0/113636119 >> 172.21.15.72:0/113636119 conn(0x7f40e40cde90 msgr2=0x7f40e40c96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:56.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.279+0000 7f40e8ace640 1 -- 172.21.15.72:0/113636119 shutdown_connections 2024-05-09T05:53:56.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.279+0000 7f40e8ace640 1 -- 172.21.15.72:0/113636119 wait complete. 2024-05-09T05:53:56.291 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2024-05-09T05:53:54.473689+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595030,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":162,"num_write_kb":1653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236056,"kb_used_data":3240,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738664,"statfs":{"total":773094113280,"available":772852391936,"internally_reserved":0,"allocated":3317760,"data_stored":2004280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":22,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006136"},"pg_stats":[{"pgid":"2.1f","version":"24'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.214757+0000","last_change":"2024-05-09T05:53:23.121824+0000","last_active":"2024-05-09T05:53:29.214757+0000","last_peered":"2024-05-09T05:53:29.214757+0000","last_clean":"2024-05-09T05:53:29.214757+0000","last_became_active":"2024-05-09T05:53:23.121097+0000","last_became_peered":"2024-05-09T05:53:23.121097+0000","last_unstale":"2024-05-09T05:53:29.214757+0000","last_undegraded":"2024-05-09T05:53:29.214757+0000","last_fullsized":"2024-05-09T05:53:29.214757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:50:51.880238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.698789+0000","last_change":"2024-05-09T05:53:24.146985+0000","last_active":"2024-05-09T05:53:29.698789+0000","last_peered":"2024-05-09T05:53:29.698789+0000","last_clean":"2024-05-09T05:53:29.698789+0000","last_became_active":"2024-05-09T05:53:24.146540+0000","last_became_peered":"2024-05-09T05:53:24.146540+0000","last_unstale":"2024-05-09T05:53:29.698789+0000","last_undegraded":"2024-05-09T05:53:29.698789+0000","last_fullsized":"2024-05-09T05:53:29.698789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:02:29.318131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.696155+0000","last_change":"2024-05-09T05:53:28.236386+0000","last_active":"2024-05-09T05:53:29.696155+0000","last_peered":"2024-05-09T05:53:29.696155+0000","last_clean":"2024-05-09T05:53:29.696155+0000","last_became_active":"2024-05-09T05:53:28.235305+0000","last_became_peered":"2024-05-09T05:53:28.235305+0000","last_unstale":"2024-05-09T05:53:29.696155+0000","last_undegraded":"2024-05-09T05:53:29.696155+0000","last_fullsized":"2024-05-09T05:53:29.696155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:57:57.134819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.699128+0000","last_change":"2024-05-09T05:53:23.139000+0000","last_active":"2024-05-09T05:53:29.699128+0000","last_peered":"2024-05-09T05:53:29.699128+0000","last_clean":"2024-05-09T05:53:29.699128+0000","last_became_active":"2024-05-09T05:53:23.138431+0000","last_became_peered":"2024-05-09T05:53:23.138431+0000","last_unstale":"2024-05-09T05:53:29.699128+0000","last_undegraded":"2024-05-09T05:53:29.699128+0000","last_fullsized":"2024-05-09T05:53:29.699128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:33:56.977263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.699378+0000","last_change":"2024-05-09T05:53:24.151811+0000","last_active":"2024-05-09T05:53:29.699378+0000","last_peered":"2024-05-09T05:53:29.699378+0000","last_clean":"2024-05-09T05:53:29.699378+0000","last_became_active":"2024-05-09T05:53:24.151407+0000","last_became_peered":"2024-05-09T05:53:24.151407+0000","last_unstale":"2024-05-09T05:53:29.699378+0000","last_undegraded":"2024-05-09T05:53:29.699378+0000","last_fullsized":"2024-05-09T05:53:29.699378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:54:17.819787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.329660+0000","last_change":"2024-05-09T05:53:28.213485+0000","last_active":"2024-05-09T05:53:29.329660+0000","last_peered":"2024-05-09T05:53:29.329660+0000","last_clean":"2024-05-09T05:53:29.329660+0000","last_became_active":"2024-05-09T05:53:28.213021+0000","last_became_peered":"2024-05-09T05:53:28.213021+0000","last_unstale":"2024-05-09T05:53:29.329660+0000","last_undegraded":"2024-05-09T05:53:29.329660+0000","last_fullsized":"2024-05-09T05:53:29.329660+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:58:22.493166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.519704+0000","last_change":"2024-05-09T05:53:23.095209+0000","last_active":"2024-05-09T05:53:29.519704+0000","last_peered":"2024-05-09T05:53:29.519704+0000","last_clean":"2024-05-09T05:53:29.519704+0000","last_became_active":"2024-05-09T05:53:23.094826+0000","last_became_peered":"2024-05-09T05:53:23.094826+0000","last_unstale":"2024-05-09T05:53:29.519704+0000","last_undegraded":"2024-05-09T05:53:29.519704+0000","last_fullsized":"2024-05-09T05:53:29.519704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:38:47.390311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.211795+0000","last_change":"2024-05-09T05:53:24.135281+0000","last_active":"2024-05-09T05:53:29.211795+0000","last_peered":"2024-05-09T05:53:29.211795+0000","last_clean":"2024-05-09T05:53:29.211795+0000","last_became_active":"2024-05-09T05:53:24.134610+0000","last_became_peered":"2024-05-09T05:53:24.134610+0000","last_unstale":"2024-05-09T05:53:29.211795+0000","last_undegraded":"2024-05-09T05:53:29.211795+0000","last_fullsized":"2024-05-09T05:53:29.211795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:28:03.947961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.329917+0000","last_change":"2024-05-09T05:53:28.205763+0000","last_active":"2024-05-09T05:53:29.329917+0000","last_peered":"2024-05-09T05:53:29.329917+0000","last_clean":"2024-05-09T05:53:29.329917+0000","last_became_active":"2024-05-09T05:53:28.205229+0000","last_became_peered":"2024-05-09T05:53:28.205229+0000","last_unstale":"2024-05-09T05:53:29.329917+0000","last_undegraded":"2024-05-09T05:53:29.329917+0000","last_fullsized":"2024-05-09T05:53:29.329917+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:38:51.267769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.519170+0000","last_change":"2024-05-09T05:53:23.097616+0000","last_active":"2024-05-09T05:53:29.519170+0000","last_peered":"2024-05-09T05:53:29.519170+0000","last_clean":"2024-05-09T05:53:29.519170+0000","last_became_active":"2024-05-09T05:53:23.094760+0000","last_became_peered":"2024-05-09T05:53:23.094760+0000","last_unstale":"2024-05-09T05:53:29.519170+0000","last_undegraded":"2024-05-09T05:53:29.519170+0000","last_fullsized":"2024-05-09T05:53:29.519170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:21:32.558852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.214927+0000","last_change":"2024-05-09T05:53:24.139467+0000","last_active":"2024-05-09T05:53:29.214927+0000","last_peered":"2024-05-09T05:53:29.214927+0000","last_clean":"2024-05-09T05:53:29.214927+0000","last_became_active":"2024-05-09T05:53:24.139109+0000","last_became_peered":"2024-05-09T05:53:24.139109+0000","last_unstale":"2024-05-09T05:53:29.214927+0000","last_undegraded":"2024-05-09T05:53:29.214927+0000","last_fullsized":"2024-05-09T05:53:29.214927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:36.783615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.329829+0000","last_change":"2024-05-09T05:53:28.216127+0000","last_active":"2024-05-09T05:53:29.329829+0000","last_peered":"2024-05-09T05:53:29.329829+0000","last_clean":"2024-05-09T05:53:29.329829+0000","last_became_active":"2024-05-09T05:53:28.215482+0000","last_became_peered":"2024-05-09T05:53:28.215482+0000","last_unstale":"2024-05-09T05:53:29.329829+0000","last_undegraded":"2024-05-09T05:53:29.329829+0000","last_fullsized":"2024-05-09T05:53:29.329829+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:48:58.387701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.213472+0000","last_change":"2024-05-09T05:53:24.132483+0000","last_active":"2024-05-09T05:53:29.213472+0000","last_peered":"2024-05-09T05:53:29.213472+0000","last_clean":"2024-05-09T05:53:29.213472+0000","last_became_active":"2024-05-09T05:53:24.132118+0000","last_became_peered":"2024-05-09T05:53:24.132118+0000","last_unstale":"2024-05-09T05:53:29.213472+0000","last_undegraded":"2024-05-09T05:53:29.213472+0000","last_fullsized":"2024-05-09T05:53:29.213472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:06:01.787707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"25'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:53.611814+0000","last_change":"2024-05-09T05:53:23.117460+0000","last_active":"2024-05-09T05:53:53.611814+0000","last_peered":"2024-05-09T05:53:53.611814+0000","last_clean":"2024-05-09T05:53:53.611814+0000","last_became_active":"2024-05-09T05:53:23.114179+0000","last_became_peered":"2024-05-09T05:53:23.114179+0000","last_unstale":"2024-05-09T05:53:53.611814+0000","last_undegraded":"2024-05-09T05:53:53.611814+0000","last_fullsized":"2024-05-09T05:53:53.611814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:44:01.784905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.214595+0000","last_change":"2024-05-09T05:53:28.227135+0000","last_active":"2024-05-09T05:53:29.214595+0000","last_peered":"2024-05-09T05:53:29.214595+0000","last_clean":"2024-05-09T05:53:29.214595+0000","last_became_active":"2024-05-09T05:53:28.226427+0000","last_became_peered":"2024-05-09T05:53:28.226427+0000","last_unstale":"2024-05-09T05:53:29.214595+0000","last_undegraded":"2024-05-09T05:53:29.214595+0000","last_fullsized":"2024-05-09T05:53:29.214595+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:37:04.413804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.695764+0000","last_change":"2024-05-09T05:53:24.135982+0000","last_active":"2024-05-09T05:53:29.695764+0000","last_peered":"2024-05-09T05:53:29.695764+0000","last_clean":"2024-05-09T05:53:29.695764+0000","last_became_active":"2024-05-09T05:53:24.135580+0000","last_became_peered":"2024-05-09T05:53:24.135580+0000","last_unstale":"2024-05-09T05:53:29.695764+0000","last_undegraded":"2024-05-09T05:53:29.695764+0000","last_fullsized":"2024-05-09T05:53:29.695764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:03:04.589608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.696302+0000","last_change":"2024-05-09T05:53:23.142679+0000","last_active":"2024-05-09T05:53:29.696302+0000","last_peered":"2024-05-09T05:53:29.696302+0000","last_clean":"2024-05-09T05:53:29.696302+0000","last_became_active":"2024-05-09T05:53:23.142018+0000","last_became_peered":"2024-05-09T05:53:23.142018+0000","last_unstale":"2024-05-09T05:53:29.696302+0000","last_undegraded":"2024-05-09T05:53:29.696302+0000","last_fullsized":"2024-05-09T05:53:29.696302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:08:29.312049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.518874+0000","last_change":"2024-05-09T05:53:28.214167+0000","last_active":"2024-05-09T05:53:29.518874+0000","last_peered":"2024-05-09T05:53:29.518874+0000","last_clean":"2024-05-09T05:53:29.518874+0000","last_became_active":"2024-05-09T05:53:28.213623+0000","last_became_peered":"2024-05-09T05:53:28.213623+0000","last_unstale":"2024-05-09T05:53:29.518874+0000","last_undegraded":"2024-05-09T05:53:29.518874+0000","last_fullsized":"2024-05-09T05:53:29.518874+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:53:53.976485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.212618+0000","last_change":"2024-05-09T05:53:24.130342+0000","last_active":"2024-05-09T05:53:29.212618+0000","last_peered":"2024-05-09T05:53:29.212618+0000","last_clean":"2024-05-09T05:53:29.212618+0000","last_became_active":"2024-05-09T05:53:24.129938+0000","last_became_peered":"2024-05-09T05:53:24.129938+0000","last_unstale":"2024-05-09T05:53:29.212618+0000","last_undegraded":"2024-05-09T05:53:29.212618+0000","last_fullsized":"2024-05-09T05:53:29.212618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:58:13.879633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.213484+0000","last_change":"2024-05-09T05:53:23.111169+0000","last_active":"2024-05-09T05:53:29.213484+0000","last_peered":"2024-05-09T05:53:29.213484+0000","last_clean":"2024-05-09T05:53:29.213484+0000","last_became_active":"2024-05-09T05:53:23.110140+0000","last_became_peered":"2024-05-09T05:53:23.110140+0000","last_unstale":"2024-05-09T05:53:29.213484+0000","last_undegraded":"2024-05-09T05:53:29.213484+0000","last_fullsized":"2024-05-09T05:53:29.213484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:18:55.367553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.696432+0000","last_change":"2024-05-09T05:53:28.233648+0000","last_active":"2024-05-09T05:53:29.696432+0000","last_peered":"2024-05-09T05:53:29.696432+0000","last_clean":"2024-05-09T05:53:29.696432+0000","last_became_active":"2024-05-09T05:53:28.227087+0000","last_became_peered":"2024-05-09T05:53:28.227087+0000","last_unstale":"2024-05-09T05:53:29.696432+0000","last_undegraded":"2024-05-09T05:53:29.696432+0000","last_fullsized":"2024-05-09T05:53:29.696432+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:03:49.709580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.213120+0000","last_change":"2024-05-09T05:53:24.147343+0000","last_active":"2024-05-09T05:53:29.213120+0000","last_peered":"2024-05-09T05:53:29.213120+0000","last_clean":"2024-05-09T05:53:29.213120+0000","last_became_active":"2024-05-09T05:53:24.144596+0000","last_became_peered":"2024-05-09T05:53:24.144596+0000","last_unstale":"2024-05-09T05:53:29.213120+0000","last_undegraded":"2024-05-09T05:53:29.213120+0000","last_fullsized":"2024-05-09T05:53:29.213120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:52:43.052055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.517799+0000","last_change":"2024-05-09T05:53:23.102976+0000","last_active":"2024-05-09T05:53:29.517799+0000","last_peered":"2024-05-09T05:53:29.517799+0000","last_clean":"2024-05-09T05:53:29.517799+0000","last_became_active":"2024-05-09T05:53:23.102420+0000","last_became_peered":"2024-05-09T05:53:23.102420+0000","last_unstale":"2024-05-09T05:53:29.517799+0000","last_undegraded":"2024-05-09T05:53:29.517799+0000","last_fullsized":"2024-05-09T05:53:29.517799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:45:11.479140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.329786+0000","last_change":"2024-05-09T05:53:28.195537+0000","last_active":"2024-05-09T05:53:29.329786+0000","last_peered":"2024-05-09T05:53:29.329786+0000","last_clean":"2024-05-09T05:53:29.329786+0000","last_became_active":"2024-05-09T05:53:28.194915+0000","last_became_peered":"2024-05-09T05:53:28.194915+0000","last_unstale":"2024-05-09T05:53:29.329786+0000","last_undegraded":"2024-05-09T05:53:29.329786+0000","last_fullsized":"2024-05-09T05:53:29.329786+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:07.554137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.214059+0000","last_change":"2024-05-09T05:53:24.130312+0000","last_active":"2024-05-09T05:53:29.214059+0000","last_peered":"2024-05-09T05:53:29.214059+0000","last_clean":"2024-05-09T05:53:29.214059+0000","last_became_active":"2024-05-09T05:53:24.129953+0000","last_became_peered":"2024-05-09T05:53:24.129953+0000","last_unstale":"2024-05-09T05:53:29.214059+0000","last_undegraded":"2024-05-09T05:53:29.214059+0000","last_fullsized":"2024-05-09T05:53:29.214059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:07:09.368521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:53.609218+0000","last_change":"2024-05-09T05:53:23.127219+0000","last_active":"2024-05-09T05:53:53.609218+0000","last_peered":"2024-05-09T05:53:53.609218+0000","last_clean":"2024-05-09T05:53:53.609218+0000","last_became_active":"2024-05-09T05:53:23.126691+0000","last_became_peered":"2024-05-09T05:53:23.126691+0000","last_unstale":"2024-05-09T05:53:53.609218+0000","last_undegraded":"2024-05-09T05:53:53.609218+0000","last_fullsized":"2024-05-09T05:53:53.609218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:17:26.711941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.329067+0000","last_change":"2024-05-09T05:53:28.191045+0000","last_active":"2024-05-09T05:53:29.329067+0000","last_peered":"2024-05-09T05:53:29.329067+0000","last_clean":"2024-05-09T05:53:29.329067+0000","last_became_active":"2024-05-09T05:53:28.190564+0000","last_became_peered":"2024-05-09T05:53:28.190564+0000","last_unstale":"2024-05-09T05:53:29.329067+0000","last_undegraded":"2024-05-09T05:53:29.329067+0000","last_fullsized":"2024-05-09T05:53:29.329067+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:53:30.541681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.214756+0000","last_change":"2024-05-09T05:53:24.138682+0000","last_active":"2024-05-09T05:53:29.214756+0000","last_peered":"2024-05-09T05:53:29.214756+0000","last_clean":"2024-05-09T05:53:29.214756+0000","last_became_active":"2024-05-09T05:53:24.138417+0000","last_became_peered":"2024-05-09T05:53:24.138417+0000","last_unstale":"2024-05-09T05:53:29.214756+0000","last_undegraded":"2024-05-09T05:53:29.214756+0000","last_fullsized":"2024-05-09T05:53:29.214756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:57:55.403156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.214850+0000","last_change":"2024-05-09T05:53:23.102986+0000","last_active":"2024-05-09T05:53:29.214850+0000","last_peered":"2024-05-09T05:53:29.214850+0000","last_clean":"2024-05-09T05:53:29.214850+0000","last_became_active":"2024-05-09T05:53:23.102020+0000","last_became_peered":"2024-05-09T05:53:23.102020+0000","last_unstale":"2024-05-09T05:53:29.214850+0000","last_undegraded":"2024-05-09T05:53:29.214850+0000","last_fullsized":"2024-05-09T05:53:29.214850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:18:11.582575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.213744+0000","last_change":"2024-05-09T05:53:28.218326+0000","last_active":"2024-05-09T05:53:29.213744+0000","last_peered":"2024-05-09T05:53:29.213744+0000","last_clean":"2024-05-09T05:53:29.213744+0000","last_became_active":"2024-05-09T05:53:28.216634+0000","last_became_peered":"2024-05-09T05:53:28.216634+0000","last_unstale":"2024-05-09T05:53:29.213744+0000","last_undegraded":"2024-05-09T05:53:29.213744+0000","last_fullsized":"2024-05-09T05:53:29.213744+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:13:05.321932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.698266+0000","last_change":"2024-05-09T05:53:24.143161+0000","last_active":"2024-05-09T05:53:29.698266+0000","last_peered":"2024-05-09T05:53:29.698266+0000","last_clean":"2024-05-09T05:53:29.698266+0000","last_became_active":"2024-05-09T05:53:24.139369+0000","last_became_peered":"2024-05-09T05:53:24.139369+0000","last_unstale":"2024-05-09T05:53:29.698266+0000","last_undegraded":"2024-05-09T05:53:29.698266+0000","last_fullsized":"2024-05-09T05:53:29.698266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:25:21.472460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"25'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.216371+0000","last_change":"2024-05-09T05:53:23.123560+0000","last_active":"2024-05-09T05:53:29.216371+0000","last_peered":"2024-05-09T05:53:29.216371+0000","last_clean":"2024-05-09T05:53:29.216371+0000","last_became_active":"2024-05-09T05:53:23.123081+0000","last_became_peered":"2024-05-09T05:53:23.123081+0000","last_unstale":"2024-05-09T05:53:29.216371+0000","last_undegraded":"2024-05-09T05:53:29.216371+0000","last_fullsized":"2024-05-09T05:53:29.216371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:15:31.371756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.695946+0000","last_change":"2024-05-09T05:53:28.229352+0000","last_active":"2024-05-09T05:53:29.695946+0000","last_peered":"2024-05-09T05:53:29.695946+0000","last_clean":"2024-05-09T05:53:29.695946+0000","last_became_active":"2024-05-09T05:53:28.225810+0000","last_became_peered":"2024-05-09T05:53:28.225810+0000","last_unstale":"2024-05-09T05:53:29.695946+0000","last_undegraded":"2024-05-09T05:53:29.695946+0000","last_fullsized":"2024-05-09T05:53:29.695946+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:17:07.192105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.329438+0000","last_change":"2024-05-09T05:53:24.130533+0000","last_active":"2024-05-09T05:53:29.329438+0000","last_peered":"2024-05-09T05:53:29.329438+0000","last_clean":"2024-05-09T05:53:29.329438+0000","last_became_active":"2024-05-09T05:53:24.129787+0000","last_became_peered":"2024-05-09T05:53:24.129787+0000","last_unstale":"2024-05-09T05:53:29.329438+0000","last_undegraded":"2024-05-09T05:53:29.329438+0000","last_fullsized":"2024-05-09T05:53:29.329438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:37:36.036271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.698698+0000","last_change":"2024-05-09T05:53:23.134379+0000","last_active":"2024-05-09T05:53:29.698698+0000","last_peered":"2024-05-09T05:53:29.698698+0000","last_clean":"2024-05-09T05:53:29.698698+0000","last_became_active":"2024-05-09T05:53:23.133587+0000","last_became_peered":"2024-05-09T05:53:23.133587+0000","last_unstale":"2024-05-09T05:53:29.698698+0000","last_undegraded":"2024-05-09T05:53:29.698698+0000","last_fullsized":"2024-05-09T05:53:29.698698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:00:33.973787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.695393+0000","last_change":"2024-05-09T05:53:28.233620+0000","last_active":"2024-05-09T05:53:29.695393+0000","last_peered":"2024-05-09T05:53:29.695393+0000","last_clean":"2024-05-09T05:53:29.695393+0000","last_became_active":"2024-05-09T05:53:28.232539+0000","last_became_peered":"2024-05-09T05:53:28.232539+0000","last_unstale":"2024-05-09T05:53:29.695393+0000","last_undegraded":"2024-05-09T05:53:29.695393+0000","last_fullsized":"2024-05-09T05:53:29.695393+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:13.789448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.519002+0000","last_change":"2024-05-09T05:53:24.132702+0000","last_active":"2024-05-09T05:53:29.519002+0000","last_peered":"2024-05-09T05:53:29.519002+0000","last_clean":"2024-05-09T05:53:29.519002+0000","last_became_active":"2024-05-09T05:53:24.132309+0000","last_became_peered":"2024-05-09T05:53:24.132309+0000","last_unstale":"2024-05-09T05:53:29.519002+0000","last_undegraded":"2024-05-09T05:53:29.519002+0000","last_fullsized":"2024-05-09T05:53:29.519002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:53:13.592038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.214038+0000","last_change":"2024-05-09T05:53:23.120384+0000","last_active":"2024-05-09T05:53:29.214038+0000","last_peered":"2024-05-09T05:53:29.214038+0000","last_clean":"2024-05-09T05:53:29.214038+0000","last_became_active":"2024-05-09T05:53:23.118321+0000","last_became_peered":"2024-05-09T05:53:23.118321+0000","last_unstale":"2024-05-09T05:53:29.214038+0000","last_undegraded":"2024-05-09T05:53:29.214038+0000","last_fullsized":"2024-05-09T05:53:29.214038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:15:51.297111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.697961+0000","last_change":"2024-05-09T05:53:28.208383+0000","last_active":"2024-05-09T05:53:29.697961+0000","last_peered":"2024-05-09T05:53:29.697961+0000","last_clean":"2024-05-09T05:53:29.697961+0000","last_became_active":"2024-05-09T05:53:28.199359+0000","last_became_peered":"2024-05-09T05:53:28.199359+0000","last_unstale":"2024-05-09T05:53:29.697961+0000","last_undegraded":"2024-05-09T05:53:29.697961+0000","last_fullsized":"2024-05-09T05:53:29.697961+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:50:19.715242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.696850+0000","last_change":"2024-05-09T05:53:24.142740+0000","last_active":"2024-05-09T05:53:29.696850+0000","last_peered":"2024-05-09T05:53:29.696850+0000","last_clean":"2024-05-09T05:53:29.696850+0000","last_became_active":"2024-05-09T05:53:24.142265+0000","last_became_peered":"2024-05-09T05:53:24.142265+0000","last_unstale":"2024-05-09T05:53:29.696850+0000","last_undegraded":"2024-05-09T05:53:29.696850+0000","last_fullsized":"2024-05-09T05:53:29.696850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:46:53.729151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.696611+0000","last_change":"2024-05-09T05:53:23.142455+0000","last_active":"2024-05-09T05:53:29.696611+0000","last_peered":"2024-05-09T05:53:29.696611+0000","last_clean":"2024-05-09T05:53:29.696611+0000","last_became_active":"2024-05-09T05:53:23.141770+0000","last_became_peered":"2024-05-09T05:53:23.141770+0000","last_unstale":"2024-05-09T05:53:29.696611+0000","last_undegraded":"2024-05-09T05:53:29.696611+0000","last_fullsized":"2024-05-09T05:53:29.696611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:30:34.301349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.697220+0000","last_change":"2024-05-09T05:53:28.212176+0000","last_active":"2024-05-09T05:53:29.697220+0000","last_peered":"2024-05-09T05:53:29.697220+0000","last_clean":"2024-05-09T05:53:29.697220+0000","last_became_active":"2024-05-09T05:53:28.210981+0000","last_became_peered":"2024-05-09T05:53:28.210981+0000","last_unstale":"2024-05-09T05:53:29.697220+0000","last_undegraded":"2024-05-09T05:53:29.697220+0000","last_fullsized":"2024-05-09T05:53:29.697220+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:17:24.122805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.698671+0000","last_change":"2024-05-09T05:53:24.132887+0000","last_active":"2024-05-09T05:53:29.698671+0000","last_peered":"2024-05-09T05:53:29.698671+0000","last_clean":"2024-05-09T05:53:29.698671+0000","last_became_active":"2024-05-09T05:53:24.132398+0000","last_became_peered":"2024-05-09T05:53:24.132398+0000","last_unstale":"2024-05-09T05:53:29.698671+0000","last_undegraded":"2024-05-09T05:53:29.698671+0000","last_fullsized":"2024-05-09T05:53:29.698671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:36:49.369162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"25'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.213099+0000","last_change":"2024-05-09T05:53:23.126202+0000","last_active":"2024-05-09T05:53:29.213099+0000","last_peered":"2024-05-09T05:53:29.213099+0000","last_clean":"2024-05-09T05:53:29.213099+0000","last_became_active":"2024-05-09T05:53:23.125799+0000","last_became_peered":"2024-05-09T05:53:23.125799+0000","last_unstale":"2024-05-09T05:53:29.213099+0000","last_undegraded":"2024-05-09T05:53:29.213099+0000","last_fullsized":"2024-05-09T05:53:29.213099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:33:12.831705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.698065+0000","last_change":"2024-05-09T05:53:28.241997+0000","last_active":"2024-05-09T05:53:29.698065+0000","last_peered":"2024-05-09T05:53:29.698065+0000","last_clean":"2024-05-09T05:53:29.698065+0000","last_became_active":"2024-05-09T05:53:28.240989+0000","last_became_peered":"2024-05-09T05:53:28.240989+0000","last_unstale":"2024-05-09T05:53:29.698065+0000","last_undegraded":"2024-05-09T05:53:29.698065+0000","last_fullsized":"2024-05-09T05:53:29.698065+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:24:16.820771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.213186+0000","last_change":"2024-05-09T05:53:24.139586+0000","last_active":"2024-05-09T05:53:29.213186+0000","last_peered":"2024-05-09T05:53:29.213186+0000","last_clean":"2024-05-09T05:53:29.213186+0000","last_became_active":"2024-05-09T05:53:24.138835+0000","last_became_peered":"2024-05-09T05:53:24.138835+0000","last_unstale":"2024-05-09T05:53:29.213186+0000","last_undegraded":"2024-05-09T05:53:29.213186+0000","last_fullsized":"2024-05-09T05:53:29.213186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:37:13.012588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"25'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:53.614348+0000","last_change":"2024-05-09T05:53:23.117121+0000","last_active":"2024-05-09T05:53:53.614348+0000","last_peered":"2024-05-09T05:53:53.614348+0000","last_clean":"2024-05-09T05:53:53.614348+0000","last_became_active":"2024-05-09T05:53:23.113294+0000","last_became_peered":"2024-05-09T05:53:23.113294+0000","last_unstale":"2024-05-09T05:53:53.614348+0000","last_undegraded":"2024-05-09T05:53:53.614348+0000","last_fullsized":"2024-05-09T05:53:53.614348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:53:41.591371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":117,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.210326+0000","last_change":"2024-05-09T05:53:12.484358+0000","last_active":"2024-05-09T05:53:29.210326+0000","last_peered":"2024-05-09T05:53:29.210326+0000","last_clean":"2024-05-09T05:53:29.210326+0000","last_became_active":"2024-05-09T05:53:12.481529+0000","last_became_peered":"2024-05-09T05:53:12.481529+0000","last_unstale":"2024-05-09T05:53:29.210326+0000","last_undegraded":"2024-05-09T05:53:29.210326+0000","last_fullsized":"2024-05-09T05:53:29.210326+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:10.902489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:10.902489+0000","last_clean_scrub_stamp":"2024-05-09T05:53:10.902489+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:28:50.650299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.215635+0000","last_change":"2024-05-09T05:53:28.190861+0000","last_active":"2024-05-09T05:53:29.215635+0000","last_peered":"2024-05-09T05:53:29.215635+0000","last_clean":"2024-05-09T05:53:29.215635+0000","last_became_active":"2024-05-09T05:53:28.190393+0000","last_became_peered":"2024-05-09T05:53:28.190393+0000","last_unstale":"2024-05-09T05:53:29.215635+0000","last_undegraded":"2024-05-09T05:53:29.215635+0000","last_fullsized":"2024-05-09T05:53:29.215635+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:05:37.653010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.215187+0000","last_change":"2024-05-09T05:53:24.143283+0000","last_active":"2024-05-09T05:53:29.215187+0000","last_peered":"2024-05-09T05:53:29.215187+0000","last_clean":"2024-05-09T05:53:29.215187+0000","last_became_active":"2024-05-09T05:53:24.139813+0000","last_became_peered":"2024-05-09T05:53:24.139813+0000","last_unstale":"2024-05-09T05:53:29.215187+0000","last_undegraded":"2024-05-09T05:53:29.215187+0000","last_fullsized":"2024-05-09T05:53:29.215187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:07:38.471778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.698418+0000","last_change":"2024-05-09T05:53:23.115534+0000","last_active":"2024-05-09T05:53:29.698418+0000","last_peered":"2024-05-09T05:53:29.698418+0000","last_clean":"2024-05-09T05:53:29.698418+0000","last_became_active":"2024-05-09T05:53:23.112260+0000","last_became_peered":"2024-05-09T05:53:23.112260+0000","last_unstale":"2024-05-09T05:53:29.698418+0000","last_undegraded":"2024-05-09T05:53:29.698418+0000","last_fullsized":"2024-05-09T05:53:29.698418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:46:53.520691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.330364+0000","last_change":"2024-05-09T05:53:28.195687+0000","last_active":"2024-05-09T05:53:29.330364+0000","last_peered":"2024-05-09T05:53:29.330364+0000","last_clean":"2024-05-09T05:53:29.330364+0000","last_became_active":"2024-05-09T05:53:28.195082+0000","last_became_peered":"2024-05-09T05:53:28.195082+0000","last_unstale":"2024-05-09T05:53:29.330364+0000","last_undegraded":"2024-05-09T05:53:29.330364+0000","last_fullsized":"2024-05-09T05:53:29.330364+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:45:56.633547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.519045+0000","last_change":"2024-05-09T05:53:24.130460+0000","last_active":"2024-05-09T05:53:29.519045+0000","last_peered":"2024-05-09T05:53:29.519045+0000","last_clean":"2024-05-09T05:53:29.519045+0000","last_became_active":"2024-05-09T05:53:24.129808+0000","last_became_peered":"2024-05-09T05:53:24.129808+0000","last_unstale":"2024-05-09T05:53:29.519045+0000","last_undegraded":"2024-05-09T05:53:29.519045+0000","last_fullsized":"2024-05-09T05:53:29.519045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:36:04.881676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.698264+0000","last_change":"2024-05-09T05:53:23.139063+0000","last_active":"2024-05-09T05:53:29.698264+0000","last_peered":"2024-05-09T05:53:29.698264+0000","last_clean":"2024-05-09T05:53:29.698264+0000","last_became_active":"2024-05-09T05:53:23.138303+0000","last_became_peered":"2024-05-09T05:53:23.138303+0000","last_unstale":"2024-05-09T05:53:29.698264+0000","last_undegraded":"2024-05-09T05:53:29.698264+0000","last_fullsized":"2024-05-09T05:53:29.698264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:18:20.172877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.696725+0000","last_change":"2024-05-09T05:53:28.214251+0000","last_active":"2024-05-09T05:53:29.696725+0000","last_peered":"2024-05-09T05:53:29.696725+0000","last_clean":"2024-05-09T05:53:29.696725+0000","last_became_active":"2024-05-09T05:53:28.206229+0000","last_became_peered":"2024-05-09T05:53:28.206229+0000","last_unstale":"2024-05-09T05:53:29.696725+0000","last_undegraded":"2024-05-09T05:53:29.696725+0000","last_fullsized":"2024-05-09T05:53:29.696725+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:12:26.761543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.519894+0000","last_change":"2024-05-09T05:53:24.135578+0000","last_active":"2024-05-09T05:53:29.519894+0000","last_peered":"2024-05-09T05:53:29.519894+0000","last_clean":"2024-05-09T05:53:29.519894+0000","last_became_active":"2024-05-09T05:53:24.135253+0000","last_became_peered":"2024-05-09T05:53:24.135253+0000","last_unstale":"2024-05-09T05:53:29.519894+0000","last_undegraded":"2024-05-09T05:53:29.519894+0000","last_fullsized":"2024-05-09T05:53:29.519894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:20:23.093397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.214436+0000","last_change":"2024-05-09T05:53:23.140175+0000","last_active":"2024-05-09T05:53:29.214436+0000","last_peered":"2024-05-09T05:53:29.214436+0000","last_clean":"2024-05-09T05:53:29.214436+0000","last_became_active":"2024-05-09T05:53:23.139516+0000","last_became_peered":"2024-05-09T05:53:23.139516+0000","last_unstale":"2024-05-09T05:53:29.214436+0000","last_undegraded":"2024-05-09T05:53:29.214436+0000","last_fullsized":"2024-05-09T05:53:29.214436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:48:42.473155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.212056+0000","last_change":"2024-05-09T05:53:28.199385+0000","last_active":"2024-05-09T05:53:29.212056+0000","last_peered":"2024-05-09T05:53:29.212056+0000","last_clean":"2024-05-09T05:53:29.212056+0000","last_became_active":"2024-05-09T05:53:28.198825+0000","last_became_peered":"2024-05-09T05:53:28.198825+0000","last_unstale":"2024-05-09T05:53:29.212056+0000","last_undegraded":"2024-05-09T05:53:29.212056+0000","last_fullsized":"2024-05-09T05:53:29.212056+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:48:22.224140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.330189+0000","last_change":"2024-05-09T05:53:24.133293+0000","last_active":"2024-05-09T05:53:29.330189+0000","last_peered":"2024-05-09T05:53:29.330189+0000","last_clean":"2024-05-09T05:53:29.330189+0000","last_became_active":"2024-05-09T05:53:24.131741+0000","last_became_peered":"2024-05-09T05:53:24.131741+0000","last_unstale":"2024-05-09T05:53:29.330189+0000","last_undegraded":"2024-05-09T05:53:29.330189+0000","last_fullsized":"2024-05-09T05:53:29.330189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:01:33.701742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.520045+0000","last_change":"2024-05-09T05:53:23.112592+0000","last_active":"2024-05-09T05:53:29.520045+0000","last_peered":"2024-05-09T05:53:29.520045+0000","last_clean":"2024-05-09T05:53:29.520045+0000","last_became_active":"2024-05-09T05:53:23.111968+0000","last_became_peered":"2024-05-09T05:53:23.111968+0000","last_unstale":"2024-05-09T05:53:29.520045+0000","last_undegraded":"2024-05-09T05:53:29.520045+0000","last_fullsized":"2024-05-09T05:53:29.520045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:32:54.694588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.210561+0000","last_change":"2024-05-09T05:53:28.227755+0000","last_active":"2024-05-09T05:53:29.210561+0000","last_peered":"2024-05-09T05:53:29.210561+0000","last_clean":"2024-05-09T05:53:29.210561+0000","last_became_active":"2024-05-09T05:53:28.227272+0000","last_became_peered":"2024-05-09T05:53:28.227272+0000","last_unstale":"2024-05-09T05:53:29.210561+0000","last_undegraded":"2024-05-09T05:53:29.210561+0000","last_fullsized":"2024-05-09T05:53:29.210561+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:13:32.020862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.212986+0000","last_change":"2024-05-09T05:53:24.144025+0000","last_active":"2024-05-09T05:53:29.212986+0000","last_peered":"2024-05-09T05:53:29.212986+0000","last_clean":"2024-05-09T05:53:29.212986+0000","last_became_active":"2024-05-09T05:53:24.143540+0000","last_became_peered":"2024-05-09T05:53:24.143540+0000","last_unstale":"2024-05-09T05:53:29.212986+0000","last_undegraded":"2024-05-09T05:53:29.212986+0000","last_fullsized":"2024-05-09T05:53:29.212986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:22:58.062541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"24'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.213687+0000","last_change":"2024-05-09T05:53:23.104452+0000","last_active":"2024-05-09T05:53:29.213687+0000","last_peered":"2024-05-09T05:53:29.213687+0000","last_clean":"2024-05-09T05:53:29.213687+0000","last_became_active":"2024-05-09T05:53:23.103471+0000","last_became_peered":"2024-05-09T05:53:23.103471+0000","last_unstale":"2024-05-09T05:53:29.213687+0000","last_undegraded":"2024-05-09T05:53:29.213687+0000","last_fullsized":"2024-05-09T05:53:29.213687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:33:30.508464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.698789+0000","last_change":"2024-05-09T05:53:28.241338+0000","last_active":"2024-05-09T05:53:29.698789+0000","last_peered":"2024-05-09T05:53:29.698789+0000","last_clean":"2024-05-09T05:53:29.698789+0000","last_became_active":"2024-05-09T05:53:28.239841+0000","last_became_peered":"2024-05-09T05:53:28.239841+0000","last_unstale":"2024-05-09T05:53:29.698789+0000","last_undegraded":"2024-05-09T05:53:29.698789+0000","last_fullsized":"2024-05-09T05:53:29.698789+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:44:47.854598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.210371+0000","last_change":"2024-05-09T05:53:24.149958+0000","last_active":"2024-05-09T05:53:29.210371+0000","last_peered":"2024-05-09T05:53:29.210371+0000","last_clean":"2024-05-09T05:53:29.210371+0000","last_became_active":"2024-05-09T05:53:24.149578+0000","last_became_peered":"2024-05-09T05:53:24.149578+0000","last_unstale":"2024-05-09T05:53:29.210371+0000","last_undegraded":"2024-05-09T05:53:29.210371+0000","last_fullsized":"2024-05-09T05:53:29.210371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:27:43.555218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.518385+0000","last_change":"2024-05-09T05:53:23.121266+0000","last_active":"2024-05-09T05:53:29.518385+0000","last_peered":"2024-05-09T05:53:29.518385+0000","last_clean":"2024-05-09T05:53:29.518385+0000","last_became_active":"2024-05-09T05:53:23.120857+0000","last_became_peered":"2024-05-09T05:53:23.120857+0000","last_unstale":"2024-05-09T05:53:29.518385+0000","last_undegraded":"2024-05-09T05:53:29.518385+0000","last_fullsized":"2024-05-09T05:53:29.518385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:03:30.185640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.698426+0000","last_change":"2024-05-09T05:53:28.240774+0000","last_active":"2024-05-09T05:53:29.698426+0000","last_peered":"2024-05-09T05:53:29.698426+0000","last_clean":"2024-05-09T05:53:29.698426+0000","last_became_active":"2024-05-09T05:53:28.240070+0000","last_became_peered":"2024-05-09T05:53:28.240070+0000","last_unstale":"2024-05-09T05:53:29.698426+0000","last_undegraded":"2024-05-09T05:53:29.698426+0000","last_fullsized":"2024-05-09T05:53:29.698426+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:25:24.019344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.214869+0000","last_change":"2024-05-09T05:53:24.132792+0000","last_active":"2024-05-09T05:53:29.214869+0000","last_peered":"2024-05-09T05:53:29.214869+0000","last_clean":"2024-05-09T05:53:29.214869+0000","last_became_active":"2024-05-09T05:53:24.132439+0000","last_became_peered":"2024-05-09T05:53:24.132439+0000","last_unstale":"2024-05-09T05:53:29.214869+0000","last_undegraded":"2024-05-09T05:53:29.214869+0000","last_fullsized":"2024-05-09T05:53:29.214869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:52:45.857475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"25'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:53.613196+0000","last_change":"2024-05-09T05:53:23.120680+0000","last_active":"2024-05-09T05:53:53.613196+0000","last_peered":"2024-05-09T05:53:53.613196+0000","last_clean":"2024-05-09T05:53:53.613196+0000","last_became_active":"2024-05-09T05:53:23.118358+0000","last_became_peered":"2024-05-09T05:53:23.118358+0000","last_unstale":"2024-05-09T05:53:53.613196+0000","last_undegraded":"2024-05-09T05:53:53.613196+0000","last_fullsized":"2024-05-09T05:53:53.613196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:52:52.360128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.697847+0000","last_change":"2024-05-09T05:53:28.222341+0000","last_active":"2024-05-09T05:53:29.697847+0000","last_peered":"2024-05-09T05:53:29.697847+0000","last_clean":"2024-05-09T05:53:29.697847+0000","last_became_active":"2024-05-09T05:53:28.219636+0000","last_became_peered":"2024-05-09T05:53:28.219636+0000","last_unstale":"2024-05-09T05:53:29.697847+0000","last_undegraded":"2024-05-09T05:53:29.697847+0000","last_fullsized":"2024-05-09T05:53:29.697847+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:29:03.459851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.696019+0000","last_change":"2024-05-09T05:53:24.143495+0000","last_active":"2024-05-09T05:53:29.696019+0000","last_peered":"2024-05-09T05:53:29.696019+0000","last_clean":"2024-05-09T05:53:29.696019+0000","last_became_active":"2024-05-09T05:53:24.143181+0000","last_became_peered":"2024-05-09T05:53:24.143181+0000","last_unstale":"2024-05-09T05:53:29.696019+0000","last_undegraded":"2024-05-09T05:53:29.696019+0000","last_fullsized":"2024-05-09T05:53:29.696019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:40:20.997659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"24'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.698981+0000","last_change":"2024-05-09T05:53:23.114815+0000","last_active":"2024-05-09T05:53:29.698981+0000","last_peered":"2024-05-09T05:53:29.698981+0000","last_clean":"2024-05-09T05:53:29.698981+0000","last_became_active":"2024-05-09T05:53:23.113524+0000","last_became_peered":"2024-05-09T05:53:23.113524+0000","last_unstale":"2024-05-09T05:53:29.698981+0000","last_undegraded":"2024-05-09T05:53:29.698981+0000","last_fullsized":"2024-05-09T05:53:29.698981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:35:45.537715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.216033+0000","last_change":"2024-05-09T05:53:28.226682+0000","last_active":"2024-05-09T05:53:29.216033+0000","last_peered":"2024-05-09T05:53:29.216033+0000","last_clean":"2024-05-09T05:53:29.216033+0000","last_became_active":"2024-05-09T05:53:28.226279+0000","last_became_peered":"2024-05-09T05:53:28.226279+0000","last_unstale":"2024-05-09T05:53:29.216033+0000","last_undegraded":"2024-05-09T05:53:29.216033+0000","last_fullsized":"2024-05-09T05:53:29.216033+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:15:55.146695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.519441+0000","last_change":"2024-05-09T05:53:24.135119+0000","last_active":"2024-05-09T05:53:29.519441+0000","last_peered":"2024-05-09T05:53:29.519441+0000","last_clean":"2024-05-09T05:53:29.519441+0000","last_became_active":"2024-05-09T05:53:24.134690+0000","last_became_peered":"2024-05-09T05:53:24.134690+0000","last_unstale":"2024-05-09T05:53:29.519441+0000","last_undegraded":"2024-05-09T05:53:29.519441+0000","last_fullsized":"2024-05-09T05:53:29.519441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:15:36.608441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:38.739048+0000","last_change":"2024-05-09T05:53:23.119626+0000","last_active":"2024-05-09T05:53:38.739048+0000","last_peered":"2024-05-09T05:53:38.739048+0000","last_clean":"2024-05-09T05:53:38.739048+0000","last_became_active":"2024-05-09T05:53:23.119173+0000","last_became_peered":"2024-05-09T05:53:23.119173+0000","last_unstale":"2024-05-09T05:53:38.739048+0000","last_undegraded":"2024-05-09T05:53:38.739048+0000","last_fullsized":"2024-05-09T05:53:38.739048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:24:03.188897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.213285+0000","last_change":"2024-05-09T05:53:28.223167+0000","last_active":"2024-05-09T05:53:29.213285+0000","last_peered":"2024-05-09T05:53:29.213285+0000","last_clean":"2024-05-09T05:53:29.213285+0000","last_became_active":"2024-05-09T05:53:28.221846+0000","last_became_peered":"2024-05-09T05:53:28.221846+0000","last_unstale":"2024-05-09T05:53:29.213285+0000","last_undegraded":"2024-05-09T05:53:29.213285+0000","last_fullsized":"2024-05-09T05:53:29.213285+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:47:12.366900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.214789+0000","last_change":"2024-05-09T05:53:24.133007+0000","last_active":"2024-05-09T05:53:29.214789+0000","last_peered":"2024-05-09T05:53:29.214789+0000","last_clean":"2024-05-09T05:53:29.214789+0000","last_became_active":"2024-05-09T05:53:24.132545+0000","last_became_peered":"2024-05-09T05:53:24.132545+0000","last_unstale":"2024-05-09T05:53:29.214789+0000","last_undegraded":"2024-05-09T05:53:29.214789+0000","last_fullsized":"2024-05-09T05:53:29.214789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:10:26.299015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"24'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.697142+0000","last_change":"2024-05-09T05:53:23.121124+0000","last_active":"2024-05-09T05:53:29.697142+0000","last_peered":"2024-05-09T05:53:29.697142+0000","last_clean":"2024-05-09T05:53:29.697142+0000","last_became_active":"2024-05-09T05:53:23.120303+0000","last_became_peered":"2024-05-09T05:53:23.120303+0000","last_unstale":"2024-05-09T05:53:29.697142+0000","last_undegraded":"2024-05-09T05:53:29.697142+0000","last_fullsized":"2024-05-09T05:53:29.697142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:36:49.445673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.329359+0000","last_change":"2024-05-09T05:53:28.188712+0000","last_active":"2024-05-09T05:53:29.329359+0000","last_peered":"2024-05-09T05:53:29.329359+0000","last_clean":"2024-05-09T05:53:29.329359+0000","last_became_active":"2024-05-09T05:53:28.184259+0000","last_became_peered":"2024-05-09T05:53:28.184259+0000","last_unstale":"2024-05-09T05:53:29.329359+0000","last_undegraded":"2024-05-09T05:53:29.329359+0000","last_fullsized":"2024-05-09T05:53:29.329359+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:56:39.668106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.698810+0000","last_change":"2024-05-09T05:53:24.146147+0000","last_active":"2024-05-09T05:53:29.698810+0000","last_peered":"2024-05-09T05:53:29.698810+0000","last_clean":"2024-05-09T05:53:29.698810+0000","last_became_active":"2024-05-09T05:53:24.145704+0000","last_became_peered":"2024-05-09T05:53:24.145704+0000","last_unstale":"2024-05-09T05:53:29.698810+0000","last_undegraded":"2024-05-09T05:53:29.698810+0000","last_fullsized":"2024-05-09T05:53:29.698810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:47:03.047479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.519380+0000","last_change":"2024-05-09T05:53:23.095689+0000","last_active":"2024-05-09T05:53:29.519380+0000","last_peered":"2024-05-09T05:53:29.519380+0000","last_clean":"2024-05-09T05:53:29.519380+0000","last_became_active":"2024-05-09T05:53:23.094889+0000","last_became_peered":"2024-05-09T05:53:23.094889+0000","last_unstale":"2024-05-09T05:53:29.519380+0000","last_undegraded":"2024-05-09T05:53:29.519380+0000","last_fullsized":"2024-05-09T05:53:29.519380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:25:35.069184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.694877+0000","last_change":"2024-05-09T05:53:28.223954+0000","last_active":"2024-05-09T05:53:29.694877+0000","last_peered":"2024-05-09T05:53:29.694877+0000","last_clean":"2024-05-09T05:53:29.694877+0000","last_became_active":"2024-05-09T05:53:28.222700+0000","last_became_peered":"2024-05-09T05:53:28.222700+0000","last_unstale":"2024-05-09T05:53:29.694877+0000","last_undegraded":"2024-05-09T05:53:29.694877+0000","last_fullsized":"2024-05-09T05:53:29.694877+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:17:17.864782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.330144+0000","last_change":"2024-05-09T05:53:24.140698+0000","last_active":"2024-05-09T05:53:29.330144+0000","last_peered":"2024-05-09T05:53:29.330144+0000","last_clean":"2024-05-09T05:53:29.330144+0000","last_became_active":"2024-05-09T05:53:24.139612+0000","last_became_peered":"2024-05-09T05:53:24.139612+0000","last_unstale":"2024-05-09T05:53:29.330144+0000","last_undegraded":"2024-05-09T05:53:29.330144+0000","last_fullsized":"2024-05-09T05:53:29.330144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:09:39.609750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.215436+0000","last_change":"2024-05-09T05:53:23.106167+0000","last_active":"2024-05-09T05:53:29.215436+0000","last_peered":"2024-05-09T05:53:29.215436+0000","last_clean":"2024-05-09T05:53:29.215436+0000","last_became_active":"2024-05-09T05:53:23.105346+0000","last_became_peered":"2024-05-09T05:53:23.105346+0000","last_unstale":"2024-05-09T05:53:29.215436+0000","last_undegraded":"2024-05-09T05:53:29.215436+0000","last_fullsized":"2024-05-09T05:53:29.215436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:06:46.109056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.213366+0000","last_change":"2024-05-09T05:53:28.194037+0000","last_active":"2024-05-09T05:53:29.213366+0000","last_peered":"2024-05-09T05:53:29.213366+0000","last_clean":"2024-05-09T05:53:29.213366+0000","last_became_active":"2024-05-09T05:53:28.192944+0000","last_became_peered":"2024-05-09T05:53:28.192944+0000","last_unstale":"2024-05-09T05:53:29.213366+0000","last_undegraded":"2024-05-09T05:53:29.213366+0000","last_fullsized":"2024-05-09T05:53:29.213366+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:28:47.664198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.214534+0000","last_change":"2024-05-09T05:53:28.226664+0000","last_active":"2024-05-09T05:53:29.214534+0000","last_peered":"2024-05-09T05:53:29.214534+0000","last_clean":"2024-05-09T05:53:29.214534+0000","last_became_active":"2024-05-09T05:53:28.222225+0000","last_became_peered":"2024-05-09T05:53:28.222225+0000","last_unstale":"2024-05-09T05:53:29.214534+0000","last_undegraded":"2024-05-09T05:53:29.214534+0000","last_fullsized":"2024-05-09T05:53:29.214534+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:24:23.614210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.213172+0000","last_change":"2024-05-09T05:53:24.128343+0000","last_active":"2024-05-09T05:53:29.213172+0000","last_peered":"2024-05-09T05:53:29.213172+0000","last_clean":"2024-05-09T05:53:29.213172+0000","last_became_active":"2024-05-09T05:53:24.127989+0000","last_became_peered":"2024-05-09T05:53:24.127989+0000","last_unstale":"2024-05-09T05:53:29.213172+0000","last_undegraded":"2024-05-09T05:53:29.213172+0000","last_fullsized":"2024-05-09T05:53:29.213172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:56:14.176175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"25'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.212869+0000","last_change":"2024-05-09T05:53:23.118882+0000","last_active":"2024-05-09T05:53:29.212869+0000","last_peered":"2024-05-09T05:53:29.212869+0000","last_clean":"2024-05-09T05:53:29.212869+0000","last_became_active":"2024-05-09T05:53:23.118119+0000","last_became_peered":"2024-05-09T05:53:23.118119+0000","last_unstale":"2024-05-09T05:53:29.212869+0000","last_undegraded":"2024-05-09T05:53:29.212869+0000","last_fullsized":"2024-05-09T05:53:29.212869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:06:48.203396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.215588+0000","last_change":"2024-05-09T05:53:28.235313+0000","last_active":"2024-05-09T05:53:29.215588+0000","last_peered":"2024-05-09T05:53:29.215588+0000","last_clean":"2024-05-09T05:53:29.215588+0000","last_became_active":"2024-05-09T05:53:28.234771+0000","last_became_peered":"2024-05-09T05:53:28.234771+0000","last_unstale":"2024-05-09T05:53:29.215588+0000","last_undegraded":"2024-05-09T05:53:29.215588+0000","last_fullsized":"2024-05-09T05:53:29.215588+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:38:46.942863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.697143+0000","last_change":"2024-05-09T05:53:24.141956+0000","last_active":"2024-05-09T05:53:29.697143+0000","last_peered":"2024-05-09T05:53:29.697143+0000","last_clean":"2024-05-09T05:53:29.697143+0000","last_became_active":"2024-05-09T05:53:24.139093+0000","last_became_peered":"2024-05-09T05:53:24.139093+0000","last_unstale":"2024-05-09T05:53:29.697143+0000","last_undegraded":"2024-05-09T05:53:29.697143+0000","last_fullsized":"2024-05-09T05:53:29.697143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:44:32.901168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.698890+0000","last_change":"2024-05-09T05:53:23.113865+0000","last_active":"2024-05-09T05:53:29.698890+0000","last_peered":"2024-05-09T05:53:29.698890+0000","last_clean":"2024-05-09T05:53:29.698890+0000","last_became_active":"2024-05-09T05:53:23.112020+0000","last_became_peered":"2024-05-09T05:53:23.112020+0000","last_unstale":"2024-05-09T05:53:29.698890+0000","last_undegraded":"2024-05-09T05:53:29.698890+0000","last_fullsized":"2024-05-09T05:53:29.698890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:37:04.425229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"24'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.213736+0000","last_change":"2024-05-09T05:53:23.127463+0000","last_active":"2024-05-09T05:53:29.213736+0000","last_peered":"2024-05-09T05:53:29.213736+0000","last_clean":"2024-05-09T05:53:29.213736+0000","last_became_active":"2024-05-09T05:53:23.126911+0000","last_became_peered":"2024-05-09T05:53:23.126911+0000","last_unstale":"2024-05-09T05:53:29.213736+0000","last_undegraded":"2024-05-09T05:53:29.213736+0000","last_fullsized":"2024-05-09T05:53:29.213736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:06:28.458926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.213862+0000","last_change":"2024-05-09T05:53:24.134391+0000","last_active":"2024-05-09T05:53:29.213862+0000","last_peered":"2024-05-09T05:53:29.213862+0000","last_clean":"2024-05-09T05:53:29.213862+0000","last_became_active":"2024-05-09T05:53:24.133994+0000","last_became_peered":"2024-05-09T05:53:24.133994+0000","last_unstale":"2024-05-09T05:53:29.213862+0000","last_undegraded":"2024-05-09T05:53:29.213862+0000","last_fullsized":"2024-05-09T05:53:29.213862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:30:32.872657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.213741+0000","last_change":"2024-05-09T05:53:28.223524+0000","last_active":"2024-05-09T05:53:29.213741+0000","last_peered":"2024-05-09T05:53:29.213741+0000","last_clean":"2024-05-09T05:53:29.213741+0000","last_became_active":"2024-05-09T05:53:28.222433+0000","last_became_peered":"2024-05-09T05:53:28.222433+0000","last_unstale":"2024-05-09T05:53:29.213741+0000","last_undegraded":"2024-05-09T05:53:29.213741+0000","last_fullsized":"2024-05-09T05:53:29.213741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:52:35.361812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"24'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.697023+0000","last_change":"2024-05-09T05:53:23.133700+0000","last_active":"2024-05-09T05:53:29.697023+0000","last_peered":"2024-05-09T05:53:29.697023+0000","last_clean":"2024-05-09T05:53:29.697023+0000","last_became_active":"2024-05-09T05:53:23.132946+0000","last_became_peered":"2024-05-09T05:53:23.132946+0000","last_unstale":"2024-05-09T05:53:29.697023+0000","last_undegraded":"2024-05-09T05:53:29.697023+0000","last_fullsized":"2024-05-09T05:53:29.697023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:39:49.829592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.210913+0000","last_change":"2024-05-09T05:53:24.138174+0000","last_active":"2024-05-09T05:53:29.210913+0000","last_peered":"2024-05-09T05:53:29.210913+0000","last_clean":"2024-05-09T05:53:29.210913+0000","last_became_active":"2024-05-09T05:53:24.137794+0000","last_became_peered":"2024-05-09T05:53:24.137794+0000","last_unstale":"2024-05-09T05:53:29.210913+0000","last_undegraded":"2024-05-09T05:53:29.210913+0000","last_fullsized":"2024-05-09T05:53:29.210913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:57:26.359258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.696516+0000","last_change":"2024-05-09T05:53:28.238375+0000","last_active":"2024-05-09T05:53:29.696516+0000","last_peered":"2024-05-09T05:53:29.696516+0000","last_clean":"2024-05-09T05:53:29.696516+0000","last_became_active":"2024-05-09T05:53:28.237414+0000","last_became_peered":"2024-05-09T05:53:28.237414+0000","last_unstale":"2024-05-09T05:53:29.696516+0000","last_undegraded":"2024-05-09T05:53:29.696516+0000","last_fullsized":"2024-05-09T05:53:29.696516+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:13:50.396951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.329027+0000","last_change":"2024-05-09T05:53:24.130839+0000","last_active":"2024-05-09T05:53:29.329027+0000","last_peered":"2024-05-09T05:53:29.329027+0000","last_clean":"2024-05-09T05:53:29.329027+0000","last_became_active":"2024-05-09T05:53:24.130201+0000","last_became_peered":"2024-05-09T05:53:24.130201+0000","last_unstale":"2024-05-09T05:53:29.329027+0000","last_undegraded":"2024-05-09T05:53:29.329027+0000","last_fullsized":"2024-05-09T05:53:29.329027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:26:03.973553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.696321+0000","last_change":"2024-05-09T05:53:24.138681+0000","last_active":"2024-05-09T05:53:29.696321+0000","last_peered":"2024-05-09T05:53:29.696321+0000","last_clean":"2024-05-09T05:53:29.696321+0000","last_became_active":"2024-05-09T05:53:24.138366+0000","last_became_peered":"2024-05-09T05:53:24.138366+0000","last_unstale":"2024-05-09T05:53:29.696321+0000","last_undegraded":"2024-05-09T05:53:29.696321+0000","last_fullsized":"2024-05-09T05:53:29.696321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:49.856205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.213330+0000","last_change":"2024-05-09T05:53:24.139915+0000","last_active":"2024-05-09T05:53:29.213330+0000","last_peered":"2024-05-09T05:53:29.213330+0000","last_clean":"2024-05-09T05:53:29.213330+0000","last_became_active":"2024-05-09T05:53:24.139058+0000","last_became_peered":"2024-05-09T05:53:24.139058+0000","last_unstale":"2024-05-09T05:53:29.213330+0000","last_undegraded":"2024-05-09T05:53:29.213330+0000","last_fullsized":"2024-05-09T05:53:29.213330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:06:00.768431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.696712+0000","last_change":"2024-05-09T05:53:24.149759+0000","last_active":"2024-05-09T05:53:29.696712+0000","last_peered":"2024-05-09T05:53:29.696712+0000","last_clean":"2024-05-09T05:53:29.696712+0000","last_became_active":"2024-05-09T05:53:24.142812+0000","last_became_peered":"2024-05-09T05:53:24.142812+0000","last_unstale":"2024-05-09T05:53:29.696712+0000","last_undegraded":"2024-05-09T05:53:29.696712+0000","last_fullsized":"2024-05-09T05:53:29.696712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:04.522514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.698128+0000","last_change":"2024-05-09T05:53:24.135373+0000","last_active":"2024-05-09T05:53:29.698128+0000","last_peered":"2024-05-09T05:53:29.698128+0000","last_clean":"2024-05-09T05:53:29.698128+0000","last_became_active":"2024-05-09T05:53:24.135043+0000","last_became_peered":"2024-05-09T05:53:24.135043+0000","last_unstale":"2024-05-09T05:53:29.698128+0000","last_undegraded":"2024-05-09T05:53:29.698128+0000","last_fullsized":"2024-05-09T05:53:29.698128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:20:03.245696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.696921+0000","last_change":"2024-05-09T05:53:24.134712+0000","last_active":"2024-05-09T05:53:29.696921+0000","last_peered":"2024-05-09T05:53:29.696921+0000","last_clean":"2024-05-09T05:53:29.696921+0000","last_became_active":"2024-05-09T05:53:24.132453+0000","last_became_peered":"2024-05-09T05:53:24.132453+0000","last_unstale":"2024-05-09T05:53:29.696921+0000","last_undegraded":"2024-05-09T05:53:29.696921+0000","last_fullsized":"2024-05-09T05:53:29.696921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:47:30.716995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.330002+0000","last_change":"2024-05-09T05:53:24.140714+0000","last_active":"2024-05-09T05:53:29.330002+0000","last_peered":"2024-05-09T05:53:29.330002+0000","last_clean":"2024-05-09T05:53:29.330002+0000","last_became_active":"2024-05-09T05:53:24.140045+0000","last_became_peered":"2024-05-09T05:53:24.140045+0000","last_unstale":"2024-05-09T05:53:29.330002+0000","last_undegraded":"2024-05-09T05:53:29.330002+0000","last_fullsized":"2024-05-09T05:53:29.330002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:36:06.166411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.697852+0000","last_change":"2024-05-09T05:53:24.151591+0000","last_active":"2024-05-09T05:53:29.697852+0000","last_peered":"2024-05-09T05:53:29.697852+0000","last_clean":"2024-05-09T05:53:29.697852+0000","last_became_active":"2024-05-09T05:53:24.151275+0000","last_became_peered":"2024-05-09T05:53:24.151275+0000","last_unstale":"2024-05-09T05:53:29.697852+0000","last_undegraded":"2024-05-09T05:53:29.697852+0000","last_fullsized":"2024-05-09T05:53:29.697852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:28:28.552732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.212703+0000","last_change":"2024-05-09T05:53:24.144315+0000","last_active":"2024-05-09T05:53:29.212703+0000","last_peered":"2024-05-09T05:53:29.212703+0000","last_clean":"2024-05-09T05:53:29.212703+0000","last_became_active":"2024-05-09T05:53:24.144005+0000","last_became_peered":"2024-05-09T05:53:24.144005+0000","last_unstale":"2024-05-09T05:53:29.212703+0000","last_undegraded":"2024-05-09T05:53:29.212703+0000","last_fullsized":"2024-05-09T05:53:29.212703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:06:37.312541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.697839+0000","last_change":"2024-05-09T05:53:24.149852+0000","last_active":"2024-05-09T05:53:29.697839+0000","last_peered":"2024-05-09T05:53:29.697839+0000","last_clean":"2024-05-09T05:53:29.697839+0000","last_became_active":"2024-05-09T05:53:24.146965+0000","last_became_peered":"2024-05-09T05:53:24.146965+0000","last_unstale":"2024-05-09T05:53:29.697839+0000","last_undegraded":"2024-05-09T05:53:29.697839+0000","last_fullsized":"2024-05-09T05:53:29.697839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:02:26.991425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.210907+0000","last_change":"2024-05-09T05:53:24.131735+0000","last_active":"2024-05-09T05:53:29.210907+0000","last_peered":"2024-05-09T05:53:29.210907+0000","last_clean":"2024-05-09T05:53:29.210907+0000","last_became_active":"2024-05-09T05:53:24.131417+0000","last_became_peered":"2024-05-09T05:53:24.131417+0000","last_unstale":"2024-05-09T05:53:29.210907+0000","last_undegraded":"2024-05-09T05:53:29.210907+0000","last_fullsized":"2024-05-09T05:53:29.210907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:59.750972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.213503+0000","last_change":"2024-05-09T05:53:24.140697+0000","last_active":"2024-05-09T05:53:29.213503+0000","last_peered":"2024-05-09T05:53:29.213503+0000","last_clean":"2024-05-09T05:53:29.213503+0000","last_became_active":"2024-05-09T05:53:24.140024+0000","last_became_peered":"2024-05-09T05:53:24.140024+0000","last_unstale":"2024-05-09T05:53:29.213503+0000","last_undegraded":"2024-05-09T05:53:29.213503+0000","last_fullsized":"2024-05-09T05:53:29.213503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:14:14.543827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.519088+0000","last_change":"2024-05-09T05:53:24.136878+0000","last_active":"2024-05-09T05:53:29.519088+0000","last_peered":"2024-05-09T05:53:29.519088+0000","last_clean":"2024-05-09T05:53:29.519088+0000","last_became_active":"2024-05-09T05:53:24.136572+0000","last_became_peered":"2024-05-09T05:53:24.136572+0000","last_unstale":"2024-05-09T05:53:29.519088+0000","last_undegraded":"2024-05-09T05:53:29.519088+0000","last_fullsized":"2024-05-09T05:53:29.519088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:46:47.509355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.216011+0000","last_change":"2024-05-09T05:53:24.147372+0000","last_active":"2024-05-09T05:53:29.216011+0000","last_peered":"2024-05-09T05:53:29.216011+0000","last_clean":"2024-05-09T05:53:29.216011+0000","last_became_active":"2024-05-09T05:53:24.144573+0000","last_became_peered":"2024-05-09T05:53:24.144573+0000","last_unstale":"2024-05-09T05:53:29.216011+0000","last_undegraded":"2024-05-09T05:53:29.216011+0000","last_fullsized":"2024-05-09T05:53:29.216011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:51:09.845748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.698543+0000","last_change":"2024-05-09T05:53:24.135964+0000","last_active":"2024-05-09T05:53:29.698543+0000","last_peered":"2024-05-09T05:53:29.698543+0000","last_clean":"2024-05-09T05:53:29.698543+0000","last_became_active":"2024-05-09T05:53:24.135625+0000","last_became_peered":"2024-05-09T05:53:24.135625+0000","last_unstale":"2024-05-09T05:53:29.698543+0000","last_undegraded":"2024-05-09T05:53:29.698543+0000","last_fullsized":"2024-05-09T05:53:29.698543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:52:02.026146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.216721+0000","last_change":"2024-05-09T05:53:24.133916+0000","last_active":"2024-05-09T05:53:29.216721+0000","last_peered":"2024-05-09T05:53:29.216721+0000","last_clean":"2024-05-09T05:53:29.216721+0000","last_became_active":"2024-05-09T05:53:24.133405+0000","last_became_peered":"2024-05-09T05:53:24.133405+0000","last_unstale":"2024-05-09T05:53:29.216721+0000","last_undegraded":"2024-05-09T05:53:29.216721+0000","last_fullsized":"2024-05-09T05:53:29.216721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:30:16.477715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.212403+0000","last_change":"2024-05-09T05:53:24.139697+0000","last_active":"2024-05-09T05:53:29.212403+0000","last_peered":"2024-05-09T05:53:29.212403+0000","last_clean":"2024-05-09T05:53:29.212403+0000","last_became_active":"2024-05-09T05:53:24.139374+0000","last_became_peered":"2024-05-09T05:53:24.139374+0000","last_unstale":"2024-05-09T05:53:29.212403+0000","last_undegraded":"2024-05-09T05:53:29.212403+0000","last_fullsized":"2024-05-09T05:53:29.212403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:26:28.502867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.697314+0000","last_change":"2024-05-09T05:53:24.147755+0000","last_active":"2024-05-09T05:53:29.697314+0000","last_peered":"2024-05-09T05:53:29.697314+0000","last_clean":"2024-05-09T05:53:29.697314+0000","last_became_active":"2024-05-09T05:53:24.145616+0000","last_became_peered":"2024-05-09T05:53:24.145616+0000","last_unstale":"2024-05-09T05:53:29.697314+0000","last_undegraded":"2024-05-09T05:53:29.697314+0000","last_fullsized":"2024-05-09T05:53:29.697314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:21:10.387393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.695743+0000","last_change":"2024-05-09T05:53:24.131741+0000","last_active":"2024-05-09T05:53:29.695743+0000","last_peered":"2024-05-09T05:53:29.695743+0000","last_clean":"2024-05-09T05:53:29.695743+0000","last_became_active":"2024-05-09T05:53:24.128870+0000","last_became_peered":"2024-05-09T05:53:24.128870+0000","last_unstale":"2024-05-09T05:53:29.695743+0000","last_undegraded":"2024-05-09T05:53:29.695743+0000","last_fullsized":"2024-05-09T05:53:29.695743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:28:25.103524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.696503+0000","last_change":"2024-05-09T05:53:24.133443+0000","last_active":"2024-05-09T05:53:29.696503+0000","last_peered":"2024-05-09T05:53:29.696503+0000","last_clean":"2024-05-09T05:53:29.696503+0000","last_became_active":"2024-05-09T05:53:24.132688+0000","last_became_peered":"2024-05-09T05:53:24.132688+0000","last_unstale":"2024-05-09T05:53:29.696503+0000","last_undegraded":"2024-05-09T05:53:29.696503+0000","last_fullsized":"2024-05-09T05:53:29.696503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:43:24.750805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.518884+0000","last_change":"2024-05-09T05:53:24.142600+0000","last_active":"2024-05-09T05:53:29.518884+0000","last_peered":"2024-05-09T05:53:29.518884+0000","last_clean":"2024-05-09T05:53:29.518884+0000","last_became_active":"2024-05-09T05:53:24.142280+0000","last_became_peered":"2024-05-09T05:53:24.142280+0000","last_unstale":"2024-05-09T05:53:29.518884+0000","last_undegraded":"2024-05-09T05:53:29.518884+0000","last_fullsized":"2024-05-09T05:53:29.518884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:20:58.962379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.519367+0000","last_change":"2024-05-09T05:53:24.144839+0000","last_active":"2024-05-09T05:53:29.519367+0000","last_peered":"2024-05-09T05:53:29.519367+0000","last_clean":"2024-05-09T05:53:29.519367+0000","last_became_active":"2024-05-09T05:53:24.144381+0000","last_became_peered":"2024-05-09T05:53:24.144381+0000","last_unstale":"2024-05-09T05:53:29.519367+0000","last_undegraded":"2024-05-09T05:53:29.519367+0000","last_fullsized":"2024-05-09T05:53:29.519367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:40:46.738053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.519277+0000","last_change":"2024-05-09T05:53:24.131521+0000","last_active":"2024-05-09T05:53:29.519277+0000","last_peered":"2024-05-09T05:53:29.519277+0000","last_clean":"2024-05-09T05:53:29.519277+0000","last_became_active":"2024-05-09T05:53:24.131218+0000","last_became_peered":"2024-05-09T05:53:24.131218+0000","last_unstale":"2024-05-09T05:53:29.519277+0000","last_undegraded":"2024-05-09T05:53:29.519277+0000","last_fullsized":"2024-05-09T05:53:29.519277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:25:59.410270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.215388+0000","last_change":"2024-05-09T05:53:24.139922+0000","last_active":"2024-05-09T05:53:29.215388+0000","last_peered":"2024-05-09T05:53:29.215388+0000","last_clean":"2024-05-09T05:53:29.215388+0000","last_became_active":"2024-05-09T05:53:24.139473+0000","last_became_peered":"2024-05-09T05:53:24.139473+0000","last_unstale":"2024-05-09T05:53:29.215388+0000","last_undegraded":"2024-05-09T05:53:29.215388+0000","last_fullsized":"2024-05-09T05:53:29.215388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:37:50.839899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.696349+0000","last_change":"2024-05-09T05:53:24.143338+0000","last_active":"2024-05-09T05:53:29.696349+0000","last_peered":"2024-05-09T05:53:29.696349+0000","last_clean":"2024-05-09T05:53:29.696349+0000","last_became_active":"2024-05-09T05:53:24.143053+0000","last_became_peered":"2024-05-09T05:53:24.143053+0000","last_unstale":"2024-05-09T05:53:29.696349+0000","last_undegraded":"2024-05-09T05:53:29.696349+0000","last_fullsized":"2024-05-09T05:53:29.696349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:22:16.337090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.518199+0000","last_change":"2024-05-09T05:53:24.145517+0000","last_active":"2024-05-09T05:53:29.518199+0000","last_peered":"2024-05-09T05:53:29.518199+0000","last_clean":"2024-05-09T05:53:29.518199+0000","last_became_active":"2024-05-09T05:53:24.145150+0000","last_became_peered":"2024-05-09T05:53:24.145150+0000","last_unstale":"2024-05-09T05:53:29.518199+0000","last_undegraded":"2024-05-09T05:53:29.518199+0000","last_fullsized":"2024-05-09T05:53:29.518199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:19:53.947349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.330681+0000","last_change":"2024-05-09T05:53:24.129669+0000","last_active":"2024-05-09T05:53:29.330681+0000","last_peered":"2024-05-09T05:53:29.330681+0000","last_clean":"2024-05-09T05:53:29.330681+0000","last_became_active":"2024-05-09T05:53:24.129339+0000","last_became_peered":"2024-05-09T05:53:24.129339+0000","last_unstale":"2024-05-09T05:53:29.330681+0000","last_undegraded":"2024-05-09T05:53:29.330681+0000","last_fullsized":"2024-05-09T05:53:29.330681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:05:51.845643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.518947+0000","last_change":"2024-05-09T05:53:24.138914+0000","last_active":"2024-05-09T05:53:29.518947+0000","last_peered":"2024-05-09T05:53:29.518947+0000","last_clean":"2024-05-09T05:53:29.518947+0000","last_became_active":"2024-05-09T05:53:24.138499+0000","last_became_peered":"2024-05-09T05:53:24.138499+0000","last_unstale":"2024-05-09T05:53:29.518947+0000","last_undegraded":"2024-05-09T05:53:29.518947+0000","last_fullsized":"2024-05-09T05:53:29.518947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:29:00.338046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.329427+0000","last_change":"2024-05-09T05:53:24.144296+0000","last_active":"2024-05-09T05:53:29.329427+0000","last_peered":"2024-05-09T05:53:29.329427+0000","last_clean":"2024-05-09T05:53:29.329427+0000","last_became_active":"2024-05-09T05:53:24.143890+0000","last_became_peered":"2024-05-09T05:53:24.143890+0000","last_unstale":"2024-05-09T05:53:29.329427+0000","last_undegraded":"2024-05-09T05:53:29.329427+0000","last_fullsized":"2024-05-09T05:53:29.329427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:34:56.860849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.697600+0000","last_change":"2024-05-09T05:53:24.152635+0000","last_active":"2024-05-09T05:53:29.697600+0000","last_peered":"2024-05-09T05:53:29.697600+0000","last_clean":"2024-05-09T05:53:29.697600+0000","last_became_active":"2024-05-09T05:53:24.151674+0000","last_became_peered":"2024-05-09T05:53:24.151674+0000","last_unstale":"2024-05-09T05:53:29.697600+0000","last_undegraded":"2024-05-09T05:53:29.697600+0000","last_fullsized":"2024-05-09T05:53:29.697600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:18:47.495857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.698463+0000","last_change":"2024-05-09T05:53:24.152746+0000","last_active":"2024-05-09T05:53:29.698463+0000","last_peered":"2024-05-09T05:53:29.698463+0000","last_clean":"2024-05-09T05:53:29.698463+0000","last_became_active":"2024-05-09T05:53:24.151418+0000","last_became_peered":"2024-05-09T05:53:24.151418+0000","last_unstale":"2024-05-09T05:53:29.698463+0000","last_undegraded":"2024-05-09T05:53:29.698463+0000","last_fullsized":"2024-05-09T05:53:29.698463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:27:19.121790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.519905+0000","last_change":"2024-05-09T05:53:24.140908+0000","last_active":"2024-05-09T05:53:29.519905+0000","last_peered":"2024-05-09T05:53:29.519905+0000","last_clean":"2024-05-09T05:53:29.519905+0000","last_became_active":"2024-05-09T05:53:24.140589+0000","last_became_peered":"2024-05-09T05:53:24.140589+0000","last_unstale":"2024-05-09T05:53:29.519905+0000","last_undegraded":"2024-05-09T05:53:29.519905+0000","last_fullsized":"2024-05-09T05:53:29.519905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:51:03.458547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4662,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":9302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509450,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":266240,"data_stored":101907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509453,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":258048,"data_stored":101783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509453,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":278528,"data_stored":106297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509450,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":270336,"data_stored":105625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509452,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":856064,"data_stored":692221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509452,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":101839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32020,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339820,"statfs":{"total":96636764160,"available":96603975680,"internally_reserved":0,"allocated":860160,"data_stored":692243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574860,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":102365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T05:53:56.296 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T05:53:56.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.483+0000 7f743d2f9640 1 Processor -- start 2024-05-09T05:53:56.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.483+0000 7f743d2f9640 1 -- start start 2024-05-09T05:53:56.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.487+0000 7f743d2f9640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f74381537d0 0x7f7438074740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:56.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.487+0000 7f743d2f9640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74380c72c0 con 0x7f74380c77a0 2024-05-09T05:53:56.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.487+0000 7f743d2f9640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74380c7bb0 con 0x7f7438161d70 2024-05-09T05:53:56.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.487+0000 7f743d2f9640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f7438074c80 con 0x7f74381537d0 2024-05-09T05:53:56.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.487+0000 7f7436ffd640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f74380c77a0 0x7f7438072e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34528/0 (socket says 172.21.15.72:34528) 2024-05-09T05:53:56.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.487+0000 7f7436ffd640 1 -- 172.21.15.72:0/349443940 learned_addr learned my addr 172.21.15.72:0/349443940 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:53:56.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.487+0000 7f74367fc640 1 --2- 172.21.15.72:0/349443940 >> v2:172.21.15.110:3300/0 conn(0x7f74381537d0 0x7f7438074740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:56.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.487+0000 7f7435ffb640 1 -- 172.21.15.72:0/349443940 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1643703171 0 0) 0x7f74380c72c0 con 0x7f74380c77a0 2024-05-09T05:53:56.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.487+0000 7f7435ffb640 1 -- 172.21.15.72:0/349443940 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7420003530 con 0x7f74380c77a0 2024-05-09T05:53:56.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.487+0000 7f7435ffb640 1 -- 172.21.15.72:0/349443940 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3832234957 0 0) 0x7f7420003530 con 0x7f74380c77a0 2024-05-09T05:53:56.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.487+0000 7f7435ffb640 1 -- 172.21.15.72:0/349443940 >> v2:172.21.15.110:3300/0 conn(0x7f74381537d0 msgr2=0x7f7438074740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:56.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.487+0000 7f7435ffb640 1 --2- 172.21.15.72:0/349443940 >> v2:172.21.15.110:3300/0 conn(0x7f74381537d0 0x7f7438074740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:56.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.487+0000 7f7435ffb640 1 -- 172.21.15.72:0/349443940 >> v1:172.21.15.110:6789/0 conn(0x7f7438161d70 legacy=0x7f7438164190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:56.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.487+0000 7f7435ffb640 1 -- 172.21.15.72:0/349443940 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7438153be0 con 0x7f74380c77a0 2024-05-09T05:53:56.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.487+0000 7f7435ffb640 1 -- 172.21.15.72:0/349443940 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2749052815 0 0) 0x7f7428001aa0 con 0x7f74380c77a0 2024-05-09T05:53:56.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.487+0000 7f7435ffb640 1 -- 172.21.15.72:0/349443940 >> v1:172.21.15.72:6789/0 conn(0x7f74380c77a0 legacy=0x7f7438072e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:56.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.487+0000 7f7435ffb640 1 --2- 172.21.15.72:0/349443940 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7420003a60 0x7f7420003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:56.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.487+0000 7f7435ffb640 1 --2- 172.21.15.72:0/349443940 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7420004810 0x7f7420004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:56.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.487+0000 7f7435ffb640 1 --2- 172.21.15.72:0/349443940 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7420005260 0x7f742000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:56.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.487+0000 7f7435ffb640 1 -- 172.21.15.72:0/349443940 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7438074c80 con 0x7f7420003a60 2024-05-09T05:53:56.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.487+0000 7f7435ffb640 1 -- 172.21.15.72:0/349443940 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f742000c1f0 con 0x7f7420005260 2024-05-09T05:53:56.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.487+0000 7f7435ffb640 1 -- 172.21.15.72:0/349443940 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f742000c3f0 con 0x7f7420004810 2024-05-09T05:53:56.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.487+0000 7f7436ffd640 1 --2- 172.21.15.72:0/349443940 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7420003a60 0x7f7420003ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:56.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.487+0000 7f74377fe640 1 --2- 172.21.15.72:0/349443940 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7420005260 0x7f742000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:56.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.487+0000 7f74367fc640 1 --2- 172.21.15.72:0/349443940 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7420004810 0x7f7420004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:56.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.487+0000 7f7436ffd640 1 -- 172.21.15.72:0/349443940 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7420004810 msgr2=0x7f7420004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:56.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.487+0000 7f7436ffd640 1 --2- 172.21.15.72:0/349443940 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7420004810 0x7f7420004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:56.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.487+0000 7f7436ffd640 1 -- 172.21.15.72:0/349443940 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7420005260 msgr2=0x7f742000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:56.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.487+0000 7f7436ffd640 1 --2- 172.21.15.72:0/349443940 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7420005260 0x7f742000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:56.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.487+0000 7f74377fe640 1 -- 172.21.15.72:0/349443940 reap_dead start 2024-05-09T05:53:56.481 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.487+0000 7f7436ffd640 1 -- 172.21.15.72:0/349443940 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7420003530 con 0x7f7420003a60 2024-05-09T05:53:56.482 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.491+0000 7f7436ffd640 1 --2- 172.21.15.72:0/349443940 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7420003a60 0x7f7420003ed0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f74380c41c0 tx=0x7f742801d250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=945bf17cef2928db server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:56.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.491+0000 7f7435ffb640 1 -- 172.21.15.72:0/349443940 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f742800a4a0 con 0x7f7420003a60 2024-05-09T05:53:56.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.491+0000 7f7435ffb640 1 -- 172.21.15.72:0/349443940 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74280ad630 con 0x7f7420003a60 2024-05-09T05:53:56.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.491+0000 7f7435ffb640 1 -- 172.21.15.72:0/349443940 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74280ada20 con 0x7f7420003a60 2024-05-09T05:53:56.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.491+0000 7f743d2f9640 1 -- 172.21.15.72:0/349443940 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7420003a60 msgr2=0x7f7420003ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:56.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.491+0000 7f743d2f9640 1 --2- 172.21.15.72:0/349443940 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7420003a60 0x7f7420003ed0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f74380c41c0 tx=0x7f742801d250 comp rx=0 tx=0).stop 2024-05-09T05:53:56.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.491+0000 7f743d2f9640 1 -- 172.21.15.72:0/349443940 shutdown_connections 2024-05-09T05:53:56.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.491+0000 7f743d2f9640 1 --2- 172.21.15.72:0/349443940 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7420003a60 0x7f7420003ed0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:56.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.491+0000 7f743d2f9640 1 -- 172.21.15.72:0/349443940 >> 172.21.15.72:0/349443940 conn(0x7f74380cde90 msgr2=0x7f74380ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:56.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.491+0000 7f743d2f9640 1 -- 172.21.15.72:0/349443940 shutdown_connections 2024-05-09T05:53:56.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.491+0000 7f743d2f9640 1 -- 172.21.15.72:0/349443940 wait complete. 2024-05-09T05:53:56.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.491+0000 7f743d2f9640 1 Processor -- start 2024-05-09T05:53:56.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.491+0000 7f743d2f9640 1 -- start start 2024-05-09T05:53:56.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.495+0000 7f743d2f9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7420003a60 0x7f743815a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:56.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.495+0000 7f743d2f9640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7438145d50 0x7f7438147e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:56.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.495+0000 7f743d2f9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74381408c0 0x7f7438140cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:56.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.495+0000 7f743d2f9640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7438072940 con 0x7f7438145d50 2024-05-09T05:53:56.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.495+0000 7f743d2f9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f74380740b0 con 0x7f74381408c0 2024-05-09T05:53:56.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.495+0000 7f743d2f9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f74380c4cb0 con 0x7f7420003a60 2024-05-09T05:53:56.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.495+0000 7f74367fc640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7438145d50 0x7f7438147e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:56.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.495+0000 7f74367fc640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7438145d50 0x7f7438147e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42338/0 (socket says 172.21.15.72:42338) 2024-05-09T05:53:56.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.495+0000 7f74367fc640 1 -- 172.21.15.72:0/203528310 learned_addr learned my addr 172.21.15.72:0/203528310 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:56.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.495+0000 7f7436ffd640 1 --2- 172.21.15.72:0/203528310 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7420003a60 0x7f743815a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:56.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.495+0000 7f74377fe640 1 --2- 172.21.15.72:0/203528310 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74381408c0 0x7f7438140cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:56.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.495+0000 7f74367fc640 1 -- 172.21.15.72:0/203528310 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7420003a60 msgr2=0x7f743815a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:56.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.495+0000 7f74367fc640 1 --2- 172.21.15.72:0/203528310 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7420003a60 0x7f743815a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:56.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.495+0000 7f74367fc640 1 -- 172.21.15.72:0/203528310 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74381408c0 msgr2=0x7f7438140cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:56.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.495+0000 7f74367fc640 1 --2- 172.21.15.72:0/203528310 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74381408c0 0x7f7438140cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:56.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.495+0000 7f74367fc640 1 -- 172.21.15.72:0/203528310 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7438148350 con 0x7f7438145d50 2024-05-09T05:53:56.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.495+0000 7f74367fc640 1 --2- 172.21.15.72:0/203528310 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7438145d50 0x7f7438147e10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f742c011600 tx=0x7f742c011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:56.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.495+0000 7f741f7fe640 1 -- 172.21.15.72:0/203528310 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f742c00f920 con 0x7f7438145d50 2024-05-09T05:53:56.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.495+0000 7f741f7fe640 1 -- 172.21.15.72:0/203528310 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f742c00fac0 con 0x7f7438145d50 2024-05-09T05:53:56.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.495+0000 7f743d2f9640 1 -- 172.21.15.72:0/203528310 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74381464d0 con 0x7f7438145d50 2024-05-09T05:53:56.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.495+0000 7f741f7fe640 1 -- 172.21.15.72:0/203528310 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f742c00fe70 con 0x7f7438145d50 2024-05-09T05:53:56.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.495+0000 7f743d2f9640 1 -- 172.21.15.72:0/203528310 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7438146a90 con 0x7f7438145d50 2024-05-09T05:53:56.487 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.495+0000 7f743d2f9640 1 -- 172.21.15.72:0/203528310 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f743806a520 con 0x7f7438145d50 2024-05-09T05:53:56.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.495+0000 7f741f7fe640 1 -- 172.21.15.72:0/203528310 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f742c015460 con 0x7f7438145d50 2024-05-09T05:53:56.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.495+0000 7f741f7fe640 1 --2- 172.21.15.72:0/203528310 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f742406f430 0x7f7424071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:56.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.495+0000 7f741f7fe640 1 -- 172.21.15.72:0/203528310 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f742c08fe50 con 0x7f7438145d50 2024-05-09T05:53:56.488 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.495+0000 7f7436ffd640 1 --2- 172.21.15.72:0/203528310 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f742406f430 0x7f7424071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:56.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.499+0000 7f7436ffd640 1 --2- 172.21.15.72:0/203528310 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f742406f430 0x7f7424071940 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f74280ad000 tx=0x7f74280a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:56.492 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.499+0000 7f741f7fe640 1 -- 172.21.15.72:0/203528310 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f742c019030 con 0x7f7438145d50 2024-05-09T05:53:56.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.647+0000 7f743d2f9640 1 -- 172.21.15.72:0/203528310 --> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7438072c50 con 0x7f742406f430 2024-05-09T05:53:56.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.671+0000 7f741f7fe640 1 -- 172.21.15.72:0/203528310 <== mgr.4102 v2:172.21.15.110:6832/1113420672 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332566 (secure 0 0 0) 0x7f7438072c50 con 0x7f742406f430 2024-05-09T05:53:56.666 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:53:56.668 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2024-05-09T05:53:56.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.675+0000 7f743d2f9640 1 -- 172.21.15.72:0/203528310 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f742406f430 msgr2=0x7f7424071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:56.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.675+0000 7f743d2f9640 1 --2- 172.21.15.72:0/203528310 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f742406f430 0x7f7424071940 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f74280ad000 tx=0x7f74280a7000 comp rx=0 tx=0).stop 2024-05-09T05:53:56.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.675+0000 7f743d2f9640 1 -- 172.21.15.72:0/203528310 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7438145d50 msgr2=0x7f7438147e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:56.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.675+0000 7f743d2f9640 1 --2- 172.21.15.72:0/203528310 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7438145d50 0x7f7438147e10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f742c011600 tx=0x7f742c011ac0 comp rx=0 tx=0).stop 2024-05-09T05:53:56.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.675+0000 7f743d2f9640 1 -- 172.21.15.72:0/203528310 shutdown_connections 2024-05-09T05:53:56.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.675+0000 7f743d2f9640 1 --2- 172.21.15.72:0/203528310 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f742406f430 0x7f7424071940 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:56.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.675+0000 7f743d2f9640 1 --2- 172.21.15.72:0/203528310 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74381408c0 0x7f7438140cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:56.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.675+0000 7f743d2f9640 1 --2- 172.21.15.72:0/203528310 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7438145d50 0x7f7438147e10 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:56.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.675+0000 7f743d2f9640 1 --2- 172.21.15.72:0/203528310 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7420003a60 0x7f743815a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:56.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.675+0000 7f743d2f9640 1 -- 172.21.15.72:0/203528310 >> 172.21.15.72:0/203528310 conn(0x7f74380cde90 msgr2=0x7f7438160600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:56.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.675+0000 7f743d2f9640 1 -- 172.21.15.72:0/203528310 shutdown_connections 2024-05-09T05:53:56.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.675+0000 7f743d2f9640 1 -- 172.21.15.72:0/203528310 wait complete. 2024-05-09T05:53:56.686 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2024-05-09T05:53:56.474905+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595652,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":164,"num_write_kb":1655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236060,"kb_used_data":3248,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738660,"statfs":{"total":773094113280,"available":772852387840,"internally_reserved":0,"allocated":3325952,"data_stored":2004902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":644,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006202"},"pg_stats":[{"pgid":"2.1f","version":"24'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.214757+0000","last_change":"2024-05-09T05:53:23.121824+0000","last_active":"2024-05-09T05:53:29.214757+0000","last_peered":"2024-05-09T05:53:29.214757+0000","last_clean":"2024-05-09T05:53:29.214757+0000","last_became_active":"2024-05-09T05:53:23.121097+0000","last_became_peered":"2024-05-09T05:53:23.121097+0000","last_unstale":"2024-05-09T05:53:29.214757+0000","last_undegraded":"2024-05-09T05:53:29.214757+0000","last_fullsized":"2024-05-09T05:53:29.214757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:50:51.880238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.698789+0000","last_change":"2024-05-09T05:53:24.146985+0000","last_active":"2024-05-09T05:53:29.698789+0000","last_peered":"2024-05-09T05:53:29.698789+0000","last_clean":"2024-05-09T05:53:29.698789+0000","last_became_active":"2024-05-09T05:53:24.146540+0000","last_became_peered":"2024-05-09T05:53:24.146540+0000","last_unstale":"2024-05-09T05:53:29.698789+0000","last_undegraded":"2024-05-09T05:53:29.698789+0000","last_fullsized":"2024-05-09T05:53:29.698789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:02:29.318131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.696155+0000","last_change":"2024-05-09T05:53:28.236386+0000","last_active":"2024-05-09T05:53:29.696155+0000","last_peered":"2024-05-09T05:53:29.696155+0000","last_clean":"2024-05-09T05:53:29.696155+0000","last_became_active":"2024-05-09T05:53:28.235305+0000","last_became_peered":"2024-05-09T05:53:28.235305+0000","last_unstale":"2024-05-09T05:53:29.696155+0000","last_undegraded":"2024-05-09T05:53:29.696155+0000","last_fullsized":"2024-05-09T05:53:29.696155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:57:57.134819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.699128+0000","last_change":"2024-05-09T05:53:23.139000+0000","last_active":"2024-05-09T05:53:29.699128+0000","last_peered":"2024-05-09T05:53:29.699128+0000","last_clean":"2024-05-09T05:53:29.699128+0000","last_became_active":"2024-05-09T05:53:23.138431+0000","last_became_peered":"2024-05-09T05:53:23.138431+0000","last_unstale":"2024-05-09T05:53:29.699128+0000","last_undegraded":"2024-05-09T05:53:29.699128+0000","last_fullsized":"2024-05-09T05:53:29.699128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:33:56.977263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.699378+0000","last_change":"2024-05-09T05:53:24.151811+0000","last_active":"2024-05-09T05:53:29.699378+0000","last_peered":"2024-05-09T05:53:29.699378+0000","last_clean":"2024-05-09T05:53:29.699378+0000","last_became_active":"2024-05-09T05:53:24.151407+0000","last_became_peered":"2024-05-09T05:53:24.151407+0000","last_unstale":"2024-05-09T05:53:29.699378+0000","last_undegraded":"2024-05-09T05:53:29.699378+0000","last_fullsized":"2024-05-09T05:53:29.699378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:54:17.819787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.329660+0000","last_change":"2024-05-09T05:53:28.213485+0000","last_active":"2024-05-09T05:53:29.329660+0000","last_peered":"2024-05-09T05:53:29.329660+0000","last_clean":"2024-05-09T05:53:29.329660+0000","last_became_active":"2024-05-09T05:53:28.213021+0000","last_became_peered":"2024-05-09T05:53:28.213021+0000","last_unstale":"2024-05-09T05:53:29.329660+0000","last_undegraded":"2024-05-09T05:53:29.329660+0000","last_fullsized":"2024-05-09T05:53:29.329660+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:58:22.493166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.519704+0000","last_change":"2024-05-09T05:53:23.095209+0000","last_active":"2024-05-09T05:53:29.519704+0000","last_peered":"2024-05-09T05:53:29.519704+0000","last_clean":"2024-05-09T05:53:29.519704+0000","last_became_active":"2024-05-09T05:53:23.094826+0000","last_became_peered":"2024-05-09T05:53:23.094826+0000","last_unstale":"2024-05-09T05:53:29.519704+0000","last_undegraded":"2024-05-09T05:53:29.519704+0000","last_fullsized":"2024-05-09T05:53:29.519704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:38:47.390311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.211795+0000","last_change":"2024-05-09T05:53:24.135281+0000","last_active":"2024-05-09T05:53:29.211795+0000","last_peered":"2024-05-09T05:53:29.211795+0000","last_clean":"2024-05-09T05:53:29.211795+0000","last_became_active":"2024-05-09T05:53:24.134610+0000","last_became_peered":"2024-05-09T05:53:24.134610+0000","last_unstale":"2024-05-09T05:53:29.211795+0000","last_undegraded":"2024-05-09T05:53:29.211795+0000","last_fullsized":"2024-05-09T05:53:29.211795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:28:03.947961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.329917+0000","last_change":"2024-05-09T05:53:28.205763+0000","last_active":"2024-05-09T05:53:29.329917+0000","last_peered":"2024-05-09T05:53:29.329917+0000","last_clean":"2024-05-09T05:53:29.329917+0000","last_became_active":"2024-05-09T05:53:28.205229+0000","last_became_peered":"2024-05-09T05:53:28.205229+0000","last_unstale":"2024-05-09T05:53:29.329917+0000","last_undegraded":"2024-05-09T05:53:29.329917+0000","last_fullsized":"2024-05-09T05:53:29.329917+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:38:51.267769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.519170+0000","last_change":"2024-05-09T05:53:23.097616+0000","last_active":"2024-05-09T05:53:29.519170+0000","last_peered":"2024-05-09T05:53:29.519170+0000","last_clean":"2024-05-09T05:53:29.519170+0000","last_became_active":"2024-05-09T05:53:23.094760+0000","last_became_peered":"2024-05-09T05:53:23.094760+0000","last_unstale":"2024-05-09T05:53:29.519170+0000","last_undegraded":"2024-05-09T05:53:29.519170+0000","last_fullsized":"2024-05-09T05:53:29.519170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:21:32.558852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.214927+0000","last_change":"2024-05-09T05:53:24.139467+0000","last_active":"2024-05-09T05:53:29.214927+0000","last_peered":"2024-05-09T05:53:29.214927+0000","last_clean":"2024-05-09T05:53:29.214927+0000","last_became_active":"2024-05-09T05:53:24.139109+0000","last_became_peered":"2024-05-09T05:53:24.139109+0000","last_unstale":"2024-05-09T05:53:29.214927+0000","last_undegraded":"2024-05-09T05:53:29.214927+0000","last_fullsized":"2024-05-09T05:53:29.214927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:36.783615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.329829+0000","last_change":"2024-05-09T05:53:28.216127+0000","last_active":"2024-05-09T05:53:29.329829+0000","last_peered":"2024-05-09T05:53:29.329829+0000","last_clean":"2024-05-09T05:53:29.329829+0000","last_became_active":"2024-05-09T05:53:28.215482+0000","last_became_peered":"2024-05-09T05:53:28.215482+0000","last_unstale":"2024-05-09T05:53:29.329829+0000","last_undegraded":"2024-05-09T05:53:29.329829+0000","last_fullsized":"2024-05-09T05:53:29.329829+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:48:58.387701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.213472+0000","last_change":"2024-05-09T05:53:24.132483+0000","last_active":"2024-05-09T05:53:29.213472+0000","last_peered":"2024-05-09T05:53:29.213472+0000","last_clean":"2024-05-09T05:53:29.213472+0000","last_became_active":"2024-05-09T05:53:24.132118+0000","last_became_peered":"2024-05-09T05:53:24.132118+0000","last_unstale":"2024-05-09T05:53:29.213472+0000","last_undegraded":"2024-05-09T05:53:29.213472+0000","last_fullsized":"2024-05-09T05:53:29.213472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:06:01.787707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"25'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:53.611814+0000","last_change":"2024-05-09T05:53:23.117460+0000","last_active":"2024-05-09T05:53:53.611814+0000","last_peered":"2024-05-09T05:53:53.611814+0000","last_clean":"2024-05-09T05:53:53.611814+0000","last_became_active":"2024-05-09T05:53:23.114179+0000","last_became_peered":"2024-05-09T05:53:23.114179+0000","last_unstale":"2024-05-09T05:53:53.611814+0000","last_undegraded":"2024-05-09T05:53:53.611814+0000","last_fullsized":"2024-05-09T05:53:53.611814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:44:01.784905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.214595+0000","last_change":"2024-05-09T05:53:28.227135+0000","last_active":"2024-05-09T05:53:29.214595+0000","last_peered":"2024-05-09T05:53:29.214595+0000","last_clean":"2024-05-09T05:53:29.214595+0000","last_became_active":"2024-05-09T05:53:28.226427+0000","last_became_peered":"2024-05-09T05:53:28.226427+0000","last_unstale":"2024-05-09T05:53:29.214595+0000","last_undegraded":"2024-05-09T05:53:29.214595+0000","last_fullsized":"2024-05-09T05:53:29.214595+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:37:04.413804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.695764+0000","last_change":"2024-05-09T05:53:24.135982+0000","last_active":"2024-05-09T05:53:29.695764+0000","last_peered":"2024-05-09T05:53:29.695764+0000","last_clean":"2024-05-09T05:53:29.695764+0000","last_became_active":"2024-05-09T05:53:24.135580+0000","last_became_peered":"2024-05-09T05:53:24.135580+0000","last_unstale":"2024-05-09T05:53:29.695764+0000","last_undegraded":"2024-05-09T05:53:29.695764+0000","last_fullsized":"2024-05-09T05:53:29.695764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:03:04.589608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.696302+0000","last_change":"2024-05-09T05:53:23.142679+0000","last_active":"2024-05-09T05:53:29.696302+0000","last_peered":"2024-05-09T05:53:29.696302+0000","last_clean":"2024-05-09T05:53:29.696302+0000","last_became_active":"2024-05-09T05:53:23.142018+0000","last_became_peered":"2024-05-09T05:53:23.142018+0000","last_unstale":"2024-05-09T05:53:29.696302+0000","last_undegraded":"2024-05-09T05:53:29.696302+0000","last_fullsized":"2024-05-09T05:53:29.696302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:08:29.312049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.518874+0000","last_change":"2024-05-09T05:53:28.214167+0000","last_active":"2024-05-09T05:53:29.518874+0000","last_peered":"2024-05-09T05:53:29.518874+0000","last_clean":"2024-05-09T05:53:29.518874+0000","last_became_active":"2024-05-09T05:53:28.213623+0000","last_became_peered":"2024-05-09T05:53:28.213623+0000","last_unstale":"2024-05-09T05:53:29.518874+0000","last_undegraded":"2024-05-09T05:53:29.518874+0000","last_fullsized":"2024-05-09T05:53:29.518874+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:53:53.976485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.212618+0000","last_change":"2024-05-09T05:53:24.130342+0000","last_active":"2024-05-09T05:53:29.212618+0000","last_peered":"2024-05-09T05:53:29.212618+0000","last_clean":"2024-05-09T05:53:29.212618+0000","last_became_active":"2024-05-09T05:53:24.129938+0000","last_became_peered":"2024-05-09T05:53:24.129938+0000","last_unstale":"2024-05-09T05:53:29.212618+0000","last_undegraded":"2024-05-09T05:53:29.212618+0000","last_fullsized":"2024-05-09T05:53:29.212618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:58:13.879633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.213484+0000","last_change":"2024-05-09T05:53:23.111169+0000","last_active":"2024-05-09T05:53:29.213484+0000","last_peered":"2024-05-09T05:53:29.213484+0000","last_clean":"2024-05-09T05:53:29.213484+0000","last_became_active":"2024-05-09T05:53:23.110140+0000","last_became_peered":"2024-05-09T05:53:23.110140+0000","last_unstale":"2024-05-09T05:53:29.213484+0000","last_undegraded":"2024-05-09T05:53:29.213484+0000","last_fullsized":"2024-05-09T05:53:29.213484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:18:55.367553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.696432+0000","last_change":"2024-05-09T05:53:28.233648+0000","last_active":"2024-05-09T05:53:29.696432+0000","last_peered":"2024-05-09T05:53:29.696432+0000","last_clean":"2024-05-09T05:53:29.696432+0000","last_became_active":"2024-05-09T05:53:28.227087+0000","last_became_peered":"2024-05-09T05:53:28.227087+0000","last_unstale":"2024-05-09T05:53:29.696432+0000","last_undegraded":"2024-05-09T05:53:29.696432+0000","last_fullsized":"2024-05-09T05:53:29.696432+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:03:49.709580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.213120+0000","last_change":"2024-05-09T05:53:24.147343+0000","last_active":"2024-05-09T05:53:29.213120+0000","last_peered":"2024-05-09T05:53:29.213120+0000","last_clean":"2024-05-09T05:53:29.213120+0000","last_became_active":"2024-05-09T05:53:24.144596+0000","last_became_peered":"2024-05-09T05:53:24.144596+0000","last_unstale":"2024-05-09T05:53:29.213120+0000","last_undegraded":"2024-05-09T05:53:29.213120+0000","last_fullsized":"2024-05-09T05:53:29.213120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:52:43.052055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.517799+0000","last_change":"2024-05-09T05:53:23.102976+0000","last_active":"2024-05-09T05:53:29.517799+0000","last_peered":"2024-05-09T05:53:29.517799+0000","last_clean":"2024-05-09T05:53:29.517799+0000","last_became_active":"2024-05-09T05:53:23.102420+0000","last_became_peered":"2024-05-09T05:53:23.102420+0000","last_unstale":"2024-05-09T05:53:29.517799+0000","last_undegraded":"2024-05-09T05:53:29.517799+0000","last_fullsized":"2024-05-09T05:53:29.517799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:45:11.479140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.329786+0000","last_change":"2024-05-09T05:53:28.195537+0000","last_active":"2024-05-09T05:53:29.329786+0000","last_peered":"2024-05-09T05:53:29.329786+0000","last_clean":"2024-05-09T05:53:29.329786+0000","last_became_active":"2024-05-09T05:53:28.194915+0000","last_became_peered":"2024-05-09T05:53:28.194915+0000","last_unstale":"2024-05-09T05:53:29.329786+0000","last_undegraded":"2024-05-09T05:53:29.329786+0000","last_fullsized":"2024-05-09T05:53:29.329786+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:07.554137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.214059+0000","last_change":"2024-05-09T05:53:24.130312+0000","last_active":"2024-05-09T05:53:29.214059+0000","last_peered":"2024-05-09T05:53:29.214059+0000","last_clean":"2024-05-09T05:53:29.214059+0000","last_became_active":"2024-05-09T05:53:24.129953+0000","last_became_peered":"2024-05-09T05:53:24.129953+0000","last_unstale":"2024-05-09T05:53:29.214059+0000","last_undegraded":"2024-05-09T05:53:29.214059+0000","last_fullsized":"2024-05-09T05:53:29.214059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:07:09.368521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:53.609218+0000","last_change":"2024-05-09T05:53:23.127219+0000","last_active":"2024-05-09T05:53:53.609218+0000","last_peered":"2024-05-09T05:53:53.609218+0000","last_clean":"2024-05-09T05:53:53.609218+0000","last_became_active":"2024-05-09T05:53:23.126691+0000","last_became_peered":"2024-05-09T05:53:23.126691+0000","last_unstale":"2024-05-09T05:53:53.609218+0000","last_undegraded":"2024-05-09T05:53:53.609218+0000","last_fullsized":"2024-05-09T05:53:53.609218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:17:26.711941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.329067+0000","last_change":"2024-05-09T05:53:28.191045+0000","last_active":"2024-05-09T05:53:29.329067+0000","last_peered":"2024-05-09T05:53:29.329067+0000","last_clean":"2024-05-09T05:53:29.329067+0000","last_became_active":"2024-05-09T05:53:28.190564+0000","last_became_peered":"2024-05-09T05:53:28.190564+0000","last_unstale":"2024-05-09T05:53:29.329067+0000","last_undegraded":"2024-05-09T05:53:29.329067+0000","last_fullsized":"2024-05-09T05:53:29.329067+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:53:30.541681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.214756+0000","last_change":"2024-05-09T05:53:24.138682+0000","last_active":"2024-05-09T05:53:29.214756+0000","last_peered":"2024-05-09T05:53:29.214756+0000","last_clean":"2024-05-09T05:53:29.214756+0000","last_became_active":"2024-05-09T05:53:24.138417+0000","last_became_peered":"2024-05-09T05:53:24.138417+0000","last_unstale":"2024-05-09T05:53:29.214756+0000","last_undegraded":"2024-05-09T05:53:29.214756+0000","last_fullsized":"2024-05-09T05:53:29.214756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:57:55.403156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.214850+0000","last_change":"2024-05-09T05:53:23.102986+0000","last_active":"2024-05-09T05:53:29.214850+0000","last_peered":"2024-05-09T05:53:29.214850+0000","last_clean":"2024-05-09T05:53:29.214850+0000","last_became_active":"2024-05-09T05:53:23.102020+0000","last_became_peered":"2024-05-09T05:53:23.102020+0000","last_unstale":"2024-05-09T05:53:29.214850+0000","last_undegraded":"2024-05-09T05:53:29.214850+0000","last_fullsized":"2024-05-09T05:53:29.214850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:18:11.582575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.213744+0000","last_change":"2024-05-09T05:53:28.218326+0000","last_active":"2024-05-09T05:53:29.213744+0000","last_peered":"2024-05-09T05:53:29.213744+0000","last_clean":"2024-05-09T05:53:29.213744+0000","last_became_active":"2024-05-09T05:53:28.216634+0000","last_became_peered":"2024-05-09T05:53:28.216634+0000","last_unstale":"2024-05-09T05:53:29.213744+0000","last_undegraded":"2024-05-09T05:53:29.213744+0000","last_fullsized":"2024-05-09T05:53:29.213744+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:13:05.321932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.698266+0000","last_change":"2024-05-09T05:53:24.143161+0000","last_active":"2024-05-09T05:53:29.698266+0000","last_peered":"2024-05-09T05:53:29.698266+0000","last_clean":"2024-05-09T05:53:29.698266+0000","last_became_active":"2024-05-09T05:53:24.139369+0000","last_became_peered":"2024-05-09T05:53:24.139369+0000","last_unstale":"2024-05-09T05:53:29.698266+0000","last_undegraded":"2024-05-09T05:53:29.698266+0000","last_fullsized":"2024-05-09T05:53:29.698266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:25:21.472460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"25'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.216371+0000","last_change":"2024-05-09T05:53:23.123560+0000","last_active":"2024-05-09T05:53:29.216371+0000","last_peered":"2024-05-09T05:53:29.216371+0000","last_clean":"2024-05-09T05:53:29.216371+0000","last_became_active":"2024-05-09T05:53:23.123081+0000","last_became_peered":"2024-05-09T05:53:23.123081+0000","last_unstale":"2024-05-09T05:53:29.216371+0000","last_undegraded":"2024-05-09T05:53:29.216371+0000","last_fullsized":"2024-05-09T05:53:29.216371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:15:31.371756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.695946+0000","last_change":"2024-05-09T05:53:28.229352+0000","last_active":"2024-05-09T05:53:29.695946+0000","last_peered":"2024-05-09T05:53:29.695946+0000","last_clean":"2024-05-09T05:53:29.695946+0000","last_became_active":"2024-05-09T05:53:28.225810+0000","last_became_peered":"2024-05-09T05:53:28.225810+0000","last_unstale":"2024-05-09T05:53:29.695946+0000","last_undegraded":"2024-05-09T05:53:29.695946+0000","last_fullsized":"2024-05-09T05:53:29.695946+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:17:07.192105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.329438+0000","last_change":"2024-05-09T05:53:24.130533+0000","last_active":"2024-05-09T05:53:29.329438+0000","last_peered":"2024-05-09T05:53:29.329438+0000","last_clean":"2024-05-09T05:53:29.329438+0000","last_became_active":"2024-05-09T05:53:24.129787+0000","last_became_peered":"2024-05-09T05:53:24.129787+0000","last_unstale":"2024-05-09T05:53:29.329438+0000","last_undegraded":"2024-05-09T05:53:29.329438+0000","last_fullsized":"2024-05-09T05:53:29.329438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:37:36.036271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.698698+0000","last_change":"2024-05-09T05:53:23.134379+0000","last_active":"2024-05-09T05:53:29.698698+0000","last_peered":"2024-05-09T05:53:29.698698+0000","last_clean":"2024-05-09T05:53:29.698698+0000","last_became_active":"2024-05-09T05:53:23.133587+0000","last_became_peered":"2024-05-09T05:53:23.133587+0000","last_unstale":"2024-05-09T05:53:29.698698+0000","last_undegraded":"2024-05-09T05:53:29.698698+0000","last_fullsized":"2024-05-09T05:53:29.698698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:00:33.973787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.695393+0000","last_change":"2024-05-09T05:53:28.233620+0000","last_active":"2024-05-09T05:53:29.695393+0000","last_peered":"2024-05-09T05:53:29.695393+0000","last_clean":"2024-05-09T05:53:29.695393+0000","last_became_active":"2024-05-09T05:53:28.232539+0000","last_became_peered":"2024-05-09T05:53:28.232539+0000","last_unstale":"2024-05-09T05:53:29.695393+0000","last_undegraded":"2024-05-09T05:53:29.695393+0000","last_fullsized":"2024-05-09T05:53:29.695393+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:13.789448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.519002+0000","last_change":"2024-05-09T05:53:24.132702+0000","last_active":"2024-05-09T05:53:29.519002+0000","last_peered":"2024-05-09T05:53:29.519002+0000","last_clean":"2024-05-09T05:53:29.519002+0000","last_became_active":"2024-05-09T05:53:24.132309+0000","last_became_peered":"2024-05-09T05:53:24.132309+0000","last_unstale":"2024-05-09T05:53:29.519002+0000","last_undegraded":"2024-05-09T05:53:29.519002+0000","last_fullsized":"2024-05-09T05:53:29.519002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:53:13.592038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.214038+0000","last_change":"2024-05-09T05:53:23.120384+0000","last_active":"2024-05-09T05:53:29.214038+0000","last_peered":"2024-05-09T05:53:29.214038+0000","last_clean":"2024-05-09T05:53:29.214038+0000","last_became_active":"2024-05-09T05:53:23.118321+0000","last_became_peered":"2024-05-09T05:53:23.118321+0000","last_unstale":"2024-05-09T05:53:29.214038+0000","last_undegraded":"2024-05-09T05:53:29.214038+0000","last_fullsized":"2024-05-09T05:53:29.214038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:15:51.297111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.697961+0000","last_change":"2024-05-09T05:53:28.208383+0000","last_active":"2024-05-09T05:53:29.697961+0000","last_peered":"2024-05-09T05:53:29.697961+0000","last_clean":"2024-05-09T05:53:29.697961+0000","last_became_active":"2024-05-09T05:53:28.199359+0000","last_became_peered":"2024-05-09T05:53:28.199359+0000","last_unstale":"2024-05-09T05:53:29.697961+0000","last_undegraded":"2024-05-09T05:53:29.697961+0000","last_fullsized":"2024-05-09T05:53:29.697961+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:50:19.715242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.696850+0000","last_change":"2024-05-09T05:53:24.142740+0000","last_active":"2024-05-09T05:53:29.696850+0000","last_peered":"2024-05-09T05:53:29.696850+0000","last_clean":"2024-05-09T05:53:29.696850+0000","last_became_active":"2024-05-09T05:53:24.142265+0000","last_became_peered":"2024-05-09T05:53:24.142265+0000","last_unstale":"2024-05-09T05:53:29.696850+0000","last_undegraded":"2024-05-09T05:53:29.696850+0000","last_fullsized":"2024-05-09T05:53:29.696850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:46:53.729151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.696611+0000","last_change":"2024-05-09T05:53:23.142455+0000","last_active":"2024-05-09T05:53:29.696611+0000","last_peered":"2024-05-09T05:53:29.696611+0000","last_clean":"2024-05-09T05:53:29.696611+0000","last_became_active":"2024-05-09T05:53:23.141770+0000","last_became_peered":"2024-05-09T05:53:23.141770+0000","last_unstale":"2024-05-09T05:53:29.696611+0000","last_undegraded":"2024-05-09T05:53:29.696611+0000","last_fullsized":"2024-05-09T05:53:29.696611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:30:34.301349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.697220+0000","last_change":"2024-05-09T05:53:28.212176+0000","last_active":"2024-05-09T05:53:29.697220+0000","last_peered":"2024-05-09T05:53:29.697220+0000","last_clean":"2024-05-09T05:53:29.697220+0000","last_became_active":"2024-05-09T05:53:28.210981+0000","last_became_peered":"2024-05-09T05:53:28.210981+0000","last_unstale":"2024-05-09T05:53:29.697220+0000","last_undegraded":"2024-05-09T05:53:29.697220+0000","last_fullsized":"2024-05-09T05:53:29.697220+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:17:24.122805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.698671+0000","last_change":"2024-05-09T05:53:24.132887+0000","last_active":"2024-05-09T05:53:29.698671+0000","last_peered":"2024-05-09T05:53:29.698671+0000","last_clean":"2024-05-09T05:53:29.698671+0000","last_became_active":"2024-05-09T05:53:24.132398+0000","last_became_peered":"2024-05-09T05:53:24.132398+0000","last_unstale":"2024-05-09T05:53:29.698671+0000","last_undegraded":"2024-05-09T05:53:29.698671+0000","last_fullsized":"2024-05-09T05:53:29.698671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:36:49.369162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"25'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.213099+0000","last_change":"2024-05-09T05:53:23.126202+0000","last_active":"2024-05-09T05:53:29.213099+0000","last_peered":"2024-05-09T05:53:29.213099+0000","last_clean":"2024-05-09T05:53:29.213099+0000","last_became_active":"2024-05-09T05:53:23.125799+0000","last_became_peered":"2024-05-09T05:53:23.125799+0000","last_unstale":"2024-05-09T05:53:29.213099+0000","last_undegraded":"2024-05-09T05:53:29.213099+0000","last_fullsized":"2024-05-09T05:53:29.213099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:33:12.831705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.698065+0000","last_change":"2024-05-09T05:53:28.241997+0000","last_active":"2024-05-09T05:53:29.698065+0000","last_peered":"2024-05-09T05:53:29.698065+0000","last_clean":"2024-05-09T05:53:29.698065+0000","last_became_active":"2024-05-09T05:53:28.240989+0000","last_became_peered":"2024-05-09T05:53:28.240989+0000","last_unstale":"2024-05-09T05:53:29.698065+0000","last_undegraded":"2024-05-09T05:53:29.698065+0000","last_fullsized":"2024-05-09T05:53:29.698065+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:24:16.820771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.213186+0000","last_change":"2024-05-09T05:53:24.139586+0000","last_active":"2024-05-09T05:53:29.213186+0000","last_peered":"2024-05-09T05:53:29.213186+0000","last_clean":"2024-05-09T05:53:29.213186+0000","last_became_active":"2024-05-09T05:53:24.138835+0000","last_became_peered":"2024-05-09T05:53:24.138835+0000","last_unstale":"2024-05-09T05:53:29.213186+0000","last_undegraded":"2024-05-09T05:53:29.213186+0000","last_fullsized":"2024-05-09T05:53:29.213186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:37:13.012588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"25'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:53.614348+0000","last_change":"2024-05-09T05:53:23.117121+0000","last_active":"2024-05-09T05:53:53.614348+0000","last_peered":"2024-05-09T05:53:53.614348+0000","last_clean":"2024-05-09T05:53:53.614348+0000","last_became_active":"2024-05-09T05:53:23.113294+0000","last_became_peered":"2024-05-09T05:53:23.113294+0000","last_unstale":"2024-05-09T05:53:53.614348+0000","last_undegraded":"2024-05-09T05:53:53.614348+0000","last_fullsized":"2024-05-09T05:53:53.614348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:53:41.591371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":117,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.210326+0000","last_change":"2024-05-09T05:53:12.484358+0000","last_active":"2024-05-09T05:53:29.210326+0000","last_peered":"2024-05-09T05:53:29.210326+0000","last_clean":"2024-05-09T05:53:29.210326+0000","last_became_active":"2024-05-09T05:53:12.481529+0000","last_became_peered":"2024-05-09T05:53:12.481529+0000","last_unstale":"2024-05-09T05:53:29.210326+0000","last_undegraded":"2024-05-09T05:53:29.210326+0000","last_fullsized":"2024-05-09T05:53:29.210326+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:10.902489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:10.902489+0000","last_clean_scrub_stamp":"2024-05-09T05:53:10.902489+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:28:50.650299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.215635+0000","last_change":"2024-05-09T05:53:28.190861+0000","last_active":"2024-05-09T05:53:29.215635+0000","last_peered":"2024-05-09T05:53:29.215635+0000","last_clean":"2024-05-09T05:53:29.215635+0000","last_became_active":"2024-05-09T05:53:28.190393+0000","last_became_peered":"2024-05-09T05:53:28.190393+0000","last_unstale":"2024-05-09T05:53:29.215635+0000","last_undegraded":"2024-05-09T05:53:29.215635+0000","last_fullsized":"2024-05-09T05:53:29.215635+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:05:37.653010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.215187+0000","last_change":"2024-05-09T05:53:24.143283+0000","last_active":"2024-05-09T05:53:29.215187+0000","last_peered":"2024-05-09T05:53:29.215187+0000","last_clean":"2024-05-09T05:53:29.215187+0000","last_became_active":"2024-05-09T05:53:24.139813+0000","last_became_peered":"2024-05-09T05:53:24.139813+0000","last_unstale":"2024-05-09T05:53:29.215187+0000","last_undegraded":"2024-05-09T05:53:29.215187+0000","last_fullsized":"2024-05-09T05:53:29.215187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:07:38.471778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.698418+0000","last_change":"2024-05-09T05:53:23.115534+0000","last_active":"2024-05-09T05:53:29.698418+0000","last_peered":"2024-05-09T05:53:29.698418+0000","last_clean":"2024-05-09T05:53:29.698418+0000","last_became_active":"2024-05-09T05:53:23.112260+0000","last_became_peered":"2024-05-09T05:53:23.112260+0000","last_unstale":"2024-05-09T05:53:29.698418+0000","last_undegraded":"2024-05-09T05:53:29.698418+0000","last_fullsized":"2024-05-09T05:53:29.698418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:46:53.520691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.330364+0000","last_change":"2024-05-09T05:53:28.195687+0000","last_active":"2024-05-09T05:53:29.330364+0000","last_peered":"2024-05-09T05:53:29.330364+0000","last_clean":"2024-05-09T05:53:29.330364+0000","last_became_active":"2024-05-09T05:53:28.195082+0000","last_became_peered":"2024-05-09T05:53:28.195082+0000","last_unstale":"2024-05-09T05:53:29.330364+0000","last_undegraded":"2024-05-09T05:53:29.330364+0000","last_fullsized":"2024-05-09T05:53:29.330364+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:45:56.633547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.519045+0000","last_change":"2024-05-09T05:53:24.130460+0000","last_active":"2024-05-09T05:53:29.519045+0000","last_peered":"2024-05-09T05:53:29.519045+0000","last_clean":"2024-05-09T05:53:29.519045+0000","last_became_active":"2024-05-09T05:53:24.129808+0000","last_became_peered":"2024-05-09T05:53:24.129808+0000","last_unstale":"2024-05-09T05:53:29.519045+0000","last_undegraded":"2024-05-09T05:53:29.519045+0000","last_fullsized":"2024-05-09T05:53:29.519045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:36:04.881676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.698264+0000","last_change":"2024-05-09T05:53:23.139063+0000","last_active":"2024-05-09T05:53:29.698264+0000","last_peered":"2024-05-09T05:53:29.698264+0000","last_clean":"2024-05-09T05:53:29.698264+0000","last_became_active":"2024-05-09T05:53:23.138303+0000","last_became_peered":"2024-05-09T05:53:23.138303+0000","last_unstale":"2024-05-09T05:53:29.698264+0000","last_undegraded":"2024-05-09T05:53:29.698264+0000","last_fullsized":"2024-05-09T05:53:29.698264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:18:20.172877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.696725+0000","last_change":"2024-05-09T05:53:28.214251+0000","last_active":"2024-05-09T05:53:29.696725+0000","last_peered":"2024-05-09T05:53:29.696725+0000","last_clean":"2024-05-09T05:53:29.696725+0000","last_became_active":"2024-05-09T05:53:28.206229+0000","last_became_peered":"2024-05-09T05:53:28.206229+0000","last_unstale":"2024-05-09T05:53:29.696725+0000","last_undegraded":"2024-05-09T05:53:29.696725+0000","last_fullsized":"2024-05-09T05:53:29.696725+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:12:26.761543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.519894+0000","last_change":"2024-05-09T05:53:24.135578+0000","last_active":"2024-05-09T05:53:29.519894+0000","last_peered":"2024-05-09T05:53:29.519894+0000","last_clean":"2024-05-09T05:53:29.519894+0000","last_became_active":"2024-05-09T05:53:24.135253+0000","last_became_peered":"2024-05-09T05:53:24.135253+0000","last_unstale":"2024-05-09T05:53:29.519894+0000","last_undegraded":"2024-05-09T05:53:29.519894+0000","last_fullsized":"2024-05-09T05:53:29.519894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:20:23.093397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.214436+0000","last_change":"2024-05-09T05:53:23.140175+0000","last_active":"2024-05-09T05:53:29.214436+0000","last_peered":"2024-05-09T05:53:29.214436+0000","last_clean":"2024-05-09T05:53:29.214436+0000","last_became_active":"2024-05-09T05:53:23.139516+0000","last_became_peered":"2024-05-09T05:53:23.139516+0000","last_unstale":"2024-05-09T05:53:29.214436+0000","last_undegraded":"2024-05-09T05:53:29.214436+0000","last_fullsized":"2024-05-09T05:53:29.214436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:48:42.473155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.212056+0000","last_change":"2024-05-09T05:53:28.199385+0000","last_active":"2024-05-09T05:53:29.212056+0000","last_peered":"2024-05-09T05:53:29.212056+0000","last_clean":"2024-05-09T05:53:29.212056+0000","last_became_active":"2024-05-09T05:53:28.198825+0000","last_became_peered":"2024-05-09T05:53:28.198825+0000","last_unstale":"2024-05-09T05:53:29.212056+0000","last_undegraded":"2024-05-09T05:53:29.212056+0000","last_fullsized":"2024-05-09T05:53:29.212056+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:48:22.224140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.330189+0000","last_change":"2024-05-09T05:53:24.133293+0000","last_active":"2024-05-09T05:53:29.330189+0000","last_peered":"2024-05-09T05:53:29.330189+0000","last_clean":"2024-05-09T05:53:29.330189+0000","last_became_active":"2024-05-09T05:53:24.131741+0000","last_became_peered":"2024-05-09T05:53:24.131741+0000","last_unstale":"2024-05-09T05:53:29.330189+0000","last_undegraded":"2024-05-09T05:53:29.330189+0000","last_fullsized":"2024-05-09T05:53:29.330189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:01:33.701742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.520045+0000","last_change":"2024-05-09T05:53:23.112592+0000","last_active":"2024-05-09T05:53:29.520045+0000","last_peered":"2024-05-09T05:53:29.520045+0000","last_clean":"2024-05-09T05:53:29.520045+0000","last_became_active":"2024-05-09T05:53:23.111968+0000","last_became_peered":"2024-05-09T05:53:23.111968+0000","last_unstale":"2024-05-09T05:53:29.520045+0000","last_undegraded":"2024-05-09T05:53:29.520045+0000","last_fullsized":"2024-05-09T05:53:29.520045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:32:54.694588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.210561+0000","last_change":"2024-05-09T05:53:28.227755+0000","last_active":"2024-05-09T05:53:29.210561+0000","last_peered":"2024-05-09T05:53:29.210561+0000","last_clean":"2024-05-09T05:53:29.210561+0000","last_became_active":"2024-05-09T05:53:28.227272+0000","last_became_peered":"2024-05-09T05:53:28.227272+0000","last_unstale":"2024-05-09T05:53:29.210561+0000","last_undegraded":"2024-05-09T05:53:29.210561+0000","last_fullsized":"2024-05-09T05:53:29.210561+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:13:32.020862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.212986+0000","last_change":"2024-05-09T05:53:24.144025+0000","last_active":"2024-05-09T05:53:29.212986+0000","last_peered":"2024-05-09T05:53:29.212986+0000","last_clean":"2024-05-09T05:53:29.212986+0000","last_became_active":"2024-05-09T05:53:24.143540+0000","last_became_peered":"2024-05-09T05:53:24.143540+0000","last_unstale":"2024-05-09T05:53:29.212986+0000","last_undegraded":"2024-05-09T05:53:29.212986+0000","last_fullsized":"2024-05-09T05:53:29.212986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:22:58.062541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"24'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.213687+0000","last_change":"2024-05-09T05:53:23.104452+0000","last_active":"2024-05-09T05:53:29.213687+0000","last_peered":"2024-05-09T05:53:29.213687+0000","last_clean":"2024-05-09T05:53:29.213687+0000","last_became_active":"2024-05-09T05:53:23.103471+0000","last_became_peered":"2024-05-09T05:53:23.103471+0000","last_unstale":"2024-05-09T05:53:29.213687+0000","last_undegraded":"2024-05-09T05:53:29.213687+0000","last_fullsized":"2024-05-09T05:53:29.213687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:33:30.508464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.698789+0000","last_change":"2024-05-09T05:53:28.241338+0000","last_active":"2024-05-09T05:53:29.698789+0000","last_peered":"2024-05-09T05:53:29.698789+0000","last_clean":"2024-05-09T05:53:29.698789+0000","last_became_active":"2024-05-09T05:53:28.239841+0000","last_became_peered":"2024-05-09T05:53:28.239841+0000","last_unstale":"2024-05-09T05:53:29.698789+0000","last_undegraded":"2024-05-09T05:53:29.698789+0000","last_fullsized":"2024-05-09T05:53:29.698789+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:44:47.854598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.210371+0000","last_change":"2024-05-09T05:53:24.149958+0000","last_active":"2024-05-09T05:53:29.210371+0000","last_peered":"2024-05-09T05:53:29.210371+0000","last_clean":"2024-05-09T05:53:29.210371+0000","last_became_active":"2024-05-09T05:53:24.149578+0000","last_became_peered":"2024-05-09T05:53:24.149578+0000","last_unstale":"2024-05-09T05:53:29.210371+0000","last_undegraded":"2024-05-09T05:53:29.210371+0000","last_fullsized":"2024-05-09T05:53:29.210371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:27:43.555218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.518385+0000","last_change":"2024-05-09T05:53:23.121266+0000","last_active":"2024-05-09T05:53:29.518385+0000","last_peered":"2024-05-09T05:53:29.518385+0000","last_clean":"2024-05-09T05:53:29.518385+0000","last_became_active":"2024-05-09T05:53:23.120857+0000","last_became_peered":"2024-05-09T05:53:23.120857+0000","last_unstale":"2024-05-09T05:53:29.518385+0000","last_undegraded":"2024-05-09T05:53:29.518385+0000","last_fullsized":"2024-05-09T05:53:29.518385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:03:30.185640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.698426+0000","last_change":"2024-05-09T05:53:28.240774+0000","last_active":"2024-05-09T05:53:29.698426+0000","last_peered":"2024-05-09T05:53:29.698426+0000","last_clean":"2024-05-09T05:53:29.698426+0000","last_became_active":"2024-05-09T05:53:28.240070+0000","last_became_peered":"2024-05-09T05:53:28.240070+0000","last_unstale":"2024-05-09T05:53:29.698426+0000","last_undegraded":"2024-05-09T05:53:29.698426+0000","last_fullsized":"2024-05-09T05:53:29.698426+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:25:24.019344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.214869+0000","last_change":"2024-05-09T05:53:24.132792+0000","last_active":"2024-05-09T05:53:29.214869+0000","last_peered":"2024-05-09T05:53:29.214869+0000","last_clean":"2024-05-09T05:53:29.214869+0000","last_became_active":"2024-05-09T05:53:24.132439+0000","last_became_peered":"2024-05-09T05:53:24.132439+0000","last_unstale":"2024-05-09T05:53:29.214869+0000","last_undegraded":"2024-05-09T05:53:29.214869+0000","last_fullsized":"2024-05-09T05:53:29.214869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:52:45.857475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"25'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:53.613196+0000","last_change":"2024-05-09T05:53:23.120680+0000","last_active":"2024-05-09T05:53:53.613196+0000","last_peered":"2024-05-09T05:53:53.613196+0000","last_clean":"2024-05-09T05:53:53.613196+0000","last_became_active":"2024-05-09T05:53:23.118358+0000","last_became_peered":"2024-05-09T05:53:23.118358+0000","last_unstale":"2024-05-09T05:53:53.613196+0000","last_undegraded":"2024-05-09T05:53:53.613196+0000","last_fullsized":"2024-05-09T05:53:53.613196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:52:52.360128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.697847+0000","last_change":"2024-05-09T05:53:28.222341+0000","last_active":"2024-05-09T05:53:29.697847+0000","last_peered":"2024-05-09T05:53:29.697847+0000","last_clean":"2024-05-09T05:53:29.697847+0000","last_became_active":"2024-05-09T05:53:28.219636+0000","last_became_peered":"2024-05-09T05:53:28.219636+0000","last_unstale":"2024-05-09T05:53:29.697847+0000","last_undegraded":"2024-05-09T05:53:29.697847+0000","last_fullsized":"2024-05-09T05:53:29.697847+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:29:03.459851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.696019+0000","last_change":"2024-05-09T05:53:24.143495+0000","last_active":"2024-05-09T05:53:29.696019+0000","last_peered":"2024-05-09T05:53:29.696019+0000","last_clean":"2024-05-09T05:53:29.696019+0000","last_became_active":"2024-05-09T05:53:24.143181+0000","last_became_peered":"2024-05-09T05:53:24.143181+0000","last_unstale":"2024-05-09T05:53:29.696019+0000","last_undegraded":"2024-05-09T05:53:29.696019+0000","last_fullsized":"2024-05-09T05:53:29.696019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:40:20.997659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"24'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.698981+0000","last_change":"2024-05-09T05:53:23.114815+0000","last_active":"2024-05-09T05:53:29.698981+0000","last_peered":"2024-05-09T05:53:29.698981+0000","last_clean":"2024-05-09T05:53:29.698981+0000","last_became_active":"2024-05-09T05:53:23.113524+0000","last_became_peered":"2024-05-09T05:53:23.113524+0000","last_unstale":"2024-05-09T05:53:29.698981+0000","last_undegraded":"2024-05-09T05:53:29.698981+0000","last_fullsized":"2024-05-09T05:53:29.698981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:35:45.537715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.216033+0000","last_change":"2024-05-09T05:53:28.226682+0000","last_active":"2024-05-09T05:53:29.216033+0000","last_peered":"2024-05-09T05:53:29.216033+0000","last_clean":"2024-05-09T05:53:29.216033+0000","last_became_active":"2024-05-09T05:53:28.226279+0000","last_became_peered":"2024-05-09T05:53:28.226279+0000","last_unstale":"2024-05-09T05:53:29.216033+0000","last_undegraded":"2024-05-09T05:53:29.216033+0000","last_fullsized":"2024-05-09T05:53:29.216033+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:15:55.146695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.519441+0000","last_change":"2024-05-09T05:53:24.135119+0000","last_active":"2024-05-09T05:53:29.519441+0000","last_peered":"2024-05-09T05:53:29.519441+0000","last_clean":"2024-05-09T05:53:29.519441+0000","last_became_active":"2024-05-09T05:53:24.134690+0000","last_became_peered":"2024-05-09T05:53:24.134690+0000","last_unstale":"2024-05-09T05:53:29.519441+0000","last_undegraded":"2024-05-09T05:53:29.519441+0000","last_fullsized":"2024-05-09T05:53:29.519441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:15:36.608441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:38.739048+0000","last_change":"2024-05-09T05:53:23.119626+0000","last_active":"2024-05-09T05:53:38.739048+0000","last_peered":"2024-05-09T05:53:38.739048+0000","last_clean":"2024-05-09T05:53:38.739048+0000","last_became_active":"2024-05-09T05:53:23.119173+0000","last_became_peered":"2024-05-09T05:53:23.119173+0000","last_unstale":"2024-05-09T05:53:38.739048+0000","last_undegraded":"2024-05-09T05:53:38.739048+0000","last_fullsized":"2024-05-09T05:53:38.739048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:24:03.188897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.213285+0000","last_change":"2024-05-09T05:53:28.223167+0000","last_active":"2024-05-09T05:53:29.213285+0000","last_peered":"2024-05-09T05:53:29.213285+0000","last_clean":"2024-05-09T05:53:29.213285+0000","last_became_active":"2024-05-09T05:53:28.221846+0000","last_became_peered":"2024-05-09T05:53:28.221846+0000","last_unstale":"2024-05-09T05:53:29.213285+0000","last_undegraded":"2024-05-09T05:53:29.213285+0000","last_fullsized":"2024-05-09T05:53:29.213285+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:47:12.366900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.214789+0000","last_change":"2024-05-09T05:53:24.133007+0000","last_active":"2024-05-09T05:53:29.214789+0000","last_peered":"2024-05-09T05:53:29.214789+0000","last_clean":"2024-05-09T05:53:29.214789+0000","last_became_active":"2024-05-09T05:53:24.132545+0000","last_became_peered":"2024-05-09T05:53:24.132545+0000","last_unstale":"2024-05-09T05:53:29.214789+0000","last_undegraded":"2024-05-09T05:53:29.214789+0000","last_fullsized":"2024-05-09T05:53:29.214789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:10:26.299015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"24'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.697142+0000","last_change":"2024-05-09T05:53:23.121124+0000","last_active":"2024-05-09T05:53:29.697142+0000","last_peered":"2024-05-09T05:53:29.697142+0000","last_clean":"2024-05-09T05:53:29.697142+0000","last_became_active":"2024-05-09T05:53:23.120303+0000","last_became_peered":"2024-05-09T05:53:23.120303+0000","last_unstale":"2024-05-09T05:53:29.697142+0000","last_undegraded":"2024-05-09T05:53:29.697142+0000","last_fullsized":"2024-05-09T05:53:29.697142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:36:49.445673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.329359+0000","last_change":"2024-05-09T05:53:28.188712+0000","last_active":"2024-05-09T05:53:29.329359+0000","last_peered":"2024-05-09T05:53:29.329359+0000","last_clean":"2024-05-09T05:53:29.329359+0000","last_became_active":"2024-05-09T05:53:28.184259+0000","last_became_peered":"2024-05-09T05:53:28.184259+0000","last_unstale":"2024-05-09T05:53:29.329359+0000","last_undegraded":"2024-05-09T05:53:29.329359+0000","last_fullsized":"2024-05-09T05:53:29.329359+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:56:39.668106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.698810+0000","last_change":"2024-05-09T05:53:24.146147+0000","last_active":"2024-05-09T05:53:29.698810+0000","last_peered":"2024-05-09T05:53:29.698810+0000","last_clean":"2024-05-09T05:53:29.698810+0000","last_became_active":"2024-05-09T05:53:24.145704+0000","last_became_peered":"2024-05-09T05:53:24.145704+0000","last_unstale":"2024-05-09T05:53:29.698810+0000","last_undegraded":"2024-05-09T05:53:29.698810+0000","last_fullsized":"2024-05-09T05:53:29.698810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:47:03.047479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.519380+0000","last_change":"2024-05-09T05:53:23.095689+0000","last_active":"2024-05-09T05:53:29.519380+0000","last_peered":"2024-05-09T05:53:29.519380+0000","last_clean":"2024-05-09T05:53:29.519380+0000","last_became_active":"2024-05-09T05:53:23.094889+0000","last_became_peered":"2024-05-09T05:53:23.094889+0000","last_unstale":"2024-05-09T05:53:29.519380+0000","last_undegraded":"2024-05-09T05:53:29.519380+0000","last_fullsized":"2024-05-09T05:53:29.519380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:25:35.069184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.694877+0000","last_change":"2024-05-09T05:53:28.223954+0000","last_active":"2024-05-09T05:53:29.694877+0000","last_peered":"2024-05-09T05:53:29.694877+0000","last_clean":"2024-05-09T05:53:29.694877+0000","last_became_active":"2024-05-09T05:53:28.222700+0000","last_became_peered":"2024-05-09T05:53:28.222700+0000","last_unstale":"2024-05-09T05:53:29.694877+0000","last_undegraded":"2024-05-09T05:53:29.694877+0000","last_fullsized":"2024-05-09T05:53:29.694877+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:17:17.864782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.330144+0000","last_change":"2024-05-09T05:53:24.140698+0000","last_active":"2024-05-09T05:53:29.330144+0000","last_peered":"2024-05-09T05:53:29.330144+0000","last_clean":"2024-05-09T05:53:29.330144+0000","last_became_active":"2024-05-09T05:53:24.139612+0000","last_became_peered":"2024-05-09T05:53:24.139612+0000","last_unstale":"2024-05-09T05:53:29.330144+0000","last_undegraded":"2024-05-09T05:53:29.330144+0000","last_fullsized":"2024-05-09T05:53:29.330144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:09:39.609750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.215436+0000","last_change":"2024-05-09T05:53:23.106167+0000","last_active":"2024-05-09T05:53:29.215436+0000","last_peered":"2024-05-09T05:53:29.215436+0000","last_clean":"2024-05-09T05:53:29.215436+0000","last_became_active":"2024-05-09T05:53:23.105346+0000","last_became_peered":"2024-05-09T05:53:23.105346+0000","last_unstale":"2024-05-09T05:53:29.215436+0000","last_undegraded":"2024-05-09T05:53:29.215436+0000","last_fullsized":"2024-05-09T05:53:29.215436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:06:46.109056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.213366+0000","last_change":"2024-05-09T05:53:28.194037+0000","last_active":"2024-05-09T05:53:29.213366+0000","last_peered":"2024-05-09T05:53:29.213366+0000","last_clean":"2024-05-09T05:53:29.213366+0000","last_became_active":"2024-05-09T05:53:28.192944+0000","last_became_peered":"2024-05-09T05:53:28.192944+0000","last_unstale":"2024-05-09T05:53:29.213366+0000","last_undegraded":"2024-05-09T05:53:29.213366+0000","last_fullsized":"2024-05-09T05:53:29.213366+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:28:47.664198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.214534+0000","last_change":"2024-05-09T05:53:28.226664+0000","last_active":"2024-05-09T05:53:29.214534+0000","last_peered":"2024-05-09T05:53:29.214534+0000","last_clean":"2024-05-09T05:53:29.214534+0000","last_became_active":"2024-05-09T05:53:28.222225+0000","last_became_peered":"2024-05-09T05:53:28.222225+0000","last_unstale":"2024-05-09T05:53:29.214534+0000","last_undegraded":"2024-05-09T05:53:29.214534+0000","last_fullsized":"2024-05-09T05:53:29.214534+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:24:23.614210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.213172+0000","last_change":"2024-05-09T05:53:24.128343+0000","last_active":"2024-05-09T05:53:29.213172+0000","last_peered":"2024-05-09T05:53:29.213172+0000","last_clean":"2024-05-09T05:53:29.213172+0000","last_became_active":"2024-05-09T05:53:24.127989+0000","last_became_peered":"2024-05-09T05:53:24.127989+0000","last_unstale":"2024-05-09T05:53:29.213172+0000","last_undegraded":"2024-05-09T05:53:29.213172+0000","last_fullsized":"2024-05-09T05:53:29.213172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:56:14.176175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"25'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.212869+0000","last_change":"2024-05-09T05:53:23.118882+0000","last_active":"2024-05-09T05:53:29.212869+0000","last_peered":"2024-05-09T05:53:29.212869+0000","last_clean":"2024-05-09T05:53:29.212869+0000","last_became_active":"2024-05-09T05:53:23.118119+0000","last_became_peered":"2024-05-09T05:53:23.118119+0000","last_unstale":"2024-05-09T05:53:29.212869+0000","last_undegraded":"2024-05-09T05:53:29.212869+0000","last_fullsized":"2024-05-09T05:53:29.212869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:06:48.203396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.215588+0000","last_change":"2024-05-09T05:53:28.235313+0000","last_active":"2024-05-09T05:53:29.215588+0000","last_peered":"2024-05-09T05:53:29.215588+0000","last_clean":"2024-05-09T05:53:29.215588+0000","last_became_active":"2024-05-09T05:53:28.234771+0000","last_became_peered":"2024-05-09T05:53:28.234771+0000","last_unstale":"2024-05-09T05:53:29.215588+0000","last_undegraded":"2024-05-09T05:53:29.215588+0000","last_fullsized":"2024-05-09T05:53:29.215588+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:38:46.942863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.697143+0000","last_change":"2024-05-09T05:53:24.141956+0000","last_active":"2024-05-09T05:53:29.697143+0000","last_peered":"2024-05-09T05:53:29.697143+0000","last_clean":"2024-05-09T05:53:29.697143+0000","last_became_active":"2024-05-09T05:53:24.139093+0000","last_became_peered":"2024-05-09T05:53:24.139093+0000","last_unstale":"2024-05-09T05:53:29.697143+0000","last_undegraded":"2024-05-09T05:53:29.697143+0000","last_fullsized":"2024-05-09T05:53:29.697143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:44:32.901168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.698890+0000","last_change":"2024-05-09T05:53:23.113865+0000","last_active":"2024-05-09T05:53:29.698890+0000","last_peered":"2024-05-09T05:53:29.698890+0000","last_clean":"2024-05-09T05:53:29.698890+0000","last_became_active":"2024-05-09T05:53:23.112020+0000","last_became_peered":"2024-05-09T05:53:23.112020+0000","last_unstale":"2024-05-09T05:53:29.698890+0000","last_undegraded":"2024-05-09T05:53:29.698890+0000","last_fullsized":"2024-05-09T05:53:29.698890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:37:04.425229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"24'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.213736+0000","last_change":"2024-05-09T05:53:23.127463+0000","last_active":"2024-05-09T05:53:29.213736+0000","last_peered":"2024-05-09T05:53:29.213736+0000","last_clean":"2024-05-09T05:53:29.213736+0000","last_became_active":"2024-05-09T05:53:23.126911+0000","last_became_peered":"2024-05-09T05:53:23.126911+0000","last_unstale":"2024-05-09T05:53:29.213736+0000","last_undegraded":"2024-05-09T05:53:29.213736+0000","last_fullsized":"2024-05-09T05:53:29.213736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:06:28.458926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.213862+0000","last_change":"2024-05-09T05:53:24.134391+0000","last_active":"2024-05-09T05:53:29.213862+0000","last_peered":"2024-05-09T05:53:29.213862+0000","last_clean":"2024-05-09T05:53:29.213862+0000","last_became_active":"2024-05-09T05:53:24.133994+0000","last_became_peered":"2024-05-09T05:53:24.133994+0000","last_unstale":"2024-05-09T05:53:29.213862+0000","last_undegraded":"2024-05-09T05:53:29.213862+0000","last_fullsized":"2024-05-09T05:53:29.213862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:30:32.872657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.213741+0000","last_change":"2024-05-09T05:53:28.223524+0000","last_active":"2024-05-09T05:53:29.213741+0000","last_peered":"2024-05-09T05:53:29.213741+0000","last_clean":"2024-05-09T05:53:29.213741+0000","last_became_active":"2024-05-09T05:53:28.222433+0000","last_became_peered":"2024-05-09T05:53:28.222433+0000","last_unstale":"2024-05-09T05:53:29.213741+0000","last_undegraded":"2024-05-09T05:53:29.213741+0000","last_fullsized":"2024-05-09T05:53:29.213741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:52:35.361812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'5","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:53.618412+0000","last_change":"2024-05-09T05:53:23.133700+0000","last_active":"2024-05-09T05:53:53.618412+0000","last_peered":"2024-05-09T05:53:53.618412+0000","last_clean":"2024-05-09T05:53:53.618412+0000","last_became_active":"2024-05-09T05:53:23.132946+0000","last_became_peered":"2024-05-09T05:53:23.132946+0000","last_unstale":"2024-05-09T05:53:53.618412+0000","last_undegraded":"2024-05-09T05:53:53.618412+0000","last_fullsized":"2024-05-09T05:53:53.618412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:39:49.829592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.210913+0000","last_change":"2024-05-09T05:53:24.138174+0000","last_active":"2024-05-09T05:53:29.210913+0000","last_peered":"2024-05-09T05:53:29.210913+0000","last_clean":"2024-05-09T05:53:29.210913+0000","last_became_active":"2024-05-09T05:53:24.137794+0000","last_became_peered":"2024-05-09T05:53:24.137794+0000","last_unstale":"2024-05-09T05:53:29.210913+0000","last_undegraded":"2024-05-09T05:53:29.210913+0000","last_fullsized":"2024-05-09T05:53:29.210913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:57:26.359258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.696516+0000","last_change":"2024-05-09T05:53:28.238375+0000","last_active":"2024-05-09T05:53:29.696516+0000","last_peered":"2024-05-09T05:53:29.696516+0000","last_clean":"2024-05-09T05:53:29.696516+0000","last_became_active":"2024-05-09T05:53:28.237414+0000","last_became_peered":"2024-05-09T05:53:28.237414+0000","last_unstale":"2024-05-09T05:53:29.696516+0000","last_undegraded":"2024-05-09T05:53:29.696516+0000","last_fullsized":"2024-05-09T05:53:29.696516+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:13:50.396951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.329027+0000","last_change":"2024-05-09T05:53:24.130839+0000","last_active":"2024-05-09T05:53:29.329027+0000","last_peered":"2024-05-09T05:53:29.329027+0000","last_clean":"2024-05-09T05:53:29.329027+0000","last_became_active":"2024-05-09T05:53:24.130201+0000","last_became_peered":"2024-05-09T05:53:24.130201+0000","last_unstale":"2024-05-09T05:53:29.329027+0000","last_undegraded":"2024-05-09T05:53:29.329027+0000","last_fullsized":"2024-05-09T05:53:29.329027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:26:03.973553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.696321+0000","last_change":"2024-05-09T05:53:24.138681+0000","last_active":"2024-05-09T05:53:29.696321+0000","last_peered":"2024-05-09T05:53:29.696321+0000","last_clean":"2024-05-09T05:53:29.696321+0000","last_became_active":"2024-05-09T05:53:24.138366+0000","last_became_peered":"2024-05-09T05:53:24.138366+0000","last_unstale":"2024-05-09T05:53:29.696321+0000","last_undegraded":"2024-05-09T05:53:29.696321+0000","last_fullsized":"2024-05-09T05:53:29.696321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:49.856205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.213330+0000","last_change":"2024-05-09T05:53:24.139915+0000","last_active":"2024-05-09T05:53:29.213330+0000","last_peered":"2024-05-09T05:53:29.213330+0000","last_clean":"2024-05-09T05:53:29.213330+0000","last_became_active":"2024-05-09T05:53:24.139058+0000","last_became_peered":"2024-05-09T05:53:24.139058+0000","last_unstale":"2024-05-09T05:53:29.213330+0000","last_undegraded":"2024-05-09T05:53:29.213330+0000","last_fullsized":"2024-05-09T05:53:29.213330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:06:00.768431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.696712+0000","last_change":"2024-05-09T05:53:24.149759+0000","last_active":"2024-05-09T05:53:29.696712+0000","last_peered":"2024-05-09T05:53:29.696712+0000","last_clean":"2024-05-09T05:53:29.696712+0000","last_became_active":"2024-05-09T05:53:24.142812+0000","last_became_peered":"2024-05-09T05:53:24.142812+0000","last_unstale":"2024-05-09T05:53:29.696712+0000","last_undegraded":"2024-05-09T05:53:29.696712+0000","last_fullsized":"2024-05-09T05:53:29.696712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:04.522514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.698128+0000","last_change":"2024-05-09T05:53:24.135373+0000","last_active":"2024-05-09T05:53:29.698128+0000","last_peered":"2024-05-09T05:53:29.698128+0000","last_clean":"2024-05-09T05:53:29.698128+0000","last_became_active":"2024-05-09T05:53:24.135043+0000","last_became_peered":"2024-05-09T05:53:24.135043+0000","last_unstale":"2024-05-09T05:53:29.698128+0000","last_undegraded":"2024-05-09T05:53:29.698128+0000","last_fullsized":"2024-05-09T05:53:29.698128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:20:03.245696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.696921+0000","last_change":"2024-05-09T05:53:24.134712+0000","last_active":"2024-05-09T05:53:29.696921+0000","last_peered":"2024-05-09T05:53:29.696921+0000","last_clean":"2024-05-09T05:53:29.696921+0000","last_became_active":"2024-05-09T05:53:24.132453+0000","last_became_peered":"2024-05-09T05:53:24.132453+0000","last_unstale":"2024-05-09T05:53:29.696921+0000","last_undegraded":"2024-05-09T05:53:29.696921+0000","last_fullsized":"2024-05-09T05:53:29.696921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:47:30.716995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.330002+0000","last_change":"2024-05-09T05:53:24.140714+0000","last_active":"2024-05-09T05:53:29.330002+0000","last_peered":"2024-05-09T05:53:29.330002+0000","last_clean":"2024-05-09T05:53:29.330002+0000","last_became_active":"2024-05-09T05:53:24.140045+0000","last_became_peered":"2024-05-09T05:53:24.140045+0000","last_unstale":"2024-05-09T05:53:29.330002+0000","last_undegraded":"2024-05-09T05:53:29.330002+0000","last_fullsized":"2024-05-09T05:53:29.330002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:36:06.166411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.697852+0000","last_change":"2024-05-09T05:53:24.151591+0000","last_active":"2024-05-09T05:53:29.697852+0000","last_peered":"2024-05-09T05:53:29.697852+0000","last_clean":"2024-05-09T05:53:29.697852+0000","last_became_active":"2024-05-09T05:53:24.151275+0000","last_became_peered":"2024-05-09T05:53:24.151275+0000","last_unstale":"2024-05-09T05:53:29.697852+0000","last_undegraded":"2024-05-09T05:53:29.697852+0000","last_fullsized":"2024-05-09T05:53:29.697852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:28:28.552732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.212703+0000","last_change":"2024-05-09T05:53:24.144315+0000","last_active":"2024-05-09T05:53:29.212703+0000","last_peered":"2024-05-09T05:53:29.212703+0000","last_clean":"2024-05-09T05:53:29.212703+0000","last_became_active":"2024-05-09T05:53:24.144005+0000","last_became_peered":"2024-05-09T05:53:24.144005+0000","last_unstale":"2024-05-09T05:53:29.212703+0000","last_undegraded":"2024-05-09T05:53:29.212703+0000","last_fullsized":"2024-05-09T05:53:29.212703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:06:37.312541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.697839+0000","last_change":"2024-05-09T05:53:24.149852+0000","last_active":"2024-05-09T05:53:29.697839+0000","last_peered":"2024-05-09T05:53:29.697839+0000","last_clean":"2024-05-09T05:53:29.697839+0000","last_became_active":"2024-05-09T05:53:24.146965+0000","last_became_peered":"2024-05-09T05:53:24.146965+0000","last_unstale":"2024-05-09T05:53:29.697839+0000","last_undegraded":"2024-05-09T05:53:29.697839+0000","last_fullsized":"2024-05-09T05:53:29.697839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:02:26.991425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.210907+0000","last_change":"2024-05-09T05:53:24.131735+0000","last_active":"2024-05-09T05:53:29.210907+0000","last_peered":"2024-05-09T05:53:29.210907+0000","last_clean":"2024-05-09T05:53:29.210907+0000","last_became_active":"2024-05-09T05:53:24.131417+0000","last_became_peered":"2024-05-09T05:53:24.131417+0000","last_unstale":"2024-05-09T05:53:29.210907+0000","last_undegraded":"2024-05-09T05:53:29.210907+0000","last_fullsized":"2024-05-09T05:53:29.210907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:59.750972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.213503+0000","last_change":"2024-05-09T05:53:24.140697+0000","last_active":"2024-05-09T05:53:29.213503+0000","last_peered":"2024-05-09T05:53:29.213503+0000","last_clean":"2024-05-09T05:53:29.213503+0000","last_became_active":"2024-05-09T05:53:24.140024+0000","last_became_peered":"2024-05-09T05:53:24.140024+0000","last_unstale":"2024-05-09T05:53:29.213503+0000","last_undegraded":"2024-05-09T05:53:29.213503+0000","last_fullsized":"2024-05-09T05:53:29.213503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:14:14.543827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.519088+0000","last_change":"2024-05-09T05:53:24.136878+0000","last_active":"2024-05-09T05:53:29.519088+0000","last_peered":"2024-05-09T05:53:29.519088+0000","last_clean":"2024-05-09T05:53:29.519088+0000","last_became_active":"2024-05-09T05:53:24.136572+0000","last_became_peered":"2024-05-09T05:53:24.136572+0000","last_unstale":"2024-05-09T05:53:29.519088+0000","last_undegraded":"2024-05-09T05:53:29.519088+0000","last_fullsized":"2024-05-09T05:53:29.519088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:46:47.509355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.216011+0000","last_change":"2024-05-09T05:53:24.147372+0000","last_active":"2024-05-09T05:53:29.216011+0000","last_peered":"2024-05-09T05:53:29.216011+0000","last_clean":"2024-05-09T05:53:29.216011+0000","last_became_active":"2024-05-09T05:53:24.144573+0000","last_became_peered":"2024-05-09T05:53:24.144573+0000","last_unstale":"2024-05-09T05:53:29.216011+0000","last_undegraded":"2024-05-09T05:53:29.216011+0000","last_fullsized":"2024-05-09T05:53:29.216011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:51:09.845748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.698543+0000","last_change":"2024-05-09T05:53:24.135964+0000","last_active":"2024-05-09T05:53:29.698543+0000","last_peered":"2024-05-09T05:53:29.698543+0000","last_clean":"2024-05-09T05:53:29.698543+0000","last_became_active":"2024-05-09T05:53:24.135625+0000","last_became_peered":"2024-05-09T05:53:24.135625+0000","last_unstale":"2024-05-09T05:53:29.698543+0000","last_undegraded":"2024-05-09T05:53:29.698543+0000","last_fullsized":"2024-05-09T05:53:29.698543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:52:02.026146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.216721+0000","last_change":"2024-05-09T05:53:24.133916+0000","last_active":"2024-05-09T05:53:29.216721+0000","last_peered":"2024-05-09T05:53:29.216721+0000","last_clean":"2024-05-09T05:53:29.216721+0000","last_became_active":"2024-05-09T05:53:24.133405+0000","last_became_peered":"2024-05-09T05:53:24.133405+0000","last_unstale":"2024-05-09T05:53:29.216721+0000","last_undegraded":"2024-05-09T05:53:29.216721+0000","last_fullsized":"2024-05-09T05:53:29.216721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:30:16.477715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.212403+0000","last_change":"2024-05-09T05:53:24.139697+0000","last_active":"2024-05-09T05:53:29.212403+0000","last_peered":"2024-05-09T05:53:29.212403+0000","last_clean":"2024-05-09T05:53:29.212403+0000","last_became_active":"2024-05-09T05:53:24.139374+0000","last_became_peered":"2024-05-09T05:53:24.139374+0000","last_unstale":"2024-05-09T05:53:29.212403+0000","last_undegraded":"2024-05-09T05:53:29.212403+0000","last_fullsized":"2024-05-09T05:53:29.212403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:26:28.502867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.697314+0000","last_change":"2024-05-09T05:53:24.147755+0000","last_active":"2024-05-09T05:53:29.697314+0000","last_peered":"2024-05-09T05:53:29.697314+0000","last_clean":"2024-05-09T05:53:29.697314+0000","last_became_active":"2024-05-09T05:53:24.145616+0000","last_became_peered":"2024-05-09T05:53:24.145616+0000","last_unstale":"2024-05-09T05:53:29.697314+0000","last_undegraded":"2024-05-09T05:53:29.697314+0000","last_fullsized":"2024-05-09T05:53:29.697314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:21:10.387393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.695743+0000","last_change":"2024-05-09T05:53:24.131741+0000","last_active":"2024-05-09T05:53:29.695743+0000","last_peered":"2024-05-09T05:53:29.695743+0000","last_clean":"2024-05-09T05:53:29.695743+0000","last_became_active":"2024-05-09T05:53:24.128870+0000","last_became_peered":"2024-05-09T05:53:24.128870+0000","last_unstale":"2024-05-09T05:53:29.695743+0000","last_undegraded":"2024-05-09T05:53:29.695743+0000","last_fullsized":"2024-05-09T05:53:29.695743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:28:25.103524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.696503+0000","last_change":"2024-05-09T05:53:24.133443+0000","last_active":"2024-05-09T05:53:29.696503+0000","last_peered":"2024-05-09T05:53:29.696503+0000","last_clean":"2024-05-09T05:53:29.696503+0000","last_became_active":"2024-05-09T05:53:24.132688+0000","last_became_peered":"2024-05-09T05:53:24.132688+0000","last_unstale":"2024-05-09T05:53:29.696503+0000","last_undegraded":"2024-05-09T05:53:29.696503+0000","last_fullsized":"2024-05-09T05:53:29.696503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:43:24.750805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.518884+0000","last_change":"2024-05-09T05:53:24.142600+0000","last_active":"2024-05-09T05:53:29.518884+0000","last_peered":"2024-05-09T05:53:29.518884+0000","last_clean":"2024-05-09T05:53:29.518884+0000","last_became_active":"2024-05-09T05:53:24.142280+0000","last_became_peered":"2024-05-09T05:53:24.142280+0000","last_unstale":"2024-05-09T05:53:29.518884+0000","last_undegraded":"2024-05-09T05:53:29.518884+0000","last_fullsized":"2024-05-09T05:53:29.518884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:20:58.962379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.519367+0000","last_change":"2024-05-09T05:53:24.144839+0000","last_active":"2024-05-09T05:53:29.519367+0000","last_peered":"2024-05-09T05:53:29.519367+0000","last_clean":"2024-05-09T05:53:29.519367+0000","last_became_active":"2024-05-09T05:53:24.144381+0000","last_became_peered":"2024-05-09T05:53:24.144381+0000","last_unstale":"2024-05-09T05:53:29.519367+0000","last_undegraded":"2024-05-09T05:53:29.519367+0000","last_fullsized":"2024-05-09T05:53:29.519367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:40:46.738053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.519277+0000","last_change":"2024-05-09T05:53:24.131521+0000","last_active":"2024-05-09T05:53:29.519277+0000","last_peered":"2024-05-09T05:53:29.519277+0000","last_clean":"2024-05-09T05:53:29.519277+0000","last_became_active":"2024-05-09T05:53:24.131218+0000","last_became_peered":"2024-05-09T05:53:24.131218+0000","last_unstale":"2024-05-09T05:53:29.519277+0000","last_undegraded":"2024-05-09T05:53:29.519277+0000","last_fullsized":"2024-05-09T05:53:29.519277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:25:59.410270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.215388+0000","last_change":"2024-05-09T05:53:24.139922+0000","last_active":"2024-05-09T05:53:29.215388+0000","last_peered":"2024-05-09T05:53:29.215388+0000","last_clean":"2024-05-09T05:53:29.215388+0000","last_became_active":"2024-05-09T05:53:24.139473+0000","last_became_peered":"2024-05-09T05:53:24.139473+0000","last_unstale":"2024-05-09T05:53:29.215388+0000","last_undegraded":"2024-05-09T05:53:29.215388+0000","last_fullsized":"2024-05-09T05:53:29.215388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:37:50.839899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.696349+0000","last_change":"2024-05-09T05:53:24.143338+0000","last_active":"2024-05-09T05:53:29.696349+0000","last_peered":"2024-05-09T05:53:29.696349+0000","last_clean":"2024-05-09T05:53:29.696349+0000","last_became_active":"2024-05-09T05:53:24.143053+0000","last_became_peered":"2024-05-09T05:53:24.143053+0000","last_unstale":"2024-05-09T05:53:29.696349+0000","last_undegraded":"2024-05-09T05:53:29.696349+0000","last_fullsized":"2024-05-09T05:53:29.696349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:22:16.337090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.518199+0000","last_change":"2024-05-09T05:53:24.145517+0000","last_active":"2024-05-09T05:53:29.518199+0000","last_peered":"2024-05-09T05:53:29.518199+0000","last_clean":"2024-05-09T05:53:29.518199+0000","last_became_active":"2024-05-09T05:53:24.145150+0000","last_became_peered":"2024-05-09T05:53:24.145150+0000","last_unstale":"2024-05-09T05:53:29.518199+0000","last_undegraded":"2024-05-09T05:53:29.518199+0000","last_fullsized":"2024-05-09T05:53:29.518199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:19:53.947349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.330681+0000","last_change":"2024-05-09T05:53:24.129669+0000","last_active":"2024-05-09T05:53:29.330681+0000","last_peered":"2024-05-09T05:53:29.330681+0000","last_clean":"2024-05-09T05:53:29.330681+0000","last_became_active":"2024-05-09T05:53:24.129339+0000","last_became_peered":"2024-05-09T05:53:24.129339+0000","last_unstale":"2024-05-09T05:53:29.330681+0000","last_undegraded":"2024-05-09T05:53:29.330681+0000","last_fullsized":"2024-05-09T05:53:29.330681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:05:51.845643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.518947+0000","last_change":"2024-05-09T05:53:24.138914+0000","last_active":"2024-05-09T05:53:29.518947+0000","last_peered":"2024-05-09T05:53:29.518947+0000","last_clean":"2024-05-09T05:53:29.518947+0000","last_became_active":"2024-05-09T05:53:24.138499+0000","last_became_peered":"2024-05-09T05:53:24.138499+0000","last_unstale":"2024-05-09T05:53:29.518947+0000","last_undegraded":"2024-05-09T05:53:29.518947+0000","last_fullsized":"2024-05-09T05:53:29.518947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:29:00.338046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.329427+0000","last_change":"2024-05-09T05:53:24.144296+0000","last_active":"2024-05-09T05:53:29.329427+0000","last_peered":"2024-05-09T05:53:29.329427+0000","last_clean":"2024-05-09T05:53:29.329427+0000","last_became_active":"2024-05-09T05:53:24.143890+0000","last_became_peered":"2024-05-09T05:53:24.143890+0000","last_unstale":"2024-05-09T05:53:29.329427+0000","last_undegraded":"2024-05-09T05:53:29.329427+0000","last_fullsized":"2024-05-09T05:53:29.329427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:34:56.860849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.697600+0000","last_change":"2024-05-09T05:53:24.152635+0000","last_active":"2024-05-09T05:53:29.697600+0000","last_peered":"2024-05-09T05:53:29.697600+0000","last_clean":"2024-05-09T05:53:29.697600+0000","last_became_active":"2024-05-09T05:53:24.151674+0000","last_became_peered":"2024-05-09T05:53:24.151674+0000","last_unstale":"2024-05-09T05:53:29.697600+0000","last_undegraded":"2024-05-09T05:53:29.697600+0000","last_fullsized":"2024-05-09T05:53:29.697600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:18:47.495857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.698463+0000","last_change":"2024-05-09T05:53:24.152746+0000","last_active":"2024-05-09T05:53:29.698463+0000","last_peered":"2024-05-09T05:53:29.698463+0000","last_clean":"2024-05-09T05:53:29.698463+0000","last_became_active":"2024-05-09T05:53:24.151418+0000","last_became_peered":"2024-05-09T05:53:24.151418+0000","last_unstale":"2024-05-09T05:53:29.698463+0000","last_undegraded":"2024-05-09T05:53:29.698463+0000","last_fullsized":"2024-05-09T05:53:29.698463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:27:19.121790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-09T05:53:29.519905+0000","last_change":"2024-05-09T05:53:24.140908+0000","last_active":"2024-05-09T05:53:29.519905+0000","last_peered":"2024-05-09T05:53:29.519905+0000","last_clean":"2024-05-09T05:53:29.519905+0000","last_became_active":"2024-05-09T05:53:24.140589+0000","last_became_peered":"2024-05-09T05:53:24.140589+0000","last_unstale":"2024-05-09T05:53:29.519905+0000","last_undegraded":"2024-05-09T05:53:29.519905+0000","last_fullsized":"2024-05-09T05:53:29.519905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:51:03.458547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5284,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":9924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":58,"ondisk_log_size":58,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509450,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":266240,"data_stored":101907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509453,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":258048,"data_stored":101783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509453,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":278528,"data_stored":106297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509450,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":270336,"data_stored":105625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509452,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":856064,"data_stored":692221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509452,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":101839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":868352,"data_stored":692865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574860,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":102365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T05:53:56.691 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-09T05:53:56.691 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-09T05:53:56.692 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-05-09T05:53:56.692 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-09T05:53:56.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.879+0000 7fc647236640 1 Processor -- start 2024-05-09T05:53:56.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.879+0000 7fc647236640 1 -- start start 2024-05-09T05:53:56.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.883+0000 7fc647236640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6401606d0 0x7fc640156ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:56.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.883+0000 7fc647236640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc6400c9630 0x7fc6400cc370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:56.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.883+0000 7fc647236640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc64006e440 con 0x7fc6400cc8b0 2024-05-09T05:53:56.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.883+0000 7fc647236640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fc6400ca9d0 con 0x7fc6400c9630 2024-05-09T05:53:56.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.883+0000 7fc647236640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fc640160bf0 con 0x7fc6401606d0 2024-05-09T05:53:56.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.883+0000 7fc63ffff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc6400c9630 0x7fc6400cc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:56.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.883+0000 7fc6457d3640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc6400cc8b0 0x7fc64015c7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34542/0 (socket says 172.21.15.72:34542) 2024-05-09T05:53:56.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.883+0000 7fc6457d3640 1 -- 172.21.15.72:0/3703904051 learned_addr learned my addr 172.21.15.72:0/3703904051 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:53:56.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.883+0000 7fc63ffff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc6400c9630 0x7fc6400cc370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42348/0 (socket says 172.21.15.72:42348) 2024-05-09T05:53:56.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.883+0000 7fc644fd2640 1 --2- 172.21.15.72:0/3703904051 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6401606d0 0x7fc640156ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:56.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.883+0000 7fc63ffff640 1 -- 172.21.15.72:0/3703904051 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6401606d0 msgr2=0x7fc640156ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:53:56.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.883+0000 7fc63ffff640 1 --2- 172.21.15.72:0/3703904051 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6401606d0 0x7fc640156ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:56.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.883+0000 7fc63ffff640 1 -- 172.21.15.72:0/3703904051 >> v1:172.21.15.72:6789/0 conn(0x7fc6400cc8b0 legacy=0x7fc64015c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:56.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.883+0000 7fc63f7fe640 1 -- 172.21.15.72:0/3703904051 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2724410475 0 0) 0x7fc64006e440 con 0x7fc6400cc8b0 2024-05-09T05:53:56.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.883+0000 7fc63ffff640 1 -- 172.21.15.72:0/3703904051 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6400ca410 con 0x7fc6400c9630 2024-05-09T05:53:56.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.883+0000 7fc63ffff640 1 --2- 172.21.15.72:0/3703904051 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6400c9630 0x7fc6400cc370 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc6340097c0 tx=0x7fc63401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5686e96e0c742326 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:56.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.883+0000 7fc63f7fe640 1 -- 172.21.15.72:0/3703904051 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6340b1070 con 0x7fc6400c9630 2024-05-09T05:53:56.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.883+0000 7fc63f7fe640 1 -- 172.21.15.72:0/3703904051 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6340ac410 con 0x7fc6400c9630 2024-05-09T05:53:56.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.883+0000 7fc63f7fe640 1 -- 172.21.15.72:0/3703904051 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6340ac7e0 con 0x7fc6400c9630 2024-05-09T05:53:56.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.883+0000 7fc647236640 1 -- 172.21.15.72:0/3703904051 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6400c9630 msgr2=0x7fc6400cc370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:56.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.883+0000 7fc647236640 1 --2- 172.21.15.72:0/3703904051 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6400c9630 0x7fc6400cc370 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc6340097c0 tx=0x7fc63401c4a0 comp rx=0 tx=0).stop 2024-05-09T05:53:56.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.883+0000 7fc647236640 1 -- 172.21.15.72:0/3703904051 shutdown_connections 2024-05-09T05:53:56.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.883+0000 7fc647236640 1 --2- 172.21.15.72:0/3703904051 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6400c9630 0x7fc6400cc370 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:56.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.883+0000 7fc647236640 1 --2- 172.21.15.72:0/3703904051 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6401606d0 0x7fc640156ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:56.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.883+0000 7fc647236640 1 -- 172.21.15.72:0/3703904051 >> 172.21.15.72:0/3703904051 conn(0x7fc640068d00 msgr2=0x7fc6400cf960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:56.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.883+0000 7fc647236640 1 -- 172.21.15.72:0/3703904051 shutdown_connections 2024-05-09T05:53:56.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.883+0000 7fc647236640 1 -- 172.21.15.72:0/3703904051 wait complete. 2024-05-09T05:53:56.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.887+0000 7fc647236640 1 Processor -- start 2024-05-09T05:53:56.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.887+0000 7fc647236640 1 -- start start 2024-05-09T05:53:56.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.887+0000 7fc647236640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6400c9630 0x7fc64014cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:56.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.887+0000 7fc647236640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6400cc8b0 0x7fc6401481f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:56.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.887+0000 7fc647236640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6401606d0 0x7fc640148730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:56.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.887+0000 7fc647236640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fc6401699e0 con 0x7fc6400cc8b0 2024-05-09T05:53:56.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.887+0000 7fc647236640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fc640169860 con 0x7fc6400c9630 2024-05-09T05:53:56.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.887+0000 7fc647236640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fc640169b60 con 0x7fc6401606d0 2024-05-09T05:53:56.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.887+0000 7fc63ffff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6400cc8b0 0x7fc6401481f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:56.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.887+0000 7fc63ffff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6400cc8b0 0x7fc6401481f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42356/0 (socket says 172.21.15.72:42356) 2024-05-09T05:53:56.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.887+0000 7fc63ffff640 1 -- 172.21.15.72:0/2747255573 learned_addr learned my addr 172.21.15.72:0/2747255573 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:53:56.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.887+0000 7fc6457d3640 1 --2- 172.21.15.72:0/2747255573 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6401606d0 0x7fc640148730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:56.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.887+0000 7fc644fd2640 1 --2- 172.21.15.72:0/2747255573 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6400c9630 0x7fc64014cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:56.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.887+0000 7fc63ffff640 1 -- 172.21.15.72:0/2747255573 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6401606d0 msgr2=0x7fc640148730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:56.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.887+0000 7fc63ffff640 1 --2- 172.21.15.72:0/2747255573 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6401606d0 0x7fc640148730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:56.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.887+0000 7fc63ffff640 1 -- 172.21.15.72:0/2747255573 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6400c9630 msgr2=0x7fc64014cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:56.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.887+0000 7fc63ffff640 1 --2- 172.21.15.72:0/2747255573 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6400c9630 0x7fc64014cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:56.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.887+0000 7fc63ffff640 1 -- 172.21.15.72:0/2747255573 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc64014d1a0 con 0x7fc6400cc8b0 2024-05-09T05:53:56.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.887+0000 7fc6457d3640 1 --2- 172.21.15.72:0/2747255573 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6401606d0 0x7fc640148730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:53:56.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.887+0000 7fc644fd2640 1 --2- 172.21.15.72:0/2747255573 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6400c9630 0x7fc64014cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:53:56.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.887+0000 7fc63ffff640 1 --2- 172.21.15.72:0/2747255573 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6400cc8b0 0x7fc6401481f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc6340af040 tx=0x7fc634019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:56.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.887+0000 7fc63d7fa640 1 -- 172.21.15.72:0/2747255573 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6340b1040 con 0x7fc6400cc8b0 2024-05-09T05:53:56.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.887+0000 7fc63d7fa640 1 -- 172.21.15.72:0/2747255573 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6340ba070 con 0x7fc6400cc8b0 2024-05-09T05:53:56.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.887+0000 7fc647236640 1 -- 172.21.15.72:0/2747255573 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc64014a740 con 0x7fc6400cc8b0 2024-05-09T05:53:56.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.887+0000 7fc63d7fa640 1 -- 172.21.15.72:0/2747255573 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6340ab6b0 con 0x7fc6400cc8b0 2024-05-09T05:53:56.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.887+0000 7fc647236640 1 -- 172.21.15.72:0/2747255573 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc64014ad00 con 0x7fc6400cc8b0 2024-05-09T05:53:56.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.891+0000 7fc647236640 1 -- 172.21.15.72:0/2747255573 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc64006a520 con 0x7fc6400cc8b0 2024-05-09T05:53:56.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.891+0000 7fc63d7fa640 1 -- 172.21.15.72:0/2747255573 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fc6340ab850 con 0x7fc6400cc8b0 2024-05-09T05:53:56.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.891+0000 7fc63d7fa640 1 --2- 172.21.15.72:0/2747255573 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fc62c06f430 0x7fc62c071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:53:56.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.891+0000 7fc63d7fa640 1 -- 172.21.15.72:0/2747255573 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc634129aa0 con 0x7fc6400cc8b0 2024-05-09T05:53:56.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.891+0000 7fc644fd2640 1 --2- 172.21.15.72:0/2747255573 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fc62c06f430 0x7fc62c071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:53:56.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.891+0000 7fc644fd2640 1 --2- 172.21.15.72:0/2747255573 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fc62c06f430 0x7fc62c071940 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc6300097a0 tx=0x7fc630008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:53:56.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:56.895+0000 7fc63d7fa640 1 -- 172.21.15.72:0/2747255573 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fc634016090 con 0x7fc6400cc8b0 2024-05-09T05:53:57.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:57.075+0000 7fc647236640 1 -- 172.21.15.72:0/2747255573 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc640151740 con 0x7fc6400cc8b0 2024-05-09T05:53:57.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:57.075+0000 7fc63d7fa640 1 -- 172.21.15.72:0/2747255573 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+196 (secure 0 0 0) 0x7fc6340f66c0 con 0x7fc6400cc8b0 2024-05-09T05:53:57.068 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:53:57.068 INFO:teuthology.orchestra.run.smithi072.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2024-05-09T05:53:57.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:57.079+0000 7fc647236640 1 -- 172.21.15.72:0/2747255573 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fc62c06f430 msgr2=0x7fc62c071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:57.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:57.079+0000 7fc647236640 1 --2- 172.21.15.72:0/2747255573 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fc62c06f430 0x7fc62c071940 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc6300097a0 tx=0x7fc630008040 comp rx=0 tx=0).stop 2024-05-09T05:53:57.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:57.079+0000 7fc647236640 1 -- 172.21.15.72:0/2747255573 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6400cc8b0 msgr2=0x7fc6401481f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:53:57.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:57.079+0000 7fc647236640 1 --2- 172.21.15.72:0/2747255573 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6400cc8b0 0x7fc6401481f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc6340af040 tx=0x7fc634019240 comp rx=0 tx=0).stop 2024-05-09T05:53:57.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:57.079+0000 7fc647236640 1 -- 172.21.15.72:0/2747255573 shutdown_connections 2024-05-09T05:53:57.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:57.079+0000 7fc647236640 1 --2- 172.21.15.72:0/2747255573 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fc62c06f430 0x7fc62c071940 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:57.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:57.079+0000 7fc647236640 1 --2- 172.21.15.72:0/2747255573 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6401606d0 0x7fc640148730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:57.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:57.079+0000 7fc647236640 1 --2- 172.21.15.72:0/2747255573 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6400cc8b0 0x7fc6401481f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:57.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:57.079+0000 7fc647236640 1 --2- 172.21.15.72:0/2747255573 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6400c9630 0x7fc64014cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:53:57.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:57.079+0000 7fc647236640 1 -- 172.21.15.72:0/2747255573 >> 172.21.15.72:0/2747255573 conn(0x7fc640068d00 msgr2=0x7fc640152ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:53:57.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:57.079+0000 7fc647236640 1 -- 172.21.15.72:0/2747255573 shutdown_connections 2024-05-09T05:53:57.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:53:57.079+0000 7fc647236640 1 -- 172.21.15.72:0/2747255573 wait complete. 2024-05-09T05:54:00.089 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-09T05:54:00.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.259+0000 7f2b9e0c7640 1 Processor -- start 2024-05-09T05:54:00.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.259+0000 7f2b9e0c7640 1 -- start start 2024-05-09T05:54:00.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.259+0000 7f2b9e0c7640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2b981537e0 0x7f2b981593f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:00.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.263+0000 7f2b9e0c7640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2b980cdce0 0x7f2b980c6910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:00.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.263+0000 7f2b9e0c7640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b980c4c90 con 0x7f2b980cd8d0 2024-05-09T05:54:00.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.263+0000 7f2b9e0c7640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f2b98074b60 con 0x7f2b980cdce0 2024-05-09T05:54:00.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.263+0000 7f2b9e0c7640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f2b980c7420 con 0x7f2b981537e0 2024-05-09T05:54:00.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.263+0000 7f2b8effd640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f2b980cd8d0 0x7f2b980c6200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34546/0 (socket says 172.21.15.72:34546) 2024-05-09T05:54:00.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.263+0000 7f2b8effd640 1 -- 172.21.15.72:0/3176660348 learned_addr learned my addr 172.21.15.72:0/3176660348 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:54:00.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.263+0000 7f2b97fff640 1 --2- 172.21.15.72:0/3176660348 >> v2:172.21.15.72:3300/0 conn(0x7f2b980cdce0 0x7f2b980c6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:00.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.263+0000 7f2b977fe640 1 --2- 172.21.15.72:0/3176660348 >> v2:172.21.15.110:3300/0 conn(0x7f2b981537e0 0x7f2b981593f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:00.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.263+0000 7f2b96ffd640 1 -- 172.21.15.72:0/3176660348 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1899374607 0 0) 0x7f2b980c4c90 con 0x7f2b980cd8d0 2024-05-09T05:54:00.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.263+0000 7f2b96ffd640 1 -- 172.21.15.72:0/3176660348 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b84005740 con 0x7f2b980cd8d0 2024-05-09T05:54:00.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.263+0000 7f2b97fff640 1 -- 172.21.15.72:0/3176660348 >> v2:172.21.15.110:3300/0 conn(0x7f2b981537e0 msgr2=0x7f2b981593f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:00.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.263+0000 7f2b97fff640 1 --2- 172.21.15.72:0/3176660348 >> v2:172.21.15.110:3300/0 conn(0x7f2b981537e0 0x7f2b981593f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:00.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.263+0000 7f2b97fff640 1 -- 172.21.15.72:0/3176660348 >> v1:172.21.15.72:6789/0 conn(0x7f2b980cd8d0 legacy=0x7f2b980c6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:00.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.263+0000 7f2b97fff640 1 -- 172.21.15.72:0/3176660348 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b980c9db0 con 0x7f2b980cdce0 2024-05-09T05:54:00.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.263+0000 7f2b97fff640 1 --2- 172.21.15.72:0/3176660348 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b980cdce0 0x7f2b980c6910 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2b980ce380 tx=0x7f2b9001c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d13c721969df6efc server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:00.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.263+0000 7f2b96ffd640 1 -- 172.21.15.72:0/3176660348 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b900a6670 con 0x7f2b980cdce0 2024-05-09T05:54:00.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.263+0000 7f2b96ffd640 1 -- 172.21.15.72:0/3176660348 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b900a6810 con 0x7f2b980cdce0 2024-05-09T05:54:00.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.263+0000 7f2b96ffd640 1 -- 172.21.15.72:0/3176660348 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b900a6be0 con 0x7f2b980cdce0 2024-05-09T05:54:00.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.263+0000 7f2b9e0c7640 1 -- 172.21.15.72:0/3176660348 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b980cdce0 msgr2=0x7f2b980c6910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:00.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.263+0000 7f2b9e0c7640 1 --2- 172.21.15.72:0/3176660348 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b980cdce0 0x7f2b980c6910 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2b980ce380 tx=0x7f2b9001c8a0 comp rx=0 tx=0).stop 2024-05-09T05:54:00.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.263+0000 7f2b9e0c7640 1 -- 172.21.15.72:0/3176660348 shutdown_connections 2024-05-09T05:54:00.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.263+0000 7f2b9e0c7640 1 --2- 172.21.15.72:0/3176660348 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b980cdce0 0x7f2b980c6910 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:00.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.263+0000 7f2b9e0c7640 1 --2- 172.21.15.72:0/3176660348 >> v2:172.21.15.110:3300/0 conn(0x7f2b981537e0 0x7f2b981593f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:00.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.263+0000 7f2b9e0c7640 1 -- 172.21.15.72:0/3176660348 >> 172.21.15.72:0/3176660348 conn(0x7f2b980700d0 msgr2=0x7f2b980704e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:00.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.263+0000 7f2b9e0c7640 1 -- 172.21.15.72:0/3176660348 shutdown_connections 2024-05-09T05:54:00.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.263+0000 7f2b9e0c7640 1 -- 172.21.15.72:0/3176660348 wait complete. 2024-05-09T05:54:00.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.267+0000 7f2b9e0c7640 1 Processor -- start 2024-05-09T05:54:00.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.267+0000 7f2b9e0c7640 1 -- start start 2024-05-09T05:54:00.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.267+0000 7f2b9e0c7640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b980cd8d0 0x7f2b981f50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:00.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.267+0000 7f2b9e0c7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b980cdce0 0x7f2b9814bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:00.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.267+0000 7f2b9e0c7640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2b981537e0 0x7f2b9814c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:00.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.267+0000 7f2b9e0c7640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f2b98072310 con 0x7f2b980cd8d0 2024-05-09T05:54:00.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.267+0000 7f2b9e0c7640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f2b980726c0 con 0x7f2b980cdce0 2024-05-09T05:54:00.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.267+0000 7f2b9e0c7640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f2b98159930 con 0x7f2b981537e0 2024-05-09T05:54:00.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.267+0000 7f2b977fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b980cd8d0 0x7f2b981f50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:00.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.267+0000 7f2b977fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b980cd8d0 0x7f2b981f50c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42372/0 (socket says 172.21.15.72:42372) 2024-05-09T05:54:00.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.267+0000 7f2b977fe640 1 -- 172.21.15.72:0/3623798154 learned_addr learned my addr 172.21.15.72:0/3623798154 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:54:00.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.267+0000 7f2b8effd640 1 --2- 172.21.15.72:0/3623798154 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b980cdce0 0x7f2b9814bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:00.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.267+0000 7f2b97fff640 1 --2- 172.21.15.72:0/3623798154 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2b981537e0 0x7f2b9814c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:00.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.267+0000 7f2b977fe640 1 -- 172.21.15.72:0/3623798154 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2b981537e0 msgr2=0x7f2b9814c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:00.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.267+0000 7f2b977fe640 1 --2- 172.21.15.72:0/3623798154 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2b981537e0 0x7f2b9814c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:00.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.267+0000 7f2b977fe640 1 -- 172.21.15.72:0/3623798154 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b980cdce0 msgr2=0x7f2b9814bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:00.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.267+0000 7f2b977fe640 1 --2- 172.21.15.72:0/3623798154 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b980cdce0 0x7f2b9814bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:00.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.267+0000 7f2b977fe640 1 -- 172.21.15.72:0/3623798154 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b98157a60 con 0x7f2b980cd8d0 2024-05-09T05:54:00.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.267+0000 7f2b8effd640 1 --2- 172.21.15.72:0/3623798154 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b980cdce0 0x7f2b9814bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:54:00.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.267+0000 7f2b977fe640 1 --2- 172.21.15.72:0/3623798154 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b980cd8d0 0x7f2b981f50c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2b8800e870 tx=0x7f2b8800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:00.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.267+0000 7f2b94ff9640 1 -- 172.21.15.72:0/3623798154 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b88017070 con 0x7f2b980cd8d0 2024-05-09T05:54:00.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.267+0000 7f2b94ff9640 1 -- 172.21.15.72:0/3623798154 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b8800c940 con 0x7f2b980cd8d0 2024-05-09T05:54:00.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.267+0000 7f2b9e0c7640 1 -- 172.21.15.72:0/3623798154 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b98158f90 con 0x7f2b980cd8d0 2024-05-09T05:54:00.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.267+0000 7f2b94ff9640 1 -- 172.21.15.72:0/3623798154 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b8800ccf0 con 0x7f2b980cd8d0 2024-05-09T05:54:00.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.271+0000 7f2b9e0c7640 1 -- 172.21.15.72:0/3623798154 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b981f5c40 con 0x7f2b980cd8d0 2024-05-09T05:54:00.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.271+0000 7f2b9e0c7640 1 -- 172.21.15.72:0/3623798154 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b9806a520 con 0x7f2b980cd8d0 2024-05-09T05:54:00.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.271+0000 7f2b94ff9640 1 -- 172.21.15.72:0/3623798154 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f2b8801a070 con 0x7f2b980cd8d0 2024-05-09T05:54:00.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.271+0000 7f2b94ff9640 1 --2- 172.21.15.72:0/3623798154 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f2b7806f400 0x7f2b78071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:00.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.271+0000 7f2b94ff9640 1 -- 172.21.15.72:0/3623798154 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f2b8808f7a0 con 0x7f2b980cd8d0 2024-05-09T05:54:00.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.271+0000 7f2b8effd640 1 --2- 172.21.15.72:0/3623798154 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f2b7806f400 0x7f2b78071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:00.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.271+0000 7f2b8effd640 1 --2- 172.21.15.72:0/3623798154 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f2b7806f400 0x7f2b78071910 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2b981469a0 tx=0x7f2b80009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:00.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.275+0000 7f2b94ff9640 1 -- 172.21.15.72:0/3623798154 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f2b8805c470 con 0x7f2b980cd8d0 2024-05-09T05:54:00.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.471+0000 7f2b9e0c7640 1 -- 172.21.15.72:0/3623798154 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f2b980729d0 con 0x7f2b980cd8d0 2024-05-09T05:54:00.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.475+0000 7f2b94ff9640 1 -- 172.21.15.72:0/3623798154 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+196 (secure 0 0 0) 0x7f2b8805bd70 con 0x7f2b980cd8d0 2024-05-09T05:54:00.465 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:54:00.465 INFO:teuthology.orchestra.run.smithi072.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2024-05-09T05:54:00.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.475+0000 7f2b9e0c7640 1 -- 172.21.15.72:0/3623798154 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f2b7806f400 msgr2=0x7f2b78071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:00.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.475+0000 7f2b9e0c7640 1 --2- 172.21.15.72:0/3623798154 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f2b7806f400 0x7f2b78071910 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2b981469a0 tx=0x7f2b80009040 comp rx=0 tx=0).stop 2024-05-09T05:54:00.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.475+0000 7f2b9e0c7640 1 -- 172.21.15.72:0/3623798154 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b980cd8d0 msgr2=0x7f2b981f50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:00.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.475+0000 7f2b9e0c7640 1 --2- 172.21.15.72:0/3623798154 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b980cd8d0 0x7f2b981f50c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2b8800e870 tx=0x7f2b8800ec70 comp rx=0 tx=0).stop 2024-05-09T05:54:00.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.475+0000 7f2b9e0c7640 1 -- 172.21.15.72:0/3623798154 shutdown_connections 2024-05-09T05:54:00.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.475+0000 7f2b9e0c7640 1 --2- 172.21.15.72:0/3623798154 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f2b7806f400 0x7f2b78071910 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:00.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.475+0000 7f2b9e0c7640 1 --2- 172.21.15.72:0/3623798154 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2b981537e0 0x7f2b9814c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:00.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.475+0000 7f2b9e0c7640 1 --2- 172.21.15.72:0/3623798154 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b980cdce0 0x7f2b9814bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:00.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.475+0000 7f2b9e0c7640 1 --2- 172.21.15.72:0/3623798154 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b980cd8d0 0x7f2b981f50c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:00.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.475+0000 7f2b9e0c7640 1 -- 172.21.15.72:0/3623798154 >> 172.21.15.72:0/3623798154 conn(0x7f2b980700d0 msgr2=0x7f2b98073b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:00.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.475+0000 7f2b9e0c7640 1 -- 172.21.15.72:0/3623798154 shutdown_connections 2024-05-09T05:54:00.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:00.475+0000 7f2b9e0c7640 1 -- 172.21.15.72:0/3623798154 wait complete. 2024-05-09T05:54:03.488 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-09T05:54:03.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.655+0000 7f36addd7640 1 Processor -- start 2024-05-09T05:54:03.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.655+0000 7f36addd7640 1 -- start start 2024-05-09T05:54:03.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.655+0000 7f36addd7640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f36a815d970 0x7f36a815dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:03.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.655+0000 7f36addd7640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f36a8074520 0x7f36a8074930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:03.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.655+0000 7f36addd7640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36a815b350 con 0x7f36a80c8040 2024-05-09T05:54:03.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.655+0000 7f36addd7640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f36a80c5c90 con 0x7f36a8074520 2024-05-09T05:54:03.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.655+0000 7f36addd7640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f36a80c59d0 con 0x7f36a815d970 2024-05-09T05:54:03.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.659+0000 7f36a77fe640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f36a80c8040 0x7f36a81542a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.72:39172/0 (socket says 172.21.15.72:39172) 2024-05-09T05:54:03.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.659+0000 7f36a7fff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f36a8074520 0x7f36a8074930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:03.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.659+0000 7f36a77fe640 1 -- 172.21.15.72:0/2458696295 learned_addr learned my addr 172.21.15.72:0/2458696295 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:54:03.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.659+0000 7f36a6ffd640 1 --2- 172.21.15.72:0/2458696295 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f36a815d970 0x7f36a815dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:03.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.659+0000 7f36a7fff640 1 -- 172.21.15.72:0/2458696295 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f36a815d970 msgr2=0x7f36a815dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:03.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.659+0000 7f36a7fff640 1 --2- 172.21.15.72:0/2458696295 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f36a815d970 0x7f36a815dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:03.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.659+0000 7f36a7fff640 1 -- 172.21.15.72:0/2458696295 >> v1:172.21.15.110:6789/0 conn(0x7f36a80c8040 legacy=0x7f36a81542a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:03.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.659+0000 7f36a7fff640 1 -- 172.21.15.72:0/2458696295 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36a815a590 con 0x7f36a8074520 2024-05-09T05:54:03.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.659+0000 7f36a6ffd640 1 --2- 172.21.15.72:0/2458696295 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f36a815d970 0x7f36a815dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T05:54:03.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.659+0000 7f36a7fff640 1 --2- 172.21.15.72:0/2458696295 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36a8074520 0x7f36a8074930 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f36a0009d90 tx=0x7f36a001c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67a304e360a1452a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:03.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.659+0000 7f36a67fc640 1 -- 172.21.15.72:0/2458696295 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a00b2070 con 0x7f36a8074520 2024-05-09T05:54:03.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.659+0000 7f36a67fc640 1 -- 172.21.15.72:0/2458696295 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36a00a5940 con 0x7f36a8074520 2024-05-09T05:54:03.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.659+0000 7f36a67fc640 1 -- 172.21.15.72:0/2458696295 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a00a5d10 con 0x7f36a8074520 2024-05-09T05:54:03.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.663+0000 7f36addd7640 1 -- 172.21.15.72:0/2458696295 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36a8074520 msgr2=0x7f36a8074930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:03.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.663+0000 7f36addd7640 1 --2- 172.21.15.72:0/2458696295 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36a8074520 0x7f36a8074930 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f36a0009d90 tx=0x7f36a001c970 comp rx=0 tx=0).stop 2024-05-09T05:54:03.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.663+0000 7f36addd7640 1 -- 172.21.15.72:0/2458696295 shutdown_connections 2024-05-09T05:54:03.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.663+0000 7f36addd7640 1 --2- 172.21.15.72:0/2458696295 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36a8074520 0x7f36a8074930 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:03.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.663+0000 7f36addd7640 1 --2- 172.21.15.72:0/2458696295 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f36a815d970 0x7f36a815dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:03.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.663+0000 7f36addd7640 1 -- 172.21.15.72:0/2458696295 >> 172.21.15.72:0/2458696295 conn(0x7f36a80700d0 msgr2=0x7f36a80704e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:03.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.663+0000 7f36addd7640 1 -- 172.21.15.72:0/2458696295 shutdown_connections 2024-05-09T05:54:03.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.663+0000 7f36addd7640 1 -- 172.21.15.72:0/2458696295 wait complete. 2024-05-09T05:54:03.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.663+0000 7f36addd7640 1 Processor -- start 2024-05-09T05:54:03.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.663+0000 7f36addd7640 1 -- start start 2024-05-09T05:54:03.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.663+0000 7f36addd7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36a8074520 0x7f36a8159f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:03.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.663+0000 7f36addd7640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f36a80c8040 0x7f36a814ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:03.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.663+0000 7f36addd7640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36a815d970 0x7f36a8148ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:03.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.663+0000 7f36addd7640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f36a80ce610 con 0x7f36a815d970 2024-05-09T05:54:03.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.663+0000 7f36addd7640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f36a80ce490 con 0x7f36a8074520 2024-05-09T05:54:03.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.663+0000 7f36addd7640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f36a80c8450 con 0x7f36a80c8040 2024-05-09T05:54:03.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.663+0000 7f36a7fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36a815d970 0x7f36a8148ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:03.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.663+0000 7f36a7fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36a815d970 0x7f36a8148ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58486/0 (socket says 172.21.15.72:58486) 2024-05-09T05:54:03.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.663+0000 7f36a7fff640 1 -- 172.21.15.72:0/1924990381 learned_addr learned my addr 172.21.15.72:0/1924990381 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:54:03.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.663+0000 7f36a6ffd640 1 --2- 172.21.15.72:0/1924990381 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f36a80c8040 0x7f36a814ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:03.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.663+0000 7f36a77fe640 1 --2- 172.21.15.72:0/1924990381 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36a8074520 0x7f36a8159f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:03.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.667+0000 7f36a7fff640 1 -- 172.21.15.72:0/1924990381 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f36a80c8040 msgr2=0x7f36a814ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:03.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.667+0000 7f36a7fff640 1 --2- 172.21.15.72:0/1924990381 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f36a80c8040 0x7f36a814ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:03.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.667+0000 7f36a7fff640 1 -- 172.21.15.72:0/1924990381 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36a8074520 msgr2=0x7f36a8159f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:03.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.667+0000 7f36a7fff640 1 --2- 172.21.15.72:0/1924990381 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36a8074520 0x7f36a8159f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:03.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.667+0000 7f36a7fff640 1 -- 172.21.15.72:0/1924990381 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36a814e7d0 con 0x7f36a815d970 2024-05-09T05:54:03.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.667+0000 7f36a7fff640 1 --2- 172.21.15.72:0/1924990381 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36a815d970 0x7f36a8148ed0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f36a001b020 tx=0x7f36a0019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:03.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.667+0000 7f368ffff640 1 -- 172.21.15.72:0/1924990381 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a00b2050 con 0x7f36a815d970 2024-05-09T05:54:03.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.667+0000 7f368ffff640 1 -- 172.21.15.72:0/1924990381 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36a00be070 con 0x7f36a815d970 2024-05-09T05:54:03.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.667+0000 7f36addd7640 1 -- 172.21.15.72:0/1924990381 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36a8150970 con 0x7f36a815d970 2024-05-09T05:54:03.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.667+0000 7f368ffff640 1 -- 172.21.15.72:0/1924990381 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a00ada70 con 0x7f36a815d970 2024-05-09T05:54:03.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.667+0000 7f36addd7640 1 -- 172.21.15.72:0/1924990381 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36a814e180 con 0x7f36a815d970 2024-05-09T05:54:03.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.667+0000 7f36addd7640 1 -- 172.21.15.72:0/1924990381 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36a806a520 con 0x7f36a815d970 2024-05-09T05:54:03.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.667+0000 7f368ffff640 1 -- 172.21.15.72:0/1924990381 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f36a00a57c0 con 0x7f36a815d970 2024-05-09T05:54:03.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.667+0000 7f368ffff640 1 --2- 172.21.15.72:0/1924990381 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f369406f400 0x7f3694071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:03.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.667+0000 7f368ffff640 1 -- 172.21.15.72:0/1924990381 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f36a012a620 con 0x7f36a815d970 2024-05-09T05:54:03.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.667+0000 7f36a77fe640 1 --2- 172.21.15.72:0/1924990381 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f369406f400 0x7f3694071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:03.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.667+0000 7f36a77fe640 1 --2- 172.21.15.72:0/1924990381 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f369406f400 0x7f3694071910 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3698000f70 tx=0x7f3698009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:03.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.671+0000 7f368ffff640 1 -- 172.21.15.72:0/1924990381 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f36a0016560 con 0x7f36a815d970 2024-05-09T05:54:03.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.867+0000 7f36addd7640 1 -- 172.21.15.72:0/1924990381 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f36a80763a0 con 0x7f36a815d970 2024-05-09T05:54:03.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.867+0000 7f368ffff640 1 -- 172.21.15.72:0/1924990381 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+196 (secure 0 0 0) 0x7f36a00f7270 con 0x7f36a815d970 2024-05-09T05:54:03.860 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:54:03.860 INFO:teuthology.orchestra.run.smithi072.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2024-05-09T05:54:03.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.871+0000 7f36addd7640 1 -- 172.21.15.72:0/1924990381 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f369406f400 msgr2=0x7f3694071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:03.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.871+0000 7f36addd7640 1 --2- 172.21.15.72:0/1924990381 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f369406f400 0x7f3694071910 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3698000f70 tx=0x7f3698009040 comp rx=0 tx=0).stop 2024-05-09T05:54:03.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.871+0000 7f36addd7640 1 -- 172.21.15.72:0/1924990381 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36a815d970 msgr2=0x7f36a8148ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:03.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.871+0000 7f36addd7640 1 --2- 172.21.15.72:0/1924990381 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36a815d970 0x7f36a8148ed0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f36a001b020 tx=0x7f36a0019710 comp rx=0 tx=0).stop 2024-05-09T05:54:03.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.871+0000 7f36addd7640 1 -- 172.21.15.72:0/1924990381 shutdown_connections 2024-05-09T05:54:03.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.871+0000 7f36addd7640 1 --2- 172.21.15.72:0/1924990381 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f369406f400 0x7f3694071910 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:03.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.871+0000 7f36addd7640 1 --2- 172.21.15.72:0/1924990381 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36a815d970 0x7f36a8148ed0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:03.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.871+0000 7f36addd7640 1 --2- 172.21.15.72:0/1924990381 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f36a80c8040 0x7f36a814ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:03.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.871+0000 7f36addd7640 1 --2- 172.21.15.72:0/1924990381 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36a8074520 0x7f36a8159f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:03.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.871+0000 7f36addd7640 1 -- 172.21.15.72:0/1924990381 >> 172.21.15.72:0/1924990381 conn(0x7f36a80700d0 msgr2=0x7f36a80cbea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:03.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.871+0000 7f36addd7640 1 -- 172.21.15.72:0/1924990381 shutdown_connections 2024-05-09T05:54:03.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:03.871+0000 7f36addd7640 1 -- 172.21.15.72:0/1924990381 wait complete. 2024-05-09T05:54:04.052 INFO:tasks.ceph.mds.b.smithi110.stderr:2024-05-09T05:54:04.062+0000 7f6833aba640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-05-09T05:54:06.882 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-09T05:54:07.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.051+0000 7f4f1ec87640 1 Processor -- start 2024-05-09T05:54:07.043 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.051+0000 7f4f1ec87640 1 -- start start 2024-05-09T05:54:07.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.051+0000 7f4f1ec87640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f18072dd0 0x7f4f18152af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:07.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.055+0000 7f4f1ec87640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f180735a0 con 0x7f4f1815bfb0 2024-05-09T05:54:07.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.055+0000 7f4f1ec87640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f18073880 con 0x7f4f1815c3c0 2024-05-09T05:54:07.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.055+0000 7f4f1ec87640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f4f18073e80 con 0x7f4f18072dd0 2024-05-09T05:54:07.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.055+0000 7f4f17fff640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f4f1815bfb0 0x7f4f1806c7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55264/0 (socket says 172.21.15.72:55264) 2024-05-09T05:54:07.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.055+0000 7f4f17fff640 1 -- 172.21.15.72:0/4270397551 learned_addr learned my addr 172.21.15.72:0/4270397551 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:54:07.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.055+0000 7f4f1ca23640 1 --2- 172.21.15.72:0/4270397551 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f18072dd0 0x7f4f18152af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:07.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.055+0000 7f4f177fe640 1 -- 172.21.15.72:0/4270397551 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2690113135 0 0) 0x7f4f180735a0 con 0x7f4f1815bfb0 2024-05-09T05:54:07.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.055+0000 7f4f177fe640 1 -- 172.21.15.72:0/4270397551 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f00003530 con 0x7f4f1815bfb0 2024-05-09T05:54:07.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.055+0000 7f4f177fe640 1 -- 172.21.15.72:0/4270397551 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3851447571 0 0) 0x7f4f00003530 con 0x7f4f1815bfb0 2024-05-09T05:54:07.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.055+0000 7f4f177fe640 1 -- 172.21.15.72:0/4270397551 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f18072dd0 msgr2=0x7f4f18152af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:07.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.055+0000 7f4f177fe640 1 --2- 172.21.15.72:0/4270397551 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f18072dd0 0x7f4f18152af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:07.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.055+0000 7f4f177fe640 1 -- 172.21.15.72:0/4270397551 >> v1:172.21.15.110:6789/0 conn(0x7f4f1815c3c0 legacy=0x7f4f18163340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:07.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.055+0000 7f4f177fe640 1 -- 172.21.15.72:0/4270397551 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f18074160 con 0x7f4f1815bfb0 2024-05-09T05:54:07.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.055+0000 7f4f177fe640 1 -- 172.21.15.72:0/4270397551 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2749052815 0 0) 0x7f4f0c001700 con 0x7f4f1815bfb0 2024-05-09T05:54:07.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.055+0000 7f4f177fe640 1 -- 172.21.15.72:0/4270397551 >> v1:172.21.15.72:6789/0 conn(0x7f4f1815bfb0 legacy=0x7f4f1806c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:07.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.055+0000 7f4f177fe640 1 --2- 172.21.15.72:0/4270397551 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f18072dd0 0x7f4f00003a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:07.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.055+0000 7f4f177fe640 1 --2- 172.21.15.72:0/4270397551 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f00004010 0x7f4f00004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:07.047 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.055+0000 7f4f177fe640 1 --2- 172.21.15.72:0/4270397551 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f00004d50 0x7f4f00005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:07.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.055+0000 7f4f177fe640 1 -- 172.21.15.72:0/4270397551 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f4f18073e80 con 0x7f4f00004010 2024-05-09T05:54:07.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.055+0000 7f4f177fe640 1 -- 172.21.15.72:0/4270397551 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f4f0000bca0 con 0x7f4f00004d50 2024-05-09T05:54:07.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.055+0000 7f4f177fe640 1 -- 172.21.15.72:0/4270397551 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f4f0000bea0 con 0x7f4f18072dd0 2024-05-09T05:54:07.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.055+0000 7f4f17fff640 1 --2- 172.21.15.72:0/4270397551 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f00004010 0x7f4f00004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:07.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.055+0000 7f4f1d224640 1 --2- 172.21.15.72:0/4270397551 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f00004d50 0x7f4f00005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:07.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.055+0000 7f4f1ca23640 1 --2- 172.21.15.72:0/4270397551 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f18072dd0 0x7f4f00003a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:07.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.055+0000 7f4f17fff640 1 -- 172.21.15.72:0/4270397551 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f18072dd0 msgr2=0x7f4f00003a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:07.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.055+0000 7f4f17fff640 1 --2- 172.21.15.72:0/4270397551 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f18072dd0 0x7f4f00003a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:07.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.055+0000 7f4f17fff640 1 -- 172.21.15.72:0/4270397551 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f00004d50 msgr2=0x7f4f00005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:07.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.055+0000 7f4f17fff640 1 --2- 172.21.15.72:0/4270397551 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f00004d50 0x7f4f00005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:07.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.055+0000 7f4f17fff640 1 -- 172.21.15.72:0/4270397551 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f00003530 con 0x7f4f00004010 2024-05-09T05:54:07.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.055+0000 7f4f17fff640 1 --2- 172.21.15.72:0/4270397551 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f00004010 0x7f4f00004810 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4f180cb550 tx=0x7f4f0c01cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57c22eb7bc0b09ce server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:07.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.055+0000 7f4f177fe640 1 -- 172.21.15.72:0/4270397551 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f0c007d50 con 0x7f4f00004010 2024-05-09T05:54:07.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.055+0000 7f4f177fe640 1 -- 172.21.15.72:0/4270397551 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f0c0a9020 con 0x7f4f00004010 2024-05-09T05:54:07.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.055+0000 7f4f177fe640 1 -- 172.21.15.72:0/4270397551 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f0c005ae0 con 0x7f4f00004010 2024-05-09T05:54:07.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.059+0000 7f4f1ec87640 1 -- 172.21.15.72:0/4270397551 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f00004010 msgr2=0x7f4f00004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:07.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.059+0000 7f4f1ec87640 1 --2- 172.21.15.72:0/4270397551 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f00004010 0x7f4f00004810 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4f180cb550 tx=0x7f4f0c01cb20 comp rx=0 tx=0).stop 2024-05-09T05:54:07.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.059+0000 7f4f1d224640 1 -- 172.21.15.72:0/4270397551 reap_dead start 2024-05-09T05:54:07.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.059+0000 7f4f1ec87640 1 -- 172.21.15.72:0/4270397551 shutdown_connections 2024-05-09T05:54:07.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.059+0000 7f4f1ec87640 1 -- 172.21.15.72:0/4270397551 >> 172.21.15.72:0/4270397551 conn(0x7f4f180700d0 msgr2=0x7f4f180704e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:07.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.059+0000 7f4f1ec87640 1 -- 172.21.15.72:0/4270397551 shutdown_connections 2024-05-09T05:54:07.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.059+0000 7f4f1ec87640 1 -- 172.21.15.72:0/4270397551 wait complete. 2024-05-09T05:54:07.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.059+0000 7f4f1ec87640 1 Processor -- start 2024-05-09T05:54:07.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.059+0000 7f4f1ec87640 1 -- start start 2024-05-09T05:54:07.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.059+0000 7f4f1ec87640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f00004010 0x7f4f18150b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:07.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.059+0000 7f4f1ec87640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f181f4ed0 0x7f4f180cc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:07.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.059+0000 7f4f1ec87640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f18155650 0x7f4f18155a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:07.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.059+0000 7f4f1ec87640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f4f180731e0 con 0x7f4f00004010 2024-05-09T05:54:07.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.059+0000 7f4f1ec87640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f4f18073b60 con 0x7f4f181f4ed0 2024-05-09T05:54:07.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.059+0000 7f4f1ec87640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f4f18073360 con 0x7f4f18155650 2024-05-09T05:54:07.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.059+0000 7f4f1ca23640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f00004010 0x7f4f18150b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:07.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.059+0000 7f4f1ca23640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f00004010 0x7f4f18150b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58498/0 (socket says 172.21.15.72:58498) 2024-05-09T05:54:07.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.059+0000 7f4f1ca23640 1 -- 172.21.15.72:0/2791001406 learned_addr learned my addr 172.21.15.72:0/2791001406 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:54:07.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.063+0000 7f4f1d224640 1 --2- 172.21.15.72:0/2791001406 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f18155650 0x7f4f18155a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:07.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.063+0000 7f4f17fff640 1 --2- 172.21.15.72:0/2791001406 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f181f4ed0 0x7f4f180cc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:07.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.063+0000 7f4f1ca23640 1 -- 172.21.15.72:0/2791001406 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f18155650 msgr2=0x7f4f18155a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:07.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.063+0000 7f4f1ca23640 1 --2- 172.21.15.72:0/2791001406 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f18155650 0x7f4f18155a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:07.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.063+0000 7f4f1ca23640 1 -- 172.21.15.72:0/2791001406 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f181f4ed0 msgr2=0x7f4f180cc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:07.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.063+0000 7f4f1ca23640 1 --2- 172.21.15.72:0/2791001406 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f181f4ed0 0x7f4f180cc6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:07.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.063+0000 7f4f1ca23640 1 -- 172.21.15.72:0/2791001406 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f18155fa0 con 0x7f4f00004010 2024-05-09T05:54:07.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.063+0000 7f4f1d224640 1 --2- 172.21.15.72:0/2791001406 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f18155650 0x7f4f18155a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:54:07.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.063+0000 7f4f17fff640 1 --2- 172.21.15.72:0/2791001406 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f181f4ed0 0x7f4f180cc6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:54:07.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.063+0000 7f4f1ca23640 1 --2- 172.21.15.72:0/2791001406 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f00004010 0x7f4f18150b40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4f080107e0 tx=0x7f4f08010ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:07.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.063+0000 7f4f157fa640 1 -- 172.21.15.72:0/2791001406 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f0800b040 con 0x7f4f00004010 2024-05-09T05:54:07.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.063+0000 7f4f157fa640 1 -- 172.21.15.72:0/2791001406 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f0800ec60 con 0x7f4f00004010 2024-05-09T05:54:07.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.063+0000 7f4f157fa640 1 -- 172.21.15.72:0/2791001406 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f08012430 con 0x7f4f00004010 2024-05-09T05:54:07.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.063+0000 7f4f1ec87640 1 -- 172.21.15.72:0/2791001406 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f180c5e00 con 0x7f4f00004010 2024-05-09T05:54:07.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.063+0000 7f4f1ec87640 1 -- 172.21.15.72:0/2791001406 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f181f46d0 con 0x7f4f00004010 2024-05-09T05:54:07.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.063+0000 7f4f1ec87640 1 -- 172.21.15.72:0/2791001406 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f1806a520 con 0x7f4f00004010 2024-05-09T05:54:07.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.063+0000 7f4f157fa640 1 -- 172.21.15.72:0/2791001406 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f4f080125d0 con 0x7f4f00004010 2024-05-09T05:54:07.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.063+0000 7f4f157fa640 1 --2- 172.21.15.72:0/2791001406 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f4f0406f400 0x7f4f04071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:07.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.063+0000 7f4f157fa640 1 -- 172.21.15.72:0/2791001406 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f4f08090150 con 0x7f4f00004010 2024-05-09T05:54:07.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.063+0000 7f4f17fff640 1 --2- 172.21.15.72:0/2791001406 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f4f0406f400 0x7f4f04071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:07.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.067+0000 7f4f17fff640 1 --2- 172.21.15.72:0/2791001406 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f4f0406f400 0x7f4f04071910 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c0aa000 tx=0x7f4f18158a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:07.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.067+0000 7f4f157fa640 1 -- 172.21.15.72:0/2791001406 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f4f0805ced0 con 0x7f4f00004010 2024-05-09T05:54:07.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.263+0000 7f4f1ec87640 1 -- 172.21.15.72:0/2791001406 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f4f180c41f0 con 0x7f4f00004010 2024-05-09T05:54:07.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.267+0000 7f4f157fa640 1 -- 172.21.15.72:0/2791001406 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f4f0805c7d0 con 0x7f4f00004010 2024-05-09T05:54:07.257 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:54:07.257 INFO:teuthology.orchestra.run.smithi072.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-09T05:54:07.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.267+0000 7f4f1ec87640 1 -- 172.21.15.72:0/2791001406 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f4f0406f400 msgr2=0x7f4f04071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:07.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.267+0000 7f4f1ec87640 1 --2- 172.21.15.72:0/2791001406 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f4f0406f400 0x7f4f04071910 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c0aa000 tx=0x7f4f18158a00 comp rx=0 tx=0).stop 2024-05-09T05:54:07.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.267+0000 7f4f1ec87640 1 -- 172.21.15.72:0/2791001406 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f00004010 msgr2=0x7f4f18150b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:07.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.267+0000 7f4f1ec87640 1 --2- 172.21.15.72:0/2791001406 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f00004010 0x7f4f18150b40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4f080107e0 tx=0x7f4f08010ca0 comp rx=0 tx=0).stop 2024-05-09T05:54:07.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.267+0000 7f4f1ec87640 1 -- 172.21.15.72:0/2791001406 shutdown_connections 2024-05-09T05:54:07.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.267+0000 7f4f1ec87640 1 --2- 172.21.15.72:0/2791001406 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f4f0406f400 0x7f4f04071910 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:07.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.267+0000 7f4f1ec87640 1 --2- 172.21.15.72:0/2791001406 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f18155650 0x7f4f18155a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:07.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.267+0000 7f4f1ec87640 1 --2- 172.21.15.72:0/2791001406 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f181f4ed0 0x7f4f180cc6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:07.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.267+0000 7f4f1ec87640 1 --2- 172.21.15.72:0/2791001406 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f00004010 0x7f4f18150b40 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:07.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.267+0000 7f4f1ec87640 1 -- 172.21.15.72:0/2791001406 >> 172.21.15.72:0/2791001406 conn(0x7f4f180700d0 msgr2=0x7f4f180cd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:07.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.267+0000 7f4f1ec87640 1 -- 172.21.15.72:0/2791001406 shutdown_connections 2024-05-09T05:54:07.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.267+0000 7f4f1ec87640 1 -- 172.21.15.72:0/2791001406 wait complete. 2024-05-09T05:54:07.279 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-05-09T05:54:07.279 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:54:07.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.439+0000 7f071614d640 1 Processor -- start 2024-05-09T05:54:07.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.439+0000 7f071614d640 1 -- start start 2024-05-09T05:54:07.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.439+0000 7f071614d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0710075020 0x7f0710074090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:07.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.439+0000 7f071614d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0710161f80 0x7f07101643a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:07.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.439+0000 7f071614d640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f071006e960 con 0x7f07100745d0 2024-05-09T05:54:07.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.439+0000 7f071614d640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f0710072b20 con 0x7f0710161f80 2024-05-09T05:54:07.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.439+0000 7f071614d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f0710072840 con 0x7f0710075020 2024-05-09T05:54:07.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.439+0000 7f070effd640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f07100745d0 0x7f07100c7480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55280/0 (socket says 172.21.15.72:55280) 2024-05-09T05:54:07.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.439+0000 7f070effd640 1 -- 172.21.15.72:0/4225306720 learned_addr learned my addr 172.21.15.72:0/4225306720 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:54:07.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.439+0000 7f070f7fe640 1 --2- 172.21.15.72:0/4225306720 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0710075020 0x7f0710074090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:07.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.439+0000 7f070ffff640 1 --2- 172.21.15.72:0/4225306720 >> v2:172.21.15.110:3300/0 conn(0x7f0710161f80 0x7f07101643a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:07.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.439+0000 7f070e7fc640 1 -- 172.21.15.72:0/4225306720 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3893423377 0 0) 0x7f071006e960 con 0x7f07100745d0 2024-05-09T05:54:07.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.439+0000 7f070e7fc640 1 -- 172.21.15.72:0/4225306720 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06fc003530 con 0x7f07100745d0 2024-05-09T05:54:07.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.439+0000 7f070e7fc640 1 -- 172.21.15.72:0/4225306720 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 20286597 0 0) 0x7f06fc003530 con 0x7f07100745d0 2024-05-09T05:54:07.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.439+0000 7f070e7fc640 1 -- 172.21.15.72:0/4225306720 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0710075020 msgr2=0x7f0710074090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:07.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.439+0000 7f070e7fc640 1 --2- 172.21.15.72:0/4225306720 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0710075020 0x7f0710074090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:07.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.439+0000 7f070e7fc640 1 -- 172.21.15.72:0/4225306720 >> v2:172.21.15.110:3300/0 conn(0x7f0710161f80 msgr2=0x7f07101643a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:07.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.439+0000 7f070e7fc640 1 --2- 172.21.15.72:0/4225306720 >> v2:172.21.15.110:3300/0 conn(0x7f0710161f80 0x7f07101643a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:07.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.443+0000 7f070e7fc640 1 -- 172.21.15.72:0/4225306720 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f071006ec20 con 0x7f07100745d0 2024-05-09T05:54:07.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.443+0000 7f070e7fc640 1 -- 172.21.15.72:0/4225306720 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2749052815 0 0) 0x7f06f8001700 con 0x7f07100745d0 2024-05-09T05:54:07.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.443+0000 7f070e7fc640 1 -- 172.21.15.72:0/4225306720 >> v1:172.21.15.72:6789/0 conn(0x7f07100745d0 legacy=0x7f07100c7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:07.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.443+0000 7f070e7fc640 1 --2- 172.21.15.72:0/4225306720 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0710075020 0x7f06fc003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:07.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.443+0000 7f070e7fc640 1 --2- 172.21.15.72:0/4225306720 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06fc003fe0 0x7f06fc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:07.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.443+0000 7f070e7fc640 1 --2- 172.21.15.72:0/4225306720 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06fc004d50 0x7f06fc005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:07.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.443+0000 7f070e7fc640 1 -- 172.21.15.72:0/4225306720 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f0710072b20 con 0x7f06fc003fe0 2024-05-09T05:54:07.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.443+0000 7f070e7fc640 1 -- 172.21.15.72:0/4225306720 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f0710072840 con 0x7f06fc004d50 2024-05-09T05:54:07.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.443+0000 7f070e7fc640 1 -- 172.21.15.72:0/4225306720 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f06fc00bb60 con 0x7f0710075020 2024-05-09T05:54:07.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.443+0000 7f070effd640 1 --2- 172.21.15.72:0/4225306720 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06fc003fe0 0x7f06fc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:07.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.443+0000 7f070f7fe640 1 --2- 172.21.15.72:0/4225306720 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0710075020 0x7f06fc003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:07.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.443+0000 7f070ffff640 1 --2- 172.21.15.72:0/4225306720 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06fc004d50 0x7f06fc005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:07.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.443+0000 7f070effd640 1 -- 172.21.15.72:0/4225306720 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0710075020 msgr2=0x7f06fc003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:07.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.443+0000 7f070effd640 1 --2- 172.21.15.72:0/4225306720 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0710075020 0x7f06fc003a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:07.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.443+0000 7f070effd640 1 -- 172.21.15.72:0/4225306720 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06fc004d50 msgr2=0x7f06fc005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:07.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.443+0000 7f070effd640 1 --2- 172.21.15.72:0/4225306720 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06fc004d50 0x7f06fc005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:07.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.443+0000 7f070effd640 1 -- 172.21.15.72:0/4225306720 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06fc003530 con 0x7f06fc003fe0 2024-05-09T05:54:07.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.443+0000 7f070ffff640 1 --2- 172.21.15.72:0/4225306720 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06fc004d50 0x7f06fc005160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:54:07.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.443+0000 7f070effd640 1 --2- 172.21.15.72:0/4225306720 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06fc003fe0 0x7f06fc004810 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f06f800c210 tx=0x7f06f801cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=decdb3e82a896fbd server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:07.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.443+0000 7f070e7fc640 1 -- 172.21.15.72:0/4225306720 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f8007d60 con 0x7f06fc003fe0 2024-05-09T05:54:07.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.443+0000 7f070e7fc640 1 -- 172.21.15.72:0/4225306720 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06f80a9070 con 0x7f06fc003fe0 2024-05-09T05:54:07.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.443+0000 7f070e7fc640 1 -- 172.21.15.72:0/4225306720 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f80058e0 con 0x7f06fc003fe0 2024-05-09T05:54:07.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.443+0000 7f071614d640 1 -- 172.21.15.72:0/4225306720 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06fc003fe0 msgr2=0x7f06fc004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:07.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.443+0000 7f071614d640 1 --2- 172.21.15.72:0/4225306720 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06fc003fe0 0x7f06fc004810 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f06f800c210 tx=0x7f06f801cc90 comp rx=0 tx=0).stop 2024-05-09T05:54:07.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.443+0000 7f070ffff640 1 -- 172.21.15.72:0/4225306720 reap_dead start 2024-05-09T05:54:07.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.443+0000 7f071614d640 1 -- 172.21.15.72:0/4225306720 shutdown_connections 2024-05-09T05:54:07.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.443+0000 7f071614d640 1 -- 172.21.15.72:0/4225306720 >> 172.21.15.72:0/4225306720 conn(0x7f07100cb350 msgr2=0x7f07100cb760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:07.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.443+0000 7f071614d640 1 -- 172.21.15.72:0/4225306720 shutdown_connections 2024-05-09T05:54:07.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.443+0000 7f071614d640 1 -- 172.21.15.72:0/4225306720 wait complete. 2024-05-09T05:54:07.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.447+0000 7f071614d640 1 Processor -- start 2024-05-09T05:54:07.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.447+0000 7f071614d640 1 -- start start 2024-05-09T05:54:07.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.447+0000 7f071614d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06fc003fe0 0x7f07101f0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:07.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.447+0000 7f071614d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0710152790 0x7f0710151060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:07.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.447+0000 7f071614d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07101515a0 0x7f0710143b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:07.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.447+0000 7f071614d640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f0710159dc0 con 0x7f07101515a0 2024-05-09T05:54:07.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.447+0000 7f071614d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f0710159ae0 con 0x7f0710152790 2024-05-09T05:54:07.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.447+0000 7f071614d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f071015a0a0 con 0x7f06fc003fe0 2024-05-09T05:54:07.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.447+0000 7f070ffff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07101515a0 0x7f0710143b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:07.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.447+0000 7f070ffff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07101515a0 0x7f0710143b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58516/0 (socket says 172.21.15.72:58516) 2024-05-09T05:54:07.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.447+0000 7f070ffff640 1 -- 172.21.15.72:0/963691647 learned_addr learned my addr 172.21.15.72:0/963691647 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:54:07.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.447+0000 7f070effd640 1 --2- 172.21.15.72:0/963691647 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0710152790 0x7f0710151060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:07.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.447+0000 7f070f7fe640 1 --2- 172.21.15.72:0/963691647 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06fc003fe0 0x7f07101f0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:07.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.447+0000 7f070ffff640 1 -- 172.21.15.72:0/963691647 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06fc003fe0 msgr2=0x7f07101f0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:07.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.447+0000 7f070ffff640 1 --2- 172.21.15.72:0/963691647 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06fc003fe0 0x7f07101f0de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:07.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.447+0000 7f070ffff640 1 -- 172.21.15.72:0/963691647 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0710152790 msgr2=0x7f0710151060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:07.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.447+0000 7f070ffff640 1 --2- 172.21.15.72:0/963691647 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0710152790 0x7f0710151060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:07.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.447+0000 7f070ffff640 1 -- 172.21.15.72:0/963691647 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0710145ee0 con 0x7f07101515a0 2024-05-09T05:54:07.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.447+0000 7f070ffff640 1 --2- 172.21.15.72:0/963691647 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07101515a0 0x7f0710143b90 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0710070830 tx=0x7f0700010b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:07.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.447+0000 7f0707fff640 1 -- 172.21.15.72:0/963691647 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f070000f040 con 0x7f07101515a0 2024-05-09T05:54:07.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.447+0000 7f0707fff640 1 -- 172.21.15.72:0/963691647 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f070001c070 con 0x7f07101515a0 2024-05-09T05:54:07.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.447+0000 7f071614d640 1 -- 172.21.15.72:0/963691647 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07101f1320 con 0x7f07101515a0 2024-05-09T05:54:07.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.447+0000 7f0707fff640 1 -- 172.21.15.72:0/963691647 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f070000ead0 con 0x7f07101515a0 2024-05-09T05:54:07.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.451+0000 7f071614d640 1 -- 172.21.15.72:0/963691647 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07101f4610 con 0x7f07101515a0 2024-05-09T05:54:07.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.451+0000 7f071614d640 1 -- 172.21.15.72:0/963691647 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07101460b0 con 0x7f07101515a0 2024-05-09T05:54:07.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.451+0000 7f0707fff640 1 -- 172.21.15.72:0/963691647 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f070000ec70 con 0x7f07101515a0 2024-05-09T05:54:07.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.451+0000 7f0707fff640 1 --2- 172.21.15.72:0/963691647 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f06f006f400 0x7f06f0071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:07.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.451+0000 7f0707fff640 1 -- 172.21.15.72:0/963691647 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f070008f240 con 0x7f07101515a0 2024-05-09T05:54:07.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.451+0000 7f070f7fe640 1 --2- 172.21.15.72:0/963691647 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f06f006f400 0x7f06f0071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:07.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.451+0000 7f070f7fe640 1 --2- 172.21.15.72:0/963691647 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f06f006f400 0x7f06f0071910 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f07080073f0 tx=0x7f070800b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:07.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.455+0000 7f0707fff640 1 -- 172.21.15.72:0/963691647 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f0700026020 con 0x7f07101515a0 2024-05-09T05:54:07.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.651+0000 7f071614d640 1 -- 172.21.15.72:0/963691647 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f071006a520 con 0x7f07101515a0 2024-05-09T05:54:07.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.655+0000 7f0707fff640 1 -- 172.21.15.72:0/963691647 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6911 (secure 0 0 0) 0x7f070005be50 con 0x7f07101515a0 2024-05-09T05:54:07.645 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:54:07.645 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6834/1142956298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1142956298},{"type":"v1","addr":"172.21.15.72:6834","nonce":1142956298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:53:23.494975+0000","modified":"2024-05-09T05:54:05.946716+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4297,"mds_1":4287,"mds_2":4263,"mds_3":4259,"mds_4":4257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4257":{"gid":4257,"name":"a","rank":4,"incarnation":18,"state":"up:creating","state_seq":1,"addr":"172.21.15.72:6835/3946563056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":3946563056},{"type":"v1","addr":"172.21.15.72:6835","nonce":3946563056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4259":{"gid":4259,"name":"f","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.110:6838/840351907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":840351907},{"type":"v1","addr":"172.21.15.110:6838","nonce":840351907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4263":{"gid":4263,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.72:6837/1048256382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":1048256382},{"type":"v1","addr":"172.21.15.72:6837","nonce":1048256382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.110:6839/966325499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6837","nonce":966325499},{"type":"v1","addr":"172.21.15.110:6839","nonce":966325499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6836/4134424941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":4134424941},{"type":"v1","addr":"172.21.15.110:6836","nonce":4134424941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4297,4287,4263,4259]},"id":1}]} 2024-05-09T05:54:07.645 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 18 2024-05-09T05:54:07.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.655+0000 7f071614d640 1 -- 172.21.15.72:0/963691647 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f06f006f400 msgr2=0x7f06f0071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:07.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.655+0000 7f071614d640 1 --2- 172.21.15.72:0/963691647 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f06f006f400 0x7f06f0071910 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f07080073f0 tx=0x7f070800b040 comp rx=0 tx=0).stop 2024-05-09T05:54:07.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.655+0000 7f071614d640 1 -- 172.21.15.72:0/963691647 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07101515a0 msgr2=0x7f0710143b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:07.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.655+0000 7f071614d640 1 --2- 172.21.15.72:0/963691647 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07101515a0 0x7f0710143b90 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0710070830 tx=0x7f0700010b70 comp rx=0 tx=0).stop 2024-05-09T05:54:07.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.655+0000 7f071614d640 1 -- 172.21.15.72:0/963691647 shutdown_connections 2024-05-09T05:54:07.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.655+0000 7f071614d640 1 --2- 172.21.15.72:0/963691647 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f06f006f400 0x7f06f0071910 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:07.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.655+0000 7f071614d640 1 --2- 172.21.15.72:0/963691647 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07101515a0 0x7f0710143b90 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:07.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.655+0000 7f071614d640 1 --2- 172.21.15.72:0/963691647 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0710152790 0x7f0710151060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:07.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.655+0000 7f071614d640 1 --2- 172.21.15.72:0/963691647 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06fc003fe0 0x7f07101f0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:07.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.655+0000 7f071614d640 1 -- 172.21.15.72:0/963691647 >> 172.21.15.72:0/963691647 conn(0x7f07100cb350 msgr2=0x7f07101588e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:07.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.655+0000 7f071614d640 1 -- 172.21.15.72:0/963691647 shutdown_connections 2024-05-09T05:54:07.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.655+0000 7f071614d640 1 -- 172.21.15.72:0/963691647 wait complete. 2024-05-09T05:54:07.668 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:54:07.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.827+0000 7f4268e0f640 1 Processor -- start 2024-05-09T05:54:07.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.827+0000 7f4268e0f640 1 -- start start 2024-05-09T05:54:07.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.827+0000 7f4268e0f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f426415dea0 0x7f42640745b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:07.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.827+0000 7f4268e0f640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42640c7c80 con 0x7f4264074af0 2024-05-09T05:54:07.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.827+0000 7f4268e0f640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f426415a4f0 con 0x7f426415da90 2024-05-09T05:54:07.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.827+0000 7f4268e0f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f42641513f0 con 0x7f426415dea0 2024-05-09T05:54:07.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.827+0000 7f4262d9d640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f4264074af0 0x7f4264164e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55284/0 (socket says 172.21.15.72:55284) 2024-05-09T05:54:07.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.827+0000 7f4262d9d640 1 -- 172.21.15.72:0/1687346190 learned_addr learned my addr 172.21.15.72:0/1687346190 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:54:07.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.827+0000 7f4261d9b640 1 --2- 172.21.15.72:0/1687346190 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f426415dea0 0x7f42640745b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:07.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.827+0000 7f426159a640 1 -- 172.21.15.72:0/1687346190 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1692168557 0 0) 0x7f42640c7c80 con 0x7f4264074af0 2024-05-09T05:54:07.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.827+0000 7f426159a640 1 -- 172.21.15.72:0/1687346190 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f424c003530 con 0x7f4264074af0 2024-05-09T05:54:07.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.827+0000 7f426159a640 1 -- 172.21.15.72:0/1687346190 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2431176933 0 0) 0x7f424c003530 con 0x7f4264074af0 2024-05-09T05:54:07.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.827+0000 7f426159a640 1 -- 172.21.15.72:0/1687346190 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f426415dea0 msgr2=0x7f42640745b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:07.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.827+0000 7f426159a640 1 --2- 172.21.15.72:0/1687346190 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f426415dea0 0x7f42640745b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:07.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.827+0000 7f426159a640 1 -- 172.21.15.72:0/1687346190 >> v1:172.21.15.110:6789/0 conn(0x7f426415da90 legacy=0x7f42640c7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:07.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.827+0000 7f426159a640 1 -- 172.21.15.72:0/1687346190 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42640c84f0 con 0x7f4264074af0 2024-05-09T05:54:07.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.827+0000 7f426159a640 1 -- 172.21.15.72:0/1687346190 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2749052815 0 0) 0x7f425c001a80 con 0x7f4264074af0 2024-05-09T05:54:07.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.827+0000 7f426159a640 1 -- 172.21.15.72:0/1687346190 >> v1:172.21.15.72:6789/0 conn(0x7f4264074af0 legacy=0x7f4264164e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:07.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.827+0000 7f426159a640 1 --2- 172.21.15.72:0/1687346190 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f424c003a40 0x7f424c003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:07.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.827+0000 7f426159a640 1 --2- 172.21.15.72:0/1687346190 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f424c004810 0x7f424c004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:07.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.827+0000 7f426159a640 1 --2- 172.21.15.72:0/1687346190 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f426415dea0 0x7f424c0052c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:07.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.827+0000 7f426159a640 1 -- 172.21.15.72:0/1687346190 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f424c00bb80 con 0x7f424c004810 2024-05-09T05:54:07.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.827+0000 7f426159a640 1 -- 172.21.15.72:0/1687346190 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f424c00bd30 con 0x7f424c003a40 2024-05-09T05:54:07.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.827+0000 7f426159a640 1 -- 172.21.15.72:0/1687346190 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f424c00bf30 con 0x7f426415dea0 2024-05-09T05:54:07.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.827+0000 7f4261d9b640 1 --2- 172.21.15.72:0/1687346190 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f424c004810 0x7f424c004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:07.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.827+0000 7f426259c640 1 --2- 172.21.15.72:0/1687346190 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f424c003a40 0x7f424c003ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:07.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.831+0000 7f4262d9d640 1 --2- 172.21.15.72:0/1687346190 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f426415dea0 0x7f424c0052c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:07.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.831+0000 7f4261d9b640 1 -- 172.21.15.72:0/1687346190 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f426415dea0 msgr2=0x7f424c0052c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:07.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.831+0000 7f4261d9b640 1 --2- 172.21.15.72:0/1687346190 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f426415dea0 0x7f424c0052c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:07.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.831+0000 7f4261d9b640 1 -- 172.21.15.72:0/1687346190 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f424c003a40 msgr2=0x7f424c003ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:07.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.831+0000 7f4261d9b640 1 --2- 172.21.15.72:0/1687346190 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f424c003a40 0x7f424c003ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:07.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.831+0000 7f4261d9b640 1 -- 172.21.15.72:0/1687346190 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f424c003530 con 0x7f424c004810 2024-05-09T05:54:07.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.831+0000 7f4261d9b640 1 --2- 172.21.15.72:0/1687346190 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f424c004810 0x7f424c004c20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4258009ab0 tx=0x7f425801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bbec15482147ad0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:07.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.831+0000 7f426159a640 1 -- 172.21.15.72:0/1687346190 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42580b2070 con 0x7f424c004810 2024-05-09T05:54:07.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.831+0000 7f426159a640 1 -- 172.21.15.72:0/1687346190 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42580a5550 con 0x7f424c004810 2024-05-09T05:54:07.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.831+0000 7f426159a640 1 -- 172.21.15.72:0/1687346190 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42580096b0 con 0x7f424c004810 2024-05-09T05:54:07.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.831+0000 7f4268e0f640 1 -- 172.21.15.72:0/1687346190 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f424c004810 msgr2=0x7f424c004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:07.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.831+0000 7f4268e0f640 1 --2- 172.21.15.72:0/1687346190 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f424c004810 0x7f424c004c20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4258009ab0 tx=0x7f425801ca70 comp rx=0 tx=0).stop 2024-05-09T05:54:07.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.831+0000 7f4262d9d640 1 -- 172.21.15.72:0/1687346190 reap_dead start 2024-05-09T05:54:07.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.831+0000 7f4268e0f640 1 -- 172.21.15.72:0/1687346190 shutdown_connections 2024-05-09T05:54:07.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.831+0000 7f4268e0f640 1 -- 172.21.15.72:0/1687346190 >> 172.21.15.72:0/1687346190 conn(0x7f42640cde90 msgr2=0x7f42640ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:07.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.831+0000 7f4268e0f640 1 -- 172.21.15.72:0/1687346190 shutdown_connections 2024-05-09T05:54:07.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.831+0000 7f4268e0f640 1 -- 172.21.15.72:0/1687346190 wait complete. 2024-05-09T05:54:07.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.835+0000 7f4268e0f640 1 Processor -- start 2024-05-09T05:54:07.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.835+0000 7f4268e0f640 1 -- start start 2024-05-09T05:54:07.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.835+0000 7f4268e0f640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f424c004810 0x7f4264073a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:07.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.835+0000 7f4268e0f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42641e42d0 0x7f4264150210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:07.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.835+0000 7f4268e0f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4264147120 0x7f4264147530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:07.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.835+0000 7f4268e0f640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f426415aa90 con 0x7f424c004810 2024-05-09T05:54:07.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.835+0000 7f4268e0f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f426415a7b0 con 0x7f42641e42d0 2024-05-09T05:54:07.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.835+0000 7f4268e0f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f426415ad70 con 0x7f4264147120 2024-05-09T05:54:07.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.835+0000 7f426259c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f424c004810 0x7f4264073a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:07.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.835+0000 7f426259c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f424c004810 0x7f4264073a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58544/0 (socket says 172.21.15.72:58544) 2024-05-09T05:54:07.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.835+0000 7f426259c640 1 -- 172.21.15.72:0/2658269526 learned_addr learned my addr 172.21.15.72:0/2658269526 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:54:07.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.835+0000 7f4261d9b640 1 --2- 172.21.15.72:0/2658269526 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42641e42d0 0x7f4264150210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:07.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.835+0000 7f4262d9d640 1 --2- 172.21.15.72:0/2658269526 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4264147120 0x7f4264147530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:07.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.835+0000 7f426259c640 1 -- 172.21.15.72:0/2658269526 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4264147120 msgr2=0x7f4264147530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:07.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.835+0000 7f426259c640 1 --2- 172.21.15.72:0/2658269526 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4264147120 0x7f4264147530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:07.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.835+0000 7f426259c640 1 -- 172.21.15.72:0/2658269526 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42641e42d0 msgr2=0x7f4264150210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:07.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.835+0000 7f426259c640 1 --2- 172.21.15.72:0/2658269526 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42641e42d0 0x7f4264150210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:07.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.835+0000 7f426259c640 1 -- 172.21.15.72:0/2658269526 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4264073f80 con 0x7f424c004810 2024-05-09T05:54:07.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.835+0000 7f426259c640 1 --2- 172.21.15.72:0/2658269526 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f424c004810 0x7f4264073a40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f425400f850 tx=0x7f425400fd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:07.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.835+0000 7f4252ffd640 1 -- 172.21.15.72:0/2658269526 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f425401a070 con 0x7f424c004810 2024-05-09T05:54:07.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.835+0000 7f4252ffd640 1 -- 172.21.15.72:0/2658269526 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4254001d10 con 0x7f424c004810 2024-05-09T05:54:07.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.835+0000 7f4268e0f640 1 -- 172.21.15.72:0/2658269526 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42640725f0 con 0x7f424c004810 2024-05-09T05:54:07.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.835+0000 7f4252ffd640 1 -- 172.21.15.72:0/2658269526 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42540067e0 con 0x7f424c004810 2024-05-09T05:54:07.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.835+0000 7f4268e0f640 1 -- 172.21.15.72:0/2658269526 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4264072bb0 con 0x7f424c004810 2024-05-09T05:54:07.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.839+0000 7f4268e0f640 1 -- 172.21.15.72:0/2658269526 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f426406a520 con 0x7f424c004810 2024-05-09T05:54:07.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.839+0000 7f4252ffd640 1 -- 172.21.15.72:0/2658269526 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f425401d070 con 0x7f424c004810 2024-05-09T05:54:07.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.839+0000 7f4252ffd640 1 --2- 172.21.15.72:0/2658269526 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f424406f400 0x7f4244071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:07.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.839+0000 7f4252ffd640 1 -- 172.21.15.72:0/2658269526 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f425408ee70 con 0x7f424c004810 2024-05-09T05:54:07.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.839+0000 7f4261d9b640 1 --2- 172.21.15.72:0/2658269526 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f424406f400 0x7f4244071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:07.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.839+0000 7f4261d9b640 1 --2- 172.21.15.72:0/2658269526 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f424406f400 0x7f4244071910 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f42580af000 tx=0x7f42580046d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:07.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:07.843+0000 7f4252ffd640 1 -- 172.21.15.72:0/2658269526 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f425405b9e0 con 0x7f424c004810 2024-05-09T05:54:08.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.039+0000 7f4268e0f640 1 -- 172.21.15.72:0/2658269526 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f42640c8b30 con 0x7f424c004810 2024-05-09T05:54:08.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.039+0000 7f4252ffd640 1 -- 172.21.15.72:0/2658269526 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6911 (secure 0 0 0) 0x7f425405b2e0 con 0x7f424c004810 2024-05-09T05:54:08.031 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:54:08.031 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6834/1142956298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1142956298},{"type":"v1","addr":"172.21.15.72:6834","nonce":1142956298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:53:23.494975+0000","modified":"2024-05-09T05:54:05.946716+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4297,"mds_1":4287,"mds_2":4263,"mds_3":4259,"mds_4":4257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4257":{"gid":4257,"name":"a","rank":4,"incarnation":18,"state":"up:creating","state_seq":1,"addr":"172.21.15.72:6835/3946563056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":3946563056},{"type":"v1","addr":"172.21.15.72:6835","nonce":3946563056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4259":{"gid":4259,"name":"f","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.110:6838/840351907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":840351907},{"type":"v1","addr":"172.21.15.110:6838","nonce":840351907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4263":{"gid":4263,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.72:6837/1048256382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":1048256382},{"type":"v1","addr":"172.21.15.72:6837","nonce":1048256382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.110:6839/966325499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6837","nonce":966325499},{"type":"v1","addr":"172.21.15.110:6839","nonce":966325499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6836/4134424941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":4134424941},{"type":"v1","addr":"172.21.15.110:6836","nonce":4134424941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4297,4287,4263,4259]},"id":1}]} 2024-05-09T05:54:08.031 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 18 2024-05-09T05:54:08.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.043+0000 7f4268e0f640 1 -- 172.21.15.72:0/2658269526 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f424406f400 msgr2=0x7f4244071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:08.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.043+0000 7f4268e0f640 1 --2- 172.21.15.72:0/2658269526 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f424406f400 0x7f4244071910 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f42580af000 tx=0x7f42580046d0 comp rx=0 tx=0).stop 2024-05-09T05:54:08.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.043+0000 7f4268e0f640 1 -- 172.21.15.72:0/2658269526 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f424c004810 msgr2=0x7f4264073a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:08.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.043+0000 7f4268e0f640 1 --2- 172.21.15.72:0/2658269526 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f424c004810 0x7f4264073a40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f425400f850 tx=0x7f425400fd10 comp rx=0 tx=0).stop 2024-05-09T05:54:08.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.043+0000 7f4268e0f640 1 -- 172.21.15.72:0/2658269526 shutdown_connections 2024-05-09T05:54:08.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.043+0000 7f4268e0f640 1 --2- 172.21.15.72:0/2658269526 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f424406f400 0x7f4244071910 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:08.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.043+0000 7f4268e0f640 1 --2- 172.21.15.72:0/2658269526 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4264147120 0x7f4264147530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:08.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.043+0000 7f4268e0f640 1 --2- 172.21.15.72:0/2658269526 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42641e42d0 0x7f4264150210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:08.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.043+0000 7f4268e0f640 1 --2- 172.21.15.72:0/2658269526 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f424c004810 0x7f4264073a40 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:08.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.043+0000 7f4268e0f640 1 -- 172.21.15.72:0/2658269526 >> 172.21.15.72:0/2658269526 conn(0x7f42640cde90 msgr2=0x7f4264159870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:08.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.043+0000 7f4268e0f640 1 -- 172.21.15.72:0/2658269526 shutdown_connections 2024-05-09T05:54:08.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.043+0000 7f4268e0f640 1 -- 172.21.15.72:0/2658269526 wait complete. 2024-05-09T05:54:08.052 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T05:54:08.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.207+0000 7f721484e640 1 Processor -- start 2024-05-09T05:54:08.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.207+0000 7f721484e640 1 -- start start 2024-05-09T05:54:08.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.207+0000 7f721484e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7210163e70 0x7f7210166290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:08.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.207+0000 7f721484e640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72100c7c80 con 0x7f721015dea0 2024-05-09T05:54:08.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.207+0000 7f721484e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f721015a4f0 con 0x7f721015da90 2024-05-09T05:54:08.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.207+0000 7f721484e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f72101513f0 con 0x7f7210163e70 2024-05-09T05:54:08.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.207+0000 7f7207fff640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f721015dea0 0x7f72100745b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55290/0 (socket says 172.21.15.72:55290) 2024-05-09T05:54:08.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.207+0000 7f7207fff640 1 -- 172.21.15.72:0/1798587367 learned_addr learned my addr 172.21.15.72:0/1798587367 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:54:08.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.207+0000 7f720ed9d640 1 --2- 172.21.15.72:0/1798587367 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7210163e70 0x7f7210166290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:08.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.207+0000 7f720dd9b640 1 -- 172.21.15.72:0/1798587367 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3268004536 0 0) 0x7f72100c7c80 con 0x7f721015dea0 2024-05-09T05:54:08.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.207+0000 7f720dd9b640 1 -- 172.21.15.72:0/1798587367 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71fc003530 con 0x7f721015dea0 2024-05-09T05:54:08.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.207+0000 7f720dd9b640 1 -- 172.21.15.72:0/1798587367 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 425411086 0 0) 0x7f71fc003530 con 0x7f721015dea0 2024-05-09T05:54:08.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.207+0000 7f720dd9b640 1 -- 172.21.15.72:0/1798587367 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7210163e70 msgr2=0x7f7210166290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:08.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.207+0000 7f720dd9b640 1 --2- 172.21.15.72:0/1798587367 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7210163e70 0x7f7210166290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:08.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.207+0000 7f720dd9b640 1 -- 172.21.15.72:0/1798587367 >> v1:172.21.15.110:6789/0 conn(0x7f721015da90 legacy=0x7f72100c7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:08.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.207+0000 7f720dd9b640 1 -- 172.21.15.72:0/1798587367 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72100c84f0 con 0x7f721015dea0 2024-05-09T05:54:08.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.207+0000 7f720dd9b640 1 -- 172.21.15.72:0/1798587367 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2749052815 0 0) 0x7f71f8001700 con 0x7f721015dea0 2024-05-09T05:54:08.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.207+0000 7f720ed9d640 1 --2- 172.21.15.72:0/1798587367 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7210163e70 0x7f7210166290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T05:54:08.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.207+0000 7f720dd9b640 1 -- 172.21.15.72:0/1798587367 >> v1:172.21.15.72:6789/0 conn(0x7f721015dea0 legacy=0x7f72100745b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:08.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.207+0000 7f720dd9b640 1 --2- 172.21.15.72:0/1798587367 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71fc003a40 0x7f71fc003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:08.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.207+0000 7f720dd9b640 1 --2- 172.21.15.72:0/1798587367 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71fc004810 0x7f71fc004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:08.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.207+0000 7f720dd9b640 1 --2- 172.21.15.72:0/1798587367 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7210163e70 0x7f71fc0052c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:08.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.207+0000 7f720dd9b640 1 -- 172.21.15.72:0/1798587367 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f71fc00bb60 con 0x7f71fc003a40 2024-05-09T05:54:08.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.207+0000 7f720dd9b640 1 -- 172.21.15.72:0/1798587367 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f71fc00bce0 con 0x7f71fc004810 2024-05-09T05:54:08.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.207+0000 7f720dd9b640 1 -- 172.21.15.72:0/1798587367 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f71fc00bee0 con 0x7f7210163e70 2024-05-09T05:54:08.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.207+0000 7f720e59c640 1 --2- 172.21.15.72:0/1798587367 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71fc003a40 0x7f71fc003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:08.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.207+0000 7f7207fff640 1 --2- 172.21.15.72:0/1798587367 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71fc004810 0x7f71fc004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:08.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.207+0000 7f720ed9d640 1 --2- 172.21.15.72:0/1798587367 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7210163e70 0x7f71fc0052c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:08.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.207+0000 7f720e59c640 1 -- 172.21.15.72:0/1798587367 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7210163e70 msgr2=0x7f71fc0052c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:08.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.207+0000 7f720e59c640 1 --2- 172.21.15.72:0/1798587367 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7210163e70 0x7f71fc0052c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:08.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.207+0000 7f720e59c640 1 -- 172.21.15.72:0/1798587367 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71fc004810 msgr2=0x7f71fc004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:08.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.207+0000 7f720e59c640 1 --2- 172.21.15.72:0/1798587367 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71fc004810 0x7f71fc004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:08.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.207+0000 7f720e59c640 1 -- 172.21.15.72:0/1798587367 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71fc003530 con 0x7f71fc003a40 2024-05-09T05:54:08.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.211+0000 7f720e59c640 1 --2- 172.21.15.72:0/1798587367 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71fc003a40 0x7f71fc003eb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f72100754b0 tx=0x7f720001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d81dcb1cb78ffb8e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:08.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.211+0000 7f720dd9b640 1 -- 172.21.15.72:0/1798587367 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72000013e0 con 0x7f71fc003a40 2024-05-09T05:54:08.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.211+0000 7f720dd9b640 1 -- 172.21.15.72:0/1798587367 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72000052d0 con 0x7f71fc003a40 2024-05-09T05:54:08.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.211+0000 7f720dd9b640 1 -- 172.21.15.72:0/1798587367 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7200003840 con 0x7f71fc003a40 2024-05-09T05:54:08.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.211+0000 7f721484e640 1 -- 172.21.15.72:0/1798587367 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71fc003a40 msgr2=0x7f71fc003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:08.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.211+0000 7f721484e640 1 --2- 172.21.15.72:0/1798587367 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71fc003a40 0x7f71fc003eb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f72100754b0 tx=0x7f720001c3d0 comp rx=0 tx=0).stop 2024-05-09T05:54:08.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.211+0000 7f720ed9d640 1 -- 172.21.15.72:0/1798587367 reap_dead start 2024-05-09T05:54:08.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.211+0000 7f721484e640 1 -- 172.21.15.72:0/1798587367 shutdown_connections 2024-05-09T05:54:08.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.211+0000 7f721484e640 1 -- 172.21.15.72:0/1798587367 >> 172.21.15.72:0/1798587367 conn(0x7f72100cde90 msgr2=0x7f72100ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:08.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.211+0000 7f721484e640 1 -- 172.21.15.72:0/1798587367 shutdown_connections 2024-05-09T05:54:08.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.211+0000 7f721484e640 1 -- 172.21.15.72:0/1798587367 wait complete. 2024-05-09T05:54:08.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.215+0000 7f721484e640 1 Processor -- start 2024-05-09T05:54:08.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.215+0000 7f721484e640 1 -- start start 2024-05-09T05:54:08.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.215+0000 7f721484e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71fc003a40 0x7f72100cd190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:08.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.215+0000 7f721484e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f721014a3a0 0x7f721015ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:08.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.215+0000 7f721484e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f721015d360 0x7f72101f6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:08.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.215+0000 7f721484e640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f72100c70e0 con 0x7f71fc003a40 2024-05-09T05:54:08.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.215+0000 7f721484e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f721015ad70 con 0x7f721014a3a0 2024-05-09T05:54:08.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.215+0000 7f721484e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f72100c81b0 con 0x7f721015d360 2024-05-09T05:54:08.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.215+0000 7f720e59c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71fc003a40 0x7f72100cd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:08.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.215+0000 7f720e59c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71fc003a40 0x7f72100cd190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58562/0 (socket says 172.21.15.72:58562) 2024-05-09T05:54:08.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.215+0000 7f720e59c640 1 -- 172.21.15.72:0/916418952 learned_addr learned my addr 172.21.15.72:0/916418952 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:54:08.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.215+0000 7f720ed9d640 1 --2- 172.21.15.72:0/916418952 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f721015d360 0x7f72101f6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:08.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.215+0000 7f7207fff640 1 --2- 172.21.15.72:0/916418952 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f721014a3a0 0x7f721015ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:08.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.215+0000 7f720e59c640 1 -- 172.21.15.72:0/916418952 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f721015d360 msgr2=0x7f72101f6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:08.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.215+0000 7f720e59c640 1 --2- 172.21.15.72:0/916418952 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f721015d360 0x7f72101f6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:08.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.215+0000 7f720e59c640 1 -- 172.21.15.72:0/916418952 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f721014a3a0 msgr2=0x7f721015ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:08.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.215+0000 7f720e59c640 1 --2- 172.21.15.72:0/916418952 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f721014a3a0 0x7f721015ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:08.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.215+0000 7f720e59c640 1 -- 172.21.15.72:0/916418952 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72101f4ca0 con 0x7f71fc003a40 2024-05-09T05:54:08.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.215+0000 7f7207fff640 1 --2- 172.21.15.72:0/916418952 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f721014a3a0 0x7f721015ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:54:08.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.215+0000 7f720ed9d640 1 --2- 172.21.15.72:0/916418952 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f721015d360 0x7f72101f6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:54:08.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.215+0000 7f720e59c640 1 --2- 172.21.15.72:0/916418952 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71fc003a40 0x7f72100cd190 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f720001aad0 tx=0x7f71fc005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:08.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.215+0000 7f7206ffd640 1 -- 172.21.15.72:0/916418952 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72000bf070 con 0x7f71fc003a40 2024-05-09T05:54:08.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.215+0000 7f7206ffd640 1 -- 172.21.15.72:0/916418952 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72000013c0 con 0x7f71fc003a40 2024-05-09T05:54:08.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.215+0000 7f721484e640 1 -- 172.21.15.72:0/916418952 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72101f4350 con 0x7f71fc003a40 2024-05-09T05:54:08.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.215+0000 7f7206ffd640 1 -- 172.21.15.72:0/916418952 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7200005480 con 0x7f71fc003a40 2024-05-09T05:54:08.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.215+0000 7f721484e640 1 -- 172.21.15.72:0/916418952 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f721014bd50 con 0x7f71fc003a40 2024-05-09T05:54:08.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.215+0000 7f721484e640 1 -- 172.21.15.72:0/916418952 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f721006a520 con 0x7f71fc003a40 2024-05-09T05:54:08.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.219+0000 7f7206ffd640 1 -- 172.21.15.72:0/916418952 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f72000c2070 con 0x7f71fc003a40 2024-05-09T05:54:08.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.219+0000 7f7206ffd640 1 --2- 172.21.15.72:0/916418952 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f71f006f430 0x7f71f0071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:08.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.219+0000 7f7206ffd640 1 -- 172.21.15.72:0/916418952 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f7200128cb0 con 0x7f71fc003a40 2024-05-09T05:54:08.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.219+0000 7f7207fff640 1 --2- 172.21.15.72:0/916418952 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f71f006f430 0x7f71f0071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:08.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.219+0000 7f7207fff640 1 --2- 172.21.15.72:0/916418952 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f71f006f430 0x7f71f0071940 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f72100cac00 tx=0x7f71f8000f00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:08.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.223+0000 7f7206ffd640 1 -- 172.21.15.72:0/916418952 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f7200016130 con 0x7f71fc003a40 2024-05-09T05:54:08.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.383+0000 7f721484e640 1 -- 172.21.15.72:0/916418952 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f72100c9830 con 0x7f71fc003a40 2024-05-09T05:54:08.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.387+0000 7f7206ffd640 1 -- 172.21.15.72:0/916418952 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18589 (secure 0 0 0) 0x7f72000f58c0 con 0x7f71fc003a40 2024-05-09T05:54:08.377 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:54:08.377 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":27,"fsid":"44c88cb9-b39b-4787-a871-80ddf0ad6292","created":"2024-05-09T05:52:59.591187+0000","modified":"2024-05-09T05:54:05.939506+0000","last_up_change":"2024-05-09T05:53:10.902489+0000","last_in_change":"2024-05-09T05:53:02.200254+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T05:53:10.503537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T05:53:21.364958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T05:53:22.461477+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-09T05:53:26.171144+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e4af2aa1-ba5c-4411-a72a-a0e38e589a74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":331913921},{"type":"v1","addr":"172.21.15.72:6817","nonce":331913921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":331913921},{"type":"v1","addr":"172.21.15.72:6819","nonce":331913921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":331913921},{"type":"v1","addr":"172.21.15.72:6823","nonce":331913921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":331913921},{"type":"v1","addr":"172.21.15.72:6821","nonce":331913921}]},"public_addr":"172.21.15.72:6817/331913921","cluster_addr":"172.21.15.72:6819/331913921","heartbeat_back_addr":"172.21.15.72:6823/331913921","heartbeat_front_addr":"172.21.15.72:6821/331913921","state":["exists","up"]},{"osd":1,"uuid":"052504f5-a523-4922-bdc7-ce2890faa5ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2197151836},{"type":"v1","addr":"172.21.15.72:6801","nonce":2197151836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2197151836},{"type":"v1","addr":"172.21.15.72:6803","nonce":2197151836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2197151836},{"type":"v1","addr":"172.21.15.72:6811","nonce":2197151836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2197151836},{"type":"v1","addr":"172.21.15.72:6807","nonce":2197151836}]},"public_addr":"172.21.15.72:6801/2197151836","cluster_addr":"172.21.15.72:6803/2197151836","heartbeat_back_addr":"172.21.15.72:6811/2197151836","heartbeat_front_addr":"172.21.15.72:6807/2197151836","state":["exists","up"]},{"osd":2,"uuid":"28bc1c95-6d0d-4263-baad-314d86e6a670","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1273581990},{"type":"v1","addr":"172.21.15.72:6825","nonce":1273581990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":1273581990},{"type":"v1","addr":"172.21.15.72:6827","nonce":1273581990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1273581990},{"type":"v1","addr":"172.21.15.72:6831","nonce":1273581990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1273581990},{"type":"v1","addr":"172.21.15.72:6829","nonce":1273581990}]},"public_addr":"172.21.15.72:6825/1273581990","cluster_addr":"172.21.15.72:6827/1273581990","heartbeat_back_addr":"172.21.15.72:6831/1273581990","heartbeat_front_addr":"172.21.15.72:6829/1273581990","state":["exists","up"]},{"osd":3,"uuid":"edcc86cb-f178-4533-8069-de9d781531ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2180866263},{"type":"v1","addr":"172.21.15.72:6806","nonce":2180866263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2180866263},{"type":"v1","addr":"172.21.15.72:6810","nonce":2180866263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2180866263},{"type":"v1","addr":"172.21.15.72:6815","nonce":2180866263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2180866263},{"type":"v1","addr":"172.21.15.72:6813","nonce":2180866263}]},"public_addr":"172.21.15.72:6806/2180866263","cluster_addr":"172.21.15.72:6810/2180866263","heartbeat_back_addr":"172.21.15.72:6815/2180866263","heartbeat_front_addr":"172.21.15.72:6813/2180866263","state":["exists","up"]},{"osd":4,"uuid":"8d138128-4829-4109-87a1-25f339f3e953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3437318248},{"type":"v1","addr":"172.21.15.110:6817","nonce":3437318248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3437318248},{"type":"v1","addr":"172.21.15.110:6819","nonce":3437318248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3437318248},{"type":"v1","addr":"172.21.15.110:6823","nonce":3437318248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3437318248},{"type":"v1","addr":"172.21.15.110:6821","nonce":3437318248}]},"public_addr":"172.21.15.110:6817/3437318248","cluster_addr":"172.21.15.110:6819/3437318248","heartbeat_back_addr":"172.21.15.110:6823/3437318248","heartbeat_front_addr":"172.21.15.110:6821/3437318248","state":["exists","up"]},{"osd":5,"uuid":"99a4a914-0a0e-4d25-94ae-3e86b8b1aa4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":977576181},{"type":"v1","addr":"172.21.15.110:6825","nonce":977576181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":977576181},{"type":"v1","addr":"172.21.15.110:6827","nonce":977576181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":977576181},{"type":"v1","addr":"172.21.15.110:6831","nonce":977576181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":977576181},{"type":"v1","addr":"172.21.15.110:6829","nonce":977576181}]},"public_addr":"172.21.15.110:6825/977576181","cluster_addr":"172.21.15.110:6827/977576181","heartbeat_back_addr":"172.21.15.110:6831/977576181","heartbeat_front_addr":"172.21.15.110:6829/977576181","state":["exists","up"]},{"osd":6,"uuid":"6e04b295-afc9-4f80-80f7-3df1f5168608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":1817638786},{"type":"v1","addr":"172.21.15.110:6809","nonce":1817638786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":1817638786},{"type":"v1","addr":"172.21.15.110:6811","nonce":1817638786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":1817638786},{"type":"v1","addr":"172.21.15.110:6815","nonce":1817638786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":1817638786},{"type":"v1","addr":"172.21.15.110:6813","nonce":1817638786}]},"public_addr":"172.21.15.110:6809/1817638786","cluster_addr":"172.21.15.110:6811/1817638786","heartbeat_back_addr":"172.21.15.110:6815/1817638786","heartbeat_front_addr":"172.21.15.110:6813/1817638786","state":["exists","up"]},{"osd":7,"uuid":"835de5c9-1e2c-41d8-bd28-d7ffe5ad8fdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":214675920},{"type":"v1","addr":"172.21.15.110:6801","nonce":214675920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":214675920},{"type":"v1","addr":"172.21.15.110:6803","nonce":214675920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":214675920},{"type":"v1","addr":"172.21.15.110:6807","nonce":214675920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":214675920},{"type":"v1","addr":"172.21.15.110:6805","nonce":214675920}]},"public_addr":"172.21.15.110:6801/214675920","cluster_addr":"172.21.15.110:6803/214675920","heartbeat_back_addr":"172.21.15.110:6807/214675920","heartbeat_front_addr":"172.21.15.110:6805/214675920","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.849761+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.670554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.743789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:08.516367+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.665550+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.518775+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.786468+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.794984+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":0,"to":7}]},{"pgid":"4.6","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T05:54:08.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.387+0000 7f721484e640 1 -- 172.21.15.72:0/916418952 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f71f006f430 msgr2=0x7f71f0071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:08.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.387+0000 7f721484e640 1 --2- 172.21.15.72:0/916418952 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f71f006f430 0x7f71f0071940 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f72100cac00 tx=0x7f71f8000f00 comp rx=0 tx=0).stop 2024-05-09T05:54:08.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.387+0000 7f721484e640 1 -- 172.21.15.72:0/916418952 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71fc003a40 msgr2=0x7f72100cd190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:08.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.387+0000 7f721484e640 1 --2- 172.21.15.72:0/916418952 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71fc003a40 0x7f72100cd190 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f720001aad0 tx=0x7f71fc005840 comp rx=0 tx=0).stop 2024-05-09T05:54:08.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.387+0000 7f721484e640 1 -- 172.21.15.72:0/916418952 shutdown_connections 2024-05-09T05:54:08.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.387+0000 7f721484e640 1 --2- 172.21.15.72:0/916418952 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f71f006f430 0x7f71f0071940 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:08.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.387+0000 7f721484e640 1 --2- 172.21.15.72:0/916418952 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f721015d360 0x7f72101f6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:08.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.387+0000 7f721484e640 1 --2- 172.21.15.72:0/916418952 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f721014a3a0 0x7f721015ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:08.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.387+0000 7f721484e640 1 --2- 172.21.15.72:0/916418952 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71fc003a40 0x7f72100cd190 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:08.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.387+0000 7f721484e640 1 -- 172.21.15.72:0/916418952 >> 172.21.15.72:0/916418952 conn(0x7f72100cde90 msgr2=0x7f721014e370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:08.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.387+0000 7f721484e640 1 -- 172.21.15.72:0/916418952 shutdown_connections 2024-05-09T05:54:08.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.387+0000 7f721484e640 1 -- 172.21.15.72:0/916418952 wait complete. 2024-05-09T05:54:08.400 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:54:08.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.555+0000 7f06f80c2640 1 Processor -- start 2024-05-09T05:54:08.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.555+0000 7f06f80c2640 1 -- start start 2024-05-09T05:54:08.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.555+0000 7f06f80c2640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f06f00c7630 0x7f06f015a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:08.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.555+0000 7f06f80c2640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f06f00c7a40 0x7f06f00745b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:08.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.555+0000 7f06f80c2640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06f00c9350 con 0x7f06f0074af0 2024-05-09T05:54:08.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.555+0000 7f06f80c2640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f06f00c58e0 con 0x7f06f00c7a40 2024-05-09T05:54:08.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.555+0000 7f06f80c2640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f06f00c5bc0 con 0x7f06f00c7630 2024-05-09T05:54:08.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.555+0000 7f06f565d640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f06f00c7a40 0x7f06f00745b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:08.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.555+0000 7f06f565d640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f06f00c7a40 0x7f06f00745b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58572/0 (socket says 172.21.15.72:58572) 2024-05-09T05:54:08.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.555+0000 7f06f565d640 1 -- 172.21.15.72:0/2080841266 learned_addr learned my addr 172.21.15.72:0/2080841266 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:54:08.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.555+0000 7f06f5e5e640 1 --2- 172.21.15.72:0/2080841266 >> v2:172.21.15.110:3300/0 conn(0x7f06f00c7630 0x7f06f015a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:08.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.555+0000 7f06f565d640 1 -- 172.21.15.72:0/2080841266 >> v2:172.21.15.110:3300/0 conn(0x7f06f00c7630 msgr2=0x7f06f015a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:08.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.555+0000 7f06f565d640 1 --2- 172.21.15.72:0/2080841266 >> v2:172.21.15.110:3300/0 conn(0x7f06f00c7630 0x7f06f015a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:08.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.555+0000 7f06f565d640 1 -- 172.21.15.72:0/2080841266 >> v1:172.21.15.110:6789/0 conn(0x7f06f0074af0 legacy=0x7f06f006fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:08.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.555+0000 7f06f565d640 1 -- 172.21.15.72:0/2080841266 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06f00c5ea0 con 0x7f06f00c7a40 2024-05-09T05:54:08.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.559+0000 7f06f565d640 1 --2- 172.21.15.72:0/2080841266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06f00c7a40 0x7f06f00745b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f06f0071b70 tx=0x7f06e001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b05fe0ae0bd7abd server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:08.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.559+0000 7f06f4e5c640 1 -- 172.21.15.72:0/2080841266 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e00b5070 con 0x7f06f00c7a40 2024-05-09T05:54:08.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.559+0000 7f06f4e5c640 1 -- 172.21.15.72:0/2080841266 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06e00a8a10 con 0x7f06f00c7a40 2024-05-09T05:54:08.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.559+0000 7f06f4e5c640 1 -- 172.21.15.72:0/2080841266 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e00a8de0 con 0x7f06f00c7a40 2024-05-09T05:54:08.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.559+0000 7f06f80c2640 1 -- 172.21.15.72:0/2080841266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06f00c7a40 msgr2=0x7f06f00745b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:08.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.559+0000 7f06f80c2640 1 --2- 172.21.15.72:0/2080841266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06f00c7a40 0x7f06f00745b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f06f0071b70 tx=0x7f06e001ed10 comp rx=0 tx=0).stop 2024-05-09T05:54:08.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.559+0000 7f06f80c2640 1 -- 172.21.15.72:0/2080841266 shutdown_connections 2024-05-09T05:54:08.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.559+0000 7f06f80c2640 1 --2- 172.21.15.72:0/2080841266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06f00c7a40 0x7f06f00745b0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:08.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.559+0000 7f06f80c2640 1 --2- 172.21.15.72:0/2080841266 >> v2:172.21.15.110:3300/0 conn(0x7f06f00c7630 0x7f06f015a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:08.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.559+0000 7f06f80c2640 1 -- 172.21.15.72:0/2080841266 >> 172.21.15.72:0/2080841266 conn(0x7f06f00cde90 msgr2=0x7f06f00ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:08.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.559+0000 7f06f80c2640 1 -- 172.21.15.72:0/2080841266 shutdown_connections 2024-05-09T05:54:08.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.559+0000 7f06f80c2640 1 -- 172.21.15.72:0/2080841266 wait complete. 2024-05-09T05:54:08.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.559+0000 7f06f80c2640 1 Processor -- start 2024-05-09T05:54:08.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.559+0000 7f06f80c2640 1 -- start start 2024-05-09T05:54:08.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.563+0000 7f06f80c2640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06f0074af0 0x7f06f014f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:08.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.563+0000 7f06f80c2640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06f00c7630 0x7f06f014e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:08.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.563+0000 7f06f80c2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06f00c7a40 0x7f06f015bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:08.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.563+0000 7f06f80c2640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f06f00c55a0 con 0x7f06f0074af0 2024-05-09T05:54:08.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.563+0000 7f06f80c2640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f06f00c98b0 con 0x7f06f00c7a40 2024-05-09T05:54:08.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.563+0000 7f06f80c2640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f06f00c9dd0 con 0x7f06f00c7630 2024-05-09T05:54:08.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.563+0000 7f06f5e5e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06f0074af0 0x7f06f014f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:08.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.563+0000 7f06f5e5e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06f0074af0 0x7f06f014f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58574/0 (socket says 172.21.15.72:58574) 2024-05-09T05:54:08.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.563+0000 7f06f5e5e640 1 -- 172.21.15.72:0/4221598253 learned_addr learned my addr 172.21.15.72:0/4221598253 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:54:08.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.563+0000 7f06f565d640 1 --2- 172.21.15.72:0/4221598253 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06f00c7630 0x7f06f014e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:08.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.563+0000 7f06f665f640 1 --2- 172.21.15.72:0/4221598253 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06f00c7a40 0x7f06f015bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:08.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.563+0000 7f06f5e5e640 1 -- 172.21.15.72:0/4221598253 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06f00c7630 msgr2=0x7f06f014e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:08.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.563+0000 7f06f5e5e640 1 --2- 172.21.15.72:0/4221598253 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06f00c7630 0x7f06f014e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:08.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.563+0000 7f06f5e5e640 1 -- 172.21.15.72:0/4221598253 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06f00c7a40 msgr2=0x7f06f015bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:08.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.563+0000 7f06f5e5e640 1 --2- 172.21.15.72:0/4221598253 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06f00c7a40 0x7f06f015bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:08.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.563+0000 7f06f5e5e640 1 -- 172.21.15.72:0/4221598253 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06f014e760 con 0x7f06f0074af0 2024-05-09T05:54:08.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.563+0000 7f06f565d640 1 --2- 172.21.15.72:0/4221598253 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06f00c7630 0x7f06f014e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:54:08.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.563+0000 7f06f5e5e640 1 --2- 172.21.15.72:0/4221598253 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06f0074af0 0x7f06f014f1f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f06ec00d5d0 tx=0x7f06ec00da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:08.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.563+0000 7f06e67fc640 1 -- 172.21.15.72:0/4221598253 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06ec004240 con 0x7f06f0074af0 2024-05-09T05:54:08.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.563+0000 7f06e67fc640 1 -- 172.21.15.72:0/4221598253 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06ec0043e0 con 0x7f06f0074af0 2024-05-09T05:54:08.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.563+0000 7f06f80c2640 1 -- 172.21.15.72:0/4221598253 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06f014e550 con 0x7f06f0074af0 2024-05-09T05:54:08.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.563+0000 7f06e67fc640 1 -- 172.21.15.72:0/4221598253 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06ec003840 con 0x7f06f0074af0 2024-05-09T05:54:08.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.563+0000 7f06f80c2640 1 -- 172.21.15.72:0/4221598253 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06f014d810 con 0x7f06f0074af0 2024-05-09T05:54:08.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.563+0000 7f06f80c2640 1 -- 172.21.15.72:0/4221598253 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06f006a520 con 0x7f06f0074af0 2024-05-09T05:54:08.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.563+0000 7f06e67fc640 1 -- 172.21.15.72:0/4221598253 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f06ec0039e0 con 0x7f06f0074af0 2024-05-09T05:54:08.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.567+0000 7f06e67fc640 1 --2- 172.21.15.72:0/4221598253 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f06d406f430 0x7f06d4071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:08.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.567+0000 7f06e67fc640 1 -- 172.21.15.72:0/4221598253 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f06ec08f730 con 0x7f06f0074af0 2024-05-09T05:54:08.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.567+0000 7f06f565d640 1 --2- 172.21.15.72:0/4221598253 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f06d406f430 0x7f06d4071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:08.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.567+0000 7f06f565d640 1 --2- 172.21.15.72:0/4221598253 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f06d406f430 0x7f06d4071940 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f06e00b2000 tx=0x7f06e0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:08.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.571+0000 7f06e67fc640 1 -- 172.21.15.72:0/4221598253 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f06f014e760 con 0x7f06f0074af0 2024-05-09T05:54:08.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.767+0000 7f06f80c2640 1 -- 172.21.15.72:0/4221598253 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f06f00c8bc0 con 0x7f06f0074af0 2024-05-09T05:54:08.759 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.767+0000 7f06e67fc640 1 -- 172.21.15.72:0/4221598253 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6911 (secure 0 0 0) 0x7f06ec05c3d0 con 0x7f06f0074af0 2024-05-09T05:54:08.759 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:54:08.759 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6834/1142956298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1142956298},{"type":"v1","addr":"172.21.15.72:6834","nonce":1142956298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:53:23.494975+0000","modified":"2024-05-09T05:54:05.946716+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4297,"mds_1":4287,"mds_2":4263,"mds_3":4259,"mds_4":4257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4257":{"gid":4257,"name":"a","rank":4,"incarnation":18,"state":"up:creating","state_seq":1,"addr":"172.21.15.72:6835/3946563056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":3946563056},{"type":"v1","addr":"172.21.15.72:6835","nonce":3946563056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4259":{"gid":4259,"name":"f","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.110:6838/840351907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":840351907},{"type":"v1","addr":"172.21.15.110:6838","nonce":840351907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4263":{"gid":4263,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.72:6837/1048256382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":1048256382},{"type":"v1","addr":"172.21.15.72:6837","nonce":1048256382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.110:6839/966325499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6837","nonce":966325499},{"type":"v1","addr":"172.21.15.110:6839","nonce":966325499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6836/4134424941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":4134424941},{"type":"v1","addr":"172.21.15.110:6836","nonce":4134424941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4297,4287,4263,4259]},"id":1}]} 2024-05-09T05:54:08.760 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 18 2024-05-09T05:54:08.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.771+0000 7f06f80c2640 1 -- 172.21.15.72:0/4221598253 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f06d406f430 msgr2=0x7f06d4071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:08.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.771+0000 7f06f80c2640 1 --2- 172.21.15.72:0/4221598253 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f06d406f430 0x7f06d4071940 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f06e00b2000 tx=0x7f06e0008040 comp rx=0 tx=0).stop 2024-05-09T05:54:08.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.771+0000 7f06f80c2640 1 -- 172.21.15.72:0/4221598253 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06f0074af0 msgr2=0x7f06f014f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:08.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.771+0000 7f06f80c2640 1 --2- 172.21.15.72:0/4221598253 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06f0074af0 0x7f06f014f1f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f06ec00d5d0 tx=0x7f06ec00da90 comp rx=0 tx=0).stop 2024-05-09T05:54:08.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.771+0000 7f06f80c2640 1 -- 172.21.15.72:0/4221598253 shutdown_connections 2024-05-09T05:54:08.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.771+0000 7f06f80c2640 1 --2- 172.21.15.72:0/4221598253 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f06d406f430 0x7f06d4071940 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:08.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.771+0000 7f06f80c2640 1 --2- 172.21.15.72:0/4221598253 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06f00c7a40 0x7f06f015bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:08.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.771+0000 7f06f80c2640 1 --2- 172.21.15.72:0/4221598253 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06f00c7630 0x7f06f014e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:08.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.771+0000 7f06f80c2640 1 --2- 172.21.15.72:0/4221598253 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06f0074af0 0x7f06f014f1f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:08.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.771+0000 7f06f80c2640 1 -- 172.21.15.72:0/4221598253 >> 172.21.15.72:0/4221598253 conn(0x7f06f00cde90 msgr2=0x7f06f0149690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:08.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.771+0000 7f06f80c2640 1 -- 172.21.15.72:0/4221598253 shutdown_connections 2024-05-09T05:54:08.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:08.771+0000 7f06f80c2640 1 -- 172.21.15.72:0/4221598253 wait complete. 2024-05-09T05:54:09.052 INFO:tasks.ceph.mds.b.smithi110.stderr:2024-05-09T05:54:09.062+0000 7f6833aba640 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2024-05-09T05:54:09.385 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-09T05:53:23.494975+0000', 'modified': '2024-05-09T05:54:05.946716+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 4297, 'mds_1': 4287, 'mds_2': 4263, 'mds_3': 4259, 'mds_4': 4257}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4257': {'gid': 4257, 'name': 'a', 'rank': 4, 'incarnation': 18, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.72:6835/3946563056', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.72:6833', 'nonce': 3946563056}, {'type': 'v1', 'addr': '172.21.15.72:6835', 'nonce': 3946563056}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4259': {'gid': 4259, 'name': 'f', 'rank': 3, 'incarnation': 16, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.110:6838/840351907', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6835', 'nonce': 840351907}, {'type': 'v1', 'addr': '172.21.15.110:6838', 'nonce': 840351907}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4263': {'gid': 4263, 'name': 'c', 'rank': 2, 'incarnation': 14, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.72:6837/1048256382', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.72:6836', 'nonce': 1048256382}, {'type': 'v1', 'addr': '172.21.15.72:6837', 'nonce': 1048256382}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4287': {'gid': 4287, 'name': 'd', 'rank': 1, 'incarnation': 10, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.110:6839/966325499', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6837', 'nonce': 966325499}, {'type': 'v1', 'addr': '172.21.15.110:6839', 'nonce': 966325499}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4297': {'gid': 4297, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.110:6836/4134424941', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6834', 'nonce': 4134424941}, {'type': 'v1', 'addr': '172.21.15.110:6836', 'nonce': 4134424941}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4297, 'qdb_cluster': [4297, 4287, 4263, 4259]} 2024-05-09T05:54:09.385 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4257:up:creating 2024-05-09T05:54:10.386 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:54:10.546 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.555+0000 7ff462618640 1 Processor -- start 2024-05-09T05:54:10.546 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.555+0000 7ff462618640 1 -- start start 2024-05-09T05:54:10.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.555+0000 7ff462618640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff45c152ed0 0x7ff45c06fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:10.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.555+0000 7ff462618640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff45c070140 0x7ff45c0ca9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:10.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.555+0000 7ff462618640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff45c15c5b0 con 0x7ff45c159770 2024-05-09T05:54:10.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.555+0000 7ff462618640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7ff45c159b80 con 0x7ff45c152ed0 2024-05-09T05:54:10.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.555+0000 7ff462618640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7ff45c073270 con 0x7ff45c070140 2024-05-09T05:54:10.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.555+0000 7ff460bb5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff45c070140 0x7ff45c0ca9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:10.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.555+0000 7ff4537fe640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff45c152ed0 0x7ff45c06fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:10.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.555+0000 7ff45bfff640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7ff45c159770 0x7ff45c0723a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.72:39224/0 (socket says 172.21.15.72:39224) 2024-05-09T05:54:10.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.555+0000 7ff45bfff640 1 -- 172.21.15.72:0/1861285185 learned_addr learned my addr 172.21.15.72:0/1861285185 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:54:10.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.559+0000 7ff45b7fe640 1 -- 172.21.15.72:0/1861285185 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2866786825 0 0) 0x7ff45c15c5b0 con 0x7ff45c159770 2024-05-09T05:54:10.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.559+0000 7ff45b7fe640 1 -- 172.21.15.72:0/1861285185 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff448003530 con 0x7ff45c159770 2024-05-09T05:54:10.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.559+0000 7ff460bb5640 1 -- 172.21.15.72:0/1861285185 >> v2:172.21.15.110:3300/0 conn(0x7ff45c152ed0 msgr2=0x7ff45c06fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:10.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.559+0000 7ff460bb5640 1 --2- 172.21.15.72:0/1861285185 >> v2:172.21.15.110:3300/0 conn(0x7ff45c152ed0 0x7ff45c06fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:10.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.559+0000 7ff460bb5640 1 -- 172.21.15.72:0/1861285185 >> v1:172.21.15.110:6789/0 conn(0x7ff45c159770 legacy=0x7ff45c0723a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:10.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.559+0000 7ff460bb5640 1 -- 172.21.15.72:0/1861285185 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff45c073530 con 0x7ff45c070140 2024-05-09T05:54:10.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.559+0000 7ff460bb5640 1 --2- 172.21.15.72:0/1861285185 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff45c070140 0x7ff45c0ca9c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff454009d90 tx=0x7ff45401f150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb3580471e20d7b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:10.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.559+0000 7ff45b7fe640 1 -- 172.21.15.72:0/1861285185 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4540b4070 con 0x7ff45c070140 2024-05-09T05:54:10.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.559+0000 7ff45b7fe640 1 -- 172.21.15.72:0/1861285185 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4540af600 con 0x7ff45c070140 2024-05-09T05:54:10.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.559+0000 7ff45b7fe640 1 -- 172.21.15.72:0/1861285185 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4540af9b0 con 0x7ff45c070140 2024-05-09T05:54:10.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.559+0000 7ff462618640 1 -- 172.21.15.72:0/1861285185 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff45c070140 msgr2=0x7ff45c0ca9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:10.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.559+0000 7ff462618640 1 --2- 172.21.15.72:0/1861285185 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff45c070140 0x7ff45c0ca9c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff454009d90 tx=0x7ff45401f150 comp rx=0 tx=0).stop 2024-05-09T05:54:10.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.559+0000 7ff462618640 1 -- 172.21.15.72:0/1861285185 shutdown_connections 2024-05-09T05:54:10.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.559+0000 7ff462618640 1 --2- 172.21.15.72:0/1861285185 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff45c070140 0x7ff45c0ca9c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:10.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.559+0000 7ff462618640 1 --2- 172.21.15.72:0/1861285185 >> v2:172.21.15.110:3300/0 conn(0x7ff45c152ed0 0x7ff45c06fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:10.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.559+0000 7ff462618640 1 -- 172.21.15.72:0/1861285185 >> 172.21.15.72:0/1861285185 conn(0x7ff45c0cde90 msgr2=0x7ff45c0ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:10.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.559+0000 7ff462618640 1 -- 172.21.15.72:0/1861285185 shutdown_connections 2024-05-09T05:54:10.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.559+0000 7ff462618640 1 -- 172.21.15.72:0/1861285185 wait complete. 2024-05-09T05:54:10.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.563+0000 7ff462618640 1 Processor -- start 2024-05-09T05:54:10.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.563+0000 7ff462618640 1 -- start start 2024-05-09T05:54:10.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.563+0000 7ff462618640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff45c070140 0x7ff45c150820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:10.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.563+0000 7ff462618640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff45c152ed0 0x7ff45c0cc880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:10.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.563+0000 7ff462618640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff45c159770 0x7ff45c146f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:10.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.563+0000 7ff462618640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff45c158f70 con 0x7ff45c070140 2024-05-09T05:54:10.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.563+0000 7ff462618640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ff45c073af0 con 0x7ff45c159770 2024-05-09T05:54:10.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.563+0000 7ff462618640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7ff45c159250 con 0x7ff45c152ed0 2024-05-09T05:54:10.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.563+0000 7ff45bfff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff45c070140 0x7ff45c150820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:10.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.563+0000 7ff45bfff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff45c070140 0x7ff45c150820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58578/0 (socket says 172.21.15.72:58578) 2024-05-09T05:54:10.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.563+0000 7ff45bfff640 1 -- 172.21.15.72:0/709297790 learned_addr learned my addr 172.21.15.72:0/709297790 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:54:10.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.563+0000 7ff460bb5640 1 --2- 172.21.15.72:0/709297790 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff45c159770 0x7ff45c146f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:10.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.563+0000 7ff4537fe640 1 --2- 172.21.15.72:0/709297790 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff45c152ed0 0x7ff45c0cc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:10.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.563+0000 7ff45bfff640 1 -- 172.21.15.72:0/709297790 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff45c152ed0 msgr2=0x7ff45c0cc880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:10.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.563+0000 7ff45bfff640 1 --2- 172.21.15.72:0/709297790 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff45c152ed0 0x7ff45c0cc880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:10.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.563+0000 7ff45bfff640 1 -- 172.21.15.72:0/709297790 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff45c159770 msgr2=0x7ff45c146f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:10.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.563+0000 7ff45bfff640 1 --2- 172.21.15.72:0/709297790 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff45c159770 0x7ff45c146f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:10.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.563+0000 7ff45bfff640 1 -- 172.21.15.72:0/709297790 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff45c15baf0 con 0x7ff45c070140 2024-05-09T05:54:10.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.563+0000 7ff460bb5640 1 --2- 172.21.15.72:0/709297790 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff45c159770 0x7ff45c146f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:54:10.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.563+0000 7ff45bfff640 1 --2- 172.21.15.72:0/709297790 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff45c070140 0x7ff45c150820 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff44c00c430 tx=0x7ff44c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:10.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.567+0000 7ff4597fa640 1 -- 172.21.15.72:0/709297790 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff44c017070 con 0x7ff45c070140 2024-05-09T05:54:10.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.567+0000 7ff4597fa640 1 -- 172.21.15.72:0/709297790 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff44c005cf0 con 0x7ff45c070140 2024-05-09T05:54:10.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.567+0000 7ff4597fa640 1 -- 172.21.15.72:0/709297790 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff44c0072d0 con 0x7ff45c070140 2024-05-09T05:54:10.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.567+0000 7ff462618640 1 -- 172.21.15.72:0/709297790 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff45c1f2900 con 0x7ff45c070140 2024-05-09T05:54:10.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.567+0000 7ff462618640 1 -- 172.21.15.72:0/709297790 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff45c151d90 con 0x7ff45c070140 2024-05-09T05:54:10.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.567+0000 7ff462618640 1 -- 172.21.15.72:0/709297790 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff45c1f2ad0 con 0x7ff45c070140 2024-05-09T05:54:10.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.567+0000 7ff4597fa640 1 -- 172.21.15.72:0/709297790 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff44c01a070 con 0x7ff45c070140 2024-05-09T05:54:10.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.567+0000 7ff4597fa640 1 --2- 172.21.15.72:0/709297790 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7ff43c06f430 0x7ff43c071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:10.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.567+0000 7ff4597fa640 1 -- 172.21.15.72:0/709297790 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7ff44c08ece0 con 0x7ff45c070140 2024-05-09T05:54:10.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.567+0000 7ff4537fe640 1 --2- 172.21.15.72:0/709297790 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7ff43c06f430 0x7ff43c071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:10.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.567+0000 7ff4537fe640 1 --2- 172.21.15.72:0/709297790 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7ff43c06f430 0x7ff43c071940 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff45c158900 tx=0x7ff444008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:10.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.571+0000 7ff4597fa640 1 -- 172.21.15.72:0/709297790 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7ff44c05b380 con 0x7ff45c070140 2024-05-09T05:54:10.759 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.767+0000 7ff462618640 1 -- 172.21.15.72:0/709297790 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff45c150f30 con 0x7ff45c070140 2024-05-09T05:54:10.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.771+0000 7ff4597fa640 1 -- 172.21.15.72:0/709297790 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6911 (secure 0 0 0) 0x7ff44c05f680 con 0x7ff45c070140 2024-05-09T05:54:10.761 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:54:10.761 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6834/1142956298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1142956298},{"type":"v1","addr":"172.21.15.72:6834","nonce":1142956298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:53:23.494975+0000","modified":"2024-05-09T05:54:05.946716+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4297,"mds_1":4287,"mds_2":4263,"mds_3":4259,"mds_4":4257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4257":{"gid":4257,"name":"a","rank":4,"incarnation":18,"state":"up:creating","state_seq":1,"addr":"172.21.15.72:6835/3946563056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":3946563056},{"type":"v1","addr":"172.21.15.72:6835","nonce":3946563056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4259":{"gid":4259,"name":"f","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.110:6838/840351907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":840351907},{"type":"v1","addr":"172.21.15.110:6838","nonce":840351907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4263":{"gid":4263,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.72:6837/1048256382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":1048256382},{"type":"v1","addr":"172.21.15.72:6837","nonce":1048256382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.110:6839/966325499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6837","nonce":966325499},{"type":"v1","addr":"172.21.15.110:6839","nonce":966325499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6836/4134424941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":4134424941},{"type":"v1","addr":"172.21.15.110:6836","nonce":4134424941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4297,4287,4263,4259]},"id":1}]} 2024-05-09T05:54:10.761 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 18 2024-05-09T05:54:10.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.771+0000 7ff462618640 1 -- 172.21.15.72:0/709297790 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7ff43c06f430 msgr2=0x7ff43c071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:10.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.771+0000 7ff462618640 1 --2- 172.21.15.72:0/709297790 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7ff43c06f430 0x7ff43c071940 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff45c158900 tx=0x7ff444008040 comp rx=0 tx=0).stop 2024-05-09T05:54:10.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.771+0000 7ff462618640 1 -- 172.21.15.72:0/709297790 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff45c070140 msgr2=0x7ff45c150820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:10.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.771+0000 7ff462618640 1 --2- 172.21.15.72:0/709297790 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff45c070140 0x7ff45c150820 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff44c00c430 tx=0x7ff44c00c8f0 comp rx=0 tx=0).stop 2024-05-09T05:54:10.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.771+0000 7ff462618640 1 -- 172.21.15.72:0/709297790 shutdown_connections 2024-05-09T05:54:10.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.771+0000 7ff462618640 1 --2- 172.21.15.72:0/709297790 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7ff43c06f430 0x7ff43c071940 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:10.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.771+0000 7ff462618640 1 --2- 172.21.15.72:0/709297790 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff45c159770 0x7ff45c146f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:10.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.771+0000 7ff462618640 1 --2- 172.21.15.72:0/709297790 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff45c152ed0 0x7ff45c0cc880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:10.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.771+0000 7ff462618640 1 --2- 172.21.15.72:0/709297790 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff45c070140 0x7ff45c150820 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:10.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.771+0000 7ff462618640 1 -- 172.21.15.72:0/709297790 >> 172.21.15.72:0/709297790 conn(0x7ff45c0cde90 msgr2=0x7ff45c14b280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:10.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.771+0000 7ff462618640 1 -- 172.21.15.72:0/709297790 shutdown_connections 2024-05-09T05:54:10.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:10.771+0000 7ff462618640 1 -- 172.21.15.72:0/709297790 wait complete. 2024-05-09T05:54:11.388 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-09T05:53:23.494975+0000', 'modified': '2024-05-09T05:54:05.946716+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 4297, 'mds_1': 4287, 'mds_2': 4263, 'mds_3': 4259, 'mds_4': 4257}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4257': {'gid': 4257, 'name': 'a', 'rank': 4, 'incarnation': 18, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.72:6835/3946563056', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.72:6833', 'nonce': 3946563056}, {'type': 'v1', 'addr': '172.21.15.72:6835', 'nonce': 3946563056}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4259': {'gid': 4259, 'name': 'f', 'rank': 3, 'incarnation': 16, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.110:6838/840351907', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6835', 'nonce': 840351907}, {'type': 'v1', 'addr': '172.21.15.110:6838', 'nonce': 840351907}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4263': {'gid': 4263, 'name': 'c', 'rank': 2, 'incarnation': 14, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.72:6837/1048256382', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.72:6836', 'nonce': 1048256382}, {'type': 'v1', 'addr': '172.21.15.72:6837', 'nonce': 1048256382}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4287': {'gid': 4287, 'name': 'd', 'rank': 1, 'incarnation': 10, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.110:6839/966325499', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6837', 'nonce': 966325499}, {'type': 'v1', 'addr': '172.21.15.110:6839', 'nonce': 966325499}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4297': {'gid': 4297, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.110:6836/4134424941', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6834', 'nonce': 4134424941}, {'type': 'v1', 'addr': '172.21.15.110:6836', 'nonce': 4134424941}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4297, 'qdb_cluster': [4297, 4287, 4263, 4259]} 2024-05-09T05:54:11.388 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4257:up:creating 2024-05-09T05:54:12.389 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:54:12.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.559+0000 7f3ef6242640 1 Processor -- start 2024-05-09T05:54:12.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.559+0000 7f3ef6242640 1 -- start start 2024-05-09T05:54:12.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.559+0000 7f3ef6242640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ef015dea0 0x7f3ef00745b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:12.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.559+0000 7f3ef6242640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3ef0074af0 0x7f3ef0164e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:12.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.559+0000 7f3ef6242640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ef00c7c80 con 0x7f3ef015da90 2024-05-09T05:54:12.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.559+0000 7f3ef6242640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f3ef01513f0 con 0x7f3ef0074af0 2024-05-09T05:54:12.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.559+0000 7f3ef6242640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f3ef015a4f0 con 0x7f3ef015dea0 2024-05-09T05:54:12.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.559+0000 7f3eef7fe640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f3ef015da90 0x7f3ef00c7570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.72:53484/0 (socket says 172.21.15.72:53484) 2024-05-09T05:54:12.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.559+0000 7f3eef7fe640 1 -- 172.21.15.72:0/551862188 learned_addr learned my addr 172.21.15.72:0/551862188 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:54:12.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.559+0000 7f3eeeffd640 1 --2- 172.21.15.72:0/551862188 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ef015dea0 0x7f3ef00745b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:12.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.559+0000 7f3eeffff640 1 --2- 172.21.15.72:0/551862188 >> v2:172.21.15.110:3300/0 conn(0x7f3ef0074af0 0x7f3ef0164e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:12.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.559+0000 7f3eeffff640 1 -- 172.21.15.72:0/551862188 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ef015dea0 msgr2=0x7f3ef00745b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:12.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.559+0000 7f3eeffff640 1 --2- 172.21.15.72:0/551862188 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ef015dea0 0x7f3ef00745b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:12.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.559+0000 7f3eeffff640 1 -- 172.21.15.72:0/551862188 >> v1:172.21.15.110:6789/0 conn(0x7f3ef015da90 legacy=0x7f3ef00c7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:12.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.559+0000 7f3eeffff640 1 -- 172.21.15.72:0/551862188 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ef00c84f0 con 0x7f3ef0074af0 2024-05-09T05:54:12.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.563+0000 7f3eeffff640 1 --2- 172.21.15.72:0/551862188 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ef0074af0 0x7f3ef0164e70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3ee8009d90 tx=0x7f3ee801c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50f2ae0b153749cf server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:12.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.563+0000 7f3eee7fc640 1 -- 172.21.15.72:0/551862188 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ee80b2070 con 0x7f3ef0074af0 2024-05-09T05:54:12.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.563+0000 7f3eee7fc640 1 -- 172.21.15.72:0/551862188 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ee80a5830 con 0x7f3ef0074af0 2024-05-09T05:54:12.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.563+0000 7f3eee7fc640 1 -- 172.21.15.72:0/551862188 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ee80a5c00 con 0x7f3ef0074af0 2024-05-09T05:54:12.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.563+0000 7f3ef6242640 1 -- 172.21.15.72:0/551862188 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ef0074af0 msgr2=0x7f3ef0164e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:12.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.563+0000 7f3ef6242640 1 --2- 172.21.15.72:0/551862188 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ef0074af0 0x7f3ef0164e70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3ee8009d90 tx=0x7f3ee801c970 comp rx=0 tx=0).stop 2024-05-09T05:54:12.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.563+0000 7f3ef6242640 1 -- 172.21.15.72:0/551862188 shutdown_connections 2024-05-09T05:54:12.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.563+0000 7f3ef6242640 1 --2- 172.21.15.72:0/551862188 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ef0074af0 0x7f3ef0164e70 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:12.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.563+0000 7f3ef6242640 1 --2- 172.21.15.72:0/551862188 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ef015dea0 0x7f3ef00745b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:12.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.563+0000 7f3ef6242640 1 -- 172.21.15.72:0/551862188 >> 172.21.15.72:0/551862188 conn(0x7f3ef00cde90 msgr2=0x7f3ef00ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:12.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.563+0000 7f3ef6242640 1 -- 172.21.15.72:0/551862188 shutdown_connections 2024-05-09T05:54:12.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.563+0000 7f3ef6242640 1 -- 172.21.15.72:0/551862188 wait complete. 2024-05-09T05:54:12.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.567+0000 7f3ef6242640 1 Processor -- start 2024-05-09T05:54:12.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.567+0000 7f3ef6242640 1 -- start start 2024-05-09T05:54:12.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.567+0000 7f3ef6242640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ef0074af0 0x7f3ef01f3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:12.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.567+0000 7f3ef6242640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ef015da90 0x7f3ef013e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:12.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.567+0000 7f3ef6242640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ef015dea0 0x7f3ef0141000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:12.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.567+0000 7f3ef6242640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f3ef00c70e0 con 0x7f3ef0074af0 2024-05-09T05:54:12.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.567+0000 7f3ef6242640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f3ef015ad70 con 0x7f3ef015da90 2024-05-09T05:54:12.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.567+0000 7f3ef6242640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f3ef00c81b0 con 0x7f3ef015dea0 2024-05-09T05:54:12.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.567+0000 7f3eef7fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ef0074af0 0x7f3ef01f3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:12.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.567+0000 7f3eef7fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ef0074af0 0x7f3ef01f3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45938/0 (socket says 172.21.15.72:45938) 2024-05-09T05:54:12.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.567+0000 7f3eef7fe640 1 -- 172.21.15.72:0/3469025074 learned_addr learned my addr 172.21.15.72:0/3469025074 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:54:12.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.567+0000 7f3eeeffd640 1 --2- 172.21.15.72:0/3469025074 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ef015da90 0x7f3ef013e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:12.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.567+0000 7f3eeffff640 1 --2- 172.21.15.72:0/3469025074 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ef015dea0 0x7f3ef0141000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:12.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.567+0000 7f3eef7fe640 1 -- 172.21.15.72:0/3469025074 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ef015dea0 msgr2=0x7f3ef0141000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:12.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.567+0000 7f3eef7fe640 1 --2- 172.21.15.72:0/3469025074 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ef015dea0 0x7f3ef0141000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:12.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.567+0000 7f3eef7fe640 1 -- 172.21.15.72:0/3469025074 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ef015da90 msgr2=0x7f3ef013e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:12.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.567+0000 7f3eef7fe640 1 --2- 172.21.15.72:0/3469025074 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ef015da90 0x7f3ef013e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:12.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.567+0000 7f3eef7fe640 1 -- 172.21.15.72:0/3469025074 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ef00cc7d0 con 0x7f3ef0074af0 2024-05-09T05:54:12.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.567+0000 7f3eeeffd640 1 --2- 172.21.15.72:0/3469025074 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ef015da90 0x7f3ef013e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:54:12.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.567+0000 7f3eef7fe640 1 --2- 172.21.15.72:0/3469025074 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ef0074af0 0x7f3ef01f3bd0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3ed800c430 tx=0x7f3ed800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:12.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.567+0000 7f3ee7fff640 1 -- 172.21.15.72:0/3469025074 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ed8017070 con 0x7f3ef0074af0 2024-05-09T05:54:12.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.567+0000 7f3ee7fff640 1 -- 172.21.15.72:0/3469025074 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ed8005cf0 con 0x7f3ef0074af0 2024-05-09T05:54:12.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.567+0000 7f3ef6242640 1 -- 172.21.15.72:0/3469025074 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ef01f72e0 con 0x7f3ef0074af0 2024-05-09T05:54:12.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.567+0000 7f3ee7fff640 1 -- 172.21.15.72:0/3469025074 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ed80072f0 con 0x7f3ef0074af0 2024-05-09T05:54:12.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.567+0000 7f3ef6242640 1 -- 172.21.15.72:0/3469025074 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ef01f78a0 con 0x7f3ef0074af0 2024-05-09T05:54:12.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.567+0000 7f3ef6242640 1 -- 172.21.15.72:0/3469025074 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ef006a520 con 0x7f3ef0074af0 2024-05-09T05:54:12.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.571+0000 7f3ee7fff640 1 -- 172.21.15.72:0/3469025074 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f3ed801a070 con 0x7f3ef0074af0 2024-05-09T05:54:12.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.571+0000 7f3ee7fff640 1 --2- 172.21.15.72:0/3469025074 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f3ed006f400 0x7f3ed0071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:12.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.571+0000 7f3ee7fff640 1 -- 172.21.15.72:0/3469025074 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f3ed808ea30 con 0x7f3ef0074af0 2024-05-09T05:54:12.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.571+0000 7f3eeeffd640 1 --2- 172.21.15.72:0/3469025074 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f3ed006f400 0x7f3ed0071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:12.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.571+0000 7f3eeeffd640 1 --2- 172.21.15.72:0/3469025074 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f3ed006f400 0x7f3ed0071910 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3ef0157c60 tx=0x7f3ee0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:12.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.575+0000 7f3ee7fff640 1 -- 172.21.15.72:0/3469025074 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f3ed805b5b0 con 0x7f3ef0074af0 2024-05-09T05:54:12.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.771+0000 7f3ef6242640 1 -- 172.21.15.72:0/3469025074 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3ef00c8b30 con 0x7f3ef0074af0 2024-05-09T05:54:12.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.771+0000 7f3ee7fff640 1 -- 172.21.15.72:0/3469025074 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6915 (secure 0 0 0) 0x7f3ed805aeb0 con 0x7f3ef0074af0 2024-05-09T05:54:12.762 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:54:12.762 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6834/1142956298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1142956298},{"type":"v1","addr":"172.21.15.72:6834","nonce":1142956298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:53:23.494975+0000","modified":"2024-05-09T05:54:11.535513+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4297,"mds_1":4287,"mds_2":4263,"mds_3":4259,"mds_4":4257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4257":{"gid":4257,"name":"a","rank":4,"incarnation":18,"state":"up:active","state_seq":15,"addr":"172.21.15.72:6835/3946563056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":3946563056},{"type":"v1","addr":"172.21.15.72:6835","nonce":3946563056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4259":{"gid":4259,"name":"f","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.110:6838/840351907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":840351907},{"type":"v1","addr":"172.21.15.110:6838","nonce":840351907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4263":{"gid":4263,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.72:6837/1048256382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":1048256382},{"type":"v1","addr":"172.21.15.72:6837","nonce":1048256382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.110:6839/966325499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6837","nonce":966325499},{"type":"v1","addr":"172.21.15.110:6839","nonce":966325499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6836/4134424941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":4134424941},{"type":"v1","addr":"172.21.15.110:6836","nonce":4134424941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4257,4259,4263,4287,4297]},"id":1}]} 2024-05-09T05:54:12.762 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 19 2024-05-09T05:54:12.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.771+0000 7f3ef6242640 1 -- 172.21.15.72:0/3469025074 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f3ed006f400 msgr2=0x7f3ed0071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:12.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.771+0000 7f3ef6242640 1 --2- 172.21.15.72:0/3469025074 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f3ed006f400 0x7f3ed0071910 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3ef0157c60 tx=0x7f3ee0008040 comp rx=0 tx=0).stop 2024-05-09T05:54:12.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.771+0000 7f3ef6242640 1 -- 172.21.15.72:0/3469025074 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ef0074af0 msgr2=0x7f3ef01f3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:12.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.771+0000 7f3ef6242640 1 --2- 172.21.15.72:0/3469025074 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ef0074af0 0x7f3ef01f3bd0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3ed800c430 tx=0x7f3ed800c8f0 comp rx=0 tx=0).stop 2024-05-09T05:54:12.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.771+0000 7f3ef6242640 1 -- 172.21.15.72:0/3469025074 shutdown_connections 2024-05-09T05:54:12.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.771+0000 7f3ef6242640 1 --2- 172.21.15.72:0/3469025074 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f3ed006f400 0x7f3ed0071910 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:12.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.771+0000 7f3ef6242640 1 --2- 172.21.15.72:0/3469025074 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ef015dea0 0x7f3ef0141000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:12.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.771+0000 7f3ef6242640 1 --2- 172.21.15.72:0/3469025074 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ef015da90 0x7f3ef013e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:12.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.771+0000 7f3ef6242640 1 --2- 172.21.15.72:0/3469025074 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ef0074af0 0x7f3ef01f3bd0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:12.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.771+0000 7f3ef6242640 1 -- 172.21.15.72:0/3469025074 >> 172.21.15.72:0/3469025074 conn(0x7f3ef00cde90 msgr2=0x7f3ef0070570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:12.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.771+0000 7f3ef6242640 1 -- 172.21.15.72:0/3469025074 shutdown_connections 2024-05-09T05:54:12.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:12.771+0000 7f3ef6242640 1 -- 172.21.15.72:0/3469025074 wait complete. 2024-05-09T05:54:13.388 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 19, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-09T05:53:23.494975+0000', 'modified': '2024-05-09T05:54:11.535513+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 4297, 'mds_1': 4287, 'mds_2': 4263, 'mds_3': 4259, 'mds_4': 4257}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4257': {'gid': 4257, 'name': 'a', 'rank': 4, 'incarnation': 18, 'state': 'up:active', 'state_seq': 15, 'addr': '172.21.15.72:6835/3946563056', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.72:6833', 'nonce': 3946563056}, {'type': 'v1', 'addr': '172.21.15.72:6835', 'nonce': 3946563056}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4259': {'gid': 4259, 'name': 'f', 'rank': 3, 'incarnation': 16, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.110:6838/840351907', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6835', 'nonce': 840351907}, {'type': 'v1', 'addr': '172.21.15.110:6838', 'nonce': 840351907}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4263': {'gid': 4263, 'name': 'c', 'rank': 2, 'incarnation': 14, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.72:6837/1048256382', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.72:6836', 'nonce': 1048256382}, {'type': 'v1', 'addr': '172.21.15.72:6837', 'nonce': 1048256382}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4287': {'gid': 4287, 'name': 'd', 'rank': 1, 'incarnation': 10, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.110:6839/966325499', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6837', 'nonce': 966325499}, {'type': 'v1', 'addr': '172.21.15.110:6839', 'nonce': 966325499}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4297': {'gid': 4297, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.110:6836/4134424941', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6834', 'nonce': 4134424941}, {'type': 'v1', 'addr': '172.21.15.110:6836', 'nonce': 4134424941}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4297, 'qdb_cluster': [4257, 4259, 4263, 4287, 4297]} 2024-05-09T05:54:13.388 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-05-09T05:54:13.389 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-05-09T05:54:13.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.563+0000 7f3126cf4640 1 Processor -- start 2024-05-09T05:54:13.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.563+0000 7f3126cf4640 1 -- start start 2024-05-09T05:54:13.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.563+0000 7f3126cf4640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f312015e470 0x7f312015e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:13.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.563+0000 7f3126cf4640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f312015edc0 0x7f312015f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:13.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.563+0000 7f3126cf4640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31200cda30 con 0x7f3120156b50 2024-05-09T05:54:13.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.563+0000 7f3126cf4640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f31200cc020 con 0x7f312015edc0 2024-05-09T05:54:13.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.563+0000 7f3126cf4640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f312015dfe0 con 0x7f312015e470 2024-05-09T05:54:13.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.563+0000 7f3125291640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f312015edc0 0x7f312015f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:13.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.563+0000 7f3124a90640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f3120156b50 0x7f3120073ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41478/0 (socket says 172.21.15.72:41478) 2024-05-09T05:54:13.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.563+0000 7f3124a90640 1 -- 172.21.15.72:0/1555410339 learned_addr learned my addr 172.21.15.72:0/1555410339 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:54:13.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.563+0000 7f311ffff640 1 --2- 172.21.15.72:0/1555410339 >> v2:172.21.15.110:3300/0 conn(0x7f312015e470 0x7f312015e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:13.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.563+0000 7f3125291640 1 -- 172.21.15.72:0/1555410339 >> v2:172.21.15.110:3300/0 conn(0x7f312015e470 msgr2=0x7f312015e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:13.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.563+0000 7f3125291640 1 --2- 172.21.15.72:0/1555410339 >> v2:172.21.15.110:3300/0 conn(0x7f312015e470 0x7f312015e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:13.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.563+0000 7f3125291640 1 -- 172.21.15.72:0/1555410339 >> v1:172.21.15.72:6789/0 conn(0x7f3120156b50 legacy=0x7f3120073ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:13.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.563+0000 7f311f7fe640 1 -- 172.21.15.72:0/1555410339 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3457593614 0 0) 0x7f31180014a0 con 0x7f3120156b50 2024-05-09T05:54:13.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.563+0000 7f3125291640 1 -- 172.21.15.72:0/1555410339 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f312015cdd0 con 0x7f312015edc0 2024-05-09T05:54:13.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.567+0000 7f3125291640 1 --2- 172.21.15.72:0/1555410339 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f312015edc0 0x7f312015f1d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f312008f980 tx=0x7f311001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71e43490b2e170e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:13.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.567+0000 7f311f7fe640 1 -- 172.21.15.72:0/1555410339 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31100b0070 con 0x7f312015edc0 2024-05-09T05:54:13.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.567+0000 7f311f7fe640 1 -- 172.21.15.72:0/1555410339 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31100ab600 con 0x7f312015edc0 2024-05-09T05:54:13.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.567+0000 7f311f7fe640 1 -- 172.21.15.72:0/1555410339 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31100ab9d0 con 0x7f312015edc0 2024-05-09T05:54:13.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.567+0000 7f3126cf4640 1 -- 172.21.15.72:0/1555410339 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f312015edc0 msgr2=0x7f312015f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:13.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.567+0000 7f3126cf4640 1 --2- 172.21.15.72:0/1555410339 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f312015edc0 0x7f312015f1d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f312008f980 tx=0x7f311001c480 comp rx=0 tx=0).stop 2024-05-09T05:54:13.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.567+0000 7f3126cf4640 1 -- 172.21.15.72:0/1555410339 shutdown_connections 2024-05-09T05:54:13.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.567+0000 7f3126cf4640 1 --2- 172.21.15.72:0/1555410339 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f312015edc0 0x7f312015f1d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:13.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.567+0000 7f3126cf4640 1 --2- 172.21.15.72:0/1555410339 >> v2:172.21.15.110:3300/0 conn(0x7f312015e470 0x7f312015e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:13.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.567+0000 7f3126cf4640 1 -- 172.21.15.72:0/1555410339 >> 172.21.15.72:0/1555410339 conn(0x7f31200d1b70 msgr2=0x7f31200d1f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:13.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.567+0000 7f3126cf4640 1 -- 172.21.15.72:0/1555410339 shutdown_connections 2024-05-09T05:54:13.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.567+0000 7f3126cf4640 1 -- 172.21.15.72:0/1555410339 wait complete. 2024-05-09T05:54:13.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.571+0000 7f3126cf4640 1 Processor -- start 2024-05-09T05:54:13.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.571+0000 7f3126cf4640 1 -- start start 2024-05-09T05:54:13.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.571+0000 7f3126cf4640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3120156b50 0x7f31200c64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:13.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.571+0000 7f3126cf4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f312015e470 0x7f31200c72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:13.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.571+0000 7f3126cf4640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f312015edc0 0x7f31201551a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:13.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.571+0000 7f3126cf4640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f312015c9b0 con 0x7f312015edc0 2024-05-09T05:54:13.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.571+0000 7f3126cf4640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f3120074cf0 con 0x7f312015e470 2024-05-09T05:54:13.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.571+0000 7f3126cf4640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f312015cb30 con 0x7f3120156b50 2024-05-09T05:54:13.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.571+0000 7f3125291640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f312015edc0 0x7f31201551a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:13.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.571+0000 7f3125291640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f312015edc0 0x7f31201551a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45946/0 (socket says 172.21.15.72:45946) 2024-05-09T05:54:13.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.571+0000 7f3125291640 1 -- 172.21.15.72:0/3891130693 learned_addr learned my addr 172.21.15.72:0/3891130693 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:54:13.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.571+0000 7f3124a90640 1 --2- 172.21.15.72:0/3891130693 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3120156b50 0x7f31200c64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:13.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.571+0000 7f311ffff640 1 --2- 172.21.15.72:0/3891130693 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f312015e470 0x7f31200c72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:13.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.571+0000 7f3125291640 1 -- 172.21.15.72:0/3891130693 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3120156b50 msgr2=0x7f31200c64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:13.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.571+0000 7f3125291640 1 --2- 172.21.15.72:0/3891130693 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3120156b50 0x7f31200c64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:13.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.571+0000 7f3125291640 1 -- 172.21.15.72:0/3891130693 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f312015e470 msgr2=0x7f31200c72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:13.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.571+0000 7f3125291640 1 --2- 172.21.15.72:0/3891130693 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f312015e470 0x7f31200c72d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:13.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.571+0000 7f3125291640 1 -- 172.21.15.72:0/3891130693 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31200c7810 con 0x7f312015edc0 2024-05-09T05:54:13.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.571+0000 7f3124a90640 1 --2- 172.21.15.72:0/3891130693 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3120156b50 0x7f31200c64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:54:13.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.571+0000 7f3125291640 1 --2- 172.21.15.72:0/3891130693 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f312015edc0 0x7f31201551a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3110019090 tx=0x7f311001acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:13.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.571+0000 7f311d7fa640 1 -- 172.21.15.72:0/3891130693 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31100b0050 con 0x7f312015edc0 2024-05-09T05:54:13.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.571+0000 7f311d7fa640 1 -- 172.21.15.72:0/3891130693 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31100bc070 con 0x7f312015edc0 2024-05-09T05:54:13.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.571+0000 7f3126cf4640 1 -- 172.21.15.72:0/3891130693 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3120155ee0 con 0x7f312015edc0 2024-05-09T05:54:13.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.571+0000 7f311d7fa640 1 -- 172.21.15.72:0/3891130693 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3110006e20 con 0x7f312015edc0 2024-05-09T05:54:13.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.571+0000 7f3126cf4640 1 -- 172.21.15.72:0/3891130693 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31201564a0 con 0x7f312015edc0 2024-05-09T05:54:13.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.575+0000 7f311d7fa640 1 -- 172.21.15.72:0/3891130693 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f31100b5830 con 0x7f312015edc0 2024-05-09T05:54:13.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.575+0000 7f311d7fa640 1 --2- 172.21.15.72:0/3891130693 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f310006f400 0x7f3100071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:13.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.575+0000 7f311d7fa640 1 -- 172.21.15.72:0/3891130693 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f3110129de0 con 0x7f312015edc0 2024-05-09T05:54:13.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.575+0000 7f3124a90640 1 --2- 172.21.15.72:0/3891130693 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f310006f400 0x7f3100071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:13.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.575+0000 7f312e052000 1 Processor -- start 2024-05-09T05:54:13.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.575+0000 7f312e052000 1 -- start start 2024-05-09T05:54:13.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.575+0000 7f3124a90640 1 --2- 172.21.15.72:0/3891130693 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f310006f400 0x7f3100071910 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3118007fd0 tx=0x7f3118005b80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:13.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.575+0000 7f312e052000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55bce1e15bd0 0x55bce1f56bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:13.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.575+0000 7f312e052000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bce1e0e180 0x55bce1f570f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:13.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.575+0000 7f312e052000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bce1df7d50 0x55bce1f57630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:13.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.575+0000 7f312e052000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55bce1dfccc0 con 0x55bce1df7d50 2024-05-09T05:54:13.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.575+0000 7f312e052000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55bce1d17370 con 0x55bce1e0e180 2024-05-09T05:54:13.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.575+0000 7f312e052000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x55bce1d648c0 con 0x55bce1e15bd0 2024-05-09T05:54:13.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.575+0000 7f3125291640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bce1df7d50 0x55bce1f57630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:13.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.575+0000 7f3125291640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bce1df7d50 0x55bce1f57630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45950/0 (socket says 172.21.15.72:45950) 2024-05-09T05:54:13.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.575+0000 7f3125291640 1 -- 172.21.15.72:0/3035400246 learned_addr learned my addr 172.21.15.72:0/3035400246 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:54:13.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.575+0000 7f3124a90640 1 --2- 172.21.15.72:0/3035400246 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55bce1e15bd0 0x55bce1f56bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:13.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.575+0000 7f311ffff640 1 --2- 172.21.15.72:0/3035400246 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bce1e0e180 0x55bce1f570f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:13.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.575+0000 7f3125291640 1 -- 172.21.15.72:0/3035400246 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55bce1e15bd0 msgr2=0x55bce1f56bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:13.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.575+0000 7f3125291640 1 --2- 172.21.15.72:0/3035400246 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55bce1e15bd0 0x55bce1f56bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:13.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.575+0000 7f3125291640 1 -- 172.21.15.72:0/3035400246 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bce1e0e180 msgr2=0x55bce1f570f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:13.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.575+0000 7f3125291640 1 --2- 172.21.15.72:0/3035400246 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bce1e0e180 0x55bce1f570f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:13.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.575+0000 7f3125291640 1 -- 172.21.15.72:0/3035400246 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bce1d25ef0 con 0x55bce1df7d50 2024-05-09T05:54:13.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.575+0000 7f311ffff640 1 --2- 172.21.15.72:0/3035400246 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bce1e0e180 0x55bce1f570f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:54:13.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.575+0000 7f3125291640 1 --2- 172.21.15.72:0/3035400246 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bce1df7d50 0x55bce1f57630 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f31100f61e0 tx=0x7f31100f2240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fe07604d3477144 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:13.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.575+0000 7f31167fc640 1 -- 172.21.15.72:0/3035400246 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31100f6950 con 0x55bce1df7d50 2024-05-09T05:54:13.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.575+0000 7f31167fc640 1 -- 172.21.15.72:0/3035400246 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31100b1040 con 0x55bce1df7d50 2024-05-09T05:54:13.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.575+0000 7f31167fc640 1 -- 172.21.15.72:0/3035400246 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31100fed90 con 0x55bce1df7d50 2024-05-09T05:54:13.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.579+0000 7f312e052000 1 -- 172.21.15.72:0/3035400246 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bce1df7d50 msgr2=0x55bce1f57630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:13.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.579+0000 7f312e052000 1 --2- 172.21.15.72:0/3035400246 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bce1df7d50 0x55bce1f57630 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f31100f61e0 tx=0x7f31100f2240 comp rx=0 tx=0).stop 2024-05-09T05:54:13.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.579+0000 7f312e052000 1 -- 172.21.15.72:0/3035400246 shutdown_connections 2024-05-09T05:54:13.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.579+0000 7f312e052000 1 --2- 172.21.15.72:0/3035400246 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bce1df7d50 0x55bce1f57630 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:13.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.579+0000 7f312e052000 1 --2- 172.21.15.72:0/3035400246 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bce1e0e180 0x55bce1f570f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:13.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.579+0000 7f312e052000 1 --2- 172.21.15.72:0/3035400246 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55bce1e15bd0 0x55bce1f56bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:13.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.579+0000 7f312e052000 1 -- 172.21.15.72:0/3035400246 >> 172.21.15.72:0/3035400246 conn(0x55bce1a22730 msgr2=0x55bce1f54970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:13.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.579+0000 7f312e052000 1 -- 172.21.15.72:0/3035400246 shutdown_connections 2024-05-09T05:54:13.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.579+0000 7f312e052000 1 -- 172.21.15.72:0/3035400246 wait complete. 2024-05-09T05:54:13.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.579+0000 7f312e052000 1 -- start start 2024-05-09T05:54:13.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.579+0000 7f312e052000 1 Processor -- start 2024-05-09T05:54:13.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.579+0000 7f312e052000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55bce1df7d50 0x55bce1f504f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:13.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.579+0000 7f312e052000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bce1e0e180 0x55bce1f50a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:13.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.579+0000 7f312e052000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bce1e15bd0 0x55bce1f17960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:13.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.579+0000 7f312e052000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55bce1d60880 con 0x55bce1e15bd0 2024-05-09T05:54:13.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.579+0000 7f312e052000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55bce1d1da00 con 0x55bce1e0e180 2024-05-09T05:54:13.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.579+0000 7f312e052000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x55bce1d04910 con 0x55bce1df7d50 2024-05-09T05:54:13.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.579+0000 7f312e052000 10 client.0 _ll_register_callbacks cb 0x55bce1f01100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T05:54:13.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.579+0000 7f3125291640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bce1e15bd0 0x55bce1f17960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:13.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.579+0000 7f3125291640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bce1e15bd0 0x55bce1f17960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45958/0 (socket says 172.21.15.72:45958) 2024-05-09T05:54:13.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.579+0000 7f3125291640 1 -- 172.21.15.72:0/3297747373 learned_addr learned my addr 172.21.15.72:0/3297747373 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:54:13.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.579+0000 7f3124a90640 1 --2- 172.21.15.72:0/3297747373 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55bce1df7d50 0x55bce1f504f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:13.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.579+0000 7f311ffff640 1 --2- 172.21.15.72:0/3297747373 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bce1e0e180 0x55bce1f50a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:13.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.579+0000 7f3125291640 1 -- 172.21.15.72:0/3297747373 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55bce1df7d50 msgr2=0x55bce1f504f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:13.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.579+0000 7f3125291640 1 --2- 172.21.15.72:0/3297747373 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55bce1df7d50 0x55bce1f504f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:13.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.579+0000 7f3125291640 1 -- 172.21.15.72:0/3297747373 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bce1e0e180 msgr2=0x55bce1f50a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:13.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.579+0000 7f3125291640 1 --2- 172.21.15.72:0/3297747373 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bce1e0e180 0x55bce1f50a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:13.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.579+0000 7f3125291640 1 -- 172.21.15.72:0/3297747373 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bce1d1dc50 con 0x55bce1e15bd0 2024-05-09T05:54:13.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.579+0000 7f3124a90640 1 --2- 172.21.15.72:0/3297747373 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55bce1df7d50 0x55bce1f504f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:54:13.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.579+0000 7f311ffff640 1 --2- 172.21.15.72:0/3297747373 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bce1e0e180 0x55bce1f50a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:54:13.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.579+0000 7f3125291640 1 --2- 172.21.15.72:0/3297747373 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bce1e15bd0 0x55bce1f17960 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f31100f34c0 tx=0x7f3110019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87966bcbaaa6a1f2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:13.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.579+0000 7f30ff7fe640 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-09T05:54:13.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.579+0000 7f30ff7fe640 1 -- 172.21.15.72:0/3297747373 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f311010f040 con 0x55bce1e15bd0 2024-05-09T05:54:13.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.579+0000 7f30ff7fe640 1 -- 172.21.15.72:0/3297747373 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f31100f1bc0 con 0x55bce1e15bd0 2024-05-09T05:54:13.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.579+0000 7f312e052000 1 -- 172.21.15.72:0/3297747373 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f31100b1040 con 0x55bce1e15bd0 2024-05-09T05:54:13.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.579+0000 7f30ff7fe640 1 -- 172.21.15.72:0/3297747373 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f31100f6950 con 0x55bce1e15bd0 2024-05-09T05:54:13.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.579+0000 7f312e052000 10 client.4713 fetch_fsmap learned FSMap version 19 2024-05-09T05:54:13.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.579+0000 7f312e052000 1 -- 172.21.15.72:0/3297747373 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55bce1d1b650 con 0x55bce1e15bd0 2024-05-09T05:54:13.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.579+0000 7f30ff7fe640 1 -- 172.21.15.72:0/3297747373 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31100b1040 con 0x55bce1e15bd0 2024-05-09T05:54:13.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.579+0000 7f30ff7fe640 1 -- 172.21.15.72:0/3297747373 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7f31100f1dc0 con 0x55bce1e15bd0 2024-05-09T05:54:13.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.579+0000 7f312e052000 10 client.4713 fetch_fsmap finished waiting for FSMap version 19 2024-05-09T05:54:13.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.579+0000 7f312e052000 10 client.4713 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-09T05:54:13.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.579+0000 7f312e052000 20 client.4713 populate_metadata read hostname 'smithi072' 2024-05-09T05:54:13.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.579+0000 7f312e052000 1 --2- 172.21.15.72:0/3297747373 >> [v2:172.21.15.72:6833/3946563056,v1:172.21.15.72:6835/3946563056] conn(0x55bce1a087d0 0x55bce1f186d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:13.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.583+0000 7f312e052000 4 client.4713 mds_command: new command op to 4257 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T05:54:13.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.583+0000 7f312e052000 1 -- 172.21.15.72:0/3297747373 --> [v2:172.21.15.72:6833/3946563056,v1:172.21.15.72:6835/3946563056] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bce1cfd620 con 0x55bce1a087d0 2024-05-09T05:54:13.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.583+0000 7f3124a90640 1 --2- 172.21.15.72:0/3297747373 >> [v2:172.21.15.72:6833/3946563056,v1:172.21.15.72:6835/3946563056] conn(0x55bce1a087d0 0x55bce1f186d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:13.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.583+0000 7f3124a90640 1 --2- 172.21.15.72:0/3297747373 >> [v2:172.21.15.72:6833/3946563056,v1:172.21.15.72:6835/3946563056] conn(0x55bce1a087d0 0x55bce1f186d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=e74dcb5c2b909bfd server_cookie=a38d396c8b37d3d1 in_seq=0 out_seq=0 2024-05-09T05:54:13.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:13.583+0000 7f30ff7fe640 10 client.4713 ms_handle_connect on v2:172.21.15.72:6833/3946563056 2024-05-09T05:54:14.053 INFO:tasks.ceph.mds.b.smithi110.stderr:2024-05-09T05:54:14.061+0000 7f6833aba640 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-05-09T05:54:16.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.535+0000 7f30ff7fe640 1 -- 172.21.15.72:0/3297747373 <== mds.4 v2:172.21.15.72:6833/3946563056 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55bce1cfd620 con 0x55bce1a087d0 2024-05-09T05:54:16.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.535+0000 7f30ff7fe640 10 client.4713 handle_command_reply: tid=0 2024-05-09T05:54:16.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.539+0000 7f312e052000 1 client.4713 shutdown 2024-05-09T05:54:16.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.539+0000 7f312e052000 1 -- 172.21.15.72:0/3297747373 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bce1e15bd0 msgr2=0x55bce1f17960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:16.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.539+0000 7f312e052000 1 --2- 172.21.15.72:0/3297747373 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bce1e15bd0 0x55bce1f17960 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f31100f34c0 tx=0x7f3110019220 comp rx=0 tx=0).stop 2024-05-09T05:54:16.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.539+0000 7f312e052000 1 -- 172.21.15.72:0/3297747373 shutdown_connections 2024-05-09T05:54:16.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.539+0000 7f312e052000 1 --2- 172.21.15.72:0/3297747373 >> [v2:172.21.15.72:6833/3946563056,v1:172.21.15.72:6835/3946563056] conn(0x55bce1a087d0 0x55bce1f186d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.539+0000 7f312e052000 1 --2- 172.21.15.72:0/3297747373 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bce1e15bd0 0x55bce1f17960 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.539+0000 7f312e052000 1 --2- 172.21.15.72:0/3297747373 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bce1e0e180 0x55bce1f50a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.539+0000 7f30ff7fe640 0 client.4713 ms_handle_reset on v2:172.21.15.72:6833/3946563056 2024-05-09T05:54:16.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.539+0000 7f312e052000 1 --2- 172.21.15.72:0/3297747373 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55bce1df7d50 0x55bce1f504f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.539+0000 7f312e052000 1 -- 172.21.15.72:0/3297747373 >> 172.21.15.72:0/3297747373 conn(0x55bce1a22730 msgr2=0x55bce1f53b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:16.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.539+0000 7f312e052000 1 -- 172.21.15.72:0/3297747373 shutdown_connections 2024-05-09T05:54:16.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.539+0000 7f312e052000 1 -- 172.21.15.72:0/3297747373 wait complete. 2024-05-09T05:54:16.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.539+0000 7f312e052000 20 client.4713 trim_cache size 0 max 16384 2024-05-09T05:54:16.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.563+0000 7f312e052000 1 Processor -- start 2024-05-09T05:54:16.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.563+0000 7f312e052000 1 -- start start 2024-05-09T05:54:16.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.567+0000 7f312e052000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bce1df7d50 0x55bce1f67f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:16.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.567+0000 7f312e052000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55bce1e0e180 0x55bce1f68480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:16.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.567+0000 7f312e052000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bce1e15bd0 0x55bce1f4e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:16.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.567+0000 7f312e052000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f3120203ed0 con 0x55bce1e15bd0 2024-05-09T05:54:16.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.567+0000 7f312e052000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f312014cae0 con 0x55bce1df7d50 2024-05-09T05:54:16.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.567+0000 7f312e052000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x55bce1d71cc0 con 0x55bce1e0e180 2024-05-09T05:54:16.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.567+0000 7f3125291640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bce1e15bd0 0x55bce1f4e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:16.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.567+0000 7f3125291640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bce1e15bd0 0x55bce1f4e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45968/0 (socket says 172.21.15.72:45968) 2024-05-09T05:54:16.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.567+0000 7f3125291640 1 -- 172.21.15.72:0/3779265187 learned_addr learned my addr 172.21.15.72:0/3779265187 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:54:16.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.567+0000 7f3124a90640 1 --2- 172.21.15.72:0/3779265187 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bce1df7d50 0x55bce1f67f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:16.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.567+0000 7f311ffff640 1 --2- 172.21.15.72:0/3779265187 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55bce1e0e180 0x55bce1f68480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:16.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.567+0000 7f3125291640 1 -- 172.21.15.72:0/3779265187 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55bce1e0e180 msgr2=0x55bce1f68480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:16.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.567+0000 7f3125291640 1 --2- 172.21.15.72:0/3779265187 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55bce1e0e180 0x55bce1f68480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.567+0000 7f3125291640 1 -- 172.21.15.72:0/3779265187 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bce1df7d50 msgr2=0x55bce1f67f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:16.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.567+0000 7f3125291640 1 --2- 172.21.15.72:0/3779265187 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bce1df7d50 0x55bce1f67f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.567+0000 7f3125291640 1 -- 172.21.15.72:0/3779265187 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bce1de60e0 con 0x55bce1e15bd0 2024-05-09T05:54:16.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.567+0000 7f311ffff640 1 --2- 172.21.15.72:0/3779265187 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55bce1e0e180 0x55bce1f68480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:54:16.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.567+0000 7f3124a90640 1 --2- 172.21.15.72:0/3779265187 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bce1df7d50 0x55bce1f67f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:54:16.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.567+0000 7f3125291640 1 --2- 172.21.15.72:0/3779265187 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bce1e15bd0 0x55bce1f4e740 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3110097d50 tx=0x7f3110124000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddcaa19ecd4c963 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:16.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.567+0000 7f3115ffb640 1 -- 172.21.15.72:0/3779265187 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f311010f040 con 0x55bce1e15bd0 2024-05-09T05:54:16.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.567+0000 7f3115ffb640 1 -- 172.21.15.72:0/3779265187 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31100fa600 con 0x55bce1e15bd0 2024-05-09T05:54:16.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.567+0000 7f3115ffb640 1 -- 172.21.15.72:0/3779265187 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31100ff020 con 0x55bce1e15bd0 2024-05-09T05:54:16.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.567+0000 7f312e052000 1 -- 172.21.15.72:0/3779265187 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bce1e15bd0 msgr2=0x55bce1f4e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:16.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.567+0000 7f312e052000 1 --2- 172.21.15.72:0/3779265187 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bce1e15bd0 0x55bce1f4e740 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3110097d50 tx=0x7f3110124000 comp rx=0 tx=0).stop 2024-05-09T05:54:16.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.567+0000 7f312e052000 1 -- 172.21.15.72:0/3779265187 shutdown_connections 2024-05-09T05:54:16.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.567+0000 7f312e052000 1 --2- 172.21.15.72:0/3779265187 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bce1e15bd0 0x55bce1f4e740 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.567+0000 7f312e052000 1 --2- 172.21.15.72:0/3779265187 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55bce1e0e180 0x55bce1f68480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.567+0000 7f312e052000 1 --2- 172.21.15.72:0/3779265187 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bce1df7d50 0x55bce1f67f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.567+0000 7f312e052000 1 -- 172.21.15.72:0/3779265187 >> 172.21.15.72:0/3779265187 conn(0x55bce1a22730 msgr2=0x55bce1f72430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:16.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.567+0000 7f312e052000 1 -- 172.21.15.72:0/3779265187 shutdown_connections 2024-05-09T05:54:16.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.567+0000 7f312e052000 1 -- 172.21.15.72:0/3779265187 wait complete. 2024-05-09T05:54:16.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.567+0000 7f312e052000 1 -- start start 2024-05-09T05:54:16.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.567+0000 7f312e052000 1 Processor -- start 2024-05-09T05:54:16.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.571+0000 7f312e052000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55bce1df7d50 0x55bce1fce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:16.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.571+0000 7f312e052000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bce1e0e180 0x55bce1fce880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:16.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.571+0000 7f312e052000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bce1e15bd0 0x55bce1f6ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:16.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.571+0000 7f312e052000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55bce1d04910 con 0x55bce1e0e180 2024-05-09T05:54:16.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.571+0000 7f312e052000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55bce1d60880 con 0x55bce1e15bd0 2024-05-09T05:54:16.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.571+0000 7f312e052000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x55bce1e1ff80 con 0x55bce1df7d50 2024-05-09T05:54:16.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.571+0000 7f312e052000 10 client.0 _ll_register_callbacks cb 0x7f31100f6020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T05:54:16.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.571+0000 7f311ffff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bce1e0e180 0x55bce1fce880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:16.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.571+0000 7f311ffff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bce1e0e180 0x55bce1fce880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45984/0 (socket says 172.21.15.72:45984) 2024-05-09T05:54:16.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.571+0000 7f311ffff640 1 -- 172.21.15.72:0/3142990434 learned_addr learned my addr 172.21.15.72:0/3142990434 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:54:16.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.571+0000 7f3124a90640 1 --2- 172.21.15.72:0/3142990434 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55bce1df7d50 0x55bce1fce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:16.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.571+0000 7f3125291640 1 --2- 172.21.15.72:0/3142990434 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bce1e15bd0 0x55bce1f6ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:16.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.571+0000 7f311ffff640 1 -- 172.21.15.72:0/3142990434 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55bce1df7d50 msgr2=0x55bce1fce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:16.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.571+0000 7f311ffff640 1 --2- 172.21.15.72:0/3142990434 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55bce1df7d50 0x55bce1fce340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.571+0000 7f311ffff640 1 -- 172.21.15.72:0/3142990434 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bce1e15bd0 msgr2=0x55bce1f6ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:16.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.571+0000 7f311ffff640 1 --2- 172.21.15.72:0/3142990434 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bce1e15bd0 0x55bce1f6ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.571+0000 7f311ffff640 1 -- 172.21.15.72:0/3142990434 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bce1dbcf90 con 0x55bce1e0e180 2024-05-09T05:54:16.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.571+0000 7f311ffff640 1 --2- 172.21.15.72:0/3142990434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bce1e0e180 0x55bce1fce880 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f31080156d0 tx=0x7f3108015b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cbbf2579b5784fa server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:16.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.571+0000 7f30ff7fe640 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-09T05:54:16.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.571+0000 7f30ff7fe640 1 -- 172.21.15.72:0/3142990434 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3108013aa0 con 0x55bce1e0e180 2024-05-09T05:54:16.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.571+0000 7f30ff7fe640 1 -- 172.21.15.72:0/3142990434 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f3108013c40 con 0x55bce1e0e180 2024-05-09T05:54:16.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.571+0000 7f312e052000 1 -- 172.21.15.72:0/3142990434 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f31100fa600 con 0x55bce1e0e180 2024-05-09T05:54:16.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.571+0000 7f30ff7fe640 1 -- 172.21.15.72:0/3142990434 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f3108013e40 con 0x55bce1e0e180 2024-05-09T05:54:16.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.571+0000 7f312e052000 10 client.4719 fetch_fsmap learned FSMap version 19 2024-05-09T05:54:16.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.571+0000 7f312e052000 1 -- 172.21.15.72:0/3142990434 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55bce1d08f30 con 0x55bce1e0e180 2024-05-09T05:54:16.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.571+0000 7f30ff7fe640 1 -- 172.21.15.72:0/3142990434 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31100fa600 con 0x55bce1e0e180 2024-05-09T05:54:16.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.571+0000 7f30ff7fe640 1 -- 172.21.15.72:0/3142990434 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7f31080059a0 con 0x55bce1e0e180 2024-05-09T05:54:16.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.571+0000 7f312e052000 10 client.4719 fetch_fsmap finished waiting for FSMap version 19 2024-05-09T05:54:16.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.571+0000 7f312e052000 10 client.4719 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-09T05:54:16.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.571+0000 7f312e052000 20 client.4719 populate_metadata read hostname 'smithi072' 2024-05-09T05:54:16.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.571+0000 7f312e052000 1 --2- 172.21.15.72:0/3142990434 >> [v2:172.21.15.72:6833/3946563056,v1:172.21.15.72:6835/3946563056] conn(0x55bce19f6830 0x55bce1fd71b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:16.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.571+0000 7f312e052000 4 client.4719 mds_command: new command op to 4257 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-09T05:54:16.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.571+0000 7f312e052000 1 -- 172.21.15.72:0/3142990434 --> [v2:172.21.15.72:6833/3946563056,v1:172.21.15.72:6835/3946563056] -- command(tid 0: {"prefix": "status"}) -- 0x55bce1d724d0 con 0x55bce19f6830 2024-05-09T05:54:16.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.571+0000 7f3124a90640 1 --2- 172.21.15.72:0/3142990434 >> [v2:172.21.15.72:6833/3946563056,v1:172.21.15.72:6835/3946563056] conn(0x55bce19f6830 0x55bce1fd71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:16.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.571+0000 7f30ff7fe640 10 client.4719 ms_handle_connect on v2:172.21.15.72:6833/3946563056 2024-05-09T05:54:16.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.571+0000 7f3124a90640 1 --2- 172.21.15.72:0/3142990434 >> [v2:172.21.15.72:6833/3946563056,v1:172.21.15.72:6835/3946563056] conn(0x55bce19f6830 0x55bce1fd71b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b70fa9bbee650d4f server_cookie=8210035d4a5be0d6 in_seq=0 out_seq=0 2024-05-09T05:54:16.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.575+0000 7f30ff7fe640 1 -- 172.21.15.72:0/3142990434 <== mds.4 v2:172.21.15.72:6833/3946563056 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55bce1d724d0 con 0x55bce19f6830 2024-05-09T05:54:16.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.575+0000 7f30ff7fe640 10 client.4719 handle_command_reply: tid=0 2024-05-09T05:54:16.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.575+0000 7f312e052000 1 client.4719 shutdown 2024-05-09T05:54:16.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.575+0000 7f312e052000 1 -- 172.21.15.72:0/3142990434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bce1e0e180 msgr2=0x55bce1fce880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:16.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.575+0000 7f312e052000 1 --2- 172.21.15.72:0/3142990434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bce1e0e180 0x55bce1fce880 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f31080156d0 tx=0x7f3108015b90 comp rx=0 tx=0).stop 2024-05-09T05:54:16.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.575+0000 7f312e052000 1 -- 172.21.15.72:0/3142990434 shutdown_connections 2024-05-09T05:54:16.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.575+0000 7f312e052000 1 --2- 172.21.15.72:0/3142990434 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bce1e15bd0 0x55bce1f6ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.575+0000 7f312e052000 1 --2- 172.21.15.72:0/3142990434 >> [v2:172.21.15.72:6833/3946563056,v1:172.21.15.72:6835/3946563056] conn(0x55bce19f6830 0x55bce1fd71b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.575+0000 7f312e052000 1 --2- 172.21.15.72:0/3142990434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55bce1e0e180 0x55bce1fce880 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.575+0000 7f312e052000 1 --2- 172.21.15.72:0/3142990434 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55bce1df7d50 0x55bce1fce340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.575+0000 7f30ff7fe640 0 client.4719 ms_handle_reset on v2:172.21.15.72:6833/3946563056 2024-05-09T05:54:16.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.575+0000 7f312e052000 1 -- 172.21.15.72:0/3142990434 >> 172.21.15.72:0/3142990434 conn(0x55bce1a22730 msgr2=0x55bce1f67510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:16.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.575+0000 7f312e052000 1 -- 172.21.15.72:0/3142990434 shutdown_connections 2024-05-09T05:54:16.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.575+0000 7f312e052000 1 -- 172.21.15.72:0/3142990434 wait complete. 2024-05-09T05:54:16.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.575+0000 7f312e052000 20 client.4719 trim_cache size 0 max 16384 2024-05-09T05:54:16.569 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-05-09T05:54:16.569 INFO:teuthology.orchestra.run.smithi072.stdout: "cluster_fsid": "44c88cb9-b39b-4787-a871-80ddf0ad6292", 2024-05-09T05:54:16.569 INFO:teuthology.orchestra.run.smithi072.stdout: "whoami": 4, 2024-05-09T05:54:16.569 INFO:teuthology.orchestra.run.smithi072.stdout: "id": 4257, 2024-05-09T05:54:16.569 INFO:teuthology.orchestra.run.smithi072.stdout: "want_state": "up:active", 2024-05-09T05:54:16.569 INFO:teuthology.orchestra.run.smithi072.stdout: "state": "up:active", 2024-05-09T05:54:16.569 INFO:teuthology.orchestra.run.smithi072.stdout: "fs_name": "cephfs", 2024-05-09T05:54:16.569 INFO:teuthology.orchestra.run.smithi072.stdout: "rank_uptime": 10.628314147999999, 2024-05-09T05:54:16.569 INFO:teuthology.orchestra.run.smithi072.stdout: "mdsmap_epoch": 19, 2024-05-09T05:54:16.570 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch": 27, 2024-05-09T05:54:16.570 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch_barrier": 27, 2024-05-09T05:54:16.570 INFO:teuthology.orchestra.run.smithi072.stdout: "uptime": 58.561111437000001 2024-05-09T05:54:16.570 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-05-09T05:54:16.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.575+0000 7f3126cf4640 1 -- 172.21.15.72:0/3891130693 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f310006f400 msgr2=0x7f3100071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:16.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.575+0000 7f3126cf4640 1 --2- 172.21.15.72:0/3891130693 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f310006f400 0x7f3100071910 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3118007fd0 tx=0x7f3118005b80 comp rx=0 tx=0).stop 2024-05-09T05:54:16.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.575+0000 7f3126cf4640 1 -- 172.21.15.72:0/3891130693 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f312015edc0 msgr2=0x7f31201551a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:16.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.575+0000 7f3126cf4640 1 --2- 172.21.15.72:0/3891130693 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f312015edc0 0x7f31201551a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3110019090 tx=0x7f311001acc0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.575+0000 7f3126cf4640 1 -- 172.21.15.72:0/3891130693 shutdown_connections 2024-05-09T05:54:16.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.575+0000 7f3126cf4640 1 --2- 172.21.15.72:0/3891130693 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f310006f400 0x7f3100071910 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.575+0000 7f3126cf4640 1 --2- 172.21.15.72:0/3891130693 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f312015edc0 0x7f31201551a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.575+0000 7f3126cf4640 1 --2- 172.21.15.72:0/3891130693 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f312015e470 0x7f31200c72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.575+0000 7f3126cf4640 1 --2- 172.21.15.72:0/3891130693 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3120156b50 0x7f31200c64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.575+0000 7f3126cf4640 1 -- 172.21.15.72:0/3891130693 >> 172.21.15.72:0/3891130693 conn(0x7f31200d1b70 msgr2=0x7f312015ab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:16.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.575+0000 7f3126cf4640 1 -- 172.21.15.72:0/3891130693 shutdown_connections 2024-05-09T05:54:16.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.575+0000 7f3126cf4640 1 -- 172.21.15.72:0/3891130693 wait complete. 2024-05-09T05:54:16.587 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-05-09T05:54:16.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.743+0000 7f1e44c69640 1 Processor -- start 2024-05-09T05:54:16.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.743+0000 7f1e44c69640 1 -- start start 2024-05-09T05:54:16.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.747+0000 7f1e44c69640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1e401537d0 0x7f1e40074740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:16.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.747+0000 7f1e44c69640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1e40161d70 0x7f1e40164190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:16.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.747+0000 7f1e44c69640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e400c72c0 con 0x7f1e400c77a0 2024-05-09T05:54:16.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.747+0000 7f1e44c69640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f1e40074c80 con 0x7f1e40161d70 2024-05-09T05:54:16.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.747+0000 7f1e44c69640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f1e400c7bb0 con 0x7f1e401537d0 2024-05-09T05:54:16.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.747+0000 7f1e3e59c640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f1e400c77a0 0x7f1e40072e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41486/0 (socket says 172.21.15.72:41486) 2024-05-09T05:54:16.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.747+0000 7f1e3ed9d640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1e40161d70 0x7f1e40164190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:16.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.747+0000 7f1e3e59c640 1 -- 172.21.15.72:0/2184613552 learned_addr learned my addr 172.21.15.72:0/2184613552 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:54:16.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.747+0000 7f1e3dd9b640 1 --2- 172.21.15.72:0/2184613552 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1e401537d0 0x7f1e40074740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:16.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.747+0000 7f1e3ed9d640 1 -- 172.21.15.72:0/2184613552 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1e401537d0 msgr2=0x7f1e40074740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:16.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.747+0000 7f1e3ed9d640 1 --2- 172.21.15.72:0/2184613552 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1e401537d0 0x7f1e40074740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.747+0000 7f1e3ed9d640 1 -- 172.21.15.72:0/2184613552 >> v1:172.21.15.72:6789/0 conn(0x7f1e400c77a0 legacy=0x7f1e40072e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:16.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.747+0000 7f1e3d59a640 1 -- 172.21.15.72:0/2184613552 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3586402425 0 0) 0x7f1e400c72c0 con 0x7f1e400c77a0 2024-05-09T05:54:16.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.747+0000 7f1e3ed9d640 1 -- 172.21.15.72:0/2184613552 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e40153be0 con 0x7f1e40161d70 2024-05-09T05:54:16.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.747+0000 7f1e3ed9d640 1 --2- 172.21.15.72:0/2184613552 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1e40161d70 0x7f1e40164190 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1e38009d90 tx=0x7f1e3801c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d73d4ad615069121 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:16.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.747+0000 7f1e3d59a640 1 -- 172.21.15.72:0/2184613552 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e380b2070 con 0x7f1e40161d70 2024-05-09T05:54:16.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.747+0000 7f1e3d59a640 1 -- 172.21.15.72:0/2184613552 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e380a5a00 con 0x7f1e40161d70 2024-05-09T05:54:16.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.747+0000 7f1e3d59a640 1 -- 172.21.15.72:0/2184613552 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e380a5dd0 con 0x7f1e40161d70 2024-05-09T05:54:16.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.751+0000 7f1e44c69640 1 -- 172.21.15.72:0/2184613552 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1e40161d70 msgr2=0x7f1e40164190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:16.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.751+0000 7f1e44c69640 1 --2- 172.21.15.72:0/2184613552 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1e40161d70 0x7f1e40164190 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1e38009d90 tx=0x7f1e3801c940 comp rx=0 tx=0).stop 2024-05-09T05:54:16.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.751+0000 7f1e44c69640 1 -- 172.21.15.72:0/2184613552 shutdown_connections 2024-05-09T05:54:16.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.751+0000 7f1e44c69640 1 --2- 172.21.15.72:0/2184613552 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1e40161d70 0x7f1e40164190 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.751+0000 7f1e44c69640 1 --2- 172.21.15.72:0/2184613552 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1e401537d0 0x7f1e40074740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.751+0000 7f1e44c69640 1 -- 172.21.15.72:0/2184613552 >> 172.21.15.72:0/2184613552 conn(0x7f1e400cde90 msgr2=0x7f1e400ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:16.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.751+0000 7f1e44c69640 1 -- 172.21.15.72:0/2184613552 shutdown_connections 2024-05-09T05:54:16.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.751+0000 7f1e44c69640 1 -- 172.21.15.72:0/2184613552 wait complete. 2024-05-09T05:54:16.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.751+0000 7f1e44c69640 1 Processor -- start 2024-05-09T05:54:16.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.751+0000 7f1e44c69640 1 -- start start 2024-05-09T05:54:16.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.751+0000 7f1e44c69640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1e400c77a0 0x7f1e4015a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:16.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.751+0000 7f1e44c69640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1e401537d0 0x7f1e40151520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:16.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.751+0000 7f1e44c69640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e40161d70 0x7f1e4006fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:16.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.751+0000 7f1e44c69640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f1e40072940 con 0x7f1e401537d0 2024-05-09T05:54:16.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.751+0000 7f1e44c69640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f1e400740b0 con 0x7f1e40161d70 2024-05-09T05:54:16.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.751+0000 7f1e44c69640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f1e400c4cb0 con 0x7f1e400c77a0 2024-05-09T05:54:16.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.751+0000 7f1e3dd9b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1e401537d0 0x7f1e40151520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:16.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.751+0000 7f1e3dd9b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1e401537d0 0x7f1e40151520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46010/0 (socket says 172.21.15.72:46010) 2024-05-09T05:54:16.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.751+0000 7f1e3dd9b640 1 -- 172.21.15.72:0/1977226271 learned_addr learned my addr 172.21.15.72:0/1977226271 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:54:16.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.751+0000 7f1e3e59c640 1 --2- 172.21.15.72:0/1977226271 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1e400c77a0 0x7f1e4015a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:16.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.751+0000 7f1e3dd9b640 1 -- 172.21.15.72:0/1977226271 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1e400c77a0 msgr2=0x7f1e4015a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:16.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.751+0000 7f1e3ed9d640 1 --2- 172.21.15.72:0/1977226271 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e40161d70 0x7f1e4006fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:16.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.751+0000 7f1e3dd9b640 1 --2- 172.21.15.72:0/1977226271 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1e400c77a0 0x7f1e4015a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.751+0000 7f1e3dd9b640 1 -- 172.21.15.72:0/1977226271 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e40161d70 msgr2=0x7f1e4006fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:16.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.751+0000 7f1e3dd9b640 1 --2- 172.21.15.72:0/1977226271 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e40161d70 0x7f1e4006fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.755+0000 7f1e3dd9b640 1 -- 172.21.15.72:0/1977226271 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e40151a60 con 0x7f1e401537d0 2024-05-09T05:54:16.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.755+0000 7f1e3dd9b640 1 --2- 172.21.15.72:0/1977226271 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1e401537d0 0x7f1e40151520 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1e3400d600 tx=0x7f1e3400dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:16.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.755+0000 7f1e2effd640 1 -- 172.21.15.72:0/1977226271 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e340125f0 con 0x7f1e401537d0 2024-05-09T05:54:16.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.755+0000 7f1e2effd640 1 -- 172.21.15.72:0/1977226271 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e34019070 con 0x7f1e401537d0 2024-05-09T05:54:16.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.755+0000 7f1e44c69640 1 -- 172.21.15.72:0/1977226271 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e40152960 con 0x7f1e401537d0 2024-05-09T05:54:16.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.755+0000 7f1e2effd640 1 -- 172.21.15.72:0/1977226271 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e340129b0 con 0x7f1e401537d0 2024-05-09T05:54:16.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.755+0000 7f1e44c69640 1 -- 172.21.15.72:0/1977226271 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e40152f20 con 0x7f1e401537d0 2024-05-09T05:54:16.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.755+0000 7f1e2effd640 1 -- 172.21.15.72:0/1977226271 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f1e34012b50 con 0x7f1e401537d0 2024-05-09T05:54:16.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.755+0000 7f1e2effd640 1 --2- 172.21.15.72:0/1977226271 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f1e2006f400 0x7f1e20071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:16.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.755+0000 7f1e2effd640 1 -- 172.21.15.72:0/1977226271 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f1e3408f960 con 0x7f1e401537d0 2024-05-09T05:54:16.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.755+0000 7f1e3e59c640 1 --2- 172.21.15.72:0/1977226271 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f1e2006f400 0x7f1e20071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:16.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.755+0000 7f1e4bfc7000 1 Processor -- start 2024-05-09T05:54:16.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.759+0000 7f1e4bfc7000 1 -- start start 2024-05-09T05:54:16.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.759+0000 7f1e3e59c640 1 --2- 172.21.15.72:0/1977226271 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f1e2006f400 0x7f1e20071910 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1e30000f70 tx=0x7f1e30009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:16.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.759+0000 7f1e4bfc7000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558359faabd0 0x55835a0ebbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:16.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.759+0000 7f1e4bfc7000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558359fa3180 0x55835a0ec0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:16.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.759+0000 7f1e4bfc7000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x558359f8cd50 0x55835a0ec630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:16.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.759+0000 7f1e4bfc7000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x558359f91cc0 con 0x558359faabd0 2024-05-09T05:54:16.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.759+0000 7f1e4bfc7000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x558359eac370 con 0x558359fa3180 2024-05-09T05:54:16.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.759+0000 7f1e4bfc7000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x558359ef98c0 con 0x558359f8cd50 2024-05-09T05:54:16.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.759+0000 7f1e3e59c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558359faabd0 0x55835a0ebbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:16.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.759+0000 7f1e3e59c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558359faabd0 0x55835a0ebbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46020/0 (socket says 172.21.15.72:46020) 2024-05-09T05:54:16.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.759+0000 7f1e3e59c640 1 -- 172.21.15.72:0/4269484827 learned_addr learned my addr 172.21.15.72:0/4269484827 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:54:16.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.759+0000 7f1e3ed9d640 1 --2- 172.21.15.72:0/4269484827 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x558359f8cd50 0x55835a0ec630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:16.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.759+0000 7f1e3dd9b640 1 --2- 172.21.15.72:0/4269484827 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558359fa3180 0x55835a0ec0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:16.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.759+0000 7f1e3e59c640 1 -- 172.21.15.72:0/4269484827 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x558359f8cd50 msgr2=0x55835a0ec630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:16.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.759+0000 7f1e3e59c640 1 --2- 172.21.15.72:0/4269484827 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x558359f8cd50 0x55835a0ec630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.759+0000 7f1e3e59c640 1 -- 172.21.15.72:0/4269484827 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558359fa3180 msgr2=0x55835a0ec0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:16.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.759+0000 7f1e3e59c640 1 --2- 172.21.15.72:0/4269484827 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558359fa3180 0x55835a0ec0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.759+0000 7f1e3e59c640 1 -- 172.21.15.72:0/4269484827 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558359ebaef0 con 0x558359faabd0 2024-05-09T05:54:16.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.759+0000 7f1e3e59c640 1 --2- 172.21.15.72:0/4269484827 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558359faabd0 0x55835a0ebbb0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1e30005ce0 tx=0x7f1e30010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70ca1b19864b9dcf server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:16.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.759+0000 7f1e1ffff640 1 -- 172.21.15.72:0/4269484827 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e30007560 con 0x558359faabd0 2024-05-09T05:54:16.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.759+0000 7f1e1ffff640 1 -- 172.21.15.72:0/4269484827 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e30007700 con 0x558359faabd0 2024-05-09T05:54:16.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.759+0000 7f1e1ffff640 1 -- 172.21.15.72:0/4269484827 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e30014bf0 con 0x558359faabd0 2024-05-09T05:54:16.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.759+0000 7f1e4bfc7000 1 -- 172.21.15.72:0/4269484827 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558359faabd0 msgr2=0x55835a0ebbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:16.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.759+0000 7f1e4bfc7000 1 --2- 172.21.15.72:0/4269484827 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558359faabd0 0x55835a0ebbb0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1e30005ce0 tx=0x7f1e30010000 comp rx=0 tx=0).stop 2024-05-09T05:54:16.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.759+0000 7f1e4bfc7000 1 -- 172.21.15.72:0/4269484827 shutdown_connections 2024-05-09T05:54:16.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.759+0000 7f1e4bfc7000 1 --2- 172.21.15.72:0/4269484827 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x558359f8cd50 0x55835a0ec630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.759+0000 7f1e4bfc7000 1 --2- 172.21.15.72:0/4269484827 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558359fa3180 0x55835a0ec0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.759+0000 7f1e4bfc7000 1 --2- 172.21.15.72:0/4269484827 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558359faabd0 0x55835a0ebbb0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.759+0000 7f1e4bfc7000 1 -- 172.21.15.72:0/4269484827 >> 172.21.15.72:0/4269484827 conn(0x558359bb7730 msgr2=0x55835a0e9970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:16.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.759+0000 7f1e4bfc7000 1 -- 172.21.15.72:0/4269484827 shutdown_connections 2024-05-09T05:54:16.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.759+0000 7f1e4bfc7000 1 -- 172.21.15.72:0/4269484827 wait complete. 2024-05-09T05:54:16.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.759+0000 7f1e4bfc7000 1 -- start start 2024-05-09T05:54:16.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.763+0000 7f1e4bfc7000 1 Processor -- start 2024-05-09T05:54:16.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.763+0000 7f1e4bfc7000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x558359f8cd50 0x55835a0f6e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:16.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.763+0000 7f1e4bfc7000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558359fa3180 0x55835a0f7380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:16.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.763+0000 7f1e4bfc7000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558359faabd0 0x55835a0ac910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:16.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.763+0000 7f1e4bfc7000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x558359ef5880 con 0x558359fa3180 2024-05-09T05:54:16.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.763+0000 7f1e4bfc7000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x558359eb2a00 con 0x558359faabd0 2024-05-09T05:54:16.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.763+0000 7f1e4bfc7000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x558359e99910 con 0x558359f8cd50 2024-05-09T05:54:16.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.763+0000 7f1e4bfc7000 10 client.0 _ll_register_callbacks cb 0x55835a096100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T05:54:16.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.763+0000 7f1e3dd9b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558359fa3180 0x55835a0f7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:16.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.763+0000 7f1e3dd9b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558359fa3180 0x55835a0f7380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46026/0 (socket says 172.21.15.72:46026) 2024-05-09T05:54:16.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.763+0000 7f1e3dd9b640 1 -- 172.21.15.72:0/525868998 learned_addr learned my addr 172.21.15.72:0/525868998 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:54:16.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.763+0000 7f1e3dd9b640 1 -- 172.21.15.72:0/525868998 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x558359f8cd50 msgr2=0x55835a0f6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:16.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.763+0000 7f1e3dd9b640 1 --2- 172.21.15.72:0/525868998 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x558359f8cd50 0x55835a0f6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.763+0000 7f1e3ed9d640 1 --2- 172.21.15.72:0/525868998 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558359faabd0 0x55835a0ac910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:16.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.763+0000 7f1e3dd9b640 1 -- 172.21.15.72:0/525868998 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558359faabd0 msgr2=0x55835a0ac910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:16.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.763+0000 7f1e3dd9b640 1 --2- 172.21.15.72:0/525868998 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558359faabd0 0x55835a0ac910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.763+0000 7f1e3dd9b640 1 -- 172.21.15.72:0/525868998 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558359eb2c50 con 0x558359fa3180 2024-05-09T05:54:16.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.763+0000 7f1e3dd9b640 1 --2- 172.21.15.72:0/525868998 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558359fa3180 0x55835a0f7380 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1e3408dbb0 tx=0x7f1e3405bb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48f51c3f844ffa4a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:16.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.763+0000 7f1e1d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-09T05:54:16.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.763+0000 7f1e1d7fa640 1 -- 172.21.15.72:0/525868998 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3405b360 con 0x558359fa3180 2024-05-09T05:54:16.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.763+0000 7f1e1d7fa640 1 -- 172.21.15.72:0/525868998 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f1e34057870 con 0x558359fa3180 2024-05-09T05:54:16.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.763+0000 7f1e4bfc7000 1 -- 172.21.15.72:0/525868998 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e30007700 con 0x558359fa3180 2024-05-09T05:54:16.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.763+0000 7f1e1d7fa640 1 -- 172.21.15.72:0/525868998 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f1e340602b0 con 0x558359fa3180 2024-05-09T05:54:16.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.763+0000 7f1e4bfc7000 10 client.4734 fetch_fsmap learned FSMap version 19 2024-05-09T05:54:16.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.763+0000 7f1e4bfc7000 1 -- 172.21.15.72:0/525868998 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x558359eb0650 con 0x558359fa3180 2024-05-09T05:54:16.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.763+0000 7f1e1d7fa640 1 -- 172.21.15.72:0/525868998 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e30007700 con 0x558359fa3180 2024-05-09T05:54:16.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.763+0000 7f1e1d7fa640 1 -- 172.21.15.72:0/525868998 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7f1e34013070 con 0x558359fa3180 2024-05-09T05:54:16.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.763+0000 7f1e4bfc7000 10 client.4734 fetch_fsmap finished waiting for FSMap version 19 2024-05-09T05:54:16.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.763+0000 7f1e4bfc7000 10 client.4734 resolve_mds: resolved name 'f' to daemon mds.f 2024-05-09T05:54:16.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.763+0000 7f1e4bfc7000 20 client.4734 populate_metadata read hostname 'smithi072' 2024-05-09T05:54:16.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.763+0000 7f1e4bfc7000 1 --2- 172.21.15.72:0/525868998 >> [v2:172.21.15.110:6835/840351907,v1:172.21.15.110:6838/840351907] conn(0x558359b9d7d0 0x55835a0ad6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:16.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.763+0000 7f1e4bfc7000 4 client.4734 mds_command: new command op to 4259 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T05:54:16.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.763+0000 7f1e4bfc7000 1 -- 172.21.15.72:0/525868998 --> [v2:172.21.15.110:6835/840351907,v1:172.21.15.110:6838/840351907] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558359e92620 con 0x558359b9d7d0 2024-05-09T05:54:16.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.763+0000 7f1e3e59c640 1 --2- 172.21.15.72:0/525868998 >> [v2:172.21.15.110:6835/840351907,v1:172.21.15.110:6838/840351907] conn(0x558359b9d7d0 0x55835a0ad6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:16.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.763+0000 7f1e3e59c640 1 --2- 172.21.15.72:0/525868998 >> [v2:172.21.15.110:6835/840351907,v1:172.21.15.110:6838/840351907] conn(0x558359b9d7d0 0x55835a0ad6b0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=dbc5384c72d4dd88 server_cookie=f332e1b9563b7b1 in_seq=0 out_seq=0 2024-05-09T05:54:16.759 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.763+0000 7f1e1d7fa640 10 client.4734 ms_handle_connect on v2:172.21.15.110:6835/840351907 2024-05-09T05:54:16.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.767+0000 7f1e1d7fa640 1 -- 172.21.15.72:0/525868998 <== mds.3 v2:172.21.15.110:6835/840351907 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x558359e92620 con 0x558359b9d7d0 2024-05-09T05:54:16.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.767+0000 7f1e1d7fa640 10 client.4734 handle_command_reply: tid=0 2024-05-09T05:54:16.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.767+0000 7f1e4bfc7000 1 client.4734 shutdown 2024-05-09T05:54:16.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.767+0000 7f1e4bfc7000 1 -- 172.21.15.72:0/525868998 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558359fa3180 msgr2=0x55835a0f7380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:16.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.767+0000 7f1e4bfc7000 1 --2- 172.21.15.72:0/525868998 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558359fa3180 0x55835a0f7380 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1e3408dbb0 tx=0x7f1e3405bb50 comp rx=0 tx=0).stop 2024-05-09T05:54:16.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.767+0000 7f1e4bfc7000 1 -- 172.21.15.72:0/525868998 shutdown_connections 2024-05-09T05:54:16.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.767+0000 7f1e4bfc7000 1 --2- 172.21.15.72:0/525868998 >> [v2:172.21.15.110:6835/840351907,v1:172.21.15.110:6838/840351907] conn(0x558359b9d7d0 0x55835a0ad6b0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.767+0000 7f1e4bfc7000 1 --2- 172.21.15.72:0/525868998 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558359faabd0 0x55835a0ac910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.767+0000 7f1e4bfc7000 1 --2- 172.21.15.72:0/525868998 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558359fa3180 0x55835a0f7380 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.767+0000 7f1e1d7fa640 0 client.4734 ms_handle_reset on v2:172.21.15.110:6835/840351907 2024-05-09T05:54:16.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.767+0000 7f1e4bfc7000 1 --2- 172.21.15.72:0/525868998 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x558359f8cd50 0x55835a0f6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.767+0000 7f1e4bfc7000 1 -- 172.21.15.72:0/525868998 >> 172.21.15.72:0/525868998 conn(0x558359bb7730 msgr2=0x55835a0e8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:16.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.767+0000 7f1e4bfc7000 1 -- 172.21.15.72:0/525868998 shutdown_connections 2024-05-09T05:54:16.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.767+0000 7f1e4bfc7000 1 -- 172.21.15.72:0/525868998 wait complete. 2024-05-09T05:54:16.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.767+0000 7f1e4bfc7000 20 client.4734 trim_cache size 0 max 16384 2024-05-09T05:54:16.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.787+0000 7f1e4bfc7000 1 Processor -- start 2024-05-09T05:54:16.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.787+0000 7f1e4bfc7000 1 -- start start 2024-05-09T05:54:16.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.787+0000 7f1e4bfc7000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x558359f8cd50 0x55835a0ac590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:16.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.787+0000 7f1e4bfc7000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558359fa3180 0x55835a0acad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:16.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.787+0000 7f1e4bfc7000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558359faabd0 0x55835a160f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:16.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.787+0000 7f1e4bfc7000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f1e40155d00 con 0x558359fa3180 2024-05-09T05:54:16.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.787+0000 7f1e4bfc7000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55835a0e6740 con 0x558359faabd0 2024-05-09T05:54:16.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.787+0000 7f1e4bfc7000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x558359fb4f80 con 0x558359f8cd50 2024-05-09T05:54:16.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.787+0000 7f1e3dd9b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558359fa3180 0x55835a0acad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:16.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.787+0000 7f1e3dd9b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558359fa3180 0x55835a0acad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46040/0 (socket says 172.21.15.72:46040) 2024-05-09T05:54:16.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.787+0000 7f1e3dd9b640 1 -- 172.21.15.72:0/284621802 learned_addr learned my addr 172.21.15.72:0/284621802 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:54:16.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.787+0000 7f1e3e59c640 1 --2- 172.21.15.72:0/284621802 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x558359f8cd50 0x55835a0ac590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:16.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.787+0000 7f1e3ed9d640 1 --2- 172.21.15.72:0/284621802 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558359faabd0 0x55835a160f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:16.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.787+0000 7f1e3dd9b640 1 -- 172.21.15.72:0/284621802 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x558359f8cd50 msgr2=0x55835a0ac590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:16.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.787+0000 7f1e3dd9b640 1 --2- 172.21.15.72:0/284621802 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x558359f8cd50 0x55835a0ac590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.787+0000 7f1e3dd9b640 1 -- 172.21.15.72:0/284621802 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558359faabd0 msgr2=0x55835a160f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:16.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.787+0000 7f1e3dd9b640 1 --2- 172.21.15.72:0/284621802 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558359faabd0 0x55835a160f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.787+0000 7f1e3dd9b640 1 -- 172.21.15.72:0/284621802 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558359f7b0e0 con 0x558359fa3180 2024-05-09T05:54:16.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.787+0000 7f1e3dd9b640 1 --2- 172.21.15.72:0/284621802 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558359fa3180 0x55835a0acad0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1e34000c10 tx=0x7f1e3408f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba4f11aa50e82715 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:16.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.787+0000 7f1e1f7fe640 1 -- 172.21.15.72:0/284621802 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3405b360 con 0x558359fa3180 2024-05-09T05:54:16.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.787+0000 7f1e1f7fe640 1 -- 172.21.15.72:0/284621802 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e34057870 con 0x558359fa3180 2024-05-09T05:54:16.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.787+0000 7f1e1f7fe640 1 -- 172.21.15.72:0/284621802 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e340750c0 con 0x558359fa3180 2024-05-09T05:54:16.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.787+0000 7f1e4bfc7000 1 -- 172.21.15.72:0/284621802 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558359fa3180 msgr2=0x55835a0acad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:16.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.787+0000 7f1e4bfc7000 1 --2- 172.21.15.72:0/284621802 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558359fa3180 0x55835a0acad0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1e34000c10 tx=0x7f1e3408f000 comp rx=0 tx=0).stop 2024-05-09T05:54:16.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.787+0000 7f1e4bfc7000 1 -- 172.21.15.72:0/284621802 shutdown_connections 2024-05-09T05:54:16.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.787+0000 7f1e4bfc7000 1 --2- 172.21.15.72:0/284621802 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558359faabd0 0x55835a160f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.791+0000 7f1e4bfc7000 1 --2- 172.21.15.72:0/284621802 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558359fa3180 0x55835a0acad0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.791+0000 7f1e4bfc7000 1 --2- 172.21.15.72:0/284621802 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x558359f8cd50 0x55835a0ac590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.791+0000 7f1e4bfc7000 1 -- 172.21.15.72:0/284621802 >> 172.21.15.72:0/284621802 conn(0x558359bb7730 msgr2=0x55835a0ab4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:16.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.791+0000 7f1e4bfc7000 1 -- 172.21.15.72:0/284621802 shutdown_connections 2024-05-09T05:54:16.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.791+0000 7f1e4bfc7000 1 -- 172.21.15.72:0/284621802 wait complete. 2024-05-09T05:54:16.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.791+0000 7f1e4bfc7000 1 -- start start 2024-05-09T05:54:16.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.791+0000 7f1e4bfc7000 1 Processor -- start 2024-05-09T05:54:16.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.791+0000 7f1e4bfc7000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558359f8cd50 0x55835a1612f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:16.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.791+0000 7f1e4bfc7000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558359fa3180 0x55835a161830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:16.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.791+0000 7f1e4bfc7000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x558359faabd0 0x55835a161fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:16.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.791+0000 7f1e4bfc7000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x558359f06cc0 con 0x558359fa3180 2024-05-09T05:54:16.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.791+0000 7f1e4bfc7000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x558359ef8bd0 con 0x558359f8cd50 2024-05-09T05:54:16.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.791+0000 7f1e4bfc7000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x558359e7b9a0 con 0x558359faabd0 2024-05-09T05:54:16.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.791+0000 7f1e4bfc7000 10 client.0 _ll_register_callbacks cb 0x7f1e3405b670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T05:54:16.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.791+0000 7f1e3dd9b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558359fa3180 0x55835a161830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:16.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.791+0000 7f1e3dd9b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558359fa3180 0x55835a161830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46050/0 (socket says 172.21.15.72:46050) 2024-05-09T05:54:16.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.791+0000 7f1e3dd9b640 1 -- 172.21.15.72:0/3443475121 learned_addr learned my addr 172.21.15.72:0/3443475121 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:54:16.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.791+0000 7f1e3e59c640 1 --2- 172.21.15.72:0/3443475121 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558359f8cd50 0x55835a1612f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:16.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.791+0000 7f1e3ed9d640 1 --2- 172.21.15.72:0/3443475121 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x558359faabd0 0x55835a161fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:16.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.791+0000 7f1e3dd9b640 1 -- 172.21.15.72:0/3443475121 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x558359faabd0 msgr2=0x55835a161fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:16.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.791+0000 7f1e3dd9b640 1 --2- 172.21.15.72:0/3443475121 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x558359faabd0 0x55835a161fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.791+0000 7f1e3dd9b640 1 -- 172.21.15.72:0/3443475121 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558359f8cd50 msgr2=0x55835a1612f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:16.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.791+0000 7f1e3dd9b640 1 --2- 172.21.15.72:0/3443475121 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558359f8cd50 0x55835a1612f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.791+0000 7f1e3dd9b640 1 -- 172.21.15.72:0/3443475121 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558359f51f90 con 0x558359fa3180 2024-05-09T05:54:16.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.791+0000 7f1e3ed9d640 1 --2- 172.21.15.72:0/3443475121 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x558359faabd0 0x55835a161fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:54:16.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.791+0000 7f1e3dd9b640 1 --2- 172.21.15.72:0/3443475121 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558359fa3180 0x55835a161830 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1e3408dc00 tx=0x7f1e3405f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb6af585e8946c0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:16.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.791+0000 7f1e1d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-09T05:54:16.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.791+0000 7f1e1d7fa640 1 -- 172.21.15.72:0/3443475121 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e340750c0 con 0x558359fa3180 2024-05-09T05:54:16.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.791+0000 7f1e1d7fa640 1 -- 172.21.15.72:0/3443475121 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f1e34075260 con 0x558359fa3180 2024-05-09T05:54:16.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.791+0000 7f1e4bfc7000 1 -- 172.21.15.72:0/3443475121 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e34057870 con 0x558359fa3180 2024-05-09T05:54:16.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.791+0000 7f1e1d7fa640 1 -- 172.21.15.72:0/3443475121 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f1e34082050 con 0x558359fa3180 2024-05-09T05:54:16.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.791+0000 7f1e4bfc7000 10 client.4740 fetch_fsmap learned FSMap version 19 2024-05-09T05:54:16.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.791+0000 7f1e4bfc7000 1 -- 172.21.15.72:0/3443475121 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x558359e9df30 con 0x558359fa3180 2024-05-09T05:54:16.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.791+0000 7f1e1d7fa640 1 -- 172.21.15.72:0/3443475121 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e34057870 con 0x558359fa3180 2024-05-09T05:54:16.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.791+0000 7f1e1d7fa640 1 -- 172.21.15.72:0/3443475121 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7f1e34085080 con 0x558359fa3180 2024-05-09T05:54:16.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.791+0000 7f1e4bfc7000 10 client.4740 fetch_fsmap finished waiting for FSMap version 19 2024-05-09T05:54:16.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.791+0000 7f1e4bfc7000 10 client.4740 resolve_mds: resolved name 'f' to daemon mds.f 2024-05-09T05:54:16.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.791+0000 7f1e4bfc7000 20 client.4740 populate_metadata read hostname 'smithi072' 2024-05-09T05:54:16.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.791+0000 7f1e4bfc7000 1 --2- 172.21.15.72:0/3443475121 >> [v2:172.21.15.110:6835/840351907,v1:172.21.15.110:6838/840351907] conn(0x558359b8b830 0x55835a162980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:16.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.791+0000 7f1e4bfc7000 4 client.4740 mds_command: new command op to 4259 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-09T05:54:16.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.791+0000 7f1e4bfc7000 1 -- 172.21.15.72:0/3443475121 --> [v2:172.21.15.110:6835/840351907,v1:172.21.15.110:6838/840351907] -- command(tid 0: {"prefix": "status"}) -- 0x558359f074d0 con 0x558359b8b830 2024-05-09T05:54:16.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.795+0000 7f1e3e59c640 1 --2- 172.21.15.72:0/3443475121 >> [v2:172.21.15.110:6835/840351907,v1:172.21.15.110:6838/840351907] conn(0x558359b8b830 0x55835a162980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:16.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.795+0000 7f1e1d7fa640 10 client.4740 ms_handle_connect on v2:172.21.15.110:6835/840351907 2024-05-09T05:54:16.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.795+0000 7f1e3e59c640 1 --2- 172.21.15.72:0/3443475121 >> [v2:172.21.15.110:6835/840351907,v1:172.21.15.110:6838/840351907] conn(0x558359b8b830 0x55835a162980 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=8455460be380751b server_cookie=9968861454d5a854 in_seq=0 out_seq=0 2024-05-09T05:54:16.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.795+0000 7f1e1d7fa640 1 -- 172.21.15.72:0/3443475121 <== mds.3 v2:172.21.15.110:6835/840351907 1 ==== command_reply(tid 0: 0 ) ==== 8+0+319 (crc 0 0 0) 0x558359f074d0 con 0x558359b8b830 2024-05-09T05:54:16.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.795+0000 7f1e1d7fa640 10 client.4740 handle_command_reply: tid=0 2024-05-09T05:54:16.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.795+0000 7f1e4bfc7000 1 client.4740 shutdown 2024-05-09T05:54:16.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.795+0000 7f1e4bfc7000 1 -- 172.21.15.72:0/3443475121 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558359fa3180 msgr2=0x55835a161830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:16.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.795+0000 7f1e4bfc7000 1 --2- 172.21.15.72:0/3443475121 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558359fa3180 0x55835a161830 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1e3408dc00 tx=0x7f1e3405f000 comp rx=0 tx=0).stop 2024-05-09T05:54:16.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.795+0000 7f1e4bfc7000 1 -- 172.21.15.72:0/3443475121 shutdown_connections 2024-05-09T05:54:16.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.795+0000 7f1e4bfc7000 1 --2- 172.21.15.72:0/3443475121 >> [v2:172.21.15.110:6835/840351907,v1:172.21.15.110:6838/840351907] conn(0x558359b8b830 0x55835a162980 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.795+0000 7f1e4bfc7000 1 --2- 172.21.15.72:0/3443475121 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x558359faabd0 0x55835a161fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.795+0000 7f1e4bfc7000 1 --2- 172.21.15.72:0/3443475121 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558359fa3180 0x55835a161830 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.795+0000 7f1e1d7fa640 0 client.4740 ms_handle_reset on v2:172.21.15.110:6835/840351907 2024-05-09T05:54:16.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.795+0000 7f1e4bfc7000 1 --2- 172.21.15.72:0/3443475121 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558359f8cd50 0x55835a1612f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.795+0000 7f1e4bfc7000 1 -- 172.21.15.72:0/3443475121 >> 172.21.15.72:0/3443475121 conn(0x558359bb7730 msgr2=0x55835a0afd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:16.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.795+0000 7f1e4bfc7000 1 -- 172.21.15.72:0/3443475121 shutdown_connections 2024-05-09T05:54:16.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.795+0000 7f1e4bfc7000 1 -- 172.21.15.72:0/3443475121 wait complete. 2024-05-09T05:54:16.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.795+0000 7f1e4bfc7000 20 client.4740 trim_cache size 0 max 16384 2024-05-09T05:54:16.790 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-05-09T05:54:16.790 INFO:teuthology.orchestra.run.smithi072.stdout: "cluster_fsid": "44c88cb9-b39b-4787-a871-80ddf0ad6292", 2024-05-09T05:54:16.790 INFO:teuthology.orchestra.run.smithi072.stdout: "whoami": 3, 2024-05-09T05:54:16.790 INFO:teuthology.orchestra.run.smithi072.stdout: "id": 4259, 2024-05-09T05:54:16.790 INFO:teuthology.orchestra.run.smithi072.stdout: "want_state": "up:active", 2024-05-09T05:54:16.790 INFO:teuthology.orchestra.run.smithi072.stdout: "state": "up:active", 2024-05-09T05:54:16.790 INFO:teuthology.orchestra.run.smithi072.stdout: "fs_name": "cephfs", 2024-05-09T05:54:16.790 INFO:teuthology.orchestra.run.smithi072.stdout: "rank_uptime": 16.118244888, 2024-05-09T05:54:16.790 INFO:teuthology.orchestra.run.smithi072.stdout: "mdsmap_epoch": 19, 2024-05-09T05:54:16.790 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch": 27, 2024-05-09T05:54:16.791 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch_barrier": 27, 2024-05-09T05:54:16.791 INFO:teuthology.orchestra.run.smithi072.stdout: "uptime": 58.519734477 2024-05-09T05:54:16.791 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-05-09T05:54:16.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.795+0000 7f1e44c69640 1 -- 172.21.15.72:0/1977226271 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f1e2006f400 msgr2=0x7f1e20071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:16.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.795+0000 7f1e44c69640 1 --2- 172.21.15.72:0/1977226271 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f1e2006f400 0x7f1e20071910 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1e30000f70 tx=0x7f1e30009040 comp rx=0 tx=0).stop 2024-05-09T05:54:16.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.795+0000 7f1e44c69640 1 -- 172.21.15.72:0/1977226271 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1e401537d0 msgr2=0x7f1e40151520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:16.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.795+0000 7f1e44c69640 1 --2- 172.21.15.72:0/1977226271 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1e401537d0 0x7f1e40151520 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1e3400d600 tx=0x7f1e3400dac0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.795+0000 7f1e44c69640 1 -- 172.21.15.72:0/1977226271 shutdown_connections 2024-05-09T05:54:16.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.795+0000 7f1e44c69640 1 --2- 172.21.15.72:0/1977226271 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f1e2006f400 0x7f1e20071910 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.795+0000 7f1e44c69640 1 --2- 172.21.15.72:0/1977226271 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e40161d70 0x7f1e4006fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.795+0000 7f1e44c69640 1 --2- 172.21.15.72:0/1977226271 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1e401537d0 0x7f1e40151520 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.795+0000 7f1e44c69640 1 --2- 172.21.15.72:0/1977226271 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1e400c77a0 0x7f1e4015a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.795+0000 7f1e44c69640 1 -- 172.21.15.72:0/1977226271 >> 172.21.15.72:0/1977226271 conn(0x7f1e400cde90 msgr2=0x7f1e400c43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:16.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.795+0000 7f1e44c69640 1 -- 172.21.15.72:0/1977226271 shutdown_connections 2024-05-09T05:54:16.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.795+0000 7f1e44c69640 1 -- 172.21.15.72:0/1977226271 wait complete. 2024-05-09T05:54:16.806 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-05-09T05:54:16.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.959+0000 7f0d7e023640 1 Processor -- start 2024-05-09T05:54:16.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.959+0000 7f0d7e023640 1 -- start start 2024-05-09T05:54:16.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.959+0000 7f0d7e023640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0d78074260 0x7f0d7815aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:16.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.959+0000 7f0d7e023640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d7806f7b0 con 0x7f0d7815af80 2024-05-09T05:54:16.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.959+0000 7f0d7e023640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d78074670 con 0x7f0d781549d0 2024-05-09T05:54:16.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.959+0000 7f0d7e023640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f0d7806f580 con 0x7f0d78074260 2024-05-09T05:54:16.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.959+0000 7f0d76ffd640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0d78074260 0x7f0d7815aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:16.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.959+0000 7f0d77fff640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f0d7815af80 0x7f0d78164e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41488/0 (socket says 172.21.15.72:41488) 2024-05-09T05:54:16.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.959+0000 7f0d77fff640 1 -- 172.21.15.72:0/931825243 learned_addr learned my addr 172.21.15.72:0/931825243 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:54:16.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.959+0000 7f0d767fc640 1 -- 172.21.15.72:0/931825243 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2154361959 0 0) 0x7f0d7806f7b0 con 0x7f0d7815af80 2024-05-09T05:54:16.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.959+0000 7f0d767fc640 1 -- 172.21.15.72:0/931825243 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d60003530 con 0x7f0d7815af80 2024-05-09T05:54:16.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.959+0000 7f0d76ffd640 1 -- 172.21.15.72:0/931825243 >> v1:172.21.15.110:6789/0 conn(0x7f0d781549d0 legacy=0x7f0d7806d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:16.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.959+0000 7f0d767fc640 1 -- 172.21.15.72:0/931825243 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2304180874 0 0) 0x7f0d78074670 con 0x7f0d781549d0 2024-05-09T05:54:16.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.959+0000 7f0d76ffd640 1 -- 172.21.15.72:0/931825243 >> v1:172.21.15.72:6789/0 conn(0x7f0d7815af80 legacy=0x7f0d78164e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:16.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.963+0000 7f0d76ffd640 1 -- 172.21.15.72:0/931825243 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d7806fa50 con 0x7f0d78074260 2024-05-09T05:54:16.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.963+0000 7f0d76ffd640 1 --2- 172.21.15.72:0/931825243 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d78074260 0x7f0d7815aa40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c0097c0 tx=0x7f0d6c01ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffab29397d962f82 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:16.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.963+0000 7f0d767fc640 1 -- 172.21.15.72:0/931825243 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c0b5070 con 0x7f0d78074260 2024-05-09T05:54:16.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.963+0000 7f0d767fc640 1 -- 172.21.15.72:0/931825243 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d6c0a8990 con 0x7f0d78074260 2024-05-09T05:54:16.955 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.963+0000 7f0d767fc640 1 -- 172.21.15.72:0/931825243 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c0a8d60 con 0x7f0d78074260 2024-05-09T05:54:16.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.963+0000 7f0d7e023640 1 -- 172.21.15.72:0/931825243 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d78074260 msgr2=0x7f0d7815aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:16.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.963+0000 7f0d7e023640 1 --2- 172.21.15.72:0/931825243 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d78074260 0x7f0d7815aa40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c0097c0 tx=0x7f0d6c01ec90 comp rx=0 tx=0).stop 2024-05-09T05:54:16.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.967+0000 7f0d7e023640 1 -- 172.21.15.72:0/931825243 shutdown_connections 2024-05-09T05:54:16.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.967+0000 7f0d7e023640 1 --2- 172.21.15.72:0/931825243 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d78074260 0x7f0d7815aa40 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.967+0000 7f0d7e023640 1 -- 172.21.15.72:0/931825243 >> 172.21.15.72:0/931825243 conn(0x7f0d7806e9b0 msgr2=0x7f0d7806edc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:16.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.967+0000 7f0d7e023640 1 -- 172.21.15.72:0/931825243 shutdown_connections 2024-05-09T05:54:16.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.967+0000 7f0d7e023640 1 -- 172.21.15.72:0/931825243 wait complete. 2024-05-09T05:54:16.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.967+0000 7f0d7e023640 1 Processor -- start 2024-05-09T05:54:16.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.967+0000 7f0d7e023640 1 -- start start 2024-05-09T05:54:16.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.967+0000 7f0d7e023640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d78074260 0x7f0d781e84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:16.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.967+0000 7f0d7e023640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d781549d0 0x7f0d781537f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:16.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.967+0000 7f0d7e023640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d7815af80 0x7f0d78153d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:16.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.967+0000 7f0d7e023640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f0d780ca2b0 con 0x7f0d781549d0 2024-05-09T05:54:16.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.967+0000 7f0d7e023640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f0d780c9fd0 con 0x7f0d7815af80 2024-05-09T05:54:16.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.967+0000 7f0d7e023640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f0d7815b390 con 0x7f0d78074260 2024-05-09T05:54:16.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.967+0000 7f0d76ffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d781549d0 0x7f0d781537f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:16.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.967+0000 7f0d76ffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d781549d0 0x7f0d781537f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46064/0 (socket says 172.21.15.72:46064) 2024-05-09T05:54:16.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.967+0000 7f0d76ffd640 1 -- 172.21.15.72:0/833235728 learned_addr learned my addr 172.21.15.72:0/833235728 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:54:16.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.967+0000 7f0d77fff640 1 --2- 172.21.15.72:0/833235728 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d7815af80 0x7f0d78153d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:16.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.967+0000 7f0d777fe640 1 --2- 172.21.15.72:0/833235728 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d78074260 0x7f0d781e84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:16.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.967+0000 7f0d76ffd640 1 -- 172.21.15.72:0/833235728 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d78074260 msgr2=0x7f0d781e84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:16.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.967+0000 7f0d76ffd640 1 --2- 172.21.15.72:0/833235728 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d78074260 0x7f0d781e84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.967+0000 7f0d76ffd640 1 -- 172.21.15.72:0/833235728 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d7815af80 msgr2=0x7f0d78153d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:16.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.967+0000 7f0d76ffd640 1 --2- 172.21.15.72:0/833235728 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d7815af80 0x7f0d78153d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.967+0000 7f0d76ffd640 1 -- 172.21.15.72:0/833235728 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d780c7c00 con 0x7f0d781549d0 2024-05-09T05:54:16.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.967+0000 7f0d777fe640 1 --2- 172.21.15.72:0/833235728 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d78074260 0x7f0d781e84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:54:16.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.967+0000 7f0d77fff640 1 --2- 172.21.15.72:0/833235728 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d7815af80 0x7f0d78153d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:54:16.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.967+0000 7f0d76ffd640 1 --2- 172.21.15.72:0/833235728 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d781549d0 0x7f0d781537f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c0097c0 tx=0x7f0d6c01ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:16.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.971+0000 7f0d5ffff640 1 -- 172.21.15.72:0/833235728 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c0b5040 con 0x7f0d781549d0 2024-05-09T05:54:16.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.971+0000 7f0d5ffff640 1 -- 172.21.15.72:0/833235728 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d6c0bf070 con 0x7f0d781549d0 2024-05-09T05:54:16.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.971+0000 7f0d5ffff640 1 -- 172.21.15.72:0/833235728 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c0b0840 con 0x7f0d781549d0 2024-05-09T05:54:16.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.971+0000 7f0d7e023640 1 -- 172.21.15.72:0/833235728 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d780c6380 con 0x7f0d781549d0 2024-05-09T05:54:16.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.971+0000 7f0d7e023640 1 -- 172.21.15.72:0/833235728 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d780c58b0 con 0x7f0d781549d0 2024-05-09T05:54:16.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.971+0000 7f0d5ffff640 1 -- 172.21.15.72:0/833235728 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f0d6c0b09e0 con 0x7f0d781549d0 2024-05-09T05:54:16.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.971+0000 7f0d5ffff640 1 --2- 172.21.15.72:0/833235728 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f0d6406f400 0x7f0d64071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:16.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.971+0000 7f0d5ffff640 1 -- 172.21.15.72:0/833235728 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f0d6c12c710 con 0x7f0d781549d0 2024-05-09T05:54:16.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.971+0000 7f0d777fe640 1 --2- 172.21.15.72:0/833235728 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f0d6406f400 0x7f0d64071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:16.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.971+0000 7f0d85381000 1 Processor -- start 2024-05-09T05:54:16.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.971+0000 7f0d85381000 1 -- start start 2024-05-09T05:54:16.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.971+0000 7f0d777fe640 1 --2- 172.21.15.72:0/833235728 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f0d6406f400 0x7f0d64071910 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0d700012f0 tx=0x7f0d70009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:16.965 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.975+0000 7f0d85381000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d792794bd0 0x55d7928d5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:16.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.975+0000 7f0d85381000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55d79278d180 0x55d7928d60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:16.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.975+0000 7f0d85381000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d792776d50 0x55d7928d6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:16.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.975+0000 7f0d85381000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55d79277bcc0 con 0x55d792776d50 2024-05-09T05:54:16.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.975+0000 7f0d85381000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55d792696370 con 0x55d792794bd0 2024-05-09T05:54:16.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.975+0000 7f0d85381000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x55d7926e38c0 con 0x55d79278d180 2024-05-09T05:54:16.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.975+0000 7f0d77fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d792776d50 0x55d7928d6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:16.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.975+0000 7f0d77fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d792776d50 0x55d7928d6630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46078/0 (socket says 172.21.15.72:46078) 2024-05-09T05:54:16.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.975+0000 7f0d77fff640 1 -- 172.21.15.72:0/3539018261 learned_addr learned my addr 172.21.15.72:0/3539018261 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:54:16.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.975+0000 7f0d777fe640 1 --2- 172.21.15.72:0/3539018261 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d792794bd0 0x55d7928d5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:16.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.975+0000 7f0d76ffd640 1 --2- 172.21.15.72:0/3539018261 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55d79278d180 0x55d7928d60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:16.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.975+0000 7f0d77fff640 1 -- 172.21.15.72:0/3539018261 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55d79278d180 msgr2=0x55d7928d60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:16.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.975+0000 7f0d77fff640 1 --2- 172.21.15.72:0/3539018261 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55d79278d180 0x55d7928d60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.975+0000 7f0d77fff640 1 -- 172.21.15.72:0/3539018261 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d792794bd0 msgr2=0x55d7928d5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:16.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.975+0000 7f0d77fff640 1 --2- 172.21.15.72:0/3539018261 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d792794bd0 0x55d7928d5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.975+0000 7f0d77fff640 1 -- 172.21.15.72:0/3539018261 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7926a4ef0 con 0x55d792776d50 2024-05-09T05:54:16.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.975+0000 7f0d77fff640 1 --2- 172.21.15.72:0/3539018261 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d792776d50 0x55d7928d6630 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0d68001670 tx=0x7f0d68001b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16ef9272b931876c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:16.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.975+0000 7f0d5d7fa640 1 -- 172.21.15.72:0/3539018261 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d68018070 con 0x55d792776d50 2024-05-09T05:54:16.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.975+0000 7f0d5d7fa640 1 -- 172.21.15.72:0/3539018261 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d68005cd0 con 0x55d792776d50 2024-05-09T05:54:16.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.975+0000 7f0d5d7fa640 1 -- 172.21.15.72:0/3539018261 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d68007310 con 0x55d792776d50 2024-05-09T05:54:16.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.975+0000 7f0d85381000 1 -- 172.21.15.72:0/3539018261 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d792776d50 msgr2=0x55d7928d6630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:16.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.975+0000 7f0d85381000 1 --2- 172.21.15.72:0/3539018261 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d792776d50 0x55d7928d6630 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0d68001670 tx=0x7f0d68001b30 comp rx=0 tx=0).stop 2024-05-09T05:54:16.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.975+0000 7f0d85381000 1 -- 172.21.15.72:0/3539018261 shutdown_connections 2024-05-09T05:54:16.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.975+0000 7f0d85381000 1 --2- 172.21.15.72:0/3539018261 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d792776d50 0x55d7928d6630 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.975+0000 7f0d85381000 1 --2- 172.21.15.72:0/3539018261 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55d79278d180 0x55d7928d60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.975+0000 7f0d85381000 1 --2- 172.21.15.72:0/3539018261 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d792794bd0 0x55d7928d5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.975+0000 7f0d85381000 1 -- 172.21.15.72:0/3539018261 >> 172.21.15.72:0/3539018261 conn(0x55d7923a1730 msgr2=0x55d7928d3970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:16.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.975+0000 7f0d85381000 1 -- 172.21.15.72:0/3539018261 shutdown_connections 2024-05-09T05:54:16.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.975+0000 7f0d85381000 1 -- 172.21.15.72:0/3539018261 wait complete. 2024-05-09T05:54:16.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.975+0000 7f0d85381000 1 -- start start 2024-05-09T05:54:16.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.975+0000 7f0d85381000 1 Processor -- start 2024-05-09T05:54:16.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.979+0000 7f0d85381000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55d792776d50 0x55d7928e0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:16.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.979+0000 7f0d85381000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d79278d180 0x55d7928e1380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:16.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.979+0000 7f0d85381000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d792794bd0 0x55d792896930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:16.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.979+0000 7f0d85381000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55d7926df880 con 0x55d79278d180 2024-05-09T05:54:16.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.979+0000 7f0d85381000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55d79269ca00 con 0x55d792794bd0 2024-05-09T05:54:16.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.979+0000 7f0d85381000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x55d792683910 con 0x55d792776d50 2024-05-09T05:54:16.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.979+0000 7f0d85381000 10 client.0 _ll_register_callbacks cb 0x55d792880100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T05:54:16.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.979+0000 7f0d76ffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d79278d180 0x55d7928e1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:16.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.979+0000 7f0d76ffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d79278d180 0x55d7928e1380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46088/0 (socket says 172.21.15.72:46088) 2024-05-09T05:54:16.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.979+0000 7f0d76ffd640 1 -- 172.21.15.72:0/2769711302 learned_addr learned my addr 172.21.15.72:0/2769711302 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:54:16.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.979+0000 7f0d77fff640 1 --2- 172.21.15.72:0/2769711302 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d792794bd0 0x55d792896930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:16.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.979+0000 7f0d777fe640 1 --2- 172.21.15.72:0/2769711302 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55d792776d50 0x55d7928e0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:16.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.979+0000 7f0d76ffd640 1 -- 172.21.15.72:0/2769711302 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55d792776d50 msgr2=0x55d7928e0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:16.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.979+0000 7f0d76ffd640 1 --2- 172.21.15.72:0/2769711302 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55d792776d50 0x55d7928e0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.979+0000 7f0d76ffd640 1 -- 172.21.15.72:0/2769711302 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d792794bd0 msgr2=0x55d792896930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:16.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.979+0000 7f0d76ffd640 1 --2- 172.21.15.72:0/2769711302 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d792794bd0 0x55d792896930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.979+0000 7f0d76ffd640 1 -- 172.21.15.72:0/2769711302 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d79269cc50 con 0x55d79278d180 2024-05-09T05:54:16.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.979+0000 7f0d77fff640 1 --2- 172.21.15.72:0/2769711302 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d792794bd0 0x55d792896930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:54:16.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.979+0000 7f0d76ffd640 1 --2- 172.21.15.72:0/2769711302 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d79278d180 0x55d7928e1380 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c12a8c0 tx=0x7f0d6c0f8440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4d819851b89da42 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:16.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.979+0000 7f0d567fc640 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-09T05:54:16.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.979+0000 7f0d567fc640 1 -- 172.21.15.72:0/2769711302 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c0f8720 con 0x55d79278d180 2024-05-09T05:54:16.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.979+0000 7f0d567fc640 1 -- 172.21.15.72:0/2769711302 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f0d6c0f7e70 con 0x55d79278d180 2024-05-09T05:54:16.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.979+0000 7f0d85381000 1 -- 172.21.15.72:0/2769711302 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d68005cd0 con 0x55d79278d180 2024-05-09T05:54:16.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.979+0000 7f0d567fc640 1 -- 172.21.15.72:0/2769711302 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f0d6c0f9310 con 0x55d79278d180 2024-05-09T05:54:16.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.979+0000 7f0d85381000 10 client.4755 fetch_fsmap learned FSMap version 19 2024-05-09T05:54:16.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.979+0000 7f0d85381000 1 -- 172.21.15.72:0/2769711302 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55d79269a650 con 0x55d79278d180 2024-05-09T05:54:16.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.979+0000 7f0d567fc640 1 -- 172.21.15.72:0/2769711302 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d68005cd0 con 0x55d79278d180 2024-05-09T05:54:16.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.979+0000 7f0d567fc640 1 -- 172.21.15.72:0/2769711302 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7f0d6c0b8050 con 0x55d79278d180 2024-05-09T05:54:16.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.979+0000 7f0d85381000 10 client.4755 fetch_fsmap finished waiting for FSMap version 19 2024-05-09T05:54:16.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.979+0000 7f0d85381000 10 client.4755 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-09T05:54:16.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.979+0000 7f0d85381000 20 client.4755 populate_metadata read hostname 'smithi072' 2024-05-09T05:54:16.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.979+0000 7f0d85381000 1 --2- 172.21.15.72:0/2769711302 >> [v2:172.21.15.72:6836/1048256382,v1:172.21.15.72:6837/1048256382] conn(0x55d7923877d0 0x55d7928976d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:16.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.979+0000 7f0d85381000 4 client.4755 mds_command: new command op to 4263 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T05:54:16.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.979+0000 7f0d85381000 1 -- 172.21.15.72:0/2769711302 --> [v2:172.21.15.72:6836/1048256382,v1:172.21.15.72:6837/1048256382] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d79267c620 con 0x55d7923877d0 2024-05-09T05:54:16.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.979+0000 7f0d777fe640 1 --2- 172.21.15.72:0/2769711302 >> [v2:172.21.15.72:6836/1048256382,v1:172.21.15.72:6837/1048256382] conn(0x55d7923877d0 0x55d7928976d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:16.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.979+0000 7f0d567fc640 10 client.4755 ms_handle_connect on v2:172.21.15.72:6836/1048256382 2024-05-09T05:54:16.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.979+0000 7f0d777fe640 1 --2- 172.21.15.72:0/2769711302 >> [v2:172.21.15.72:6836/1048256382,v1:172.21.15.72:6837/1048256382] conn(0x55d7923877d0 0x55d7928976d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ee6ddd33a3f71217 server_cookie=55a66f54ed168f6 in_seq=0 out_seq=0 2024-05-09T05:54:16.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.979+0000 7f0d567fc640 1 -- 172.21.15.72:0/2769711302 <== mds.2 v2:172.21.15.72:6836/1048256382 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55d79267c620 con 0x55d7923877d0 2024-05-09T05:54:16.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.979+0000 7f0d567fc640 10 client.4755 handle_command_reply: tid=0 2024-05-09T05:54:16.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.979+0000 7f0d85381000 1 client.4755 shutdown 2024-05-09T05:54:16.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.979+0000 7f0d85381000 1 -- 172.21.15.72:0/2769711302 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d79278d180 msgr2=0x55d7928e1380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:16.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.979+0000 7f0d85381000 1 --2- 172.21.15.72:0/2769711302 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d79278d180 0x55d7928e1380 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c12a8c0 tx=0x7f0d6c0f8440 comp rx=0 tx=0).stop 2024-05-09T05:54:16.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.979+0000 7f0d85381000 1 -- 172.21.15.72:0/2769711302 shutdown_connections 2024-05-09T05:54:16.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.979+0000 7f0d85381000 1 --2- 172.21.15.72:0/2769711302 >> [v2:172.21.15.72:6836/1048256382,v1:172.21.15.72:6837/1048256382] conn(0x55d7923877d0 0x55d7928976d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.979+0000 7f0d85381000 1 --2- 172.21.15.72:0/2769711302 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d792794bd0 0x55d792896930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.979+0000 7f0d85381000 1 --2- 172.21.15.72:0/2769711302 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d79278d180 0x55d7928e1380 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.979+0000 7f0d567fc640 0 client.4755 ms_handle_reset on v2:172.21.15.72:6836/1048256382 2024-05-09T05:54:16.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.979+0000 7f0d85381000 1 --2- 172.21.15.72:0/2769711302 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55d792776d50 0x55d7928e0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.979+0000 7f0d85381000 1 -- 172.21.15.72:0/2769711302 >> 172.21.15.72:0/2769711302 conn(0x55d7923a1730 msgr2=0x55d7928d2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:16.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.979+0000 7f0d85381000 1 -- 172.21.15.72:0/2769711302 shutdown_connections 2024-05-09T05:54:16.976 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.979+0000 7f0d85381000 1 -- 172.21.15.72:0/2769711302 wait complete. 2024-05-09T05:54:16.976 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.979+0000 7f0d85381000 20 client.4755 trim_cache size 0 max 16384 2024-05-09T05:54:16.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.999+0000 7f0d85381000 1 Processor -- start 2024-05-09T05:54:16.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.999+0000 7f0d85381000 1 -- start start 2024-05-09T05:54:16.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.999+0000 7f0d85381000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d792776d50 0x55d792895ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:16.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.999+0000 7f0d85381000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55d79278d180 0x55d7928e6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:16.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.999+0000 7f0d85381000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d792794bd0 0x55d7928e7400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:16.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.999+0000 7f0d85381000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f0d78200380 con 0x55d792794bd0 2024-05-09T05:54:16.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.999+0000 7f0d85381000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f0d78200a50 con 0x55d792776d50 2024-05-09T05:54:16.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:16.999+0000 7f0d85381000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f0d781f6dc0 con 0x55d79278d180 2024-05-09T05:54:16.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.003+0000 7f0d77fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d792794bd0 0x55d7928e7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:16.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.003+0000 7f0d77fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d792794bd0 0x55d7928e7400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46102/0 (socket says 172.21.15.72:46102) 2024-05-09T05:54:16.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.003+0000 7f0d777fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d792776d50 0x55d792895ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:16.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.003+0000 7f0d76ffd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55d79278d180 0x55d7928e6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:16.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.003+0000 7f0d77fff640 1 -- 172.21.15.72:0/3434253492 learned_addr learned my addr 172.21.15.72:0/3434253492 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:54:16.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.003+0000 7f0d77fff640 1 -- 172.21.15.72:0/3434253492 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55d79278d180 msgr2=0x55d7928e6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:16.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.003+0000 7f0d77fff640 1 --2- 172.21.15.72:0/3434253492 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55d79278d180 0x55d7928e6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.003+0000 7f0d77fff640 1 -- 172.21.15.72:0/3434253492 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d792776d50 msgr2=0x55d792895ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:16.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.003+0000 7f0d77fff640 1 --2- 172.21.15.72:0/3434253492 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d792776d50 0x55d792895ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.003+0000 7f0d77fff640 1 -- 172.21.15.72:0/3434253492 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7927650e0 con 0x55d792794bd0 2024-05-09T05:54:16.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.003+0000 7f0d76ffd640 1 --2- 172.21.15.72:0/3434253492 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55d79278d180 0x55d7928e6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:54:16.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.003+0000 7f0d777fe640 1 --2- 172.21.15.72:0/3434253492 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d792776d50 0x55d792895ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:54:16.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.003+0000 7f0d77fff640 1 --2- 172.21.15.72:0/3434253492 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d792794bd0 0x55d7928e7400 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0d68000c10 tx=0x7f0d6800b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c39b67ad90fd19c9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:16.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.003+0000 7f0d5cff9640 1 -- 172.21.15.72:0/3434253492 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d68018070 con 0x55d792794bd0 2024-05-09T05:54:16.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.003+0000 7f0d5cff9640 1 -- 172.21.15.72:0/3434253492 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d68023070 con 0x55d792794bd0 2024-05-09T05:54:16.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.003+0000 7f0d5cff9640 1 -- 172.21.15.72:0/3434253492 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d68007310 con 0x55d792794bd0 2024-05-09T05:54:16.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.003+0000 7f0d85381000 1 -- 172.21.15.72:0/3434253492 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d792794bd0 msgr2=0x55d7928e7400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:16.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.003+0000 7f0d85381000 1 --2- 172.21.15.72:0/3434253492 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d792794bd0 0x55d7928e7400 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0d68000c10 tx=0x7f0d6800b000 comp rx=0 tx=0).stop 2024-05-09T05:54:16.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.003+0000 7f0d85381000 1 -- 172.21.15.72:0/3434253492 shutdown_connections 2024-05-09T05:54:16.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.003+0000 7f0d85381000 1 --2- 172.21.15.72:0/3434253492 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d792794bd0 0x55d7928e7400 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.003+0000 7f0d85381000 1 --2- 172.21.15.72:0/3434253492 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55d79278d180 0x55d7928e6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.003+0000 7f0d85381000 1 --2- 172.21.15.72:0/3434253492 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d792776d50 0x55d792895ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:16.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.003+0000 7f0d85381000 1 -- 172.21.15.72:0/3434253492 >> 172.21.15.72:0/3434253492 conn(0x55d7923a1730 msgr2=0x55d792896980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:16.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.003+0000 7f0d85381000 1 -- 172.21.15.72:0/3434253492 shutdown_connections 2024-05-09T05:54:16.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.003+0000 7f0d85381000 1 -- 172.21.15.72:0/3434253492 wait complete. 2024-05-09T05:54:16.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.003+0000 7f0d85381000 1 -- start start 2024-05-09T05:54:16.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.003+0000 7f0d85381000 1 Processor -- start 2024-05-09T05:54:17.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.007+0000 7f0d85381000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d792776d50 0x55d7928e69f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:17.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.007+0000 7f0d85381000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55d79278d180 0x55d7928e6f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:17.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.007+0000 7f0d85381000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d792794bd0 0x55d79290d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:17.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.007+0000 7f0d85381000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55d79279ef80 con 0x55d792794bd0 2024-05-09T05:54:17.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.007+0000 7f0d85381000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55d7926ae080 con 0x55d792776d50 2024-05-09T05:54:17.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.007+0000 7f0d85381000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x55d7926e7ef0 con 0x55d79278d180 2024-05-09T05:54:17.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.007+0000 7f0d85381000 10 client.0 _ll_register_callbacks cb 0x7f0d6c009420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T05:54:17.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.007+0000 7f0d77fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d792794bd0 0x55d79290d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:17.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.007+0000 7f0d77fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d792794bd0 0x55d79290d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46118/0 (socket says 172.21.15.72:46118) 2024-05-09T05:54:17.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.007+0000 7f0d77fff640 1 -- 172.21.15.72:0/1645025624 learned_addr learned my addr 172.21.15.72:0/1645025624 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:54:17.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.007+0000 7f0d777fe640 1 --2- 172.21.15.72:0/1645025624 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d792776d50 0x55d7928e69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:17.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.007+0000 7f0d76ffd640 1 --2- 172.21.15.72:0/1645025624 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55d79278d180 0x55d7928e6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:17.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.007+0000 7f0d77fff640 1 -- 172.21.15.72:0/1645025624 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55d79278d180 msgr2=0x55d7928e6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:17.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.007+0000 7f0d77fff640 1 --2- 172.21.15.72:0/1645025624 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55d79278d180 0x55d7928e6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.007+0000 7f0d77fff640 1 -- 172.21.15.72:0/1645025624 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d792776d50 msgr2=0x55d7928e69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:17.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.007+0000 7f0d77fff640 1 --2- 172.21.15.72:0/1645025624 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d792776d50 0x55d7928e69f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.007+0000 7f0d77fff640 1 -- 172.21.15.72:0/1645025624 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d79273bf90 con 0x55d792794bd0 2024-05-09T05:54:17.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.007+0000 7f0d76ffd640 1 --2- 172.21.15.72:0/1645025624 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55d79278d180 0x55d7928e6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:54:17.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.007+0000 7f0d777fe640 1 --2- 172.21.15.72:0/1645025624 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d792776d50 0x55d7928e69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:54:17.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.007+0000 7f0d77fff640 1 --2- 172.21.15.72:0/1645025624 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d792794bd0 0x55d79290d960 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0d68000fe0 tx=0x7f0d68001180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46ba7cc05fbf9ea5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:17.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.007+0000 7f0d567fc640 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-09T05:54:17.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.007+0000 7f0d567fc640 1 -- 172.21.15.72:0/1645025624 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d68018040 con 0x55d792794bd0 2024-05-09T05:54:17.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.007+0000 7f0d567fc640 1 -- 172.21.15.72:0/1645025624 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f0d68031e30 con 0x55d792794bd0 2024-05-09T05:54:17.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.007+0000 7f0d85381000 1 -- 172.21.15.72:0/1645025624 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d68023070 con 0x55d792794bd0 2024-05-09T05:54:17.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.007+0000 7f0d567fc640 1 -- 172.21.15.72:0/1645025624 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f0d680074e0 con 0x55d792794bd0 2024-05-09T05:54:17.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.007+0000 7f0d85381000 10 client.4761 fetch_fsmap learned FSMap version 19 2024-05-09T05:54:17.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.007+0000 7f0d85381000 1 -- 172.21.15.72:0/1645025624 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55d792687f30 con 0x55d792794bd0 2024-05-09T05:54:17.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.007+0000 7f0d567fc640 1 -- 172.21.15.72:0/1645025624 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d68023070 con 0x55d792794bd0 2024-05-09T05:54:17.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.007+0000 7f0d567fc640 1 -- 172.21.15.72:0/1645025624 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7f0d68007680 con 0x55d792794bd0 2024-05-09T05:54:17.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.007+0000 7f0d85381000 10 client.4761 fetch_fsmap finished waiting for FSMap version 19 2024-05-09T05:54:17.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.007+0000 7f0d85381000 10 client.4761 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-09T05:54:17.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.007+0000 7f0d85381000 20 client.4761 populate_metadata read hostname 'smithi072' 2024-05-09T05:54:17.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.007+0000 7f0d85381000 1 --2- 172.21.15.72:0/1645025624 >> [v2:172.21.15.72:6836/1048256382,v1:172.21.15.72:6837/1048256382] conn(0x55d792375830 0x55d79290dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:17.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.007+0000 7f0d85381000 4 client.4761 mds_command: new command op to 4263 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-09T05:54:17.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.007+0000 7f0d85381000 1 -- 172.21.15.72:0/1645025624 --> [v2:172.21.15.72:6836/1048256382,v1:172.21.15.72:6837/1048256382] -- command(tid 0: {"prefix": "status"}) -- 0x55d7926f14d0 con 0x55d792375830 2024-05-09T05:54:17.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.007+0000 7f0d777fe640 1 --2- 172.21.15.72:0/1645025624 >> [v2:172.21.15.72:6836/1048256382,v1:172.21.15.72:6837/1048256382] conn(0x55d792375830 0x55d79290dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:17.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.007+0000 7f0d567fc640 10 client.4761 ms_handle_connect on v2:172.21.15.72:6836/1048256382 2024-05-09T05:54:17.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.007+0000 7f0d777fe640 1 --2- 172.21.15.72:0/1645025624 >> [v2:172.21.15.72:6836/1048256382,v1:172.21.15.72:6837/1048256382] conn(0x55d792375830 0x55d79290dea0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=17de0f5a880c19cb server_cookie=f45833c3c4000f6e in_seq=0 out_seq=0 2024-05-09T05:54:17.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.007+0000 7f0d567fc640 1 -- 172.21.15.72:0/1645025624 <== mds.2 v2:172.21.15.72:6836/1048256382 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55d7926f14d0 con 0x55d792375830 2024-05-09T05:54:17.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.007+0000 7f0d567fc640 10 client.4761 handle_command_reply: tid=0 2024-05-09T05:54:17.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.007+0000 7f0d85381000 1 client.4761 shutdown 2024-05-09T05:54:17.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.007+0000 7f0d85381000 1 -- 172.21.15.72:0/1645025624 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d792794bd0 msgr2=0x55d79290d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:17.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.007+0000 7f0d85381000 1 --2- 172.21.15.72:0/1645025624 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d792794bd0 0x55d79290d960 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0d68000fe0 tx=0x7f0d68001180 comp rx=0 tx=0).stop 2024-05-09T05:54:17.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.007+0000 7f0d85381000 1 -- 172.21.15.72:0/1645025624 shutdown_connections 2024-05-09T05:54:17.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.007+0000 7f0d85381000 1 --2- 172.21.15.72:0/1645025624 >> [v2:172.21.15.72:6836/1048256382,v1:172.21.15.72:6837/1048256382] conn(0x55d792375830 0x55d79290dea0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.007+0000 7f0d85381000 1 --2- 172.21.15.72:0/1645025624 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d792794bd0 0x55d79290d960 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.007+0000 7f0d85381000 1 --2- 172.21.15.72:0/1645025624 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55d79278d180 0x55d7928e6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.007+0000 7f0d85381000 1 --2- 172.21.15.72:0/1645025624 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d792776d50 0x55d7928e69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.007+0000 7f0d567fc640 0 client.4761 ms_handle_reset on v2:172.21.15.72:6836/1048256382 2024-05-09T05:54:17.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.007+0000 7f0d85381000 1 -- 172.21.15.72:0/1645025624 >> 172.21.15.72:0/1645025624 conn(0x55d7923a1730 msgr2=0x55d7928954a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:17.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.007+0000 7f0d85381000 1 -- 172.21.15.72:0/1645025624 shutdown_connections 2024-05-09T05:54:17.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.007+0000 7f0d85381000 1 -- 172.21.15.72:0/1645025624 wait complete. 2024-05-09T05:54:17.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.007+0000 7f0d85381000 20 client.4761 trim_cache size 0 max 16384 2024-05-09T05:54:17.004 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-05-09T05:54:17.004 INFO:teuthology.orchestra.run.smithi072.stdout: "cluster_fsid": "44c88cb9-b39b-4787-a871-80ddf0ad6292", 2024-05-09T05:54:17.004 INFO:teuthology.orchestra.run.smithi072.stdout: "whoami": 2, 2024-05-09T05:54:17.004 INFO:teuthology.orchestra.run.smithi072.stdout: "id": 4263, 2024-05-09T05:54:17.004 INFO:teuthology.orchestra.run.smithi072.stdout: "want_state": "up:active", 2024-05-09T05:54:17.005 INFO:teuthology.orchestra.run.smithi072.stdout: "state": "up:active", 2024-05-09T05:54:17.005 INFO:teuthology.orchestra.run.smithi072.stdout: "fs_name": "cephfs", 2024-05-09T05:54:17.005 INFO:teuthology.orchestra.run.smithi072.stdout: "rank_uptime": 22.371845792999999, 2024-05-09T05:54:17.005 INFO:teuthology.orchestra.run.smithi072.stdout: "mdsmap_epoch": 19, 2024-05-09T05:54:17.005 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch": 27, 2024-05-09T05:54:17.005 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch_barrier": 27, 2024-05-09T05:54:17.005 INFO:teuthology.orchestra.run.smithi072.stdout: "uptime": 58.970847298000002 2024-05-09T05:54:17.005 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-05-09T05:54:17.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.007+0000 7f0d7e023640 1 -- 172.21.15.72:0/833235728 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f0d6406f400 msgr2=0x7f0d64071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:17.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.007+0000 7f0d7e023640 1 --2- 172.21.15.72:0/833235728 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f0d6406f400 0x7f0d64071910 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0d700012f0 tx=0x7f0d70009040 comp rx=0 tx=0).stop 2024-05-09T05:54:17.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.007+0000 7f0d7e023640 1 -- 172.21.15.72:0/833235728 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d781549d0 msgr2=0x7f0d781537f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:17.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.007+0000 7f0d7e023640 1 --2- 172.21.15.72:0/833235728 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d781549d0 0x7f0d781537f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c0097c0 tx=0x7f0d6c01ba30 comp rx=0 tx=0).stop 2024-05-09T05:54:17.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.007+0000 7f0d7e023640 1 -- 172.21.15.72:0/833235728 shutdown_connections 2024-05-09T05:54:17.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.007+0000 7f0d7e023640 1 --2- 172.21.15.72:0/833235728 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f0d6406f400 0x7f0d64071910 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.007+0000 7f0d7e023640 1 --2- 172.21.15.72:0/833235728 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d7815af80 0x7f0d78153d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.007+0000 7f0d7e023640 1 --2- 172.21.15.72:0/833235728 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d781549d0 0x7f0d781537f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.007+0000 7f0d7e023640 1 --2- 172.21.15.72:0/833235728 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d78074260 0x7f0d781e84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.007+0000 7f0d7e023640 1 -- 172.21.15.72:0/833235728 >> 172.21.15.72:0/833235728 conn(0x7f0d7806e9b0 msgr2=0x7f0d780c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:17.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.007+0000 7f0d7e023640 1 -- 172.21.15.72:0/833235728 shutdown_connections 2024-05-09T05:54:17.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.007+0000 7f0d7e023640 1 -- 172.21.15.72:0/833235728 wait complete. 2024-05-09T05:54:17.019 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-05-09T05:54:17.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.167+0000 7f9d6e7c6640 1 Processor -- start 2024-05-09T05:54:17.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.167+0000 7f9d6e7c6640 1 -- start start 2024-05-09T05:54:17.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.171+0000 7f9d6e7c6640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9d68159ed0 0x7f9d68153860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:17.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.171+0000 7f9d6e7c6640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9d680c73e0 0x7f9d68073350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:17.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.171+0000 7f9d6e7c6640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d68072b00 con 0x7f9d68072f40 2024-05-09T05:54:17.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.171+0000 7f9d6e7c6640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f9d68072540 con 0x7f9d680c73e0 2024-05-09T05:54:17.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.171+0000 7f9d6e7c6640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f9d68072820 con 0x7f9d68159ed0 2024-05-09T05:54:17.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.171+0000 7f9d6cd63640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9d680c73e0 0x7f9d68073350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:17.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.171+0000 7f9d6cd63640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9d680c73e0 0x7f9d68073350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46132/0 (socket says 172.21.15.72:46132) 2024-05-09T05:54:17.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.171+0000 7f9d6cd63640 1 -- 172.21.15.72:0/171111137 learned_addr learned my addr 172.21.15.72:0/171111137 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:54:17.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.171+0000 7f9d67fff640 1 --2- 172.21.15.72:0/171111137 >> v2:172.21.15.110:3300/0 conn(0x7f9d68159ed0 0x7f9d68153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:17.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.171+0000 7f9d6cd63640 1 -- 172.21.15.72:0/171111137 >> v2:172.21.15.110:3300/0 conn(0x7f9d68159ed0 msgr2=0x7f9d68153860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:17.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.171+0000 7f9d6cd63640 1 --2- 172.21.15.72:0/171111137 >> v2:172.21.15.110:3300/0 conn(0x7f9d68159ed0 0x7f9d68153860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.171+0000 7f9d6cd63640 1 -- 172.21.15.72:0/171111137 >> v1:172.21.15.110:6789/0 conn(0x7f9d68072f40 legacy=0x7f9d680c6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:17.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.171+0000 7f9d6cd63640 1 -- 172.21.15.72:0/171111137 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d680c64d0 con 0x7f9d680c73e0 2024-05-09T05:54:17.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.171+0000 7f9d6cd63640 1 --2- 172.21.15.72:0/171111137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d680c73e0 0x7f9d68073350 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9d680ca0e0 tx=0x7f9d600213e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56a1460111721ebf server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:17.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.171+0000 7f9d66ffd640 1 -- 172.21.15.72:0/171111137 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d600b6070 con 0x7f9d680c73e0 2024-05-09T05:54:17.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.171+0000 7f9d66ffd640 1 -- 172.21.15.72:0/171111137 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d6000b2d0 con 0x7f9d680c73e0 2024-05-09T05:54:17.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.171+0000 7f9d66ffd640 1 -- 172.21.15.72:0/171111137 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d6000b480 con 0x7f9d680c73e0 2024-05-09T05:54:17.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.171+0000 7f9d6e7c6640 1 -- 172.21.15.72:0/171111137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d680c73e0 msgr2=0x7f9d68073350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:17.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.171+0000 7f9d6e7c6640 1 --2- 172.21.15.72:0/171111137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d680c73e0 0x7f9d68073350 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9d680ca0e0 tx=0x7f9d600213e0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.171+0000 7f9d6e7c6640 1 -- 172.21.15.72:0/171111137 shutdown_connections 2024-05-09T05:54:17.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.171+0000 7f9d6e7c6640 1 --2- 172.21.15.72:0/171111137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d680c73e0 0x7f9d68073350 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.171+0000 7f9d6e7c6640 1 --2- 172.21.15.72:0/171111137 >> v2:172.21.15.110:3300/0 conn(0x7f9d68159ed0 0x7f9d68153860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.171+0000 7f9d6e7c6640 1 -- 172.21.15.72:0/171111137 >> 172.21.15.72:0/171111137 conn(0x7f9d680cde90 msgr2=0x7f9d680ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:17.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.171+0000 7f9d6e7c6640 1 -- 172.21.15.72:0/171111137 shutdown_connections 2024-05-09T05:54:17.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.171+0000 7f9d6e7c6640 1 -- 172.21.15.72:0/171111137 wait complete. 2024-05-09T05:54:17.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.175+0000 7f9d6e7c6640 1 Processor -- start 2024-05-09T05:54:17.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.175+0000 7f9d6e7c6640 1 -- start start 2024-05-09T05:54:17.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.175+0000 7f9d6e7c6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d68072f40 0x7f9d681eeb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:17.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.175+0000 7f9d6e7c6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d680c73e0 0x7f9d6815ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:17.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.175+0000 7f9d6e7c6640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d68159ed0 0x7f9d68159540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:17.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.175+0000 7f9d6e7c6640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f9d680c4e30 con 0x7f9d68159ed0 2024-05-09T05:54:17.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.175+0000 7f9d6e7c6640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f9d680c4cb0 con 0x7f9d68072f40 2024-05-09T05:54:17.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.175+0000 7f9d6e7c6640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f9d6806fc00 con 0x7f9d680c73e0 2024-05-09T05:54:17.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.175+0000 7f9d6cd63640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d68159ed0 0x7f9d68159540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:17.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.175+0000 7f9d6cd63640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d68159ed0 0x7f9d68159540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46138/0 (socket says 172.21.15.72:46138) 2024-05-09T05:54:17.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.175+0000 7f9d6cd63640 1 -- 172.21.15.72:0/2251503795 learned_addr learned my addr 172.21.15.72:0/2251503795 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:54:17.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.175+0000 7f9d67fff640 1 --2- 172.21.15.72:0/2251503795 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d68072f40 0x7f9d681eeb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:17.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.175+0000 7f9d677fe640 1 --2- 172.21.15.72:0/2251503795 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d680c73e0 0x7f9d6815ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:17.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.175+0000 7f9d6cd63640 1 -- 172.21.15.72:0/2251503795 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d680c73e0 msgr2=0x7f9d6815ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:17.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.175+0000 7f9d6cd63640 1 --2- 172.21.15.72:0/2251503795 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d680c73e0 0x7f9d6815ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.175+0000 7f9d6cd63640 1 -- 172.21.15.72:0/2251503795 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d68072f40 msgr2=0x7f9d681eeb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:17.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.175+0000 7f9d6cd63640 1 --2- 172.21.15.72:0/2251503795 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d68072f40 0x7f9d681eeb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.175+0000 7f9d6cd63640 1 -- 172.21.15.72:0/2251503795 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d68149c80 con 0x7f9d68159ed0 2024-05-09T05:54:17.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.175+0000 7f9d677fe640 1 --2- 172.21.15.72:0/2251503795 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d680c73e0 0x7f9d6815ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:54:17.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.175+0000 7f9d6cd63640 1 --2- 172.21.15.72:0/2251503795 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d68159ed0 0x7f9d68159540 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9d600b4040 tx=0x7f9d6001e180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:17.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.175+0000 7f9d64ff9640 1 -- 172.21.15.72:0/2251503795 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d600b6040 con 0x7f9d68159ed0 2024-05-09T05:54:17.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.175+0000 7f9d64ff9640 1 -- 172.21.15.72:0/2251503795 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d6000b0d0 con 0x7f9d68159ed0 2024-05-09T05:54:17.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.175+0000 7f9d6e7c6640 1 -- 172.21.15.72:0/2251503795 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d6815b340 con 0x7f9d68159ed0 2024-05-09T05:54:17.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.175+0000 7f9d64ff9640 1 -- 172.21.15.72:0/2251503795 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d6000b480 con 0x7f9d68159ed0 2024-05-09T05:54:17.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.175+0000 7f9d6e7c6640 1 -- 172.21.15.72:0/2251503795 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d681ef720 con 0x7f9d68159ed0 2024-05-09T05:54:17.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.179+0000 7f9d64ff9640 1 -- 172.21.15.72:0/2251503795 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f9d600c4020 con 0x7f9d68159ed0 2024-05-09T05:54:17.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.179+0000 7f9d64ff9640 1 --2- 172.21.15.72:0/2251503795 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f9d5406f430 0x7f9d54071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:17.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.179+0000 7f9d64ff9640 1 -- 172.21.15.72:0/2251503795 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f9d6012f090 con 0x7f9d68159ed0 2024-05-09T05:54:17.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.179+0000 7f9d67fff640 1 --2- 172.21.15.72:0/2251503795 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f9d5406f430 0x7f9d54071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:17.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.179+0000 7f9d75b24000 1 Processor -- start 2024-05-09T05:54:17.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.179+0000 7f9d75b24000 1 -- start start 2024-05-09T05:54:17.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.179+0000 7f9d67fff640 1 --2- 172.21.15.72:0/2251503795 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f9d5406f430 0x7f9d54071940 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9d5800b930 tx=0x7f9d58008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:17.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.183+0000 7f9d75b24000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x556eef29cbd0 0x556eef3ddbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:17.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.183+0000 7f9d75b24000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556eef295180 0x556eef3de0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:17.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.183+0000 7f9d75b24000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556eef27ed50 0x556eef3de630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:17.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.183+0000 7f9d75b24000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x556eef283cc0 con 0x556eef295180 2024-05-09T05:54:17.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.183+0000 7f9d75b24000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x556eef19e370 con 0x556eef27ed50 2024-05-09T05:54:17.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.183+0000 7f9d75b24000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x556eef1eb8c0 con 0x556eef29cbd0 2024-05-09T05:54:17.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.183+0000 7f9d677fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556eef295180 0x556eef3de0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:17.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.183+0000 7f9d677fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556eef295180 0x556eef3de0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46144/0 (socket says 172.21.15.72:46144) 2024-05-09T05:54:17.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.183+0000 7f9d677fe640 1 -- 172.21.15.72:0/3331062505 learned_addr learned my addr 172.21.15.72:0/3331062505 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:54:17.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.183+0000 7f9d67fff640 1 --2- 172.21.15.72:0/3331062505 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x556eef29cbd0 0x556eef3ddbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:17.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.183+0000 7f9d677fe640 1 -- 172.21.15.72:0/3331062505 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x556eef29cbd0 msgr2=0x556eef3ddbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:17.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.183+0000 7f9d677fe640 1 --2- 172.21.15.72:0/3331062505 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x556eef29cbd0 0x556eef3ddbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.183+0000 7f9d677fe640 1 -- 172.21.15.72:0/3331062505 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556eef27ed50 msgr2=0x556eef3de630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:17.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.183+0000 7f9d677fe640 1 --2- 172.21.15.72:0/3331062505 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556eef27ed50 0x556eef3de630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.183+0000 7f9d677fe640 1 -- 172.21.15.72:0/3331062505 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556eef1acef0 con 0x556eef295180 2024-05-09T05:54:17.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.183+0000 7f9d677fe640 1 --2- 172.21.15.72:0/3331062505 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556eef295180 0x556eef3de0f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c00a8b0 tx=0x7f9d5c00ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ad037628c893031 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:17.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.183+0000 7f9d4dffb640 1 -- 172.21.15.72:0/3331062505 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c015070 con 0x556eef295180 2024-05-09T05:54:17.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.183+0000 7f9d4dffb640 1 -- 172.21.15.72:0/3331062505 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d5c00cb40 con 0x556eef295180 2024-05-09T05:54:17.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.183+0000 7f9d4dffb640 1 -- 172.21.15.72:0/3331062505 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c0113f0 con 0x556eef295180 2024-05-09T05:54:17.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.183+0000 7f9d75b24000 1 -- 172.21.15.72:0/3331062505 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556eef295180 msgr2=0x556eef3de0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:17.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.183+0000 7f9d75b24000 1 --2- 172.21.15.72:0/3331062505 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556eef295180 0x556eef3de0f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c00a8b0 tx=0x7f9d5c00ad70 comp rx=0 tx=0).stop 2024-05-09T05:54:17.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.183+0000 7f9d75b24000 1 -- 172.21.15.72:0/3331062505 shutdown_connections 2024-05-09T05:54:17.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.183+0000 7f9d75b24000 1 --2- 172.21.15.72:0/3331062505 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556eef27ed50 0x556eef3de630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.183+0000 7f9d75b24000 1 --2- 172.21.15.72:0/3331062505 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556eef295180 0x556eef3de0f0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.183+0000 7f9d75b24000 1 --2- 172.21.15.72:0/3331062505 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x556eef29cbd0 0x556eef3ddbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.183+0000 7f9d75b24000 1 -- 172.21.15.72:0/3331062505 >> 172.21.15.72:0/3331062505 conn(0x556eeeea9730 msgr2=0x556eef3db970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:17.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.183+0000 7f9d75b24000 1 -- 172.21.15.72:0/3331062505 shutdown_connections 2024-05-09T05:54:17.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.183+0000 7f9d75b24000 1 -- 172.21.15.72:0/3331062505 wait complete. 2024-05-09T05:54:17.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.183+0000 7f9d75b24000 1 -- start start 2024-05-09T05:54:17.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.183+0000 7f9d75b24000 1 Processor -- start 2024-05-09T05:54:17.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.183+0000 7f9d75b24000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556eef27ed50 0x556eef3e8c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:17.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.183+0000 7f9d75b24000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x556eef295180 0x556eef3e91a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:17.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.183+0000 7f9d75b24000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556eef29cbd0 0x556eef39e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:17.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.183+0000 7f9d75b24000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x556eef1e7880 con 0x556eef27ed50 2024-05-09T05:54:17.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.183+0000 7f9d75b24000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x556eef1a4a00 con 0x556eef29cbd0 2024-05-09T05:54:17.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.183+0000 7f9d75b24000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x556eef18b910 con 0x556eef295180 2024-05-09T05:54:17.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.183+0000 7f9d75b24000 10 client.0 _ll_register_callbacks cb 0x556eef388100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T05:54:17.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.183+0000 7f9d67fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556eef27ed50 0x556eef3e8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:17.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.183+0000 7f9d67fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556eef27ed50 0x556eef3e8c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46152/0 (socket says 172.21.15.72:46152) 2024-05-09T05:54:17.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.183+0000 7f9d67fff640 1 -- 172.21.15.72:0/2834459797 learned_addr learned my addr 172.21.15.72:0/2834459797 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:54:17.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.187+0000 7f9d677fe640 1 --2- 172.21.15.72:0/2834459797 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x556eef295180 0x556eef3e91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:17.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.187+0000 7f9d6cd63640 1 --2- 172.21.15.72:0/2834459797 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556eef29cbd0 0x556eef39e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:17.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.187+0000 7f9d67fff640 1 -- 172.21.15.72:0/2834459797 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x556eef295180 msgr2=0x556eef3e91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:17.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.187+0000 7f9d67fff640 1 --2- 172.21.15.72:0/2834459797 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x556eef295180 0x556eef3e91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.187+0000 7f9d67fff640 1 -- 172.21.15.72:0/2834459797 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556eef29cbd0 msgr2=0x556eef39e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:17.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.187+0000 7f9d67fff640 1 --2- 172.21.15.72:0/2834459797 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556eef29cbd0 0x556eef39e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.187+0000 7f9d67fff640 1 -- 172.21.15.72:0/2834459797 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556eef1a4c50 con 0x556eef27ed50 2024-05-09T05:54:17.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.187+0000 7f9d6cd63640 1 --2- 172.21.15.72:0/2834459797 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556eef29cbd0 0x556eef39e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:54:17.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.187+0000 7f9d677fe640 1 --2- 172.21.15.72:0/2834459797 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x556eef295180 0x556eef3e91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:54:17.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.187+0000 7f9d67fff640 1 --2- 172.21.15.72:0/2834459797 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556eef27ed50 0x556eef3e8c60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9d5800ffd0 tx=0x7f9d58004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1a33ea2624005e0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:17.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.187+0000 7f9d46ffd640 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-09T05:54:17.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.187+0000 7f9d46ffd640 1 -- 172.21.15.72:0/2834459797 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d58015820 con 0x556eef27ed50 2024-05-09T05:54:17.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.187+0000 7f9d46ffd640 1 -- 172.21.15.72:0/2834459797 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f9d580159c0 con 0x556eef27ed50 2024-05-09T05:54:17.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.187+0000 7f9d75b24000 1 -- 172.21.15.72:0/2834459797 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d5c00cb40 con 0x556eef27ed50 2024-05-09T05:54:17.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.187+0000 7f9d46ffd640 1 -- 172.21.15.72:0/2834459797 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f9d5802e050 con 0x556eef27ed50 2024-05-09T05:54:17.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.187+0000 7f9d75b24000 10 client.4773 fetch_fsmap learned FSMap version 19 2024-05-09T05:54:17.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.187+0000 7f9d75b24000 1 -- 172.21.15.72:0/2834459797 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x556eef1a2650 con 0x556eef27ed50 2024-05-09T05:54:17.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.187+0000 7f9d46ffd640 1 -- 172.21.15.72:0/2834459797 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d5c00cb40 con 0x556eef27ed50 2024-05-09T05:54:17.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.187+0000 7f9d46ffd640 1 -- 172.21.15.72:0/2834459797 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7f9d58031020 con 0x556eef27ed50 2024-05-09T05:54:17.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.187+0000 7f9d75b24000 10 client.4773 fetch_fsmap finished waiting for FSMap version 19 2024-05-09T05:54:17.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.187+0000 7f9d75b24000 10 client.4773 resolve_mds: resolved name 'd' to daemon mds.d 2024-05-09T05:54:17.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.187+0000 7f9d75b24000 20 client.4773 populate_metadata read hostname 'smithi072' 2024-05-09T05:54:17.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.187+0000 7f9d75b24000 1 --2- 172.21.15.72:0/2834459797 >> [v2:172.21.15.110:6837/966325499,v1:172.21.15.110:6839/966325499] conn(0x556eeee8f7d0 0x556eef39f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:17.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.187+0000 7f9d75b24000 4 client.4773 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T05:54:17.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.187+0000 7f9d75b24000 1 -- 172.21.15.72:0/2834459797 --> [v2:172.21.15.110:6837/966325499,v1:172.21.15.110:6839/966325499] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556eef184620 con 0x556eeee8f7d0 2024-05-09T05:54:17.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.187+0000 7f9d677fe640 1 --2- 172.21.15.72:0/2834459797 >> [v2:172.21.15.110:6837/966325499,v1:172.21.15.110:6839/966325499] conn(0x556eeee8f7d0 0x556eef39f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:17.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.187+0000 7f9d46ffd640 10 client.4773 ms_handle_connect on v2:172.21.15.110:6837/966325499 2024-05-09T05:54:17.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.187+0000 7f9d677fe640 1 --2- 172.21.15.72:0/2834459797 >> [v2:172.21.15.110:6837/966325499,v1:172.21.15.110:6839/966325499] conn(0x556eeee8f7d0 0x556eef39f330 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e518a578d5d03b76 server_cookie=1aeb0d4f8fc1e4be in_seq=0 out_seq=0 2024-05-09T05:54:17.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.191+0000 7f9d46ffd640 1 -- 172.21.15.72:0/2834459797 <== mds.1 v2:172.21.15.110:6837/966325499 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x556eef184620 con 0x556eeee8f7d0 2024-05-09T05:54:17.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.191+0000 7f9d46ffd640 10 client.4773 handle_command_reply: tid=0 2024-05-09T05:54:17.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.191+0000 7f9d75b24000 1 client.4773 shutdown 2024-05-09T05:54:17.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.191+0000 7f9d75b24000 1 -- 172.21.15.72:0/2834459797 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556eef27ed50 msgr2=0x556eef3e8c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:17.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.191+0000 7f9d75b24000 1 --2- 172.21.15.72:0/2834459797 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556eef27ed50 0x556eef3e8c60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9d5800ffd0 tx=0x7f9d58004740 comp rx=0 tx=0).stop 2024-05-09T05:54:17.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.191+0000 7f9d75b24000 1 -- 172.21.15.72:0/2834459797 shutdown_connections 2024-05-09T05:54:17.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.191+0000 7f9d75b24000 1 --2- 172.21.15.72:0/2834459797 >> [v2:172.21.15.110:6837/966325499,v1:172.21.15.110:6839/966325499] conn(0x556eeee8f7d0 0x556eef39f330 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.191+0000 7f9d75b24000 1 --2- 172.21.15.72:0/2834459797 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556eef29cbd0 0x556eef39e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.191+0000 7f9d75b24000 1 --2- 172.21.15.72:0/2834459797 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x556eef295180 0x556eef3e91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.191+0000 7f9d75b24000 1 --2- 172.21.15.72:0/2834459797 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556eef27ed50 0x556eef3e8c60 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.191+0000 7f9d46ffd640 0 client.4773 ms_handle_reset on v2:172.21.15.110:6837/966325499 2024-05-09T05:54:17.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.191+0000 7f9d75b24000 1 -- 172.21.15.72:0/2834459797 >> 172.21.15.72:0/2834459797 conn(0x556eeeea9730 msgr2=0x556eef3dab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:17.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.191+0000 7f9d75b24000 1 -- 172.21.15.72:0/2834459797 shutdown_connections 2024-05-09T05:54:17.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.191+0000 7f9d75b24000 1 -- 172.21.15.72:0/2834459797 wait complete. 2024-05-09T05:54:17.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.191+0000 7f9d75b24000 20 client.4773 trim_cache size 0 max 16384 2024-05-09T05:54:17.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.207+0000 7f9d75b24000 1 Processor -- start 2024-05-09T05:54:17.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.207+0000 7f9d75b24000 1 -- start start 2024-05-09T05:54:17.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.207+0000 7f9d75b24000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556eef27ed50 0x556eef3a21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:17.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.207+0000 7f9d75b24000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556eef295180 0x556eef3a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:17.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.207+0000 7f9d75b24000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x556eef29cbd0 0x556eef3a1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:17.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.207+0000 7f9d75b24000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f9d681fc6a0 con 0x556eef295180 2024-05-09T05:54:17.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.207+0000 7f9d75b24000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f9d681f2a40 con 0x556eef27ed50 2024-05-09T05:54:17.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.207+0000 7f9d75b24000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x556eef3d8740 con 0x556eef29cbd0 2024-05-09T05:54:17.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.207+0000 7f9d677fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556eef295180 0x556eef3a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:17.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.207+0000 7f9d677fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556eef295180 0x556eef3a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46164/0 (socket says 172.21.15.72:46164) 2024-05-09T05:54:17.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.207+0000 7f9d677fe640 1 -- 172.21.15.72:0/3923396029 learned_addr learned my addr 172.21.15.72:0/3923396029 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:54:17.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.207+0000 7f9d677fe640 1 -- 172.21.15.72:0/3923396029 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x556eef29cbd0 msgr2=0x556eef3a1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:17.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.207+0000 7f9d677fe640 1 --2- 172.21.15.72:0/3923396029 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x556eef29cbd0 0x556eef3a1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.207+0000 7f9d677fe640 1 -- 172.21.15.72:0/3923396029 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556eef27ed50 msgr2=0x556eef3a21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:17.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.207+0000 7f9d677fe640 1 --2- 172.21.15.72:0/3923396029 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556eef27ed50 0x556eef3a21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.207+0000 7f9d677fe640 1 -- 172.21.15.72:0/3923396029 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556eef26d0e0 con 0x556eef295180 2024-05-09T05:54:17.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.207+0000 7f9d677fe640 1 --2- 172.21.15.72:0/3923396029 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556eef295180 0x556eef3a1340 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c014000 tx=0x7f9d5c011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=534c3f5d187843ec server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:17.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.211+0000 7f9d4d7fa640 1 -- 172.21.15.72:0/3923396029 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c015040 con 0x556eef295180 2024-05-09T05:54:17.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.211+0000 7f9d4d7fa640 1 -- 172.21.15.72:0/3923396029 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d5c00cb40 con 0x556eef295180 2024-05-09T05:54:17.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.211+0000 7f9d4d7fa640 1 -- 172.21.15.72:0/3923396029 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c004260 con 0x556eef295180 2024-05-09T05:54:17.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.211+0000 7f9d75b24000 1 -- 172.21.15.72:0/3923396029 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556eef295180 msgr2=0x556eef3a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:17.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.211+0000 7f9d75b24000 1 --2- 172.21.15.72:0/3923396029 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556eef295180 0x556eef3a1340 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c014000 tx=0x7f9d5c011000 comp rx=0 tx=0).stop 2024-05-09T05:54:17.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.211+0000 7f9d75b24000 1 -- 172.21.15.72:0/3923396029 shutdown_connections 2024-05-09T05:54:17.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.211+0000 7f9d75b24000 1 --2- 172.21.15.72:0/3923396029 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x556eef29cbd0 0x556eef3a1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.211+0000 7f9d75b24000 1 --2- 172.21.15.72:0/3923396029 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556eef295180 0x556eef3a1340 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.211+0000 7f9d75b24000 1 --2- 172.21.15.72:0/3923396029 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556eef27ed50 0x556eef3a21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.211+0000 7f9d75b24000 1 -- 172.21.15.72:0/3923396029 >> 172.21.15.72:0/3923396029 conn(0x556eeeea9730 msgr2=0x556eef3ef400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:17.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.211+0000 7f9d75b24000 1 -- 172.21.15.72:0/3923396029 shutdown_connections 2024-05-09T05:54:17.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.211+0000 7f9d75b24000 1 -- 172.21.15.72:0/3923396029 wait complete. 2024-05-09T05:54:17.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.211+0000 7f9d75b24000 1 -- start start 2024-05-09T05:54:17.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.211+0000 7f9d75b24000 1 Processor -- start 2024-05-09T05:54:17.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.211+0000 7f9d75b24000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x556eef27ed50 0x556eef45d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:17.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.211+0000 7f9d75b24000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556eef29cbd0 0x556eef45de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:17.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.211+0000 7f9d75b24000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556eeee7d830 0x556eef3ebfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:17.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.211+0000 7f9d75b24000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x556eef1eabd0 con 0x556eeee7d830 2024-05-09T05:54:17.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.211+0000 7f9d75b24000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x556eef2a6f80 con 0x556eef29cbd0 2024-05-09T05:54:17.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.211+0000 7f9d75b24000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x556eef1f8cc0 con 0x556eef27ed50 2024-05-09T05:54:17.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.211+0000 7f9d75b24000 10 client.0 _ll_register_callbacks cb 0x7f9d5800bf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T05:54:17.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.211+0000 7f9d6cd63640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556eeee7d830 0x556eef3ebfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:17.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.211+0000 7f9d6cd63640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556eeee7d830 0x556eef3ebfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46174/0 (socket says 172.21.15.72:46174) 2024-05-09T05:54:17.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.211+0000 7f9d6cd63640 1 -- 172.21.15.72:0/3320903825 learned_addr learned my addr 172.21.15.72:0/3320903825 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:54:17.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.211+0000 7f9d677fe640 1 --2- 172.21.15.72:0/3320903825 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556eef29cbd0 0x556eef45de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:17.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.211+0000 7f9d67fff640 1 --2- 172.21.15.72:0/3320903825 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x556eef27ed50 0x556eef45d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:17.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.211+0000 7f9d6cd63640 1 -- 172.21.15.72:0/3320903825 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x556eef27ed50 msgr2=0x556eef45d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:17.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.211+0000 7f9d6cd63640 1 --2- 172.21.15.72:0/3320903825 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x556eef27ed50 0x556eef45d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.211+0000 7f9d6cd63640 1 -- 172.21.15.72:0/3320903825 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556eef29cbd0 msgr2=0x556eef45de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:17.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.211+0000 7f9d6cd63640 1 --2- 172.21.15.72:0/3320903825 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556eef29cbd0 0x556eef45de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.211+0000 7f9d6cd63640 1 -- 172.21.15.72:0/3320903825 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556eef243f90 con 0x556eeee7d830 2024-05-09T05:54:17.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.211+0000 7f9d67fff640 1 --2- 172.21.15.72:0/3320903825 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x556eef27ed50 0x556eef45d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:54:17.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.211+0000 7f9d6cd63640 1 --2- 172.21.15.72:0/3320903825 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556eeee7d830 0x556eef3ebfe0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9d6000d210 tx=0x7f9d600fae10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9ce618eb196da0f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:17.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.211+0000 7f9d46ffd640 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-09T05:54:17.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.211+0000 7f9d46ffd640 1 -- 172.21.15.72:0/3320903825 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d600fbce0 con 0x556eeee7d830 2024-05-09T05:54:17.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.211+0000 7f9d46ffd640 1 -- 172.21.15.72:0/3320903825 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f9d60104130 con 0x556eeee7d830 2024-05-09T05:54:17.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.211+0000 7f9d75b24000 1 -- 172.21.15.72:0/3320903825 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d5c00cb40 con 0x556eeee7d830 2024-05-09T05:54:17.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.215+0000 7f9d46ffd640 1 -- 172.21.15.72:0/3320903825 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f9d600fb5e0 con 0x556eeee7d830 2024-05-09T05:54:17.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.215+0000 7f9d75b24000 10 client.4779 fetch_fsmap learned FSMap version 19 2024-05-09T05:54:17.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.215+0000 7f9d75b24000 1 -- 172.21.15.72:0/3320903825 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x556eef18ff30 con 0x556eeee7d830 2024-05-09T05:54:17.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.215+0000 7f9d46ffd640 1 -- 172.21.15.72:0/3320903825 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d5c00cb40 con 0x556eeee7d830 2024-05-09T05:54:17.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.215+0000 7f9d46ffd640 1 -- 172.21.15.72:0/3320903825 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7f9d600b9030 con 0x556eeee7d830 2024-05-09T05:54:17.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.215+0000 7f9d75b24000 10 client.4779 fetch_fsmap finished waiting for FSMap version 19 2024-05-09T05:54:17.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.215+0000 7f9d75b24000 10 client.4779 resolve_mds: resolved name 'd' to daemon mds.d 2024-05-09T05:54:17.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.215+0000 7f9d75b24000 20 client.4779 populate_metadata read hostname 'smithi072' 2024-05-09T05:54:17.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.215+0000 7f9d75b24000 1 --2- 172.21.15.72:0/3320903825 >> [v2:172.21.15.110:6837/966325499,v1:172.21.15.110:6839/966325499] conn(0x556eef3ec910 0x556eef3ecd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:17.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.215+0000 7f9d75b24000 4 client.4779 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-09T05:54:17.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.215+0000 7f9d75b24000 1 -- 172.21.15.72:0/3320903825 --> [v2:172.21.15.110:6837/966325499,v1:172.21.15.110:6839/966325499] -- command(tid 0: {"prefix": "status"}) -- 0x556eef1f94d0 con 0x556eef3ec910 2024-05-09T05:54:17.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.215+0000 7f9d67fff640 1 --2- 172.21.15.72:0/3320903825 >> [v2:172.21.15.110:6837/966325499,v1:172.21.15.110:6839/966325499] conn(0x556eef3ec910 0x556eef3ecd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:17.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.215+0000 7f9d46ffd640 10 client.4779 ms_handle_connect on v2:172.21.15.110:6837/966325499 2024-05-09T05:54:17.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.215+0000 7f9d67fff640 1 --2- 172.21.15.72:0/3320903825 >> [v2:172.21.15.110:6837/966325499,v1:172.21.15.110:6839/966325499] conn(0x556eef3ec910 0x556eef3ecd20 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=40b6cf6240f8614e server_cookie=c8846445b59abcf in_seq=0 out_seq=0 2024-05-09T05:54:17.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.215+0000 7f9d46ffd640 1 -- 172.21.15.72:0/3320903825 <== mds.1 v2:172.21.15.110:6837/966325499 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x556eef1f94d0 con 0x556eef3ec910 2024-05-09T05:54:17.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.215+0000 7f9d46ffd640 10 client.4779 handle_command_reply: tid=0 2024-05-09T05:54:17.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.215+0000 7f9d75b24000 1 client.4779 shutdown 2024-05-09T05:54:17.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.215+0000 7f9d75b24000 1 -- 172.21.15.72:0/3320903825 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556eeee7d830 msgr2=0x556eef3ebfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:17.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.215+0000 7f9d75b24000 1 --2- 172.21.15.72:0/3320903825 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556eeee7d830 0x556eef3ebfe0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9d6000d210 tx=0x7f9d600fae10 comp rx=0 tx=0).stop 2024-05-09T05:54:17.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.215+0000 7f9d75b24000 1 -- 172.21.15.72:0/3320903825 shutdown_connections 2024-05-09T05:54:17.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.215+0000 7f9d75b24000 1 --2- 172.21.15.72:0/3320903825 >> [v2:172.21.15.110:6837/966325499,v1:172.21.15.110:6839/966325499] conn(0x556eef3ec910 0x556eef3ecd20 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.215+0000 7f9d75b24000 1 --2- 172.21.15.72:0/3320903825 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556eeee7d830 0x556eef3ebfe0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.215+0000 7f9d75b24000 1 --2- 172.21.15.72:0/3320903825 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556eef29cbd0 0x556eef45de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.215+0000 7f9d46ffd640 0 client.4779 ms_handle_reset on v2:172.21.15.110:6837/966325499 2024-05-09T05:54:17.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.215+0000 7f9d75b24000 1 --2- 172.21.15.72:0/3320903825 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x556eef27ed50 0x556eef45d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.215+0000 7f9d75b24000 1 -- 172.21.15.72:0/3320903825 >> 172.21.15.72:0/3320903825 conn(0x556eeeea9730 msgr2=0x556eef3a1340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:17.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.215+0000 7f9d75b24000 1 -- 172.21.15.72:0/3320903825 shutdown_connections 2024-05-09T05:54:17.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.215+0000 7f9d75b24000 1 -- 172.21.15.72:0/3320903825 wait complete. 2024-05-09T05:54:17.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.215+0000 7f9d75b24000 20 client.4779 trim_cache size 0 max 16384 2024-05-09T05:54:17.211 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-05-09T05:54:17.211 INFO:teuthology.orchestra.run.smithi072.stdout: "cluster_fsid": "44c88cb9-b39b-4787-a871-80ddf0ad6292", 2024-05-09T05:54:17.211 INFO:teuthology.orchestra.run.smithi072.stdout: "whoami": 1, 2024-05-09T05:54:17.211 INFO:teuthology.orchestra.run.smithi072.stdout: "id": 4287, 2024-05-09T05:54:17.211 INFO:teuthology.orchestra.run.smithi072.stdout: "want_state": "up:active", 2024-05-09T05:54:17.211 INFO:teuthology.orchestra.run.smithi072.stdout: "state": "up:active", 2024-05-09T05:54:17.211 INFO:teuthology.orchestra.run.smithi072.stdout: "fs_name": "cephfs", 2024-05-09T05:54:17.211 INFO:teuthology.orchestra.run.smithi072.stdout: "rank_uptime": 28.621040022999999, 2024-05-09T05:54:17.211 INFO:teuthology.orchestra.run.smithi072.stdout: "mdsmap_epoch": 19, 2024-05-09T05:54:17.212 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch": 27, 2024-05-09T05:54:17.212 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch_barrier": 27, 2024-05-09T05:54:17.212 INFO:teuthology.orchestra.run.smithi072.stdout: "uptime": 58.938981847000001 2024-05-09T05:54:17.212 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-05-09T05:54:17.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.215+0000 7f9d6e7c6640 1 -- 172.21.15.72:0/2251503795 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f9d5406f430 msgr2=0x7f9d54071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:17.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.215+0000 7f9d6e7c6640 1 --2- 172.21.15.72:0/2251503795 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f9d5406f430 0x7f9d54071940 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9d5800b930 tx=0x7f9d58008040 comp rx=0 tx=0).stop 2024-05-09T05:54:17.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.215+0000 7f9d6e7c6640 1 -- 172.21.15.72:0/2251503795 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d68159ed0 msgr2=0x7f9d68159540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:17.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.215+0000 7f9d6e7c6640 1 --2- 172.21.15.72:0/2251503795 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d68159ed0 0x7f9d68159540 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9d600b4040 tx=0x7f9d6001e180 comp rx=0 tx=0).stop 2024-05-09T05:54:17.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.215+0000 7f9d6e7c6640 1 -- 172.21.15.72:0/2251503795 shutdown_connections 2024-05-09T05:54:17.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.215+0000 7f9d6e7c6640 1 --2- 172.21.15.72:0/2251503795 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f9d5406f430 0x7f9d54071940 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.215+0000 7f9d6e7c6640 1 --2- 172.21.15.72:0/2251503795 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d68159ed0 0x7f9d68159540 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.215+0000 7f9d6e7c6640 1 --2- 172.21.15.72:0/2251503795 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d680c73e0 0x7f9d6815ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.215+0000 7f9d6e7c6640 1 --2- 172.21.15.72:0/2251503795 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d68072f40 0x7f9d681eeb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.215+0000 7f9d6e7c6640 1 -- 172.21.15.72:0/2251503795 >> 172.21.15.72:0/2251503795 conn(0x7f9d680cde90 msgr2=0x7f9d680cbca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:17.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.215+0000 7f9d6e7c6640 1 -- 172.21.15.72:0/2251503795 shutdown_connections 2024-05-09T05:54:17.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.215+0000 7f9d6e7c6640 1 -- 172.21.15.72:0/2251503795 wait complete. 2024-05-09T05:54:17.224 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-09T05:54:17.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.375+0000 7f86aecee640 1 Processor -- start 2024-05-09T05:54:17.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.375+0000 7f86aecee640 1 -- start start 2024-05-09T05:54:17.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.375+0000 7f86aecee640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f86a8156b50 0x7f86a8073ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:17.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.375+0000 7f86aecee640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86a8074410 0x7f86a80cc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:17.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.375+0000 7f86aecee640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86a80cda30 con 0x7f86a80cca30 2024-05-09T05:54:17.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.375+0000 7f86aecee640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f86a80cc020 con 0x7f86a8156b50 2024-05-09T05:54:17.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.375+0000 7f86aecee640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f86a815dfe0 con 0x7f86a8074410 2024-05-09T05:54:17.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.375+0000 7f86a7fff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86a8074410 0x7f86a80cc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:17.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.375+0000 7f86aca8a640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f86a8156b50 0x7f86a8073ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:17.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.375+0000 7f86a7fff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86a8074410 0x7f86a80cc4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.72:45510/0 (socket says 172.21.15.72:45510) 2024-05-09T05:54:17.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.375+0000 7f86a7fff640 1 -- 172.21.15.72:0/161931718 learned_addr learned my addr 172.21.15.72:0/161931718 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:54:17.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.375+0000 7f86ad28b640 1 --1- 172.21.15.72:0/161931718 >> v1:172.21.15.110:6789/0 conn(0x7f86a80cca30 0x7f86a80cce40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.72:53510/0 (socket says 172.21.15.72:53510) 2024-05-09T05:54:17.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.379+0000 7f86a7fff640 1 -- 172.21.15.72:0/161931718 >> v2:172.21.15.110:3300/0 conn(0x7f86a8156b50 msgr2=0x7f86a8073ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:17.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.379+0000 7f86a7fff640 1 --2- 172.21.15.72:0/161931718 >> v2:172.21.15.110:3300/0 conn(0x7f86a8156b50 0x7f86a8073ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.379+0000 7f86a7fff640 1 -- 172.21.15.72:0/161931718 >> v1:172.21.15.110:6789/0 conn(0x7f86a80cca30 legacy=0x7f86a80cce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:17.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.379+0000 7f86a7fff640 1 -- 172.21.15.72:0/161931718 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86a815cdd0 con 0x7f86a8074410 2024-05-09T05:54:17.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.379+0000 7f86aca8a640 1 --2- 172.21.15.72:0/161931718 >> v2:172.21.15.110:3300/0 conn(0x7f86a8156b50 0x7f86a8073ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T05:54:17.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.379+0000 7f86a7fff640 1 --2- 172.21.15.72:0/161931718 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86a8074410 0x7f86a80cc4f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f869c009870 tx=0x7f869c01c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1c1d18f704845a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:17.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.379+0000 7f86a77fe640 1 -- 172.21.15.72:0/161931718 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f869c0b2070 con 0x7f86a8074410 2024-05-09T05:54:17.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.379+0000 7f86a77fe640 1 -- 172.21.15.72:0/161931718 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f869c0a9070 con 0x7f86a8074410 2024-05-09T05:54:17.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.379+0000 7f86a77fe640 1 -- 172.21.15.72:0/161931718 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f869c0ad880 con 0x7f86a8074410 2024-05-09T05:54:17.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.379+0000 7f86aecee640 1 -- 172.21.15.72:0/161931718 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86a8074410 msgr2=0x7f86a80cc4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:17.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.379+0000 7f86aecee640 1 --2- 172.21.15.72:0/161931718 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86a8074410 0x7f86a80cc4f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f869c009870 tx=0x7f869c01c560 comp rx=0 tx=0).stop 2024-05-09T05:54:17.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.379+0000 7f86aecee640 1 -- 172.21.15.72:0/161931718 shutdown_connections 2024-05-09T05:54:17.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.379+0000 7f86aecee640 1 --2- 172.21.15.72:0/161931718 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86a8074410 0x7f86a80cc4f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.379+0000 7f86aecee640 1 --2- 172.21.15.72:0/161931718 >> v2:172.21.15.110:3300/0 conn(0x7f86a8156b50 0x7f86a8073ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.379+0000 7f86aecee640 1 -- 172.21.15.72:0/161931718 >> 172.21.15.72:0/161931718 conn(0x7f86a80d1b70 msgr2=0x7f86a80d1f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:17.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.379+0000 7f86aecee640 1 -- 172.21.15.72:0/161931718 shutdown_connections 2024-05-09T05:54:17.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.379+0000 7f86aecee640 1 -- 172.21.15.72:0/161931718 wait complete. 2024-05-09T05:54:17.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.383+0000 7f86aecee640 1 Processor -- start 2024-05-09T05:54:17.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.383+0000 7f86aecee640 1 -- start start 2024-05-09T05:54:17.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.383+0000 7f86aecee640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86a8074410 0x7f86a81f6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:17.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.383+0000 7f86aecee640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86a80cca30 0x7f86a815b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:17.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.383+0000 7f86aecee640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86a8156b50 0x7f86a814ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:17.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.383+0000 7f86aecee640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f86a8074cf0 con 0x7f86a8156b50 2024-05-09T05:54:17.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.383+0000 7f86aecee640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f86a815d950 con 0x7f86a8074410 2024-05-09T05:54:17.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.383+0000 7f86aecee640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f86a80cd550 con 0x7f86a80cca30 2024-05-09T05:54:17.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.383+0000 7f86ad28b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86a8156b50 0x7f86a814ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:17.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.383+0000 7f86ad28b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86a8156b50 0x7f86a814ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46180/0 (socket says 172.21.15.72:46180) 2024-05-09T05:54:17.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.383+0000 7f86ad28b640 1 -- 172.21.15.72:0/375720850 learned_addr learned my addr 172.21.15.72:0/375720850 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:54:17.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.383+0000 7f86aca8a640 1 --2- 172.21.15.72:0/375720850 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86a8074410 0x7f86a81f6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:17.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.383+0000 7f86a7fff640 1 --2- 172.21.15.72:0/375720850 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86a80cca30 0x7f86a815b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:17.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.383+0000 7f86ad28b640 1 -- 172.21.15.72:0/375720850 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86a80cca30 msgr2=0x7f86a815b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:17.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.383+0000 7f86ad28b640 1 --2- 172.21.15.72:0/375720850 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86a80cca30 0x7f86a815b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.383+0000 7f86ad28b640 1 -- 172.21.15.72:0/375720850 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86a8074410 msgr2=0x7f86a81f6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:17.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.383+0000 7f86ad28b640 1 --2- 172.21.15.72:0/375720850 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86a8074410 0x7f86a81f6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.383+0000 7f86ad28b640 1 -- 172.21.15.72:0/375720850 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86a8157ea0 con 0x7f86a8156b50 2024-05-09T05:54:17.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.383+0000 7f86aca8a640 1 --2- 172.21.15.72:0/375720850 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86a8074410 0x7f86a81f6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:54:17.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.383+0000 7f86ad28b640 1 --2- 172.21.15.72:0/375720850 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86a8156b50 0x7f86a814ed30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f86a000c730 tx=0x7f86a000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:17.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.383+0000 7f86a57fa640 1 -- 172.21.15.72:0/375720850 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a0017070 con 0x7f86a8156b50 2024-05-09T05:54:17.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.383+0000 7f86a57fa640 1 -- 172.21.15.72:0/375720850 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86a000ce40 con 0x7f86a8156b50 2024-05-09T05:54:17.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.383+0000 7f86a57fa640 1 -- 172.21.15.72:0/375720850 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a000a860 con 0x7f86a8156b50 2024-05-09T05:54:17.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.387+0000 7f86aecee640 1 -- 172.21.15.72:0/375720850 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86a81ef020 con 0x7f86a8156b50 2024-05-09T05:54:17.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.387+0000 7f86aecee640 1 -- 172.21.15.72:0/375720850 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86a81ef5e0 con 0x7f86a8156b50 2024-05-09T05:54:17.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.387+0000 7f86a57fa640 1 -- 172.21.15.72:0/375720850 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f86a001a070 con 0x7f86a8156b50 2024-05-09T05:54:17.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.387+0000 7f86a57fa640 1 --2- 172.21.15.72:0/375720850 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f869406f430 0x7f8694071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:17.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.387+0000 7f86a57fa640 1 -- 172.21.15.72:0/375720850 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f86a008ec00 con 0x7f86a8156b50 2024-05-09T05:54:17.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.387+0000 7f86aca8a640 1 --2- 172.21.15.72:0/375720850 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f869406f430 0x7f8694071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:17.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.387+0000 7f86b604c000 1 Processor -- start 2024-05-09T05:54:17.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.387+0000 7f86b604c000 1 -- start start 2024-05-09T05:54:17.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.387+0000 7f86aca8a640 1 --2- 172.21.15.72:0/375720850 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f869406f430 0x7f8694071940 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8698009b10 tx=0x7f8698008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:17.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.391+0000 7f86b604c000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d2da085bd0 0x55d2da1c6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:17.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.391+0000 7f86b604c000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d2da07e180 0x55d2da1c70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:17.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.391+0000 7f86b604c000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55d2da067d50 0x55d2da1c7630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:17.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.391+0000 7f86b604c000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55d2da06ccc0 con 0x55d2da07e180 2024-05-09T05:54:17.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.391+0000 7f86b604c000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55d2d9f87370 con 0x55d2da085bd0 2024-05-09T05:54:17.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.391+0000 7f86b604c000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x55d2d9fd48c0 con 0x55d2da067d50 2024-05-09T05:54:17.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.391+0000 7f86a7fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d2da07e180 0x55d2da1c70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:17.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.391+0000 7f86a7fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d2da07e180 0x55d2da1c70f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46188/0 (socket says 172.21.15.72:46188) 2024-05-09T05:54:17.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.391+0000 7f86a7fff640 1 -- 172.21.15.72:0/3164223967 learned_addr learned my addr 172.21.15.72:0/3164223967 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:54:17.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.391+0000 7f86aca8a640 1 --2- 172.21.15.72:0/3164223967 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d2da085bd0 0x55d2da1c6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:17.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.391+0000 7f86ad28b640 1 --2- 172.21.15.72:0/3164223967 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55d2da067d50 0x55d2da1c7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:17.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.391+0000 7f86a7fff640 1 -- 172.21.15.72:0/3164223967 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55d2da067d50 msgr2=0x55d2da1c7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:17.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.391+0000 7f86a7fff640 1 --2- 172.21.15.72:0/3164223967 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55d2da067d50 0x55d2da1c7630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.391+0000 7f86a7fff640 1 -- 172.21.15.72:0/3164223967 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d2da085bd0 msgr2=0x55d2da1c6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:17.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.391+0000 7f86a7fff640 1 --2- 172.21.15.72:0/3164223967 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d2da085bd0 0x55d2da1c6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.391+0000 7f86a7fff640 1 -- 172.21.15.72:0/3164223967 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2d9f95ef0 con 0x55d2da07e180 2024-05-09T05:54:17.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.391+0000 7f86a7fff640 1 --2- 172.21.15.72:0/3164223967 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d2da07e180 0x55d2da1c70f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f869c01a190 tx=0x7f869c0a7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b26e5ab38c52d69a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:17.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.391+0000 7f868e7fc640 1 -- 172.21.15.72:0/3164223967 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f869c0b2040 con 0x55d2da07e180 2024-05-09T05:54:17.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.391+0000 7f868e7fc640 1 -- 172.21.15.72:0/3164223967 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f869c0ad810 con 0x55d2da07e180 2024-05-09T05:54:17.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.391+0000 7f868e7fc640 1 -- 172.21.15.72:0/3164223967 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f869c0adbc0 con 0x55d2da07e180 2024-05-09T05:54:17.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.391+0000 7f86b604c000 1 -- 172.21.15.72:0/3164223967 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d2da07e180 msgr2=0x55d2da1c70f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:17.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.391+0000 7f86b604c000 1 --2- 172.21.15.72:0/3164223967 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d2da07e180 0x55d2da1c70f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f869c01a190 tx=0x7f869c0a7000 comp rx=0 tx=0).stop 2024-05-09T05:54:17.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.391+0000 7f86b604c000 1 -- 172.21.15.72:0/3164223967 shutdown_connections 2024-05-09T05:54:17.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.391+0000 7f86b604c000 1 --2- 172.21.15.72:0/3164223967 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55d2da067d50 0x55d2da1c7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.391+0000 7f86b604c000 1 --2- 172.21.15.72:0/3164223967 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d2da07e180 0x55d2da1c70f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.391+0000 7f86b604c000 1 --2- 172.21.15.72:0/3164223967 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d2da085bd0 0x55d2da1c6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.391+0000 7f86b604c000 1 -- 172.21.15.72:0/3164223967 >> 172.21.15.72:0/3164223967 conn(0x55d2d9c92730 msgr2=0x55d2da1c4970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:17.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.391+0000 7f86b604c000 1 -- 172.21.15.72:0/3164223967 shutdown_connections 2024-05-09T05:54:17.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.391+0000 7f86b604c000 1 -- 172.21.15.72:0/3164223967 wait complete. 2024-05-09T05:54:17.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.391+0000 7f86b604c000 1 -- start start 2024-05-09T05:54:17.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.391+0000 7f86b604c000 1 Processor -- start 2024-05-09T05:54:17.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.395+0000 7f86b604c000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d2da067d50 0x55d2da1d1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:17.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.395+0000 7f86b604c000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55d2da07e180 0x55d2da1d2380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:17.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.395+0000 7f86b604c000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d2da085bd0 0x55d2da187930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:17.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.395+0000 7f86b604c000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55d2d9fd0880 con 0x55d2da085bd0 2024-05-09T05:54:17.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.395+0000 7f86b604c000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55d2d9f8da00 con 0x55d2da067d50 2024-05-09T05:54:17.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.395+0000 7f86b604c000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x55d2d9f74910 con 0x55d2da07e180 2024-05-09T05:54:17.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.395+0000 7f86b604c000 10 client.0 _ll_register_callbacks cb 0x55d2da171100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T05:54:17.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.395+0000 7f86ad28b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d2da085bd0 0x55d2da187930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:17.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.395+0000 7f86ad28b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d2da085bd0 0x55d2da187930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46196/0 (socket says 172.21.15.72:46196) 2024-05-09T05:54:17.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.395+0000 7f86ad28b640 1 -- 172.21.15.72:0/1130065957 learned_addr learned my addr 172.21.15.72:0/1130065957 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:54:17.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.395+0000 7f86aca8a640 1 --2- 172.21.15.72:0/1130065957 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d2da067d50 0x55d2da1d1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:17.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.395+0000 7f86a7fff640 1 --2- 172.21.15.72:0/1130065957 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55d2da07e180 0x55d2da1d2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:17.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.395+0000 7f86ad28b640 1 -- 172.21.15.72:0/1130065957 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55d2da07e180 msgr2=0x55d2da1d2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:17.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.395+0000 7f86ad28b640 1 --2- 172.21.15.72:0/1130065957 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55d2da07e180 0x55d2da1d2380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.395+0000 7f86ad28b640 1 -- 172.21.15.72:0/1130065957 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d2da067d50 msgr2=0x55d2da1d1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:17.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.395+0000 7f86ad28b640 1 --2- 172.21.15.72:0/1130065957 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d2da067d50 0x55d2da1d1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.395+0000 7f86ad28b640 1 -- 172.21.15.72:0/1130065957 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2d9f8dc50 con 0x55d2da085bd0 2024-05-09T05:54:17.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.395+0000 7f86ad28b640 1 --2- 172.21.15.72:0/1130065957 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d2da085bd0 0x55d2da187930 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f86a008cdc0 tx=0x7f86a005ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a079878c93a1575 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:17.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.395+0000 7f86877fe640 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-09T05:54:17.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.395+0000 7f86877fe640 1 -- 172.21.15.72:0/1130065957 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a0074070 con 0x55d2da085bd0 2024-05-09T05:54:17.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.395+0000 7f86877fe640 1 -- 172.21.15.72:0/1130065957 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f86a0063c50 con 0x55d2da085bd0 2024-05-09T05:54:17.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.395+0000 7f86b604c000 1 -- 172.21.15.72:0/1130065957 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f869c0ad810 con 0x55d2da085bd0 2024-05-09T05:54:17.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.395+0000 7f86877fe640 1 -- 172.21.15.72:0/1130065957 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f86a005f430 con 0x55d2da085bd0 2024-05-09T05:54:17.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.395+0000 7f86b604c000 10 client.4788 fetch_fsmap learned FSMap version 19 2024-05-09T05:54:17.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.395+0000 7f86b604c000 1 -- 172.21.15.72:0/1130065957 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55d2d9f8b650 con 0x55d2da085bd0 2024-05-09T05:54:17.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.395+0000 7f86877fe640 1 -- 172.21.15.72:0/1130065957 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f869c0ad810 con 0x55d2da085bd0 2024-05-09T05:54:17.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.395+0000 7f86877fe640 1 -- 172.21.15.72:0/1130065957 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7f86a005a2e0 con 0x55d2da085bd0 2024-05-09T05:54:17.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.395+0000 7f86b604c000 10 client.4788 fetch_fsmap finished waiting for FSMap version 19 2024-05-09T05:54:17.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.395+0000 7f86b604c000 10 client.4788 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-09T05:54:17.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.395+0000 7f86b604c000 20 client.4788 populate_metadata read hostname 'smithi072' 2024-05-09T05:54:17.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.395+0000 7f86b604c000 1 --2- 172.21.15.72:0/1130065957 >> [v2:172.21.15.110:6834/4134424941,v1:172.21.15.110:6836/4134424941] conn(0x55d2d9c787d0 0x55d2da1886d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:17.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.395+0000 7f86b604c000 4 client.4788 mds_command: new command op to 4297 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T05:54:17.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.395+0000 7f86b604c000 1 -- 172.21.15.72:0/1130065957 --> [v2:172.21.15.110:6834/4134424941,v1:172.21.15.110:6836/4134424941] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d2d9f6d620 con 0x55d2d9c787d0 2024-05-09T05:54:17.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.395+0000 7f86aca8a640 1 --2- 172.21.15.72:0/1130065957 >> [v2:172.21.15.110:6834/4134424941,v1:172.21.15.110:6836/4134424941] conn(0x55d2d9c787d0 0x55d2da1886d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:17.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.395+0000 7f86877fe640 10 client.4788 ms_handle_connect on v2:172.21.15.110:6834/4134424941 2024-05-09T05:54:17.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.395+0000 7f86aca8a640 1 --2- 172.21.15.72:0/1130065957 >> [v2:172.21.15.110:6834/4134424941,v1:172.21.15.110:6836/4134424941] conn(0x55d2d9c787d0 0x55d2da1886d0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b069128842ddf71a server_cookie=fe6b91db16bf530f in_seq=0 out_seq=0 2024-05-09T05:54:17.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.399+0000 7f86877fe640 1 -- 172.21.15.72:0/1130065957 <== mds.0 v2:172.21.15.110:6834/4134424941 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55d2d9f6d620 con 0x55d2d9c787d0 2024-05-09T05:54:17.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.399+0000 7f86877fe640 10 client.4788 handle_command_reply: tid=0 2024-05-09T05:54:17.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.399+0000 7f86b604c000 1 client.4788 shutdown 2024-05-09T05:54:17.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.399+0000 7f86b604c000 1 -- 172.21.15.72:0/1130065957 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d2da085bd0 msgr2=0x55d2da187930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:17.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.399+0000 7f86b604c000 1 --2- 172.21.15.72:0/1130065957 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d2da085bd0 0x55d2da187930 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f86a008cdc0 tx=0x7f86a005ac50 comp rx=0 tx=0).stop 2024-05-09T05:54:17.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.399+0000 7f86b604c000 1 -- 172.21.15.72:0/1130065957 shutdown_connections 2024-05-09T05:54:17.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.399+0000 7f86b604c000 1 --2- 172.21.15.72:0/1130065957 >> [v2:172.21.15.110:6834/4134424941,v1:172.21.15.110:6836/4134424941] conn(0x55d2d9c787d0 0x55d2da1886d0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.399+0000 7f86b604c000 1 --2- 172.21.15.72:0/1130065957 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d2da085bd0 0x55d2da187930 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.399+0000 7f86877fe640 0 client.4788 ms_handle_reset on v2:172.21.15.110:6834/4134424941 2024-05-09T05:54:17.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.399+0000 7f86b604c000 1 --2- 172.21.15.72:0/1130065957 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55d2da07e180 0x55d2da1d2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.399+0000 7f86b604c000 1 --2- 172.21.15.72:0/1130065957 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d2da067d50 0x55d2da1d1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.399+0000 7f86b604c000 1 -- 172.21.15.72:0/1130065957 >> 172.21.15.72:0/1130065957 conn(0x55d2d9c92730 msgr2=0x55d2da1c3b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:17.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.399+0000 7f86b604c000 1 -- 172.21.15.72:0/1130065957 shutdown_connections 2024-05-09T05:54:17.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.399+0000 7f86b604c000 1 -- 172.21.15.72:0/1130065957 wait complete. 2024-05-09T05:54:17.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.399+0000 7f86b604c000 20 client.4788 trim_cache size 0 max 16384 2024-05-09T05:54:17.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.415+0000 7f86b604c000 1 Processor -- start 2024-05-09T05:54:17.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.415+0000 7f86b604c000 1 -- start start 2024-05-09T05:54:17.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.415+0000 7f86b604c000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d2da067d50 0x55d2da1864a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:17.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.415+0000 7f86b604c000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d2da07e180 0x55d2da1869e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:17.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.415+0000 7f86b604c000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55d2da085bd0 0x55d2da186f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:17.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.415+0000 7f86b604c000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f86a8203460 con 0x55d2da067d50 2024-05-09T05:54:17.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.415+0000 7f86b604c000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f86a8203b30 con 0x55d2da07e180 2024-05-09T05:54:17.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.415+0000 7f86b604c000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f86a8201d20 con 0x55d2da085bd0 2024-05-09T05:54:17.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.415+0000 7f86aca8a640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d2da067d50 0x55d2da1864a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:17.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.415+0000 7f86aca8a640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d2da067d50 0x55d2da1864a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46202/0 (socket says 172.21.15.72:46202) 2024-05-09T05:54:17.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.415+0000 7f86aca8a640 1 -- 172.21.15.72:0/4261832368 learned_addr learned my addr 172.21.15.72:0/4261832368 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:54:17.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.419+0000 7f86aca8a640 1 -- 172.21.15.72:0/4261832368 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55d2da085bd0 msgr2=0x55d2da186f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:17.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.419+0000 7f86aca8a640 1 --2- 172.21.15.72:0/4261832368 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55d2da085bd0 0x55d2da186f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.419+0000 7f86aca8a640 1 -- 172.21.15.72:0/4261832368 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d2da07e180 msgr2=0x55d2da1869e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:17.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.419+0000 7f86aca8a640 1 --2- 172.21.15.72:0/4261832368 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d2da07e180 0x55d2da1869e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.419+0000 7f86aca8a640 1 -- 172.21.15.72:0/4261832368 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2da0560e0 con 0x55d2da067d50 2024-05-09T05:54:17.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.419+0000 7f86aca8a640 1 --2- 172.21.15.72:0/4261832368 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d2da067d50 0x55d2da1864a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x55d2d9f9f860 tx=0x7f8698017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffcd913ea2c311bd server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:17.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.419+0000 7f868dffb640 1 -- 172.21.15.72:0/4261832368 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f869802a2c0 con 0x55d2da067d50 2024-05-09T05:54:17.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.419+0000 7f868dffb640 1 -- 172.21.15.72:0/4261832368 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f869802f070 con 0x55d2da067d50 2024-05-09T05:54:17.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.419+0000 7f868dffb640 1 -- 172.21.15.72:0/4261832368 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f869802a660 con 0x55d2da067d50 2024-05-09T05:54:17.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.419+0000 7f86b604c000 1 -- 172.21.15.72:0/4261832368 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d2da067d50 msgr2=0x55d2da1864a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:17.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.419+0000 7f86b604c000 1 --2- 172.21.15.72:0/4261832368 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d2da067d50 0x55d2da1864a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x55d2d9f9f860 tx=0x7f8698017000 comp rx=0 tx=0).stop 2024-05-09T05:54:17.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.419+0000 7f86b604c000 1 -- 172.21.15.72:0/4261832368 shutdown_connections 2024-05-09T05:54:17.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.419+0000 7f86b604c000 1 --2- 172.21.15.72:0/4261832368 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55d2da085bd0 0x55d2da186f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.419+0000 7f86b604c000 1 --2- 172.21.15.72:0/4261832368 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d2da07e180 0x55d2da1869e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.419+0000 7f86b604c000 1 --2- 172.21.15.72:0/4261832368 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d2da067d50 0x55d2da1864a0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.419+0000 7f86b604c000 1 -- 172.21.15.72:0/4261832368 >> 172.21.15.72:0/4261832368 conn(0x55d2d9c92730 msgr2=0x55d2da18b780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:17.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.419+0000 7f86b604c000 1 -- 172.21.15.72:0/4261832368 shutdown_connections 2024-05-09T05:54:17.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.419+0000 7f86b604c000 1 -- 172.21.15.72:0/4261832368 wait complete. 2024-05-09T05:54:17.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.419+0000 7f86b604c000 1 -- start start 2024-05-09T05:54:17.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.419+0000 7f86b604c000 1 Processor -- start 2024-05-09T05:54:17.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.419+0000 7f86b604c000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d2da067d50 0x55d2da1d7930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:17.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.419+0000 7f86b604c000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55d2da07e180 0x55d2da1fe960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:17.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.419+0000 7f86b604c000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d2da085bd0 0x55d2da1feea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:17.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.419+0000 7f86b604c000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55d2da055c50 con 0x55d2da085bd0 2024-05-09T05:54:17.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.419+0000 7f86b604c000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55d2d9f6ca00 con 0x55d2da067d50 2024-05-09T05:54:17.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.419+0000 7f86b604c000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x55d2d9fd8ef0 con 0x55d2da07e180 2024-05-09T05:54:17.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.419+0000 7f86b604c000 10 client.0 _ll_register_callbacks cb 0x7f86a0057750 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T05:54:17.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.419+0000 7f86ad28b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d2da085bd0 0x55d2da1feea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:17.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.419+0000 7f86ad28b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d2da085bd0 0x55d2da1feea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46204/0 (socket says 172.21.15.72:46204) 2024-05-09T05:54:17.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.419+0000 7f86ad28b640 1 -- 172.21.15.72:0/541601559 learned_addr learned my addr 172.21.15.72:0/541601559 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:54:17.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.419+0000 7f86aca8a640 1 --2- 172.21.15.72:0/541601559 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d2da067d50 0x55d2da1d7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:17.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.419+0000 7f86a7fff640 1 --2- 172.21.15.72:0/541601559 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55d2da07e180 0x55d2da1fe960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:17.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.423+0000 7f86ad28b640 1 -- 172.21.15.72:0/541601559 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55d2da07e180 msgr2=0x55d2da1fe960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:17.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.423+0000 7f86ad28b640 1 --2- 172.21.15.72:0/541601559 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55d2da07e180 0x55d2da1fe960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.423+0000 7f86ad28b640 1 -- 172.21.15.72:0/541601559 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d2da067d50 msgr2=0x55d2da1d7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:17.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.423+0000 7f86ad28b640 1 --2- 172.21.15.72:0/541601559 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d2da067d50 0x55d2da1d7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.423+0000 7f86ad28b640 1 -- 172.21.15.72:0/541601559 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2da02cf90 con 0x55d2da085bd0 2024-05-09T05:54:17.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.423+0000 7f86aca8a640 1 --2- 172.21.15.72:0/541601559 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d2da067d50 0x55d2da1d7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:54:17.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.423+0000 7f86a7fff640 1 --2- 172.21.15.72:0/541601559 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55d2da07e180 0x55d2da1fe960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:54:17.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.423+0000 7f86ad28b640 1 --2- 172.21.15.72:0/541601559 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d2da085bd0 0x55d2da1feea0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f86a005f5f0 tx=0x7f86a0001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6485bdd5fecf1137 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:17.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.423+0000 7f86877fe640 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-05-09T05:54:17.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.423+0000 7f86877fe640 1 -- 172.21.15.72:0/541601559 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a0074040 con 0x55d2da085bd0 2024-05-09T05:54:17.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.423+0000 7f86877fe640 1 -- 172.21.15.72:0/541601559 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f86a00569f0 con 0x55d2da085bd0 2024-05-09T05:54:17.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.423+0000 7f86b604c000 1 -- 172.21.15.72:0/541601559 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f869802f070 con 0x55d2da085bd0 2024-05-09T05:54:17.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.423+0000 7f86877fe640 1 -- 172.21.15.72:0/541601559 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f86a0063ee0 con 0x55d2da085bd0 2024-05-09T05:54:17.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.423+0000 7f86b604c000 10 client.4794 fetch_fsmap learned FSMap version 19 2024-05-09T05:54:17.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.423+0000 7f86b604c000 1 -- 172.21.15.72:0/541601559 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55d2d9f78f30 con 0x55d2da085bd0 2024-05-09T05:54:17.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.423+0000 7f86877fe640 1 -- 172.21.15.72:0/541601559 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86a0066080 con 0x55d2da085bd0 2024-05-09T05:54:17.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.423+0000 7f86877fe640 1 -- 172.21.15.72:0/541601559 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7f86a0059d50 con 0x55d2da085bd0 2024-05-09T05:54:17.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.423+0000 7f86b604c000 10 client.4794 fetch_fsmap finished waiting for FSMap version 19 2024-05-09T05:54:17.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.423+0000 7f86b604c000 10 client.4794 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-09T05:54:17.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.423+0000 7f86b604c000 20 client.4794 populate_metadata read hostname 'smithi072' 2024-05-09T05:54:17.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.423+0000 7f86b604c000 1 --2- 172.21.15.72:0/541601559 >> [v2:172.21.15.110:6834/4134424941,v1:172.21.15.110:6836/4134424941] conn(0x55d2d9c66830 0x55d2da245d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:17.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.423+0000 7f86b604c000 4 client.4794 mds_command: new command op to 4297 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-09T05:54:17.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.423+0000 7f86b604c000 1 -- 172.21.15.72:0/541601559 --> [v2:172.21.15.110:6834/4134424941,v1:172.21.15.110:6836/4134424941] -- command(tid 0: {"prefix": "status"}) -- 0x55d2d9fe24d0 con 0x55d2d9c66830 2024-05-09T05:54:17.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.423+0000 7f86aca8a640 1 --2- 172.21.15.72:0/541601559 >> [v2:172.21.15.110:6834/4134424941,v1:172.21.15.110:6836/4134424941] conn(0x55d2d9c66830 0x55d2da245d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:17.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.423+0000 7f86877fe640 10 client.4794 ms_handle_connect on v2:172.21.15.110:6834/4134424941 2024-05-09T05:54:17.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.423+0000 7f86aca8a640 1 --2- 172.21.15.72:0/541601559 >> [v2:172.21.15.110:6834/4134424941,v1:172.21.15.110:6836/4134424941] conn(0x55d2d9c66830 0x55d2da245d90 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21a0cce28153c6c4 server_cookie=1746967cd969d0a9 in_seq=0 out_seq=0 2024-05-09T05:54:17.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.423+0000 7f86877fe640 1 -- 172.21.15.72:0/541601559 <== mds.0 v2:172.21.15.110:6834/4134424941 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55d2d9fe24d0 con 0x55d2d9c66830 2024-05-09T05:54:17.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.423+0000 7f86877fe640 10 client.4794 handle_command_reply: tid=0 2024-05-09T05:54:17.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.423+0000 7f86b604c000 1 client.4794 shutdown 2024-05-09T05:54:17.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.423+0000 7f86b604c000 1 -- 172.21.15.72:0/541601559 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d2da085bd0 msgr2=0x55d2da1feea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:17.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.423+0000 7f86b604c000 1 --2- 172.21.15.72:0/541601559 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d2da085bd0 0x55d2da1feea0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f86a005f5f0 tx=0x7f86a0001260 comp rx=0 tx=0).stop 2024-05-09T05:54:17.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.423+0000 7f86b604c000 1 -- 172.21.15.72:0/541601559 shutdown_connections 2024-05-09T05:54:17.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.423+0000 7f86b604c000 1 --2- 172.21.15.72:0/541601559 >> [v2:172.21.15.110:6834/4134424941,v1:172.21.15.110:6836/4134424941] conn(0x55d2d9c66830 0x55d2da245d90 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.423+0000 7f86b604c000 1 --2- 172.21.15.72:0/541601559 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d2da085bd0 0x55d2da1feea0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.423+0000 7f86877fe640 0 client.4794 ms_handle_reset on v2:172.21.15.110:6834/4134424941 2024-05-09T05:54:17.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.423+0000 7f86b604c000 1 --2- 172.21.15.72:0/541601559 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55d2da07e180 0x55d2da1fe960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.423+0000 7f86b604c000 1 --2- 172.21.15.72:0/541601559 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d2da067d50 0x55d2da1d7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.423+0000 7f86b604c000 1 -- 172.21.15.72:0/541601559 >> 172.21.15.72:0/541601559 conn(0x55d2d9c92730 msgr2=0x55d2da1876c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:17.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.423+0000 7f86b604c000 1 -- 172.21.15.72:0/541601559 shutdown_connections 2024-05-09T05:54:17.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.423+0000 7f86b604c000 1 -- 172.21.15.72:0/541601559 wait complete. 2024-05-09T05:54:17.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.423+0000 7f86b604c000 20 client.4794 trim_cache size 0 max 16384 2024-05-09T05:54:17.420 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-05-09T05:54:17.420 INFO:teuthology.orchestra.run.smithi072.stdout: "cluster_fsid": "44c88cb9-b39b-4787-a871-80ddf0ad6292", 2024-05-09T05:54:17.420 INFO:teuthology.orchestra.run.smithi072.stdout: "whoami": 0, 2024-05-09T05:54:17.420 INFO:teuthology.orchestra.run.smithi072.stdout: "id": 4297, 2024-05-09T05:54:17.420 INFO:teuthology.orchestra.run.smithi072.stdout: "want_state": "up:active", 2024-05-09T05:54:17.420 INFO:teuthology.orchestra.run.smithi072.stdout: "state": "up:active", 2024-05-09T05:54:17.420 INFO:teuthology.orchestra.run.smithi072.stdout: "fs_name": "cephfs", 2024-05-09T05:54:17.421 INFO:teuthology.orchestra.run.smithi072.stdout: "rank_uptime": 53.313518291999998, 2024-05-09T05:54:17.421 INFO:teuthology.orchestra.run.smithi072.stdout: "mdsmap_epoch": 19, 2024-05-09T05:54:17.421 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch": 27, 2024-05-09T05:54:17.421 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch_barrier": 27, 2024-05-09T05:54:17.421 INFO:teuthology.orchestra.run.smithi072.stdout: "uptime": 59.149071683999999 2024-05-09T05:54:17.421 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-05-09T05:54:17.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.423+0000 7f86aecee640 1 -- 172.21.15.72:0/375720850 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f869406f430 msgr2=0x7f8694071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:17.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.423+0000 7f86aecee640 1 --2- 172.21.15.72:0/375720850 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f869406f430 0x7f8694071940 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8698009b10 tx=0x7f8698008040 comp rx=0 tx=0).stop 2024-05-09T05:54:17.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.423+0000 7f86aecee640 1 -- 172.21.15.72:0/375720850 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86a8156b50 msgr2=0x7f86a814ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:17.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.423+0000 7f86aecee640 1 --2- 172.21.15.72:0/375720850 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86a8156b50 0x7f86a814ed30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f86a000c730 tx=0x7f86a000cbf0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.423+0000 7f86aecee640 1 -- 172.21.15.72:0/375720850 shutdown_connections 2024-05-09T05:54:17.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.423+0000 7f86aecee640 1 --2- 172.21.15.72:0/375720850 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f869406f430 0x7f8694071940 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.423+0000 7f86aecee640 1 --2- 172.21.15.72:0/375720850 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86a8156b50 0x7f86a814ed30 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.423+0000 7f86aecee640 1 --2- 172.21.15.72:0/375720850 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86a80cca30 0x7f86a815b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.423+0000 7f86aecee640 1 --2- 172.21.15.72:0/375720850 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86a8074410 0x7f86a81f6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.423+0000 7f86aecee640 1 -- 172.21.15.72:0/375720850 >> 172.21.15.72:0/375720850 conn(0x7f86a80d1b70 msgr2=0x7f86a80cce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:17.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.423+0000 7f86aecee640 1 -- 172.21.15.72:0/375720850 shutdown_connections 2024-05-09T05:54:17.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.423+0000 7f86aecee640 1 -- 172.21.15.72:0/375720850 wait complete. 2024-05-09T05:54:17.433 INFO:teuthology.run_tasks:Running task sequential... 2024-05-09T05:54:17.443 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-05-09T05:54:17.443 INFO:teuthology.task.sequential:In sequential, running task print... 2024-05-09T05:54:17.443 INFO:teuthology.task.print:Enabling mgr modules 2024-05-09T05:54:17.443 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-05-09T05:54:17.468 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-05-09T05:54:17.468 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-05-09T05:54:17.468 INFO:tasks.ceph_fuse:client.0 config is {} 2024-05-09T05:54:17.468 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-09T05:54:17.468 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-09T05:54:17.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:54:17.469 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2024-05-09T05:54:17.473 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-05-09T05:54:17.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:54:17.474 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-09T05:54:17.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:54:17.527 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link delete ceph-brx 2024-05-09T05:54:17.734 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-05-09T05:54:17.734 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-09T05:54:17.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.895+0000 7fe194c1e640 1 Processor -- start 2024-05-09T05:54:17.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.895+0000 7fe194c1e640 1 -- start start 2024-05-09T05:54:17.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.895+0000 7fe194c1e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe19015da90 0x7fe1900c7570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:17.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.895+0000 7fe194c1e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe190162e60 0x7fe190165280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:17.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.895+0000 7fe194c1e640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe19015a4f0 con 0x7fe19015dea0 2024-05-09T05:54:17.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.895+0000 7fe194c1e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fe1901513f0 con 0x7fe190162e60 2024-05-09T05:54:17.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.895+0000 7fe194c1e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fe1900c84f0 con 0x7fe19015da90 2024-05-09T05:54:17.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.895+0000 7fe18dd9b640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe19015dea0 0x7fe1900745b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41504/0 (socket says 172.21.15.72:41504) 2024-05-09T05:54:17.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.895+0000 7fe18dd9b640 1 -- 172.21.15.72:0/2006102065 learned_addr learned my addr 172.21.15.72:0/2006102065 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:54:17.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.895+0000 7fe18e59c640 1 --2- 172.21.15.72:0/2006102065 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe19015da90 0x7fe1900c7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:17.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.895+0000 7fe18ed9d640 1 --2- 172.21.15.72:0/2006102065 >> v2:172.21.15.110:3300/0 conn(0x7fe190162e60 0x7fe190165280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:17.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.895+0000 7fe18d59a640 1 -- 172.21.15.72:0/2006102065 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1728029915 0 0) 0x7fe19015a4f0 con 0x7fe19015dea0 2024-05-09T05:54:17.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.895+0000 7fe18d59a640 1 -- 172.21.15.72:0/2006102065 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe178003530 con 0x7fe19015dea0 2024-05-09T05:54:17.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.895+0000 7fe18d59a640 1 -- 172.21.15.72:0/2006102065 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2234207126 0 0) 0x7fe178003530 con 0x7fe19015dea0 2024-05-09T05:54:17.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.895+0000 7fe18d59a640 1 -- 172.21.15.72:0/2006102065 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe19015da90 msgr2=0x7fe1900c7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:17.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.895+0000 7fe18d59a640 1 --2- 172.21.15.72:0/2006102065 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe19015da90 0x7fe1900c7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.895+0000 7fe18d59a640 1 -- 172.21.15.72:0/2006102065 >> v2:172.21.15.110:3300/0 conn(0x7fe190162e60 msgr2=0x7fe190165280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:17.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.895+0000 7fe18d59a640 1 --2- 172.21.15.72:0/2006102065 >> v2:172.21.15.110:3300/0 conn(0x7fe190162e60 0x7fe190165280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.895+0000 7fe18d59a640 1 -- 172.21.15.72:0/2006102065 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1900c87d0 con 0x7fe19015dea0 2024-05-09T05:54:17.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.895+0000 7fe18d59a640 1 -- 172.21.15.72:0/2006102065 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2749052815 0 0) 0x7fe184001700 con 0x7fe19015dea0 2024-05-09T05:54:17.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.895+0000 7fe18d59a640 1 -- 172.21.15.72:0/2006102065 >> v1:172.21.15.72:6789/0 conn(0x7fe19015dea0 legacy=0x7fe1900745b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:17.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.895+0000 7fe18d59a640 1 --2- 172.21.15.72:0/2006102065 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe178003a10 0x7fe178003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:17.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.895+0000 7fe18d59a640 1 --2- 172.21.15.72:0/2006102065 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe19015da90 0x7fe178004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:17.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.899+0000 7fe18d59a640 1 --2- 172.21.15.72:0/2006102065 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe178004d50 0x7fe178005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:17.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.899+0000 7fe18d59a640 1 -- 172.21.15.72:0/2006102065 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe1900c84f0 con 0x7fe178004d50 2024-05-09T05:54:17.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.899+0000 7fe18d59a640 1 -- 172.21.15.72:0/2006102065 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fe17800ba80 con 0x7fe178003a10 2024-05-09T05:54:17.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.899+0000 7fe18d59a640 1 -- 172.21.15.72:0/2006102065 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fe17800bc00 con 0x7fe19015da90 2024-05-09T05:54:17.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.899+0000 7fe18ed9d640 1 --2- 172.21.15.72:0/2006102065 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe178004d50 0x7fe178005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:17.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.899+0000 7fe18e59c640 1 --2- 172.21.15.72:0/2006102065 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe178003a10 0x7fe178003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:17.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.899+0000 7fe18dd9b640 1 --2- 172.21.15.72:0/2006102065 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe19015da90 0x7fe178004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:17.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.899+0000 7fe18ed9d640 1 -- 172.21.15.72:0/2006102065 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe19015da90 msgr2=0x7fe178004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:17.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.899+0000 7fe18ed9d640 1 --2- 172.21.15.72:0/2006102065 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe19015da90 0x7fe178004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.899+0000 7fe18ed9d640 1 -- 172.21.15.72:0/2006102065 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe178003a10 msgr2=0x7fe178003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:17.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.899+0000 7fe18ed9d640 1 --2- 172.21.15.72:0/2006102065 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe178003a10 0x7fe178003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.899+0000 7fe18ed9d640 1 -- 172.21.15.72:0/2006102065 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe178003530 con 0x7fe178004d50 2024-05-09T05:54:17.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.899+0000 7fe18ed9d640 1 --2- 172.21.15.72:0/2006102065 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe178004d50 0x7fe178005160 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe180009f90 tx=0x7fe18001cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc86c627f65e8e22 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:17.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.899+0000 7fe18d59a640 1 -- 172.21.15.72:0/2006102065 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1800b2070 con 0x7fe178004d50 2024-05-09T05:54:17.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.899+0000 7fe18d59a640 1 -- 172.21.15.72:0/2006102065 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1800a5c90 con 0x7fe178004d50 2024-05-09T05:54:17.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.899+0000 7fe18d59a640 1 -- 172.21.15.72:0/2006102065 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe180009c10 con 0x7fe178004d50 2024-05-09T05:54:17.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.899+0000 7fe194c1e640 1 -- 172.21.15.72:0/2006102065 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe178004d50 msgr2=0x7fe178005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:17.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.899+0000 7fe194c1e640 1 --2- 172.21.15.72:0/2006102065 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe178004d50 0x7fe178005160 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe180009f90 tx=0x7fe18001cc80 comp rx=0 tx=0).stop 2024-05-09T05:54:17.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.899+0000 7fe18ed9d640 1 -- 172.21.15.72:0/2006102065 reap_dead start 2024-05-09T05:54:17.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.899+0000 7fe194c1e640 1 -- 172.21.15.72:0/2006102065 shutdown_connections 2024-05-09T05:54:17.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.899+0000 7fe194c1e640 1 -- 172.21.15.72:0/2006102065 >> 172.21.15.72:0/2006102065 conn(0x7fe1900cde90 msgr2=0x7fe1900ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:17.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.899+0000 7fe194c1e640 1 -- 172.21.15.72:0/2006102065 shutdown_connections 2024-05-09T05:54:17.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.899+0000 7fe194c1e640 1 -- 172.21.15.72:0/2006102065 wait complete. 2024-05-09T05:54:17.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.903+0000 7fe194c1e640 1 Processor -- start 2024-05-09T05:54:17.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.903+0000 7fe194c1e640 1 -- start start 2024-05-09T05:54:17.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.903+0000 7fe194c1e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe178004d50 0x7fe190151630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:17.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.903+0000 7fe194c1e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1900c39a0 0x7fe190153ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:17.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.903+0000 7fe194c1e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe190154530 0x7fe1901f6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:17.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.903+0000 7fe194c1e640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe19015ad70 con 0x7fe190154530 2024-05-09T05:54:17.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.903+0000 7fe194c1e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fe19015aa90 con 0x7fe178004d50 2024-05-09T05:54:17.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.903+0000 7fe194c1e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fe1900c70e0 con 0x7fe1900c39a0 2024-05-09T05:54:17.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.903+0000 7fe18ed9d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe190154530 0x7fe1901f6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:17.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.903+0000 7fe18ed9d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe190154530 0x7fe1901f6160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46220/0 (socket says 172.21.15.72:46220) 2024-05-09T05:54:17.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.903+0000 7fe18ed9d640 1 -- 172.21.15.72:0/3965042209 learned_addr learned my addr 172.21.15.72:0/3965042209 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:54:17.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.903+0000 7fe18e59c640 1 --2- 172.21.15.72:0/3965042209 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe178004d50 0x7fe190151630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:17.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.903+0000 7fe18dd9b640 1 --2- 172.21.15.72:0/3965042209 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1900c39a0 0x7fe190153ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:17.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.903+0000 7fe18ed9d640 1 -- 172.21.15.72:0/3965042209 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1900c39a0 msgr2=0x7fe190153ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:17.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.903+0000 7fe18ed9d640 1 --2- 172.21.15.72:0/3965042209 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1900c39a0 0x7fe190153ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.903+0000 7fe18ed9d640 1 -- 172.21.15.72:0/3965042209 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe178004d50 msgr2=0x7fe190151630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:17.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.903+0000 7fe18ed9d640 1 --2- 172.21.15.72:0/3965042209 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe178004d50 0x7fe190151630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:17.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.903+0000 7fe18ed9d640 1 -- 172.21.15.72:0/3965042209 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe190151b70 con 0x7fe190154530 2024-05-09T05:54:17.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.903+0000 7fe18ed9d640 1 --2- 172.21.15.72:0/3965042209 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe190154530 0x7fe1901f6160 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe180002240 tx=0x7fe180009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:17.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.903+0000 7fe17effd640 1 -- 172.21.15.72:0/3965042209 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1800b2040 con 0x7fe190154530 2024-05-09T05:54:17.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.903+0000 7fe17effd640 1 -- 172.21.15.72:0/3965042209 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1800adb50 con 0x7fe190154530 2024-05-09T05:54:17.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.903+0000 7fe194c1e640 1 -- 172.21.15.72:0/3965042209 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe190160900 con 0x7fe190154530 2024-05-09T05:54:17.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.903+0000 7fe17effd640 1 -- 172.21.15.72:0/3965042209 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe180009c10 con 0x7fe190154530 2024-05-09T05:54:17.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.903+0000 7fe194c1e640 1 -- 172.21.15.72:0/3965042209 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1901f3180 con 0x7fe190154530 2024-05-09T05:54:17.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.907+0000 7fe194c1e640 1 -- 172.21.15.72:0/3965042209 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe19006a520 con 0x7fe190154530 2024-05-09T05:54:17.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.907+0000 7fe17effd640 1 -- 172.21.15.72:0/3965042209 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe1800bf060 con 0x7fe190154530 2024-05-09T05:54:17.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.907+0000 7fe17effd640 1 --2- 172.21.15.72:0/3965042209 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fe17006f400 0x7fe170071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:17.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.907+0000 7fe17effd640 1 -- 172.21.15.72:0/3965042209 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7fe1801294c0 con 0x7fe190154530 2024-05-09T05:54:17.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.907+0000 7fe18e59c640 1 --2- 172.21.15.72:0/3965042209 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fe17006f400 0x7fe170071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:17.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.907+0000 7fe18e59c640 1 --2- 172.21.15.72:0/3965042209 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fe17006f400 0x7fe170071910 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe1900754b0 tx=0x7fe188008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:17.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:17.911+0000 7fe17effd640 1 -- 172.21.15.72:0/3965042209 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fe180016990 con 0x7fe190154530 2024-05-09T05:54:18.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:18.107+0000 7fe194c1e640 1 -- 172.21.15.72:0/3965042209 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fe190076740 con 0x7fe190154530 2024-05-09T05:54:18.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:18.107+0000 7fe17effd640 1 -- 172.21.15.72:0/3965042209 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v19) ==== 53+0+88 (secure 0 0 0) 0x7fe1800f6040 con 0x7fe190154530 2024-05-09T05:54:18.097 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-09T05:54:18.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:18.111+0000 7fe194c1e640 1 -- 172.21.15.72:0/3965042209 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fe17006f400 msgr2=0x7fe170071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:18.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:18.111+0000 7fe194c1e640 1 --2- 172.21.15.72:0/3965042209 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fe17006f400 0x7fe170071910 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe1900754b0 tx=0x7fe188008040 comp rx=0 tx=0).stop 2024-05-09T05:54:18.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:18.111+0000 7fe194c1e640 1 -- 172.21.15.72:0/3965042209 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe190154530 msgr2=0x7fe1901f6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:18.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:18.111+0000 7fe194c1e640 1 --2- 172.21.15.72:0/3965042209 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe190154530 0x7fe1901f6160 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe180002240 tx=0x7fe180009750 comp rx=0 tx=0).stop 2024-05-09T05:54:18.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:18.111+0000 7fe194c1e640 1 -- 172.21.15.72:0/3965042209 shutdown_connections 2024-05-09T05:54:18.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:18.111+0000 7fe194c1e640 1 --2- 172.21.15.72:0/3965042209 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fe17006f400 0x7fe170071910 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:18.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:18.111+0000 7fe194c1e640 1 --2- 172.21.15.72:0/3965042209 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe190154530 0x7fe1901f6160 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:18.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:18.111+0000 7fe194c1e640 1 --2- 172.21.15.72:0/3965042209 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1900c39a0 0x7fe190153ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:18.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:18.111+0000 7fe194c1e640 1 --2- 172.21.15.72:0/3965042209 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe178004d50 0x7fe190151630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:18.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:18.111+0000 7fe194c1e640 1 -- 172.21.15.72:0/3965042209 >> 172.21.15.72:0/3965042209 conn(0x7fe1900cde90 msgr2=0x7fe19015cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:18.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:18.111+0000 7fe194c1e640 1 -- 172.21.15.72:0/3965042209 shutdown_connections 2024-05-09T05:54:18.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:18.111+0000 7fe194c1e640 1 -- 172.21.15.72:0/3965042209 wait complete. 2024-05-09T05:54:18.118 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-09T05:54:18.118 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-09T05:54:18.119 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi072.front.sepia.ceph.com 2024-05-09T05:54:18.119 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-09T05:54:18.119 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-09T05:54:18.119 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-09T05:54:18.119 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-09T05:54:18.119 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-09T05:54:18.119 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-09T05:54:18.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:54:18.119 DEBUG:teuthology.orchestra.run.smithi072:> ip addr 2024-05-09T05:54:18.125 INFO:teuthology.orchestra.run.smithi072.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-09T05:54:18.125 INFO:teuthology.orchestra.run.smithi072.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-09T05:54:18.125 INFO:teuthology.orchestra.run.smithi072.stdout: inet 127.0.0.1/8 scope host lo 2024-05-09T05:54:18.125 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-05-09T05:54:18.125 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 ::1/128 scope host 2024-05-09T05:54:18.125 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-05-09T05:54:18.125 INFO:teuthology.orchestra.run.smithi072.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-09T05:54:18.125 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f4 brd ff:ff:ff:ff:ff:ff 2024-05-09T05:54:18.125 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f0 2024-05-09T05:54:18.125 INFO:teuthology.orchestra.run.smithi072.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-09T05:54:18.126 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f5 brd ff:ff:ff:ff:ff:ff 2024-05-09T05:54:18.126 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f1 2024-05-09T05:54:18.126 INFO:teuthology.orchestra.run.smithi072.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-09T05:54:18.126 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:64 brd ff:ff:ff:ff:ff:ff 2024-05-09T05:54:18.126 INFO:teuthology.orchestra.run.smithi072.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-09T05:54:18.126 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:65 brd ff:ff:ff:ff:ff:ff 2024-05-09T05:54:18.126 INFO:teuthology.orchestra.run.smithi072.stdout: inet 172.21.15.72/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-09T05:54:18.126 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft 42449sec preferred_lft 42449sec 2024-05-09T05:54:18.126 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::ec4:7aff:fe8f:b765/64 scope link 2024-05-09T05:54:18.126 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-05-09T05:54:18.126 INFO:teuthology.orchestra.run.smithi072.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-05-09T05:54:18.126 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 02:42:8f:f6:66:bc brd ff:ff:ff:ff:ff:ff 2024-05-09T05:54:18.126 INFO:teuthology.orchestra.run.smithi072.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-05-09T05:54:18.127 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-05-09T05:54:18.127 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-09T05:54:18.127 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T05:54:18.127 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2024-05-09T05:54:18.127 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link add name ceph-brx type bridge 2024-05-09T05:54:18.127 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip addr flush dev ceph-brx 2024-05-09T05:54:18.127 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set ceph-brx up 2024-05-09T05:54:18.127 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-09T05:54:18.127 DEBUG:teuthology.orchestra.run.smithi072:> ') 2024-05-09T05:54:18.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T05:54:18.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T05:54:18.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:54:18.254 DEBUG:teuthology.orchestra.run.smithi072:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-09T05:54:18.263 INFO:teuthology.orchestra.run.smithi072.stdout:1 2024-05-09T05:54:18.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:54:18.265 DEBUG:teuthology.orchestra.run.smithi072:> route 2024-05-09T05:54:18.320 INFO:teuthology.orchestra.run.smithi072.stdout:Kernel IP routing table 2024-05-09T05:54:18.320 INFO:teuthology.orchestra.run.smithi072.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-09T05:54:18.320 INFO:teuthology.orchestra.run.smithi072.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-05-09T05:54:18.320 INFO:teuthology.orchestra.run.smithi072.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-09T05:54:18.320 INFO:teuthology.orchestra.run.smithi072.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-05-09T05:54:18.320 INFO:teuthology.orchestra.run.smithi072.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-05-09T05:54:18.320 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-09T05:54:18.320 INFO:teuthology.orchestra.run.smithi072.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-09T05:54:18.320 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-09T05:54:18.320 INFO:teuthology.orchestra.run.smithi072.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-09T05:54:18.320 INFO:teuthology.orchestra.run.smithi072.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-09T05:54:18.321 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T05:54:18.321 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2024-05-09T05:54:18.321 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-09T05:54:18.321 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-09T05:54:18.321 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-09T05:54:18.321 DEBUG:teuthology.orchestra.run.smithi072:> ') 2024-05-09T05:54:18.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T05:54:18.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T05:54:18.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:54:18.435 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2024-05-09T05:54:18.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:54:18.481 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list-id 2024-05-09T05:54:18.528 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T05:54:18.528 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2024-05-09T05:54:18.528 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-09T05:54:18.528 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-09T05:54:18.528 DEBUG:teuthology.orchestra.run.smithi072:> ') 2024-05-09T05:54:18.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T05:54:18.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T05:54:18.644 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-09T05:54:18.644 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T05:54:18.645 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2024-05-09T05:54:18.645 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-09T05:54:18.645 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-09T05:54:18.645 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-09T05:54:18.645 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-09T05:54:18.645 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-09T05:54:18.645 DEBUG:teuthology.orchestra.run.smithi072:> ') 2024-05-09T05:54:18.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T05:54:18.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T05:54:18.735 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T05:54:18.735 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2024-05-09T05:54:18.735 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set brx.0 up 2024-05-09T05:54:18.735 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set dev brx.0 master ceph-brx 2024-05-09T05:54:18.735 DEBUG:teuthology.orchestra.run.smithi072:> ') 2024-05-09T05:54:18.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T05:54:18.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T05:54:18.836 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-05-09T05:54:18.836 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-09T05:54:18.836 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-09T05:54:18.884 INFO:teuthology.orchestra.run.smithi072.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-09T05:54:18.884 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-09T05:54:18.884 DEBUG:teuthology.orchestra.run.smithi072:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-09T05:54:18.936 DEBUG:teuthology.orchestra.run.smithi072:> sudo modprobe fuse 2024-05-09T05:54:18.994 DEBUG:teuthology.orchestra.run.smithi072:> cat /proc/self/mounts | awk '{print $2}' 2024-05-09T05:54:19.042 INFO:teuthology.orchestra.run.smithi072.stdout:/sys 2024-05-09T05:54:19.042 INFO:teuthology.orchestra.run.smithi072.stdout:/proc 2024-05-09T05:54:19.042 INFO:teuthology.orchestra.run.smithi072.stdout:/dev 2024-05-09T05:54:19.042 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/pts 2024-05-09T05:54:19.043 INFO:teuthology.orchestra.run.smithi072.stdout:/run 2024-05-09T05:54:19.043 INFO:teuthology.orchestra.run.smithi072.stdout:/ 2024-05-09T05:54:19.043 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/security 2024-05-09T05:54:19.043 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/shm 2024-05-09T05:54:19.043 INFO:teuthology.orchestra.run.smithi072.stdout:/run/lock 2024-05-09T05:54:19.043 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/cgroup 2024-05-09T05:54:19.043 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/pstore 2024-05-09T05:54:19.043 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/bpf 2024-05-09T05:54:19.043 INFO:teuthology.orchestra.run.smithi072.stdout:/proc/sys/fs/binfmt_misc 2024-05-09T05:54:19.043 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/hugepages 2024-05-09T05:54:19.043 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/mqueue 2024-05-09T05:54:19.043 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/debug 2024-05-09T05:54:19.043 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/tracing 2024-05-09T05:54:19.044 INFO:teuthology.orchestra.run.smithi072.stdout:/proc/fs/nfsd 2024-05-09T05:54:19.044 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/fuse/connections 2024-05-09T05:54:19.044 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/config 2024-05-09T05:54:19.044 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-sysusers.service 2024-05-09T05:54:19.044 INFO:teuthology.orchestra.run.smithi072.stdout:/run/rpc_pipefs 2024-05-09T05:54:19.044 INFO:teuthology.orchestra.run.smithi072.stdout:/run/user/1000 2024-05-09T05:54:19.044 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph 2024-05-09T05:54:19.044 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-0 2024-05-09T05:54:19.044 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-1 2024-05-09T05:54:19.044 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-2 2024-05-09T05:54:19.044 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-3 2024-05-09T05:54:19.044 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns 2024-05-09T05:54:19.044 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-09T05:54:19.044 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-09T05:54:19.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:54:19.045 DEBUG:teuthology.orchestra.run.smithi072:> ls /sys/fs/fuse/connections 2024-05-09T05:54:19.092 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-09T05:54:19.093 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-05-09T05:54:19.138 DEBUG:teuthology.orchestra.run.smithi072:> sudo modprobe fuse 2024-05-09T05:54:19.152 DEBUG:teuthology.orchestra.run.smithi072:> cat /proc/self/mounts | awk '{print $2}' 2024-05-09T05:54:19.201 INFO:teuthology.orchestra.run.smithi072.stdout:/sys 2024-05-09T05:54:19.201 INFO:teuthology.orchestra.run.smithi072.stdout:/proc 2024-05-09T05:54:19.201 INFO:teuthology.orchestra.run.smithi072.stdout:/dev 2024-05-09T05:54:19.201 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/pts 2024-05-09T05:54:19.201 INFO:teuthology.orchestra.run.smithi072.stdout:/run 2024-05-09T05:54:19.201 INFO:teuthology.orchestra.run.smithi072.stdout:/ 2024-05-09T05:54:19.201 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/security 2024-05-09T05:54:19.202 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/shm 2024-05-09T05:54:19.202 INFO:teuthology.orchestra.run.smithi072.stdout:/run/lock 2024-05-09T05:54:19.202 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/cgroup 2024-05-09T05:54:19.202 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/pstore 2024-05-09T05:54:19.202 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/bpf 2024-05-09T05:54:19.202 INFO:teuthology.orchestra.run.smithi072.stdout:/proc/sys/fs/binfmt_misc 2024-05-09T05:54:19.202 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/hugepages 2024-05-09T05:54:19.202 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/mqueue 2024-05-09T05:54:19.202 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/debug 2024-05-09T05:54:19.202 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/tracing 2024-05-09T05:54:19.202 INFO:teuthology.orchestra.run.smithi072.stdout:/proc/fs/nfsd 2024-05-09T05:54:19.202 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/fuse/connections 2024-05-09T05:54:19.202 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/config 2024-05-09T05:54:19.202 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-sysusers.service 2024-05-09T05:54:19.203 INFO:teuthology.orchestra.run.smithi072.stdout:/run/rpc_pipefs 2024-05-09T05:54:19.203 INFO:teuthology.orchestra.run.smithi072.stdout:/run/user/1000 2024-05-09T05:54:19.203 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph 2024-05-09T05:54:19.203 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-0 2024-05-09T05:54:19.203 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-1 2024-05-09T05:54:19.203 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-2 2024-05-09T05:54:19.203 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-3 2024-05-09T05:54:19.203 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns 2024-05-09T05:54:19.203 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-09T05:54:19.203 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-09T05:54:19.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:54:19.204 DEBUG:teuthology.orchestra.run.smithi072:> ls /sys/fs/fuse/connections 2024-05-09T05:54:19.246 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi072.stderr:2024-05-09T05:54:19.255+0000 7f5514ae3580 -1 init, newargv = 0x7f5504005440 newargc=15 2024-05-09T05:54:19.246 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi072.stderr:ceph-fuse[35468]: starting ceph client 2024-05-09T05:54:19.265 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi072.stderr:ceph-fuse[35468]: starting fuse 2024-05-09T05:54:20.349 DEBUG:teuthology.orchestra.run.smithi072:> sudo modprobe fuse 2024-05-09T05:54:20.365 DEBUG:teuthology.orchestra.run.smithi072:> cat /proc/self/mounts | awk '{print $2}' 2024-05-09T05:54:20.414 INFO:teuthology.orchestra.run.smithi072.stdout:/sys 2024-05-09T05:54:20.414 INFO:teuthology.orchestra.run.smithi072.stdout:/proc 2024-05-09T05:54:20.414 INFO:teuthology.orchestra.run.smithi072.stdout:/dev 2024-05-09T05:54:20.414 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/pts 2024-05-09T05:54:20.414 INFO:teuthology.orchestra.run.smithi072.stdout:/run 2024-05-09T05:54:20.414 INFO:teuthology.orchestra.run.smithi072.stdout:/ 2024-05-09T05:54:20.414 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/security 2024-05-09T05:54:20.415 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/shm 2024-05-09T05:54:20.415 INFO:teuthology.orchestra.run.smithi072.stdout:/run/lock 2024-05-09T05:54:20.415 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/cgroup 2024-05-09T05:54:20.415 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/pstore 2024-05-09T05:54:20.415 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/bpf 2024-05-09T05:54:20.415 INFO:teuthology.orchestra.run.smithi072.stdout:/proc/sys/fs/binfmt_misc 2024-05-09T05:54:20.415 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/hugepages 2024-05-09T05:54:20.415 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/mqueue 2024-05-09T05:54:20.415 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/debug 2024-05-09T05:54:20.415 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/tracing 2024-05-09T05:54:20.415 INFO:teuthology.orchestra.run.smithi072.stdout:/proc/fs/nfsd 2024-05-09T05:54:20.415 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/fuse/connections 2024-05-09T05:54:20.416 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/config 2024-05-09T05:54:20.416 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-sysusers.service 2024-05-09T05:54:20.416 INFO:teuthology.orchestra.run.smithi072.stdout:/run/rpc_pipefs 2024-05-09T05:54:20.416 INFO:teuthology.orchestra.run.smithi072.stdout:/run/user/1000 2024-05-09T05:54:20.416 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph 2024-05-09T05:54:20.416 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-0 2024-05-09T05:54:20.416 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-1 2024-05-09T05:54:20.416 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-2 2024-05-09T05:54:20.416 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-3 2024-05-09T05:54:20.416 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns 2024-05-09T05:54:20.416 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-09T05:54:20.417 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-09T05:54:20.417 INFO:teuthology.orchestra.run.smithi072.stdout:/home/ubuntu/cephtest/mnt.0 2024-05-09T05:54:20.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:54:20.418 DEBUG:teuthology.orchestra.run.smithi072:> ls /sys/fs/fuse/connections 2024-05-09T05:54:20.465 INFO:teuthology.orchestra.run.smithi072.stdout:45 2024-05-09T05:54:20.465 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-05-09T05:54:20.465 DEBUG:teuthology.orchestra.run.smithi072:> sudo stdin-killer -- python3 -c ' 2024-05-09T05:54:20.465 DEBUG:teuthology.orchestra.run.smithi072:> import glob 2024-05-09T05:54:20.465 DEBUG:teuthology.orchestra.run.smithi072:> import re 2024-05-09T05:54:20.466 DEBUG:teuthology.orchestra.run.smithi072:> import os 2024-05-09T05:54:20.466 DEBUG:teuthology.orchestra.run.smithi072:> import subprocess 2024-05-09T05:54:20.466 DEBUG:teuthology.orchestra.run.smithi072:> 2024-05-09T05:54:20.466 DEBUG:teuthology.orchestra.run.smithi072:> def _find_admin_socket(client_name): 2024-05-09T05:54:20.466 DEBUG:teuthology.orchestra.run.smithi072:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-05-09T05:54:20.466 DEBUG:teuthology.orchestra.run.smithi072:> files = glob.glob(asok_path) 2024-05-09T05:54:20.466 DEBUG:teuthology.orchestra.run.smithi072:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-05-09T05:54:20.466 DEBUG:teuthology.orchestra.run.smithi072:> 2024-05-09T05:54:20.466 DEBUG:teuthology.orchestra.run.smithi072:> # Given a non-glob path, it better be there 2024-05-09T05:54:20.466 DEBUG:teuthology.orchestra.run.smithi072:> if "*" not in asok_path: 2024-05-09T05:54:20.467 DEBUG:teuthology.orchestra.run.smithi072:> assert(len(files) == 1) 2024-05-09T05:54:20.467 DEBUG:teuthology.orchestra.run.smithi072:> return files[0] 2024-05-09T05:54:20.467 DEBUG:teuthology.orchestra.run.smithi072:> 2024-05-09T05:54:20.467 DEBUG:teuthology.orchestra.run.smithi072:> for f in files: 2024-05-09T05:54:20.467 DEBUG:teuthology.orchestra.run.smithi072:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-09T05:54:20.467 DEBUG:teuthology.orchestra.run.smithi072:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-09T05:54:20.467 DEBUG:teuthology.orchestra.run.smithi072:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-09T05:54:20.467 DEBUG:teuthology.orchestra.run.smithi072:> contents = proc_f.read() 2024-05-09T05:54:20.467 DEBUG:teuthology.orchestra.run.smithi072:> if mountpoint in contents: 2024-05-09T05:54:20.467 DEBUG:teuthology.orchestra.run.smithi072:> return f 2024-05-09T05:54:20.467 DEBUG:teuthology.orchestra.run.smithi072:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-09T05:54:20.467 DEBUG:teuthology.orchestra.run.smithi072:> 2024-05-09T05:54:20.467 DEBUG:teuthology.orchestra.run.smithi072:> print(_find_admin_socket("client.0")) 2024-05-09T05:54:20.467 DEBUG:teuthology.orchestra.run.smithi072:> ' 2024-05-09T05:54:20.587 INFO:teuthology.orchestra.run.smithi072.stdout:/var/run/ceph/ceph-client.0.35468.asok 2024-05-09T05:54:20.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T05:54:20.599 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.35468.asok 2024-05-09T05:54:20.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:54:20.599 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.35468.asok status 2024-05-09T05:54:20.780 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-05-09T05:54:20.780 INFO:teuthology.orchestra.run.smithi072.stdout: "metadata": { 2024-05-09T05:54:20.780 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph_sha1": "c9da4049f638c0f84bdd9b4e33c42e86046ac554", 2024-05-09T05:54:20.780 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph_version": "ceph version 19.0.0-3594-gc9da4049 (c9da4049f638c0f84bdd9b4e33c42e86046ac554) squid (dev)", 2024-05-09T05:54:20.781 INFO:teuthology.orchestra.run.smithi072.stdout: "entity_id": "0", 2024-05-09T05:54:20.781 INFO:teuthology.orchestra.run.smithi072.stdout: "hostname": "smithi072", 2024-05-09T05:54:20.781 INFO:teuthology.orchestra.run.smithi072.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-05-09T05:54:20.781 INFO:teuthology.orchestra.run.smithi072.stdout: "pid": "35468", 2024-05-09T05:54:20.781 INFO:teuthology.orchestra.run.smithi072.stdout: "root": "/" 2024-05-09T05:54:20.781 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-09T05:54:20.781 INFO:teuthology.orchestra.run.smithi072.stdout: "dentry_count": 0, 2024-05-09T05:54:20.781 INFO:teuthology.orchestra.run.smithi072.stdout: "dentry_pinned_count": 0, 2024-05-09T05:54:20.781 INFO:teuthology.orchestra.run.smithi072.stdout: "id": 4806, 2024-05-09T05:54:20.781 INFO:teuthology.orchestra.run.smithi072.stdout: "inst": { 2024-05-09T05:54:20.782 INFO:teuthology.orchestra.run.smithi072.stdout: "name": { 2024-05-09T05:54:20.782 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "client", 2024-05-09T05:54:20.782 INFO:teuthology.orchestra.run.smithi072.stdout: "num": 4806 2024-05-09T05:54:20.782 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-09T05:54:20.782 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": { 2024-05-09T05:54:20.782 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "v1", 2024-05-09T05:54:20.782 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": "192.168.0.1:0", 2024-05-09T05:54:20.782 INFO:teuthology.orchestra.run.smithi072.stdout: "nonce": 4141680664 2024-05-09T05:54:20.782 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-05-09T05:54:20.782 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-09T05:54:20.782 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": { 2024-05-09T05:54:20.782 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "v1", 2024-05-09T05:54:20.782 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": "192.168.0.1:0", 2024-05-09T05:54:20.783 INFO:teuthology.orchestra.run.smithi072.stdout: "nonce": 4141680664 2024-05-09T05:54:20.783 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-05-09T05:54:20.783 INFO:teuthology.orchestra.run.smithi072.stdout: "inst_str": "client.4806 192.168.0.1:0/4141680664", 2024-05-09T05:54:20.783 INFO:teuthology.orchestra.run.smithi072.stdout: "addr_str": "192.168.0.1:0/4141680664", 2024-05-09T05:54:20.783 INFO:teuthology.orchestra.run.smithi072.stdout: "inode_count": 1, 2024-05-09T05:54:20.783 INFO:teuthology.orchestra.run.smithi072.stdout: "mds_epoch": 19, 2024-05-09T05:54:20.783 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_epoch": 27, 2024-05-09T05:54:20.783 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_epoch_barrier": 0, 2024-05-09T05:54:20.783 INFO:teuthology.orchestra.run.smithi072.stdout: "blocklisted": false, 2024-05-09T05:54:20.783 INFO:teuthology.orchestra.run.smithi072.stdout: "fs_name": "cephfs" 2024-05-09T05:54:20.783 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-05-09T05:54:20.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:54:20.796 DEBUG:teuthology.orchestra.run.smithi072:> stat --file-system '--printf=%T 2024-05-09T05:54:20.797 DEBUG:teuthology.orchestra.run.smithi072:> ' -- /home/ubuntu/cephtest/mnt.0 2024-05-09T05:54:20.802 INFO:teuthology.orchestra.run.smithi072.stdout:fuseblk 2024-05-09T05:54:20.803 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-05-09T05:54:20.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:54:20.803 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-09T05:54:20.854 INFO:teuthology.run_tasks:Running task mds_thrash... 2024-05-09T05:54:20.866 INFO:tasks.mds_thrash:mds thrasher using random seed: 1715234060 2024-05-09T05:54:20.866 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T05:54:21.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.059+0000 7fbe256b9640 1 Processor -- start 2024-05-09T05:54:21.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.059+0000 7fbe256b9640 1 -- start start 2024-05-09T05:54:21.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.059+0000 7fbe256b9640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbe2015da90 0x7fbe200c7570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:21.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.059+0000 7fbe256b9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe20162e60 0x7fbe20165280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:21.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.059+0000 7fbe256b9640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe2015a4f0 con 0x7fbe2015dea0 2024-05-09T05:54:21.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.059+0000 7fbe256b9640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fbe201513f0 con 0x7fbe2015da90 2024-05-09T05:54:21.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.059+0000 7fbe256b9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fbe200c84f0 con 0x7fbe20162e60 2024-05-09T05:54:21.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.059+0000 7fbe1e7fc640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fbe2015dea0 0x7fbe200745b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41506/0 (socket says 172.21.15.72:41506) 2024-05-09T05:54:21.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.059+0000 7fbe1e7fc640 1 -- 172.21.15.72:0/3299417537 learned_addr learned my addr 172.21.15.72:0/3299417537 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:54:21.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.059+0000 7fbe1effd640 1 --2- 172.21.15.72:0/3299417537 >> v2:172.21.15.110:3300/0 conn(0x7fbe2015da90 0x7fbe200c7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:21.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.059+0000 7fbe1f7fe640 1 --2- 172.21.15.72:0/3299417537 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe20162e60 0x7fbe20165280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:21.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.059+0000 7fbe1dffb640 1 -- 172.21.15.72:0/3299417537 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3940381160 0 0) 0x7fbe2015a4f0 con 0x7fbe2015dea0 2024-05-09T05:54:21.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.059+0000 7fbe1dffb640 1 -- 172.21.15.72:0/3299417537 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe08003530 con 0x7fbe2015dea0 2024-05-09T05:54:21.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.059+0000 7fbe1dffb640 1 -- 172.21.15.72:0/3299417537 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 649241109 0 0) 0x7fbe08003530 con 0x7fbe2015dea0 2024-05-09T05:54:21.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.059+0000 7fbe1dffb640 1 -- 172.21.15.72:0/3299417537 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe20162e60 msgr2=0x7fbe20165280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:21.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.059+0000 7fbe1dffb640 1 --2- 172.21.15.72:0/3299417537 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe20162e60 0x7fbe20165280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:21.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.059+0000 7fbe1dffb640 1 -- 172.21.15.72:0/3299417537 >> v2:172.21.15.110:3300/0 conn(0x7fbe2015da90 msgr2=0x7fbe200c7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:21.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.059+0000 7fbe1dffb640 1 --2- 172.21.15.72:0/3299417537 >> v2:172.21.15.110:3300/0 conn(0x7fbe2015da90 0x7fbe200c7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:21.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.059+0000 7fbe1dffb640 1 -- 172.21.15.72:0/3299417537 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe200c87d0 con 0x7fbe2015dea0 2024-05-09T05:54:21.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.059+0000 7fbe1dffb640 1 -- 172.21.15.72:0/3299417537 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2749052815 0 0) 0x7fbe14001700 con 0x7fbe2015dea0 2024-05-09T05:54:21.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.059+0000 7fbe1dffb640 1 -- 172.21.15.72:0/3299417537 >> v1:172.21.15.72:6789/0 conn(0x7fbe2015dea0 legacy=0x7fbe200745b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:21.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.059+0000 7fbe1dffb640 1 --2- 172.21.15.72:0/3299417537 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe20162e60 0x7fbe08003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:21.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.059+0000 7fbe1dffb640 1 --2- 172.21.15.72:0/3299417537 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe08004000 0x7fbe08004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:21.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.059+0000 7fbe1dffb640 1 --2- 172.21.15.72:0/3299417537 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe08004d50 0x7fbe08005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:21.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.059+0000 7fbe1dffb640 1 -- 172.21.15.72:0/3299417537 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fbe200c84f0 con 0x7fbe08004d50 2024-05-09T05:54:21.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.059+0000 7fbe1dffb640 1 -- 172.21.15.72:0/3299417537 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0800ba80 con 0x7fbe08004000 2024-05-09T05:54:21.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.059+0000 7fbe1dffb640 1 -- 172.21.15.72:0/3299417537 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fbe0800bc80 con 0x7fbe20162e60 2024-05-09T05:54:21.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.059+0000 7fbe1f7fe640 1 --2- 172.21.15.72:0/3299417537 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe08004d50 0x7fbe08005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:21.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.059+0000 7fbe1e7fc640 1 --2- 172.21.15.72:0/3299417537 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe08004000 0x7fbe08004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:21.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.059+0000 7fbe1effd640 1 --2- 172.21.15.72:0/3299417537 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe20162e60 0x7fbe08003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:21.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.059+0000 7fbe1f7fe640 1 -- 172.21.15.72:0/3299417537 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe20162e60 msgr2=0x7fbe08003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:21.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.059+0000 7fbe1f7fe640 1 --2- 172.21.15.72:0/3299417537 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe20162e60 0x7fbe08003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:21.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.059+0000 7fbe1f7fe640 1 -- 172.21.15.72:0/3299417537 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe08004000 msgr2=0x7fbe08004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:21.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.059+0000 7fbe1f7fe640 1 --2- 172.21.15.72:0/3299417537 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe08004000 0x7fbe08004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:21.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.059+0000 7fbe1f7fe640 1 -- 172.21.15.72:0/3299417537 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe08003530 con 0x7fbe08004d50 2024-05-09T05:54:21.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.063+0000 7fbe1effd640 1 --2- 172.21.15.72:0/3299417537 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe20162e60 0x7fbe08003a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:54:21.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.063+0000 7fbe1f7fe640 1 --2- 172.21.15.72:0/3299417537 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe08004d50 0x7fbe08005160 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fbe18009f90 tx=0x7fbe1801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f00846761e768875 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:21.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.063+0000 7fbe1dffb640 1 -- 172.21.15.72:0/3299417537 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe180b2070 con 0x7fbe08004d50 2024-05-09T05:54:21.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.063+0000 7fbe1dffb640 1 -- 172.21.15.72:0/3299417537 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe180a5c70 con 0x7fbe08004d50 2024-05-09T05:54:21.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.063+0000 7fbe1dffb640 1 -- 172.21.15.72:0/3299417537 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe18009c10 con 0x7fbe08004d50 2024-05-09T05:54:21.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.063+0000 7fbe256b9640 1 -- 172.21.15.72:0/3299417537 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe08004d50 msgr2=0x7fbe08005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:21.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.063+0000 7fbe256b9640 1 --2- 172.21.15.72:0/3299417537 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe08004d50 0x7fbe08005160 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fbe18009f90 tx=0x7fbe1801cc60 comp rx=0 tx=0).stop 2024-05-09T05:54:21.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.063+0000 7fbe1f7fe640 1 -- 172.21.15.72:0/3299417537 reap_dead start 2024-05-09T05:54:21.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.063+0000 7fbe256b9640 1 -- 172.21.15.72:0/3299417537 shutdown_connections 2024-05-09T05:54:21.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.063+0000 7fbe256b9640 1 -- 172.21.15.72:0/3299417537 >> 172.21.15.72:0/3299417537 conn(0x7fbe200cde90 msgr2=0x7fbe200ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:21.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.063+0000 7fbe256b9640 1 -- 172.21.15.72:0/3299417537 shutdown_connections 2024-05-09T05:54:21.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.063+0000 7fbe256b9640 1 -- 172.21.15.72:0/3299417537 wait complete. 2024-05-09T05:54:21.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.067+0000 7fbe256b9640 1 Processor -- start 2024-05-09T05:54:21.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.067+0000 7fbe256b9640 1 -- start start 2024-05-09T05:54:21.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.067+0000 7fbe256b9640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe201604c0 0x7fbe201495a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:21.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.067+0000 7fbe256b9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe2014cba0 0x7fbe2014e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:21.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.067+0000 7fbe256b9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe2014cfb0 0x7fbe2014ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:21.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.067+0000 7fbe256b9640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fbe2015ad70 con 0x7fbe201604c0 2024-05-09T05:54:21.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.067+0000 7fbe256b9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fbe2015aa90 con 0x7fbe2014cfb0 2024-05-09T05:54:21.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.067+0000 7fbe256b9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fbe200c70e0 con 0x7fbe2014cba0 2024-05-09T05:54:21.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.067+0000 7fbe1effd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe201604c0 0x7fbe201495a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:21.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.067+0000 7fbe1effd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe201604c0 0x7fbe201495a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46230/0 (socket says 172.21.15.72:46230) 2024-05-09T05:54:21.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.067+0000 7fbe1effd640 1 -- 172.21.15.72:0/3413677205 learned_addr learned my addr 172.21.15.72:0/3413677205 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:54:21.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.067+0000 7fbe1e7fc640 1 --2- 172.21.15.72:0/3413677205 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe2014cba0 0x7fbe2014e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:21.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.067+0000 7fbe1f7fe640 1 --2- 172.21.15.72:0/3413677205 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe2014cfb0 0x7fbe2014ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:21.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.067+0000 7fbe1effd640 1 -- 172.21.15.72:0/3413677205 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe2014cba0 msgr2=0x7fbe2014e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:21.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.067+0000 7fbe1effd640 1 --2- 172.21.15.72:0/3413677205 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe2014cba0 0x7fbe2014e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:21.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.067+0000 7fbe1effd640 1 -- 172.21.15.72:0/3413677205 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe2014cfb0 msgr2=0x7fbe2014ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:21.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.067+0000 7fbe1effd640 1 --2- 172.21.15.72:0/3413677205 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe2014cfb0 0x7fbe2014ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:21.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.067+0000 7fbe1effd640 1 -- 172.21.15.72:0/3413677205 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe201f0910 con 0x7fbe201604c0 2024-05-09T05:54:21.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.067+0000 7fbe1e7fc640 1 --2- 172.21.15.72:0/3413677205 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe2014cba0 0x7fbe2014e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:54:21.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.067+0000 7fbe1f7fe640 1 --2- 172.21.15.72:0/3413677205 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe2014cfb0 0x7fbe2014ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:54:21.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.067+0000 7fbe1effd640 1 --2- 172.21.15.72:0/3413677205 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe201604c0 0x7fbe201495a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fbe10010860 tx=0x7fbe10010c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:21.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.067+0000 7fbe077fe640 1 -- 172.21.15.72:0/3413677205 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe1000f040 con 0x7fbe201604c0 2024-05-09T05:54:21.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.067+0000 7fbe077fe640 1 -- 172.21.15.72:0/3413677205 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe1000eb00 con 0x7fbe201604c0 2024-05-09T05:54:21.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.067+0000 7fbe077fe640 1 -- 172.21.15.72:0/3413677205 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe10010e50 con 0x7fbe201604c0 2024-05-09T05:54:21.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.067+0000 7fbe256b9640 1 -- 172.21.15.72:0/3413677205 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe201f0bf0 con 0x7fbe201604c0 2024-05-09T05:54:21.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.067+0000 7fbe256b9640 1 -- 172.21.15.72:0/3413677205 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe201f11b0 con 0x7fbe201604c0 2024-05-09T05:54:21.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.071+0000 7fbe256b9640 1 -- 172.21.15.72:0/3413677205 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe2006a520 con 0x7fbe201604c0 2024-05-09T05:54:21.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.071+0000 7fbe077fe640 1 -- 172.21.15.72:0/3413677205 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fbe10026430 con 0x7fbe201604c0 2024-05-09T05:54:21.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.071+0000 7fbe077fe640 1 --2- 172.21.15.72:0/3413677205 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fbe0c06f400 0x7fbe0c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:21.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.071+0000 7fbe077fe640 1 -- 172.21.15.72:0/3413677205 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7fbe1008faa0 con 0x7fbe201604c0 2024-05-09T05:54:21.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.071+0000 7fbe1e7fc640 1 --2- 172.21.15.72:0/3413677205 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fbe0c06f400 0x7fbe0c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:21.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.071+0000 7fbe1e7fc640 1 --2- 172.21.15.72:0/3413677205 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fbe0c06f400 0x7fbe0c071910 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbe20158050 tx=0x7fbe14009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:21.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.075+0000 7fbe077fe640 1 -- 172.21.15.72:0/3413677205 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fbe10018030 con 0x7fbe201604c0 2024-05-09T05:54:21.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.239+0000 7fbe256b9640 1 -- 172.21.15.72:0/3413677205 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbe20157cf0 con 0x7fbe201604c0 2024-05-09T05:54:21.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.243+0000 7fbe077fe640 1 -- 172.21.15.72:0/3413677205 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18589 (secure 0 0 0) 0x7fbe1005c790 con 0x7fbe201604c0 2024-05-09T05:54:21.234 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:54:21.234 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":27,"fsid":"44c88cb9-b39b-4787-a871-80ddf0ad6292","created":"2024-05-09T05:52:59.591187+0000","modified":"2024-05-09T05:54:05.939506+0000","last_up_change":"2024-05-09T05:53:10.902489+0000","last_in_change":"2024-05-09T05:53:02.200254+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T05:53:10.503537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T05:53:21.364958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T05:53:22.461477+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-09T05:53:26.171144+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e4af2aa1-ba5c-4411-a72a-a0e38e589a74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":331913921},{"type":"v1","addr":"172.21.15.72:6817","nonce":331913921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":331913921},{"type":"v1","addr":"172.21.15.72:6819","nonce":331913921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":331913921},{"type":"v1","addr":"172.21.15.72:6823","nonce":331913921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":331913921},{"type":"v1","addr":"172.21.15.72:6821","nonce":331913921}]},"public_addr":"172.21.15.72:6817/331913921","cluster_addr":"172.21.15.72:6819/331913921","heartbeat_back_addr":"172.21.15.72:6823/331913921","heartbeat_front_addr":"172.21.15.72:6821/331913921","state":["exists","up"]},{"osd":1,"uuid":"052504f5-a523-4922-bdc7-ce2890faa5ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2197151836},{"type":"v1","addr":"172.21.15.72:6801","nonce":2197151836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2197151836},{"type":"v1","addr":"172.21.15.72:6803","nonce":2197151836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2197151836},{"type":"v1","addr":"172.21.15.72:6811","nonce":2197151836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2197151836},{"type":"v1","addr":"172.21.15.72:6807","nonce":2197151836}]},"public_addr":"172.21.15.72:6801/2197151836","cluster_addr":"172.21.15.72:6803/2197151836","heartbeat_back_addr":"172.21.15.72:6811/2197151836","heartbeat_front_addr":"172.21.15.72:6807/2197151836","state":["exists","up"]},{"osd":2,"uuid":"28bc1c95-6d0d-4263-baad-314d86e6a670","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1273581990},{"type":"v1","addr":"172.21.15.72:6825","nonce":1273581990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":1273581990},{"type":"v1","addr":"172.21.15.72:6827","nonce":1273581990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1273581990},{"type":"v1","addr":"172.21.15.72:6831","nonce":1273581990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1273581990},{"type":"v1","addr":"172.21.15.72:6829","nonce":1273581990}]},"public_addr":"172.21.15.72:6825/1273581990","cluster_addr":"172.21.15.72:6827/1273581990","heartbeat_back_addr":"172.21.15.72:6831/1273581990","heartbeat_front_addr":"172.21.15.72:6829/1273581990","state":["exists","up"]},{"osd":3,"uuid":"edcc86cb-f178-4533-8069-de9d781531ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2180866263},{"type":"v1","addr":"172.21.15.72:6806","nonce":2180866263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2180866263},{"type":"v1","addr":"172.21.15.72:6810","nonce":2180866263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2180866263},{"type":"v1","addr":"172.21.15.72:6815","nonce":2180866263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2180866263},{"type":"v1","addr":"172.21.15.72:6813","nonce":2180866263}]},"public_addr":"172.21.15.72:6806/2180866263","cluster_addr":"172.21.15.72:6810/2180866263","heartbeat_back_addr":"172.21.15.72:6815/2180866263","heartbeat_front_addr":"172.21.15.72:6813/2180866263","state":["exists","up"]},{"osd":4,"uuid":"8d138128-4829-4109-87a1-25f339f3e953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3437318248},{"type":"v1","addr":"172.21.15.110:6817","nonce":3437318248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3437318248},{"type":"v1","addr":"172.21.15.110:6819","nonce":3437318248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3437318248},{"type":"v1","addr":"172.21.15.110:6823","nonce":3437318248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3437318248},{"type":"v1","addr":"172.21.15.110:6821","nonce":3437318248}]},"public_addr":"172.21.15.110:6817/3437318248","cluster_addr":"172.21.15.110:6819/3437318248","heartbeat_back_addr":"172.21.15.110:6823/3437318248","heartbeat_front_addr":"172.21.15.110:6821/3437318248","state":["exists","up"]},{"osd":5,"uuid":"99a4a914-0a0e-4d25-94ae-3e86b8b1aa4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":977576181},{"type":"v1","addr":"172.21.15.110:6825","nonce":977576181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":977576181},{"type":"v1","addr":"172.21.15.110:6827","nonce":977576181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":977576181},{"type":"v1","addr":"172.21.15.110:6831","nonce":977576181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":977576181},{"type":"v1","addr":"172.21.15.110:6829","nonce":977576181}]},"public_addr":"172.21.15.110:6825/977576181","cluster_addr":"172.21.15.110:6827/977576181","heartbeat_back_addr":"172.21.15.110:6831/977576181","heartbeat_front_addr":"172.21.15.110:6829/977576181","state":["exists","up"]},{"osd":6,"uuid":"6e04b295-afc9-4f80-80f7-3df1f5168608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":1817638786},{"type":"v1","addr":"172.21.15.110:6809","nonce":1817638786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":1817638786},{"type":"v1","addr":"172.21.15.110:6811","nonce":1817638786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":1817638786},{"type":"v1","addr":"172.21.15.110:6815","nonce":1817638786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":1817638786},{"type":"v1","addr":"172.21.15.110:6813","nonce":1817638786}]},"public_addr":"172.21.15.110:6809/1817638786","cluster_addr":"172.21.15.110:6811/1817638786","heartbeat_back_addr":"172.21.15.110:6815/1817638786","heartbeat_front_addr":"172.21.15.110:6813/1817638786","state":["exists","up"]},{"osd":7,"uuid":"835de5c9-1e2c-41d8-bd28-d7ffe5ad8fdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":214675920},{"type":"v1","addr":"172.21.15.110:6801","nonce":214675920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":214675920},{"type":"v1","addr":"172.21.15.110:6803","nonce":214675920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":214675920},{"type":"v1","addr":"172.21.15.110:6807","nonce":214675920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":214675920},{"type":"v1","addr":"172.21.15.110:6805","nonce":214675920}]},"public_addr":"172.21.15.110:6801/214675920","cluster_addr":"172.21.15.110:6803/214675920","heartbeat_back_addr":"172.21.15.110:6807/214675920","heartbeat_front_addr":"172.21.15.110:6805/214675920","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.849761+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.670554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.743789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:08.516367+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.665550+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.518775+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.786468+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.794984+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":0,"to":7}]},{"pgid":"4.6","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T05:54:21.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.243+0000 7fbe256b9640 1 -- 172.21.15.72:0/3413677205 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fbe0c06f400 msgr2=0x7fbe0c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:21.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.243+0000 7fbe256b9640 1 --2- 172.21.15.72:0/3413677205 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fbe0c06f400 0x7fbe0c071910 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbe20158050 tx=0x7fbe14009040 comp rx=0 tx=0).stop 2024-05-09T05:54:21.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.243+0000 7fbe256b9640 1 -- 172.21.15.72:0/3413677205 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe201604c0 msgr2=0x7fbe201495a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:21.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.243+0000 7fbe256b9640 1 --2- 172.21.15.72:0/3413677205 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe201604c0 0x7fbe201495a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fbe10010860 tx=0x7fbe10010c60 comp rx=0 tx=0).stop 2024-05-09T05:54:21.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.243+0000 7fbe256b9640 1 -- 172.21.15.72:0/3413677205 shutdown_connections 2024-05-09T05:54:21.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.243+0000 7fbe256b9640 1 --2- 172.21.15.72:0/3413677205 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fbe0c06f400 0x7fbe0c071910 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:21.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.247+0000 7fbe256b9640 1 --2- 172.21.15.72:0/3413677205 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe2014cfb0 0x7fbe2014ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:21.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.247+0000 7fbe256b9640 1 --2- 172.21.15.72:0/3413677205 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe2014cba0 0x7fbe2014e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:21.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.247+0000 7fbe256b9640 1 --2- 172.21.15.72:0/3413677205 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe201604c0 0x7fbe201495a0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:21.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.247+0000 7fbe256b9640 1 -- 172.21.15.72:0/3413677205 >> 172.21.15.72:0/3413677205 conn(0x7fbe200cde90 msgr2=0x7fbe200cc370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:21.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.247+0000 7fbe256b9640 1 -- 172.21.15.72:0/3413677205 shutdown_connections 2024-05-09T05:54:21.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.247+0000 7fbe256b9640 1 -- 172.21.15.72:0/3413677205 wait complete. 2024-05-09T05:54:21.256 INFO:tasks.mds_thrash.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-09T05:53:10.503537+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-09T05:53:21.364958+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-09T05:53:22.461477+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-09T05:53:26.171144+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-09T05:54:21.256 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-09T05:54:21.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.407+0000 7fa99c884640 1 Processor -- start 2024-05-09T05:54:21.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.407+0000 7fa99c884640 1 -- start start 2024-05-09T05:54:21.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.411+0000 7fa99c884640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa9980c77a0 0x7fa9981537d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:21.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.411+0000 7fa99c884640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa998161d70 0x7fa998164190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:21.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.411+0000 7fa99c884640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9980c72c0 con 0x7fa998074740 2024-05-09T05:54:21.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.411+0000 7fa99c884640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fa9980c7bb0 con 0x7fa998161d70 2024-05-09T05:54:21.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.411+0000 7fa99c884640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fa998074460 con 0x7fa9980c77a0 2024-05-09T05:54:21.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.411+0000 7fa996d9d640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa998161d70 0x7fa998164190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:21.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.411+0000 7fa995d9b640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fa998074740 0x7fa998072e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41518/0 (socket says 172.21.15.72:41518) 2024-05-09T05:54:21.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.411+0000 7fa996d9d640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa998161d70 0x7fa998164190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46238/0 (socket says 172.21.15.72:46238) 2024-05-09T05:54:21.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.411+0000 7fa995d9b640 1 -- 172.21.15.72:0/1967960829 learned_addr learned my addr 172.21.15.72:0/1967960829 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:54:21.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.411+0000 7fa99659c640 1 --2- 172.21.15.72:0/1967960829 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa9980c77a0 0x7fa9981537d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:21.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.411+0000 7fa996d9d640 1 -- 172.21.15.72:0/1967960829 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa9980c77a0 msgr2=0x7fa9981537d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:21.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.411+0000 7fa996d9d640 1 --2- 172.21.15.72:0/1967960829 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa9980c77a0 0x7fa9981537d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:21.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.411+0000 7fa996d9d640 1 -- 172.21.15.72:0/1967960829 >> v1:172.21.15.72:6789/0 conn(0x7fa998074740 legacy=0x7fa998072e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:21.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.411+0000 7fa99559a640 1 -- 172.21.15.72:0/1967960829 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2573983222 0 0) 0x7fa9980c72c0 con 0x7fa998074740 2024-05-09T05:54:21.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.411+0000 7fa996d9d640 1 -- 172.21.15.72:0/1967960829 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa998073af0 con 0x7fa998161d70 2024-05-09T05:54:21.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.415+0000 7fa996d9d640 1 --2- 172.21.15.72:0/1967960829 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa998161d70 0x7fa998164190 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa990009d90 tx=0x7fa99001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e998fdded025ff90 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:21.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.415+0000 7fa99559a640 1 -- 172.21.15.72:0/1967960829 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9900b2070 con 0x7fa998161d70 2024-05-09T05:54:21.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.415+0000 7fa99559a640 1 -- 172.21.15.72:0/1967960829 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9900a5a40 con 0x7fa998161d70 2024-05-09T05:54:21.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.415+0000 7fa99559a640 1 -- 172.21.15.72:0/1967960829 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9900a5e10 con 0x7fa998161d70 2024-05-09T05:54:21.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.415+0000 7fa99c884640 1 -- 172.21.15.72:0/1967960829 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa998161d70 msgr2=0x7fa998164190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:21.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.415+0000 7fa99c884640 1 --2- 172.21.15.72:0/1967960829 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa998161d70 0x7fa998164190 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa990009d90 tx=0x7fa99001c960 comp rx=0 tx=0).stop 2024-05-09T05:54:21.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.415+0000 7fa99c884640 1 -- 172.21.15.72:0/1967960829 shutdown_connections 2024-05-09T05:54:21.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.415+0000 7fa99c884640 1 --2- 172.21.15.72:0/1967960829 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa998161d70 0x7fa998164190 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:21.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.415+0000 7fa99c884640 1 --2- 172.21.15.72:0/1967960829 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa9980c77a0 0x7fa9981537d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:21.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.415+0000 7fa99c884640 1 -- 172.21.15.72:0/1967960829 >> 172.21.15.72:0/1967960829 conn(0x7fa9980cde90 msgr2=0x7fa9980ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:21.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.415+0000 7fa99c884640 1 -- 172.21.15.72:0/1967960829 shutdown_connections 2024-05-09T05:54:21.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.415+0000 7fa99c884640 1 -- 172.21.15.72:0/1967960829 wait complete. 2024-05-09T05:54:21.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.415+0000 7fa99c884640 1 Processor -- start 2024-05-09T05:54:21.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.415+0000 7fa99c884640 1 -- start start 2024-05-09T05:54:21.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.415+0000 7fa99c884640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa998074740 0x7fa998163ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:21.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.415+0000 7fa99c884640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9980c77a0 0x7fa998152340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:21.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.415+0000 7fa99c884640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa998161d70 0x7fa9981480b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:21.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.415+0000 7fa99c884640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fa9980c4cb0 con 0x7fa998074740 2024-05-09T05:54:21.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.415+0000 7fa99c884640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fa998072940 con 0x7fa9980c77a0 2024-05-09T05:54:21.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.415+0000 7fa99c884640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fa9980c4e30 con 0x7fa998161d70 2024-05-09T05:54:21.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.419+0000 7fa99659c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa998074740 0x7fa998163ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:21.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.419+0000 7fa99659c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa998074740 0x7fa998163ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46240/0 (socket says 172.21.15.72:46240) 2024-05-09T05:54:21.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.419+0000 7fa99659c640 1 -- 172.21.15.72:0/977106775 learned_addr learned my addr 172.21.15.72:0/977106775 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:54:21.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.419+0000 7fa996d9d640 1 --2- 172.21.15.72:0/977106775 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa998161d70 0x7fa9981480b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:21.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.419+0000 7fa995d9b640 1 --2- 172.21.15.72:0/977106775 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9980c77a0 0x7fa998152340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:21.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.419+0000 7fa99659c640 1 -- 172.21.15.72:0/977106775 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa998161d70 msgr2=0x7fa9981480b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:21.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.419+0000 7fa99659c640 1 --2- 172.21.15.72:0/977106775 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa998161d70 0x7fa9981480b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:21.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.419+0000 7fa99659c640 1 -- 172.21.15.72:0/977106775 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9980c77a0 msgr2=0x7fa998152340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:21.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.419+0000 7fa99659c640 1 --2- 172.21.15.72:0/977106775 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9980c77a0 0x7fa998152340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:21.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.419+0000 7fa99659c640 1 -- 172.21.15.72:0/977106775 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa998152880 con 0x7fa998074740 2024-05-09T05:54:21.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.419+0000 7fa995d9b640 1 --2- 172.21.15.72:0/977106775 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9980c77a0 0x7fa998152340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:54:21.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.419+0000 7fa99659c640 1 --2- 172.21.15.72:0/977106775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa998074740 0x7fa998163ec0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa98800fa40 tx=0x7fa98800ff00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:21.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.419+0000 7fa986ffd640 1 -- 172.21.15.72:0/977106775 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa988004440 con 0x7fa998074740 2024-05-09T05:54:21.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.419+0000 7fa986ffd640 1 -- 172.21.15.72:0/977106775 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa988017070 con 0x7fa998074740 2024-05-09T05:54:21.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.419+0000 7fa99c884640 1 -- 172.21.15.72:0/977106775 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa99815ae50 con 0x7fa998074740 2024-05-09T05:54:21.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.419+0000 7fa986ffd640 1 -- 172.21.15.72:0/977106775 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa988007a40 con 0x7fa998074740 2024-05-09T05:54:21.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.419+0000 7fa99c884640 1 -- 172.21.15.72:0/977106775 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa99815b410 con 0x7fa998074740 2024-05-09T05:54:21.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.419+0000 7fa99c884640 1 -- 172.21.15.72:0/977106775 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa99806a520 con 0x7fa998074740 2024-05-09T05:54:21.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.419+0000 7fa986ffd640 1 -- 172.21.15.72:0/977106775 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fa988007be0 con 0x7fa998074740 2024-05-09T05:54:21.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.419+0000 7fa986ffd640 1 --2- 172.21.15.72:0/977106775 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fa97806f400 0x7fa978071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:21.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.419+0000 7fa986ffd640 1 -- 172.21.15.72:0/977106775 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7fa9880918d0 con 0x7fa998074740 2024-05-09T05:54:21.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.419+0000 7fa995d9b640 1 --2- 172.21.15.72:0/977106775 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fa97806f400 0x7fa978071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:21.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.423+0000 7fa995d9b640 1 --2- 172.21.15.72:0/977106775 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fa97806f400 0x7fa978071910 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa9980c6530 tx=0x7fa98c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:21.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.423+0000 7fa986ffd640 1 -- 172.21.15.72:0/977106775 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fa98805df20 con 0x7fa998074740 2024-05-09T05:54:21.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.587+0000 7fa99c884640 1 -- 172.21.15.72:0/977106775 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa998072c50 con 0x7fa998074740 2024-05-09T05:54:21.577 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.587+0000 7fa986ffd640 1 -- 172.21.15.72:0/977106775 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7fa988062220 con 0x7fa998074740 2024-05-09T05:54:21.577 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2024-05-09T05:54:21.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.587+0000 7fa99c884640 1 -- 172.21.15.72:0/977106775 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fa97806f400 msgr2=0x7fa978071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:21.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.587+0000 7fa99c884640 1 --2- 172.21.15.72:0/977106775 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fa97806f400 0x7fa978071910 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa9980c6530 tx=0x7fa98c009040 comp rx=0 tx=0).stop 2024-05-09T05:54:21.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.587+0000 7fa99c884640 1 -- 172.21.15.72:0/977106775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa998074740 msgr2=0x7fa998163ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:21.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.587+0000 7fa99c884640 1 --2- 172.21.15.72:0/977106775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa998074740 0x7fa998163ec0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa98800fa40 tx=0x7fa98800ff00 comp rx=0 tx=0).stop 2024-05-09T05:54:21.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.587+0000 7fa99c884640 1 -- 172.21.15.72:0/977106775 shutdown_connections 2024-05-09T05:54:21.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.587+0000 7fa99c884640 1 --2- 172.21.15.72:0/977106775 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fa97806f400 0x7fa978071910 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:21.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.587+0000 7fa99c884640 1 --2- 172.21.15.72:0/977106775 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa998161d70 0x7fa9981480b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:21.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.587+0000 7fa99c884640 1 --2- 172.21.15.72:0/977106775 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9980c77a0 0x7fa998152340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:21.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.587+0000 7fa99c884640 1 --2- 172.21.15.72:0/977106775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa998074740 0x7fa998163ec0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:21.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.587+0000 7fa99c884640 1 -- 172.21.15.72:0/977106775 >> 172.21.15.72:0/977106775 conn(0x7fa9980cde90 msgr2=0x7fa9980c4540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:21.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.587+0000 7fa99c884640 1 -- 172.21.15.72:0/977106775 shutdown_connections 2024-05-09T05:54:21.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.587+0000 7fa99c884640 1 -- 172.21.15.72:0/977106775 wait complete. 2024-05-09T05:54:21.598 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-09T05:54:21.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.747+0000 7ff9f38cc640 1 Processor -- start 2024-05-09T05:54:21.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.747+0000 7ff9f38cc640 1 -- start start 2024-05-09T05:54:21.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.747+0000 7ff9f38cc640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9ec15dea0 0x7ff9ec0745b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:21.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.747+0000 7ff9f38cc640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9ec0c7c80 con 0x7ff9ec15da90 2024-05-09T05:54:21.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.747+0000 7ff9f38cc640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9ec15a4f0 con 0x7ff9ec074af0 2024-05-09T05:54:21.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.747+0000 7ff9f38cc640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7ff9ec1513f0 con 0x7ff9ec15dea0 2024-05-09T05:54:21.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.747+0000 7ff9f1668640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff9ec15da90 0x7ff9ec0c7570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41526/0 (socket says 172.21.15.72:41526) 2024-05-09T05:54:21.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.747+0000 7ff9f1668640 1 -- 172.21.15.72:0/2012783470 learned_addr learned my addr 172.21.15.72:0/2012783470 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:54:21.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.747+0000 7ff9e3fff640 1 -- 172.21.15.72:0/2012783470 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1479886642 0 0) 0x7ff9ec0c7c80 con 0x7ff9ec15da90 2024-05-09T05:54:21.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.747+0000 7ff9e3fff640 1 -- 172.21.15.72:0/2012783470 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9d8003530 con 0x7ff9ec15da90 2024-05-09T05:54:21.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.747+0000 7ff9f0e67640 1 --2- 172.21.15.72:0/2012783470 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9ec15dea0 0x7ff9ec0745b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:21.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.747+0000 7ff9e3fff640 1 -- 172.21.15.72:0/2012783470 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4107104802 0 0) 0x7ff9d8003530 con 0x7ff9ec15da90 2024-05-09T05:54:21.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.747+0000 7ff9e3fff640 1 -- 172.21.15.72:0/2012783470 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9ec15dea0 msgr2=0x7ff9ec0745b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:21.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.747+0000 7ff9e3fff640 1 --2- 172.21.15.72:0/2012783470 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9ec15dea0 0x7ff9ec0745b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:21.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.747+0000 7ff9e3fff640 1 -- 172.21.15.72:0/2012783470 >> v1:172.21.15.110:6789/0 conn(0x7ff9ec074af0 legacy=0x7ff9ec164e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:21.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.747+0000 7ff9e3fff640 1 -- 172.21.15.72:0/2012783470 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9ec0c84f0 con 0x7ff9ec15da90 2024-05-09T05:54:21.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.747+0000 7ff9e3fff640 1 -- 172.21.15.72:0/2012783470 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2749052815 0 0) 0x7ff9e4001700 con 0x7ff9ec15da90 2024-05-09T05:54:21.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.747+0000 7ff9e3fff640 1 -- 172.21.15.72:0/2012783470 >> v1:172.21.15.72:6789/0 conn(0x7ff9ec15da90 legacy=0x7ff9ec0c7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:21.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.747+0000 7ff9e3fff640 1 --2- 172.21.15.72:0/2012783470 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9ec15dea0 0x7ff9d8003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:21.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.747+0000 7ff9e3fff640 1 --2- 172.21.15.72:0/2012783470 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9d80040e0 0x7ff9d8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:21.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.747+0000 7ff9e3fff640 1 --2- 172.21.15.72:0/2012783470 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9d8004e70 0x7ff9d80052e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:21.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.747+0000 7ff9e3fff640 1 -- 172.21.15.72:0/2012783470 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d800bca0 con 0x7ff9d8004e70 2024-05-09T05:54:21.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.747+0000 7ff9e3fff640 1 -- 172.21.15.72:0/2012783470 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d800be50 con 0x7ff9d80040e0 2024-05-09T05:54:21.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.747+0000 7ff9e3fff640 1 -- 172.21.15.72:0/2012783470 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7ff9d800c050 con 0x7ff9ec15dea0 2024-05-09T05:54:21.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.747+0000 7ff9f1e69640 1 --2- 172.21.15.72:0/2012783470 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9d8004e70 0x7ff9d80052e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:21.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.747+0000 7ff9f0e67640 1 --2- 172.21.15.72:0/2012783470 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9d80040e0 0x7ff9d8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:21.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.747+0000 7ff9f1668640 1 --2- 172.21.15.72:0/2012783470 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9ec15dea0 0x7ff9d8003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:21.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.747+0000 7ff9f1e69640 1 -- 172.21.15.72:0/2012783470 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9ec15dea0 msgr2=0x7ff9d8003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:21.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.747+0000 7ff9f1e69640 1 --2- 172.21.15.72:0/2012783470 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9ec15dea0 0x7ff9d8003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:21.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.747+0000 7ff9f1e69640 1 -- 172.21.15.72:0/2012783470 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9d80040e0 msgr2=0x7ff9d8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:21.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.747+0000 7ff9f1e69640 1 --2- 172.21.15.72:0/2012783470 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9d80040e0 0x7ff9d8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:21.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.747+0000 7ff9f1e69640 1 -- 172.21.15.72:0/2012783470 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9d8003530 con 0x7ff9d8004e70 2024-05-09T05:54:21.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.751+0000 7ff9f1e69640 1 --2- 172.21.15.72:0/2012783470 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9d8004e70 0x7ff9d80052e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec0c74d0 tx=0x7ff9e801c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61a656e6588e7ce4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:21.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.751+0000 7ff9e3fff640 1 -- 172.21.15.72:0/2012783470 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e8001ae0 con 0x7ff9d8004e70 2024-05-09T05:54:21.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.751+0000 7ff9e3fff640 1 -- 172.21.15.72:0/2012783470 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9e8003b80 con 0x7ff9d8004e70 2024-05-09T05:54:21.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.751+0000 7ff9e3fff640 1 -- 172.21.15.72:0/2012783470 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e8005080 con 0x7ff9d8004e70 2024-05-09T05:54:21.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.751+0000 7ff9f38cc640 1 -- 172.21.15.72:0/2012783470 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9d8004e70 msgr2=0x7ff9d80052e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:21.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.751+0000 7ff9f38cc640 1 --2- 172.21.15.72:0/2012783470 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9d8004e70 0x7ff9d80052e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec0c74d0 tx=0x7ff9e801c710 comp rx=0 tx=0).stop 2024-05-09T05:54:21.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.751+0000 7ff9f1e69640 1 -- 172.21.15.72:0/2012783470 reap_dead start 2024-05-09T05:54:21.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.751+0000 7ff9f38cc640 1 -- 172.21.15.72:0/2012783470 shutdown_connections 2024-05-09T05:54:21.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.751+0000 7ff9f38cc640 1 -- 172.21.15.72:0/2012783470 >> 172.21.15.72:0/2012783470 conn(0x7ff9ec0cde90 msgr2=0x7ff9ec0ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:21.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.751+0000 7ff9f38cc640 1 -- 172.21.15.72:0/2012783470 shutdown_connections 2024-05-09T05:54:21.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.751+0000 7ff9f38cc640 1 -- 172.21.15.72:0/2012783470 wait complete. 2024-05-09T05:54:21.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.755+0000 7ff9f38cc640 1 Processor -- start 2024-05-09T05:54:21.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.755+0000 7ff9f38cc640 1 -- start start 2024-05-09T05:54:21.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.755+0000 7ff9f38cc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9ec14ed50 0x7ff9ec14d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:21.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.755+0000 7ff9f38cc640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9ec14f4b0 0x7ff9ec14f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:21.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.755+0000 7ff9f38cc640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9ec1f2d20 0x7ff9ec1f3130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:21.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.755+0000 7ff9f38cc640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff9ec15aa90 con 0x7ff9ec1f2d20 2024-05-09T05:54:21.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.755+0000 7ff9f38cc640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ff9ec15a7b0 con 0x7ff9ec14ed50 2024-05-09T05:54:21.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.755+0000 7ff9f38cc640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7ff9ec15ad70 con 0x7ff9ec14f4b0 2024-05-09T05:54:21.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.755+0000 7ff9f1e69640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9ec1f2d20 0x7ff9ec1f3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:21.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.755+0000 7ff9f1e69640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9ec1f2d20 0x7ff9ec1f3130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46260/0 (socket says 172.21.15.72:46260) 2024-05-09T05:54:21.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.755+0000 7ff9f1e69640 1 -- 172.21.15.72:0/3821903470 learned_addr learned my addr 172.21.15.72:0/3821903470 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:54:21.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.755+0000 7ff9f1668640 1 --2- 172.21.15.72:0/3821903470 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9ec14ed50 0x7ff9ec14d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:21.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.755+0000 7ff9f0e67640 1 --2- 172.21.15.72:0/3821903470 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9ec14f4b0 0x7ff9ec14f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:21.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.755+0000 7ff9f1e69640 1 -- 172.21.15.72:0/3821903470 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9ec14f4b0 msgr2=0x7ff9ec14f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:21.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.755+0000 7ff9f1e69640 1 --2- 172.21.15.72:0/3821903470 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9ec14f4b0 0x7ff9ec14f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:21.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.755+0000 7ff9f1e69640 1 -- 172.21.15.72:0/3821903470 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9ec14ed50 msgr2=0x7ff9ec14d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:21.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.755+0000 7ff9f1e69640 1 --2- 172.21.15.72:0/3821903470 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9ec14ed50 0x7ff9ec14d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:21.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.755+0000 7ff9f1e69640 1 -- 172.21.15.72:0/3821903470 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9ec1f6290 con 0x7ff9ec1f2d20 2024-05-09T05:54:21.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.755+0000 7ff9f0e67640 1 --2- 172.21.15.72:0/3821903470 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9ec14f4b0 0x7ff9ec14f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:54:21.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.755+0000 7ff9f1e69640 1 --2- 172.21.15.72:0/3821903470 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9ec1f2d20 0x7ff9ec1f3130 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8098180 tx=0x7ff9d8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:21.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.755+0000 7ff9e1ffb640 1 -- 172.21.15.72:0/3821903470 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e80b7070 con 0x7ff9ec1f2d20 2024-05-09T05:54:21.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.755+0000 7ff9e1ffb640 1 -- 172.21.15.72:0/3821903470 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9e8001ac0 con 0x7ff9ec1f2d20 2024-05-09T05:54:21.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.755+0000 7ff9f38cc640 1 -- 172.21.15.72:0/3821903470 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9ec1f6570 con 0x7ff9ec1f2d20 2024-05-09T05:54:21.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.755+0000 7ff9e1ffb640 1 -- 172.21.15.72:0/3821903470 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e8007e00 con 0x7ff9ec1f2d20 2024-05-09T05:54:21.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.755+0000 7ff9f38cc640 1 -- 172.21.15.72:0/3821903470 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9ec1f6b30 con 0x7ff9ec1f2d20 2024-05-09T05:54:21.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.755+0000 7ff9f38cc640 1 -- 172.21.15.72:0/3821903470 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9ec06a520 con 0x7ff9ec1f2d20 2024-05-09T05:54:21.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.759+0000 7ff9e1ffb640 1 -- 172.21.15.72:0/3821903470 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff9e80ba070 con 0x7ff9ec1f2d20 2024-05-09T05:54:21.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.759+0000 7ff9e1ffb640 1 --2- 172.21.15.72:0/3821903470 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7ff9d006f400 0x7ff9d0071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:21.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.759+0000 7ff9e1ffb640 1 -- 172.21.15.72:0/3821903470 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7ff9e81285e0 con 0x7ff9ec1f2d20 2024-05-09T05:54:21.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.759+0000 7ff9f1668640 1 --2- 172.21.15.72:0/3821903470 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7ff9d006f400 0x7ff9d0071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:21.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.759+0000 7ff9f1668640 1 --2- 172.21.15.72:0/3821903470 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7ff9d006f400 0x7ff9d0071910 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4001ec0 tx=0x7ff9e4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:21.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.763+0000 7ff9e1ffb640 1 -- 172.21.15.72:0/3821903470 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7ff9e80ac020 con 0x7ff9ec1f2d20 2024-05-09T05:54:21.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.911+0000 7ff9f38cc640 1 -- 172.21.15.72:0/3821903470 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ff9ec0c8b30 con 0x7ff9ec1f2d20 2024-05-09T05:54:21.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.911+0000 7ff9e1ffb640 1 -- 172.21.15.72:0/3821903470 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7ff9e8016470 con 0x7ff9ec1f2d20 2024-05-09T05:54:21.901 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2024-05-09T05:54:21.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.911+0000 7ff9f38cc640 1 -- 172.21.15.72:0/3821903470 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7ff9d006f400 msgr2=0x7ff9d0071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:21.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.911+0000 7ff9f38cc640 1 --2- 172.21.15.72:0/3821903470 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7ff9d006f400 0x7ff9d0071910 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4001ec0 tx=0x7ff9e4009040 comp rx=0 tx=0).stop 2024-05-09T05:54:21.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.911+0000 7ff9f38cc640 1 -- 172.21.15.72:0/3821903470 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9ec1f2d20 msgr2=0x7ff9ec1f3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:21.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.911+0000 7ff9f38cc640 1 --2- 172.21.15.72:0/3821903470 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9ec1f2d20 0x7ff9ec1f3130 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8098180 tx=0x7ff9d8005840 comp rx=0 tx=0).stop 2024-05-09T05:54:21.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.911+0000 7ff9f38cc640 1 -- 172.21.15.72:0/3821903470 shutdown_connections 2024-05-09T05:54:21.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.911+0000 7ff9f38cc640 1 --2- 172.21.15.72:0/3821903470 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7ff9d006f400 0x7ff9d0071910 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:21.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.911+0000 7ff9f38cc640 1 --2- 172.21.15.72:0/3821903470 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9ec1f2d20 0x7ff9ec1f3130 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:21.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.911+0000 7ff9f38cc640 1 --2- 172.21.15.72:0/3821903470 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9ec14f4b0 0x7ff9ec14f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:21.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.911+0000 7ff9f38cc640 1 --2- 172.21.15.72:0/3821903470 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9ec14ed50 0x7ff9ec14d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:21.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.911+0000 7ff9f38cc640 1 -- 172.21.15.72:0/3821903470 >> 172.21.15.72:0/3821903470 conn(0x7ff9ec0cde90 msgr2=0x7ff9ec06f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:21.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.911+0000 7ff9f38cc640 1 -- 172.21.15.72:0/3821903470 shutdown_connections 2024-05-09T05:54:21.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:21.911+0000 7ff9f38cc640 1 -- 172.21.15.72:0/3821903470 wait complete. 2024-05-09T05:54:21.921 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-09T05:54:22.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.071+0000 7f094519b640 1 Processor -- start 2024-05-09T05:54:22.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.071+0000 7f094519b640 1 -- start start 2024-05-09T05:54:22.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.071+0000 7f094519b640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f094015da90 0x7f09400c7570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:22.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.071+0000 7f094519b640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f094015dea0 0x7f09400745b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:22.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.071+0000 7f094519b640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f094015a4f0 con 0x7f0940074af0 2024-05-09T05:54:22.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.071+0000 7f094519b640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f09401513f0 con 0x7f094015dea0 2024-05-09T05:54:22.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.071+0000 7f094519b640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f09400c84f0 con 0x7f094015da90 2024-05-09T05:54:22.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.071+0000 7f093659c640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f094015dea0 0x7f09400745b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:22.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.071+0000 7f093659c640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f094015dea0 0x7f09400745b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46248/0 (socket says 172.21.15.72:46248) 2024-05-09T05:54:22.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.071+0000 7f093659c640 1 -- 172.21.15.72:0/3402465601 learned_addr learned my addr 172.21.15.72:0/3402465601 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:54:22.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.071+0000 7f093659c640 1 -- 172.21.15.72:0/3402465601 >> v2:172.21.15.110:3300/0 conn(0x7f094015da90 msgr2=0x7f09400c7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:22.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.071+0000 7f093659c640 1 --2- 172.21.15.72:0/3402465601 >> v2:172.21.15.110:3300/0 conn(0x7f094015da90 0x7f09400c7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:22.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.071+0000 7f093659c640 1 -- 172.21.15.72:0/3402465601 >> v1:172.21.15.110:6789/0 conn(0x7f0940074af0 legacy=0x7f094006fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:22.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.071+0000 7f093659c640 1 -- 172.21.15.72:0/3402465601 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09400c87d0 con 0x7f094015dea0 2024-05-09T05:54:22.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.075+0000 7f093659c640 1 --2- 172.21.15.72:0/3402465601 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f094015dea0 0x7f09400745b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0940071b70 tx=0x7f092801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12645e5ead4e7ab server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:22.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.075+0000 7f093e59c640 1 -- 172.21.15.72:0/3402465601 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09280b0070 con 0x7f094015dea0 2024-05-09T05:54:22.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.075+0000 7f093e59c640 1 -- 172.21.15.72:0/3402465601 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09280ab600 con 0x7f094015dea0 2024-05-09T05:54:22.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.075+0000 7f093e59c640 1 -- 172.21.15.72:0/3402465601 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09280ab9d0 con 0x7f094015dea0 2024-05-09T05:54:22.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.075+0000 7f094519b640 1 -- 172.21.15.72:0/3402465601 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f094015dea0 msgr2=0x7f09400745b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:22.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.075+0000 7f094519b640 1 --2- 172.21.15.72:0/3402465601 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f094015dea0 0x7f09400745b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0940071b70 tx=0x7f092801c520 comp rx=0 tx=0).stop 2024-05-09T05:54:22.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.075+0000 7f094519b640 1 -- 172.21.15.72:0/3402465601 shutdown_connections 2024-05-09T05:54:22.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.075+0000 7f094519b640 1 --2- 172.21.15.72:0/3402465601 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f094015dea0 0x7f09400745b0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:22.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.075+0000 7f094519b640 1 --2- 172.21.15.72:0/3402465601 >> v2:172.21.15.110:3300/0 conn(0x7f094015da90 0x7f09400c7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:22.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.075+0000 7f094519b640 1 -- 172.21.15.72:0/3402465601 >> 172.21.15.72:0/3402465601 conn(0x7f09400cde90 msgr2=0x7f09400ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:22.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.075+0000 7f094519b640 1 -- 172.21.15.72:0/3402465601 shutdown_connections 2024-05-09T05:54:22.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.075+0000 7f094519b640 1 -- 172.21.15.72:0/3402465601 wait complete. 2024-05-09T05:54:22.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.075+0000 7f094519b640 1 Processor -- start 2024-05-09T05:54:22.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.079+0000 7f094519b640 1 -- start start 2024-05-09T05:54:22.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.079+0000 7f094519b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0940074af0 0x7f0940156490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:22.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.079+0000 7f094519b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f094015da90 0x7f0940157110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:22.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.079+0000 7f094519b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f094015dea0 0x7f094014afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:22.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.079+0000 7f094519b640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f09400c81b0 con 0x7f094015dea0 2024-05-09T05:54:22.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.079+0000 7f094519b640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f09400c70e0 con 0x7f0940074af0 2024-05-09T05:54:22.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.079+0000 7f094519b640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f0940154ab0 con 0x7f094015da90 2024-05-09T05:54:22.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.079+0000 7f093f59e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f094015dea0 0x7f094014afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:22.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.079+0000 7f093f59e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f094015dea0 0x7f094014afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46250/0 (socket says 172.21.15.72:46250) 2024-05-09T05:54:22.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.079+0000 7f093f59e640 1 -- 172.21.15.72:0/4091676565 learned_addr learned my addr 172.21.15.72:0/4091676565 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:54:22.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.079+0000 7f093ed9d640 1 --2- 172.21.15.72:0/4091676565 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0940074af0 0x7f0940156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:22.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.079+0000 7f093659c640 1 --2- 172.21.15.72:0/4091676565 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f094015da90 0x7f0940157110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:22.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.079+0000 7f093f59e640 1 -- 172.21.15.72:0/4091676565 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f094015da90 msgr2=0x7f0940157110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:22.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.079+0000 7f093f59e640 1 --2- 172.21.15.72:0/4091676565 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f094015da90 0x7f0940157110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:22.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.079+0000 7f093f59e640 1 -- 172.21.15.72:0/4091676565 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0940074af0 msgr2=0x7f0940156490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:22.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.079+0000 7f093f59e640 1 --2- 172.21.15.72:0/4091676565 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0940074af0 0x7f0940156490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:22.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.079+0000 7f093f59e640 1 -- 172.21.15.72:0/4091676565 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f094015b6b0 con 0x7f094015dea0 2024-05-09T05:54:22.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.079+0000 7f093ed9d640 1 --2- 172.21.15.72:0/4091676565 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0940074af0 0x7f0940156490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:54:22.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.079+0000 7f093f59e640 1 --2- 172.21.15.72:0/4091676565 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f094015dea0 0x7f094014afc0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f093800b9f0 tx=0x7f093800beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:22.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.079+0000 7f0937fff640 1 -- 172.21.15.72:0/4091676565 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0938019070 con 0x7f094015dea0 2024-05-09T05:54:22.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.079+0000 7f0937fff640 1 -- 172.21.15.72:0/4091676565 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f093800cbd0 con 0x7f094015dea0 2024-05-09T05:54:22.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.079+0000 7f094519b640 1 -- 172.21.15.72:0/4091676565 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f094014c280 con 0x7f094015dea0 2024-05-09T05:54:22.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.079+0000 7f0937fff640 1 -- 172.21.15.72:0/4091676565 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0938014440 con 0x7f094015dea0 2024-05-09T05:54:22.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.079+0000 7f094519b640 1 -- 172.21.15.72:0/4091676565 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09401559b0 con 0x7f094015dea0 2024-05-09T05:54:22.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.079+0000 7f094519b640 1 -- 172.21.15.72:0/4091676565 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f094006a520 con 0x7f094015dea0 2024-05-09T05:54:22.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.079+0000 7f0937fff640 1 -- 172.21.15.72:0/4091676565 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f093801c070 con 0x7f094015dea0 2024-05-09T05:54:22.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.083+0000 7f0937fff640 1 --2- 172.21.15.72:0/4091676565 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f092006f400 0x7f0920071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:22.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.083+0000 7f0937fff640 1 -- 172.21.15.72:0/4091676565 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f093808f340 con 0x7f094015dea0 2024-05-09T05:54:22.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.083+0000 7f093ed9d640 1 --2- 172.21.15.72:0/4091676565 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f092006f400 0x7f0920071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:22.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.083+0000 7f093ed9d640 1 --2- 172.21.15.72:0/4091676565 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f092006f400 0x7f0920071910 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f09400754b0 tx=0x7f0930008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:22.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.087+0000 7f0937fff640 1 -- 172.21.15.72:0/4091676565 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f093805bf50 con 0x7f094015dea0 2024-05-09T05:54:22.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.235+0000 7f094519b640 1 -- 172.21.15.72:0/4091676565 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f09400c92f0 con 0x7f094015dea0 2024-05-09T05:54:22.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.235+0000 7f0937fff640 1 -- 172.21.15.72:0/4091676565 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f093805b850 con 0x7f094015dea0 2024-05-09T05:54:22.227 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2024-05-09T05:54:22.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.239+0000 7f094519b640 1 -- 172.21.15.72:0/4091676565 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f092006f400 msgr2=0x7f0920071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:22.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.239+0000 7f094519b640 1 --2- 172.21.15.72:0/4091676565 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f092006f400 0x7f0920071910 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f09400754b0 tx=0x7f0930008040 comp rx=0 tx=0).stop 2024-05-09T05:54:22.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.239+0000 7f094519b640 1 -- 172.21.15.72:0/4091676565 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f094015dea0 msgr2=0x7f094014afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:22.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.239+0000 7f094519b640 1 --2- 172.21.15.72:0/4091676565 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f094015dea0 0x7f094014afc0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f093800b9f0 tx=0x7f093800beb0 comp rx=0 tx=0).stop 2024-05-09T05:54:22.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.239+0000 7f094519b640 1 -- 172.21.15.72:0/4091676565 shutdown_connections 2024-05-09T05:54:22.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.239+0000 7f094519b640 1 --2- 172.21.15.72:0/4091676565 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f092006f400 0x7f0920071910 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:22.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.239+0000 7f094519b640 1 --2- 172.21.15.72:0/4091676565 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f094015dea0 0x7f094014afc0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:22.229 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.239+0000 7f094519b640 1 --2- 172.21.15.72:0/4091676565 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f094015da90 0x7f0940157110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:22.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.239+0000 7f094519b640 1 --2- 172.21.15.72:0/4091676565 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0940074af0 0x7f0940156490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:22.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.239+0000 7f094519b640 1 -- 172.21.15.72:0/4091676565 >> 172.21.15.72:0/4091676565 conn(0x7f09400cde90 msgr2=0x7f09401590a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:22.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.239+0000 7f094519b640 1 -- 172.21.15.72:0/4091676565 shutdown_connections 2024-05-09T05:54:22.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.239+0000 7f094519b640 1 -- 172.21.15.72:0/4091676565 wait complete. 2024-05-09T05:54:22.246 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-09T05:54:22.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.395+0000 7fe4ef07c640 1 Processor -- start 2024-05-09T05:54:22.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.395+0000 7fe4ef07c640 1 -- start start 2024-05-09T05:54:22.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.395+0000 7fe4ef07c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe4e8159ed0 0x7fe4e8153860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:22.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.395+0000 7fe4ef07c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe4e8072f40 0x7fe4e8073350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:22.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.395+0000 7fe4ef07c640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4e8072b00 con 0x7fe4e80c6cd0 2024-05-09T05:54:22.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.395+0000 7fe4ef07c640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fe4e8072540 con 0x7fe4e8159ed0 2024-05-09T05:54:22.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.395+0000 7fe4ef07c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fe4e8072820 con 0x7fe4e8072f40 2024-05-09T05:54:22.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.395+0000 7fe4ed619640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe4e80c6cd0 0x7fe4e80c70e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33252/0 (socket says 172.21.15.72:33252) 2024-05-09T05:54:22.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.395+0000 7fe4ed619640 1 -- 172.21.15.72:0/930476667 learned_addr learned my addr 172.21.15.72:0/930476667 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:54:22.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.395+0000 7fe4e77fe640 1 -- 172.21.15.72:0/930476667 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1443765159 0 0) 0x7fe4e8072b00 con 0x7fe4e80c6cd0 2024-05-09T05:54:22.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.395+0000 7fe4ece18640 1 --2- 172.21.15.72:0/930476667 >> v2:172.21.15.110:3300/0 conn(0x7fe4e8159ed0 0x7fe4e8153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:22.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.395+0000 7fe4e77fe640 1 -- 172.21.15.72:0/930476667 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4d0003530 con 0x7fe4e80c6cd0 2024-05-09T05:54:22.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.395+0000 7fe4e7fff640 1 --2- 172.21.15.72:0/930476667 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe4e8072f40 0x7fe4e8073350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:22.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.395+0000 7fe4e77fe640 1 -- 172.21.15.72:0/930476667 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1291443541 0 0) 0x7fe4d0003530 con 0x7fe4e80c6cd0 2024-05-09T05:54:22.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.395+0000 7fe4e77fe640 1 -- 172.21.15.72:0/930476667 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe4e8072f40 msgr2=0x7fe4e8073350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:22.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.395+0000 7fe4e77fe640 1 --2- 172.21.15.72:0/930476667 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe4e8072f40 0x7fe4e8073350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:22.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.395+0000 7fe4e77fe640 1 -- 172.21.15.72:0/930476667 >> v2:172.21.15.110:3300/0 conn(0x7fe4e8159ed0 msgr2=0x7fe4e8153860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:22.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.395+0000 7fe4e77fe640 1 --2- 172.21.15.72:0/930476667 >> v2:172.21.15.110:3300/0 conn(0x7fe4e8159ed0 0x7fe4e8153860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:22.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.395+0000 7fe4e77fe640 1 -- 172.21.15.72:0/930476667 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4e80c64d0 con 0x7fe4e80c6cd0 2024-05-09T05:54:22.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.395+0000 7fe4e77fe640 1 -- 172.21.15.72:0/930476667 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2749052815 0 0) 0x7fe4e0001a80 con 0x7fe4e80c6cd0 2024-05-09T05:54:22.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.395+0000 7fe4e77fe640 1 -- 172.21.15.72:0/930476667 >> v1:172.21.15.72:6789/0 conn(0x7fe4e80c6cd0 legacy=0x7fe4e80c70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:22.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.395+0000 7fe4e77fe640 1 --2- 172.21.15.72:0/930476667 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4d0003a10 0x7fe4d0003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:22.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.395+0000 7fe4e77fe640 1 --2- 172.21.15.72:0/930476667 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe4d0004810 0x7fe4d0004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:22.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.395+0000 7fe4e77fe640 1 --2- 172.21.15.72:0/930476667 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe4d0005160 0x7fe4d000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:22.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.395+0000 7fe4e77fe640 1 -- 172.21.15.72:0/930476667 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e8072540 con 0x7fe4d0003a10 2024-05-09T05:54:22.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.395+0000 7fe4e77fe640 1 -- 172.21.15.72:0/930476667 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e8072820 con 0x7fe4d0005160 2024-05-09T05:54:22.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.395+0000 7fe4e77fe640 1 -- 172.21.15.72:0/930476667 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fe4d000c0d0 con 0x7fe4d0004810 2024-05-09T05:54:22.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.395+0000 7fe4e7fff640 1 --2- 172.21.15.72:0/930476667 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe4e8072f40 0x7fe4e8073350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:54:22.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.395+0000 7fe4ece18640 1 --2- 172.21.15.72:0/930476667 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4d0003a10 0x7fe4d0003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:22.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.395+0000 7fe4ece18640 1 -- 172.21.15.72:0/930476667 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe4d0004810 msgr2=0x7fe4d0004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:22.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.395+0000 7fe4ece18640 1 --2- 172.21.15.72:0/930476667 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe4d0004810 0x7fe4d0004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:22.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.395+0000 7fe4ece18640 1 -- 172.21.15.72:0/930476667 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe4d0005160 msgr2=0x7fe4d000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:22.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.395+0000 7fe4ece18640 1 --2- 172.21.15.72:0/930476667 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe4d0005160 0x7fe4d000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:22.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.395+0000 7fe4ece18640 1 -- 172.21.15.72:0/930476667 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4d0003530 con 0x7fe4d0003a10 2024-05-09T05:54:22.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.399+0000 7fe4ece18640 1 --2- 172.21.15.72:0/930476667 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4d0003a10 0x7fe4d0003e80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8009ae0 tx=0x7fe4d801cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9505166eae2ac2c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:22.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.399+0000 7fe4e77fe640 1 -- 172.21.15.72:0/930476667 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d80b2070 con 0x7fe4d0003a10 2024-05-09T05:54:22.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.399+0000 7fe4e77fe640 1 -- 172.21.15.72:0/930476667 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4d80a56a0 con 0x7fe4d0003a10 2024-05-09T05:54:22.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.399+0000 7fe4e77fe640 1 -- 172.21.15.72:0/930476667 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d80096b0 con 0x7fe4d0003a10 2024-05-09T05:54:22.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.399+0000 7fe4ef07c640 1 -- 172.21.15.72:0/930476667 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4d0003a10 msgr2=0x7fe4d0003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:22.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.399+0000 7fe4ef07c640 1 --2- 172.21.15.72:0/930476667 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4d0003a10 0x7fe4d0003e80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8009ae0 tx=0x7fe4d801cab0 comp rx=0 tx=0).stop 2024-05-09T05:54:22.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.399+0000 7fe4ed619640 1 -- 172.21.15.72:0/930476667 reap_dead start 2024-05-09T05:54:22.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.399+0000 7fe4ef07c640 1 -- 172.21.15.72:0/930476667 shutdown_connections 2024-05-09T05:54:22.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.399+0000 7fe4ef07c640 1 -- 172.21.15.72:0/930476667 >> 172.21.15.72:0/930476667 conn(0x7fe4e80cde90 msgr2=0x7fe4e80ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:22.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.399+0000 7fe4ef07c640 1 -- 172.21.15.72:0/930476667 shutdown_connections 2024-05-09T05:54:22.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.399+0000 7fe4ef07c640 1 -- 172.21.15.72:0/930476667 wait complete. 2024-05-09T05:54:22.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.403+0000 7fe4ef07c640 1 Processor -- start 2024-05-09T05:54:22.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.403+0000 7fe4ef07c640 1 -- start start 2024-05-09T05:54:22.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.403+0000 7fe4ef07c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe4e81f0ae0 0x7fe4e80bc670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:22.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.403+0000 7fe4ef07c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe4e8154630 0x7fe4e80bb100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:22.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.403+0000 7fe4ef07c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4e8156590 0x7fe4e81569a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:22.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.403+0000 7fe4ef07c640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e80c4e30 con 0x7fe4e8156590 2024-05-09T05:54:22.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.403+0000 7fe4ef07c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e80c4cb0 con 0x7fe4e8154630 2024-05-09T05:54:22.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.403+0000 7fe4ef07c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fe4e8073350 con 0x7fe4e81f0ae0 2024-05-09T05:54:22.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.403+0000 7fe4ed619640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4e8156590 0x7fe4e81569a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:22.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.403+0000 7fe4ed619640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4e8156590 0x7fe4e81569a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46270/0 (socket says 172.21.15.72:46270) 2024-05-09T05:54:22.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.403+0000 7fe4ed619640 1 -- 172.21.15.72:0/4263762285 learned_addr learned my addr 172.21.15.72:0/4263762285 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:54:22.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.403+0000 7fe4ece18640 1 --2- 172.21.15.72:0/4263762285 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe4e81f0ae0 0x7fe4e80bc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:22.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.403+0000 7fe4e7fff640 1 --2- 172.21.15.72:0/4263762285 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe4e8154630 0x7fe4e80bb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:22.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.403+0000 7fe4ed619640 1 -- 172.21.15.72:0/4263762285 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe4e81f0ae0 msgr2=0x7fe4e80bc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:22.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.403+0000 7fe4ed619640 1 --2- 172.21.15.72:0/4263762285 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe4e81f0ae0 0x7fe4e80bc670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:22.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.403+0000 7fe4ed619640 1 -- 172.21.15.72:0/4263762285 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe4e8154630 msgr2=0x7fe4e80bb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:22.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.403+0000 7fe4ed619640 1 --2- 172.21.15.72:0/4263762285 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe4e8154630 0x7fe4e80bb100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:22.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.403+0000 7fe4ed619640 1 -- 172.21.15.72:0/4263762285 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4e81f0fb0 con 0x7fe4e8156590 2024-05-09T05:54:22.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.403+0000 7fe4ed619640 1 --2- 172.21.15.72:0/4263762285 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4e8156590 0x7fe4e81569a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe4e80cb170 tx=0x7fe4e000fc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:22.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.403+0000 7fe4e57fa640 1 -- 172.21.15.72:0/4263762285 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e001b070 con 0x7fe4e8156590 2024-05-09T05:54:22.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.403+0000 7fe4e57fa640 1 -- 172.21.15.72:0/4263762285 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4e000da20 con 0x7fe4e8156590 2024-05-09T05:54:22.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.403+0000 7fe4ef07c640 1 -- 172.21.15.72:0/4263762285 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4e81f1290 con 0x7fe4e8156590 2024-05-09T05:54:22.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.403+0000 7fe4e57fa640 1 -- 172.21.15.72:0/4263762285 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e000de10 con 0x7fe4e8156590 2024-05-09T05:54:22.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.403+0000 7fe4ef07c640 1 -- 172.21.15.72:0/4263762285 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4e81f1850 con 0x7fe4e8156590 2024-05-09T05:54:22.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.403+0000 7fe4ef07c640 1 -- 172.21.15.72:0/4263762285 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4e806a520 con 0x7fe4e8156590 2024-05-09T05:54:22.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.407+0000 7fe4e57fa640 1 -- 172.21.15.72:0/4263762285 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe4e001e070 con 0x7fe4e8156590 2024-05-09T05:54:22.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.407+0000 7fe4e57fa640 1 --2- 172.21.15.72:0/4263762285 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fe4d406f400 0x7fe4d4071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:22.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.407+0000 7fe4e57fa640 1 -- 172.21.15.72:0/4263762285 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7fe4e0091c20 con 0x7fe4e8156590 2024-05-09T05:54:22.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.407+0000 7fe4ece18640 1 --2- 172.21.15.72:0/4263762285 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fe4d406f400 0x7fe4d4071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:22.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.407+0000 7fe4ece18640 1 --2- 172.21.15.72:0/4263762285 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fe4d406f400 0x7fe4d4071910 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe4d80af000 tx=0x7fe4d8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:22.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.411+0000 7fe4e57fa640 1 -- 172.21.15.72:0/4263762285 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fe4e005e830 con 0x7fe4e8156590 2024-05-09T05:54:22.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.559+0000 7fe4ef07c640 1 -- 172.21.15.72:0/4263762285 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fe4e80c5f30 con 0x7fe4e8156590 2024-05-09T05:54:22.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.559+0000 7fe4e57fa640 1 -- 172.21.15.72:0/4263762285 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7fe4e005e130 con 0x7fe4e8156590 2024-05-09T05:54:22.550 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2024-05-09T05:54:22.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.563+0000 7fe4ef07c640 1 -- 172.21.15.72:0/4263762285 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fe4d406f400 msgr2=0x7fe4d4071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:22.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.563+0000 7fe4ef07c640 1 --2- 172.21.15.72:0/4263762285 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fe4d406f400 0x7fe4d4071910 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe4d80af000 tx=0x7fe4d8008040 comp rx=0 tx=0).stop 2024-05-09T05:54:22.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.563+0000 7fe4ef07c640 1 -- 172.21.15.72:0/4263762285 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4e8156590 msgr2=0x7fe4e81569a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:22.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.563+0000 7fe4ef07c640 1 --2- 172.21.15.72:0/4263762285 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4e8156590 0x7fe4e81569a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe4e80cb170 tx=0x7fe4e000fc30 comp rx=0 tx=0).stop 2024-05-09T05:54:22.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.563+0000 7fe4ef07c640 1 -- 172.21.15.72:0/4263762285 shutdown_connections 2024-05-09T05:54:22.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.563+0000 7fe4ef07c640 1 --2- 172.21.15.72:0/4263762285 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fe4d406f400 0x7fe4d4071910 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:22.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.563+0000 7fe4ef07c640 1 --2- 172.21.15.72:0/4263762285 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4e8156590 0x7fe4e81569a0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:22.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.563+0000 7fe4ef07c640 1 --2- 172.21.15.72:0/4263762285 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe4e8154630 0x7fe4e80bb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:22.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.563+0000 7fe4ef07c640 1 --2- 172.21.15.72:0/4263762285 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe4e81f0ae0 0x7fe4e80bc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:22.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.563+0000 7fe4ef07c640 1 -- 172.21.15.72:0/4263762285 >> 172.21.15.72:0/4263762285 conn(0x7fe4e80cde90 msgr2=0x7fe4e81e2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:22.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.563+0000 7fe4ef07c640 1 -- 172.21.15.72:0/4263762285 shutdown_connections 2024-05-09T05:54:22.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.563+0000 7fe4ef07c640 1 -- 172.21.15.72:0/4263762285 wait complete. 2024-05-09T05:54:22.570 INFO:tasks.mds_thrash:Wait for all MDSs to reach steady state... 2024-05-09T05:54:22.570 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:54:22.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.723+0000 7ffa1a81e640 1 Processor -- start 2024-05-09T05:54:22.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.723+0000 7ffa1a81e640 1 -- start start 2024-05-09T05:54:22.718 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.727+0000 7ffa1a81e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ffa1415dea0 0x7ffa140745b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:22.718 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.727+0000 7ffa1a81e640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ffa14074af0 0x7ffa14164e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:22.718 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.727+0000 7ffa1a81e640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa140c7c80 con 0x7ffa1415da90 2024-05-09T05:54:22.718 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.727+0000 7ffa1a81e640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7ffa141513f0 con 0x7ffa14074af0 2024-05-09T05:54:22.718 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.727+0000 7ffa1a81e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7ffa1415a4f0 con 0x7ffa1415dea0 2024-05-09T05:54:22.718 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.727+0000 7ffa13fff640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ffa1415da90 0x7ffa140c7570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33268/0 (socket says 172.21.15.72:33268) 2024-05-09T05:54:22.718 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.727+0000 7ffa13fff640 1 -- 172.21.15.72:0/2563241864 learned_addr learned my addr 172.21.15.72:0/2563241864 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:54:22.718 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.727+0000 7ffa18dbb640 1 --2- 172.21.15.72:0/2563241864 >> v2:172.21.15.72:3300/0 conn(0x7ffa14074af0 0x7ffa14164e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:22.718 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.727+0000 7ffa137fe640 1 --2- 172.21.15.72:0/2563241864 >> v2:172.21.15.110:3300/0 conn(0x7ffa1415dea0 0x7ffa140745b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:22.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.727+0000 7ffa12ffd640 1 -- 172.21.15.72:0/2563241864 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1177019501 0 0) 0x7ffa140c7c80 con 0x7ffa1415da90 2024-05-09T05:54:22.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.727+0000 7ffa12ffd640 1 -- 172.21.15.72:0/2563241864 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9fc003530 con 0x7ffa1415da90 2024-05-09T05:54:22.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.727+0000 7ffa18dbb640 1 -- 172.21.15.72:0/2563241864 >> v2:172.21.15.110:3300/0 conn(0x7ffa1415dea0 msgr2=0x7ffa140745b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:22.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.727+0000 7ffa18dbb640 1 --2- 172.21.15.72:0/2563241864 >> v2:172.21.15.110:3300/0 conn(0x7ffa1415dea0 0x7ffa140745b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:22.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.727+0000 7ffa18dbb640 1 -- 172.21.15.72:0/2563241864 >> v1:172.21.15.72:6789/0 conn(0x7ffa1415da90 legacy=0x7ffa140c7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:22.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.727+0000 7ffa18dbb640 1 -- 172.21.15.72:0/2563241864 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa140c84f0 con 0x7ffa14074af0 2024-05-09T05:54:22.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.731+0000 7ffa18dbb640 1 --2- 172.21.15.72:0/2563241864 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa14074af0 0x7ffa14164e70 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ffa140715b0 tx=0x7ffa0c01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acc8c178ad0b54c1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:22.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.731+0000 7ffa12ffd640 1 -- 172.21.15.72:0/2563241864 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c0b2070 con 0x7ffa14074af0 2024-05-09T05:54:22.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.731+0000 7ffa12ffd640 1 -- 172.21.15.72:0/2563241864 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa0c0a57f0 con 0x7ffa14074af0 2024-05-09T05:54:22.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.731+0000 7ffa12ffd640 1 -- 172.21.15.72:0/2563241864 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c0a5bc0 con 0x7ffa14074af0 2024-05-09T05:54:22.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.731+0000 7ffa1a81e640 1 -- 172.21.15.72:0/2563241864 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa14074af0 msgr2=0x7ffa14164e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:22.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.731+0000 7ffa1a81e640 1 --2- 172.21.15.72:0/2563241864 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa14074af0 0x7ffa14164e70 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ffa140715b0 tx=0x7ffa0c01c930 comp rx=0 tx=0).stop 2024-05-09T05:54:22.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.731+0000 7ffa1a81e640 1 -- 172.21.15.72:0/2563241864 shutdown_connections 2024-05-09T05:54:22.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.731+0000 7ffa1a81e640 1 --2- 172.21.15.72:0/2563241864 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa14074af0 0x7ffa14164e70 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:22.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.731+0000 7ffa1a81e640 1 --2- 172.21.15.72:0/2563241864 >> v2:172.21.15.110:3300/0 conn(0x7ffa1415dea0 0x7ffa140745b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:22.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.731+0000 7ffa1a81e640 1 -- 172.21.15.72:0/2563241864 >> 172.21.15.72:0/2563241864 conn(0x7ffa140cde90 msgr2=0x7ffa140ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:22.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.731+0000 7ffa1a81e640 1 -- 172.21.15.72:0/2563241864 shutdown_connections 2024-05-09T05:54:22.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.731+0000 7ffa1a81e640 1 -- 172.21.15.72:0/2563241864 wait complete. 2024-05-09T05:54:22.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.731+0000 7ffa1a81e640 1 Processor -- start 2024-05-09T05:54:22.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.731+0000 7ffa1a81e640 1 -- start start 2024-05-09T05:54:22.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.735+0000 7ffa1a81e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa14074af0 0x7ffa141f39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:22.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.735+0000 7ffa1a81e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa1415da90 0x7ffa141437f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:22.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.735+0000 7ffa1a81e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa1415dea0 0x7ffa1415c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:22.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.735+0000 7ffa1a81e640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ffa140c70e0 con 0x7ffa14074af0 2024-05-09T05:54:22.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.735+0000 7ffa1a81e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ffa1415ad70 con 0x7ffa1415da90 2024-05-09T05:54:22.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.735+0000 7ffa1a81e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7ffa140c81b0 con 0x7ffa1415dea0 2024-05-09T05:54:22.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.735+0000 7ffa13fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa14074af0 0x7ffa141f39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:22.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.735+0000 7ffa13fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa14074af0 0x7ffa141f39c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46292/0 (socket says 172.21.15.72:46292) 2024-05-09T05:54:22.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.735+0000 7ffa13fff640 1 -- 172.21.15.72:0/4199327662 learned_addr learned my addr 172.21.15.72:0/4199327662 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:54:22.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.735+0000 7ffa18dbb640 1 --2- 172.21.15.72:0/4199327662 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa1415dea0 0x7ffa1415c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:22.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.735+0000 7ffa137fe640 1 --2- 172.21.15.72:0/4199327662 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa1415da90 0x7ffa141437f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:22.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.735+0000 7ffa13fff640 1 -- 172.21.15.72:0/4199327662 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa1415dea0 msgr2=0x7ffa1415c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:22.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.735+0000 7ffa13fff640 1 --2- 172.21.15.72:0/4199327662 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa1415dea0 0x7ffa1415c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:22.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.735+0000 7ffa13fff640 1 -- 172.21.15.72:0/4199327662 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa1415da90 msgr2=0x7ffa141437f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:22.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.735+0000 7ffa13fff640 1 --2- 172.21.15.72:0/4199327662 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa1415da90 0x7ffa141437f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:22.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.735+0000 7ffa13fff640 1 -- 172.21.15.72:0/4199327662 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa1415d3f0 con 0x7ffa14074af0 2024-05-09T05:54:22.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.735+0000 7ffa13fff640 1 --2- 172.21.15.72:0/4199327662 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa14074af0 0x7ffa141f39c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ffa0400c400 tx=0x7ffa0400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:22.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.735+0000 7ffa10ff9640 1 -- 172.21.15.72:0/4199327662 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa04017070 con 0x7ffa14074af0 2024-05-09T05:54:22.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.735+0000 7ffa10ff9640 1 -- 172.21.15.72:0/4199327662 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa04005cf0 con 0x7ffa14074af0 2024-05-09T05:54:22.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.735+0000 7ffa1a81e640 1 -- 172.21.15.72:0/4199327662 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa1415d6d0 con 0x7ffa14074af0 2024-05-09T05:54:22.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.735+0000 7ffa10ff9640 1 -- 172.21.15.72:0/4199327662 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa040072f0 con 0x7ffa14074af0 2024-05-09T05:54:22.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.735+0000 7ffa1a81e640 1 -- 172.21.15.72:0/4199327662 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa141f4070 con 0x7ffa14074af0 2024-05-09T05:54:22.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.735+0000 7ffa1a81e640 1 -- 172.21.15.72:0/4199327662 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa141f42d0 con 0x7ffa14074af0 2024-05-09T05:54:22.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.735+0000 7ffa10ff9640 1 -- 172.21.15.72:0/4199327662 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ffa0401a070 con 0x7ffa14074af0 2024-05-09T05:54:22.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.735+0000 7ffa10ff9640 1 --2- 172.21.15.72:0/4199327662 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7ffa0006f400 0x7ffa00071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:22.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.735+0000 7ffa10ff9640 1 -- 172.21.15.72:0/4199327662 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7ffa0408ec30 con 0x7ffa14074af0 2024-05-09T05:54:22.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.739+0000 7ffa137fe640 1 --2- 172.21.15.72:0/4199327662 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7ffa0006f400 0x7ffa00071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:22.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.739+0000 7ffa137fe640 1 --2- 172.21.15.72:0/4199327662 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7ffa0006f400 0x7ffa00071910 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ffa1414d460 tx=0x7ffa08008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:22.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.739+0000 7ffa10ff9640 1 -- 172.21.15.72:0/4199327662 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7ffa04021020 con 0x7ffa14074af0 2024-05-09T05:54:22.927 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.935+0000 7ffa1a81e640 1 -- 172.21.15.72:0/4199327662 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffa1406a520 con 0x7ffa14074af0 2024-05-09T05:54:22.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.939+0000 7ffa10ff9640 1 -- 172.21.15.72:0/4199327662 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6915 (secure 0 0 0) 0x7ffa0405b9b0 con 0x7ffa14074af0 2024-05-09T05:54:22.928 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:54:22.928 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6834/1142956298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1142956298},{"type":"v1","addr":"172.21.15.72:6834","nonce":1142956298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:53:23.494975+0000","modified":"2024-05-09T05:54:11.535513+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4297,"mds_1":4287,"mds_2":4263,"mds_3":4259,"mds_4":4257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4257":{"gid":4257,"name":"a","rank":4,"incarnation":18,"state":"up:active","state_seq":15,"addr":"172.21.15.72:6835/3946563056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":3946563056},{"type":"v1","addr":"172.21.15.72:6835","nonce":3946563056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4259":{"gid":4259,"name":"f","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.110:6838/840351907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":840351907},{"type":"v1","addr":"172.21.15.110:6838","nonce":840351907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4263":{"gid":4263,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.72:6837/1048256382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":1048256382},{"type":"v1","addr":"172.21.15.72:6837","nonce":1048256382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.110:6839/966325499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6837","nonce":966325499},{"type":"v1","addr":"172.21.15.110:6839","nonce":966325499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6836/4134424941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":4134424941},{"type":"v1","addr":"172.21.15.110:6836","nonce":4134424941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4257,4259,4263,4287,4297]},"id":1}]} 2024-05-09T05:54:22.929 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 19 2024-05-09T05:54:22.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.939+0000 7ffa1a81e640 1 -- 172.21.15.72:0/4199327662 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7ffa0006f400 msgr2=0x7ffa00071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:22.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.939+0000 7ffa1a81e640 1 --2- 172.21.15.72:0/4199327662 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7ffa0006f400 0x7ffa00071910 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ffa1414d460 tx=0x7ffa08008040 comp rx=0 tx=0).stop 2024-05-09T05:54:22.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.939+0000 7ffa1a81e640 1 -- 172.21.15.72:0/4199327662 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa14074af0 msgr2=0x7ffa141f39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:22.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.939+0000 7ffa1a81e640 1 --2- 172.21.15.72:0/4199327662 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa14074af0 0x7ffa141f39c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ffa0400c400 tx=0x7ffa0400c8c0 comp rx=0 tx=0).stop 2024-05-09T05:54:22.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.939+0000 7ffa1a81e640 1 -- 172.21.15.72:0/4199327662 shutdown_connections 2024-05-09T05:54:22.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.939+0000 7ffa1a81e640 1 --2- 172.21.15.72:0/4199327662 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7ffa0006f400 0x7ffa00071910 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:22.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.939+0000 7ffa1a81e640 1 --2- 172.21.15.72:0/4199327662 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa1415dea0 0x7ffa1415c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:22.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.939+0000 7ffa1a81e640 1 --2- 172.21.15.72:0/4199327662 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa1415da90 0x7ffa141437f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:22.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.939+0000 7ffa1a81e640 1 --2- 172.21.15.72:0/4199327662 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa14074af0 0x7ffa141f39c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:22.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.939+0000 7ffa1a81e640 1 -- 172.21.15.72:0/4199327662 >> 172.21.15.72:0/4199327662 conn(0x7ffa140cde90 msgr2=0x7ffa140c7430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:22.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.939+0000 7ffa1a81e640 1 -- 172.21.15.72:0/4199327662 shutdown_connections 2024-05-09T05:54:22.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:22.939+0000 7ffa1a81e640 1 -- 172.21.15.72:0/4199327662 wait complete. 2024-05-09T05:54:22.950 INFO:tasks.mds_thrash:Ready to start thrashing 2024-05-09T05:54:22.950 INFO:tasks.mds_thrash.ceph_manager:waiting for clean 2024-05-09T05:54:22.950 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T05:54:23.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.107+0000 7f7114a18640 1 Processor -- start 2024-05-09T05:54:23.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.107+0000 7f7114a18640 1 -- start start 2024-05-09T05:54:23.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.107+0000 7f7114a18640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f71101537d0 0x7f7110074740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:23.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.107+0000 7f7114a18640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7110161d70 0x7f7110164190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:23.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.107+0000 7f7114a18640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71100c72c0 con 0x7f71100c77a0 2024-05-09T05:54:23.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.107+0000 7f7114a18640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f7110074c80 con 0x7f7110161d70 2024-05-09T05:54:23.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.107+0000 7f7114a18640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f71100c7bb0 con 0x7f71101537d0 2024-05-09T05:54:23.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.107+0000 7f710ed9d640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7110161d70 0x7f7110164190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:23.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.107+0000 7f710ed9d640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7110161d70 0x7f7110164190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46302/0 (socket says 172.21.15.72:46302) 2024-05-09T05:54:23.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.107+0000 7f710ed9d640 1 -- 172.21.15.72:0/3681125337 learned_addr learned my addr 172.21.15.72:0/3681125337 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:54:23.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.107+0000 7f7107fff640 1 --2- 172.21.15.72:0/3681125337 >> v2:172.21.15.110:3300/0 conn(0x7f71101537d0 0x7f7110074740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:23.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.107+0000 7f710ed9d640 1 -- 172.21.15.72:0/3681125337 >> v2:172.21.15.110:3300/0 conn(0x7f71101537d0 msgr2=0x7f7110074740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:23.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.107+0000 7f710ed9d640 1 --2- 172.21.15.72:0/3681125337 >> v2:172.21.15.110:3300/0 conn(0x7f71101537d0 0x7f7110074740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:23.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.107+0000 7f710ed9d640 1 -- 172.21.15.72:0/3681125337 >> v1:172.21.15.110:6789/0 conn(0x7f71100c77a0 legacy=0x7f7110072e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:23.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.107+0000 7f710ed9d640 1 -- 172.21.15.72:0/3681125337 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7110153be0 con 0x7f7110161d70 2024-05-09T05:54:23.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.111+0000 7f710ed9d640 1 --2- 172.21.15.72:0/3681125337 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7110161d70 0x7f7110164190 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f71100ca000 tx=0x7f710801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65b436b19e165460 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:23.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.111+0000 7f710dd9b640 1 -- 172.21.15.72:0/3681125337 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71080a5840 con 0x7f7110161d70 2024-05-09T05:54:23.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.111+0000 7f710dd9b640 1 -- 172.21.15.72:0/3681125337 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71080a59e0 con 0x7f7110161d70 2024-05-09T05:54:23.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.111+0000 7f710dd9b640 1 -- 172.21.15.72:0/3681125337 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71080a5db0 con 0x7f7110161d70 2024-05-09T05:54:23.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.111+0000 7f7114a18640 1 -- 172.21.15.72:0/3681125337 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7110161d70 msgr2=0x7f7110164190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:23.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.111+0000 7f7114a18640 1 --2- 172.21.15.72:0/3681125337 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7110161d70 0x7f7110164190 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f71100ca000 tx=0x7f710801c9c0 comp rx=0 tx=0).stop 2024-05-09T05:54:23.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.111+0000 7f7114a18640 1 -- 172.21.15.72:0/3681125337 shutdown_connections 2024-05-09T05:54:23.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.111+0000 7f7114a18640 1 --2- 172.21.15.72:0/3681125337 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7110161d70 0x7f7110164190 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:23.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.111+0000 7f7114a18640 1 --2- 172.21.15.72:0/3681125337 >> v2:172.21.15.110:3300/0 conn(0x7f71101537d0 0x7f7110074740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:23.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.111+0000 7f7114a18640 1 -- 172.21.15.72:0/3681125337 >> 172.21.15.72:0/3681125337 conn(0x7f71100cde90 msgr2=0x7f71100ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:23.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.111+0000 7f7114a18640 1 -- 172.21.15.72:0/3681125337 shutdown_connections 2024-05-09T05:54:23.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.111+0000 7f7114a18640 1 -- 172.21.15.72:0/3681125337 wait complete. 2024-05-09T05:54:23.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.111+0000 7f7114a18640 1 Processor -- start 2024-05-09T05:54:23.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.111+0000 7f7114a18640 1 -- start start 2024-05-09T05:54:23.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.115+0000 7f7114a18640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71100c77a0 0x7f7110143390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:23.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.115+0000 7f7114a18640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71101537d0 0x7f71101633b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:23.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.115+0000 7f7114a18640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7110161d70 0x7f7110148150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:23.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.115+0000 7f7114a18640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7110072940 con 0x7f71101537d0 2024-05-09T05:54:23.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.115+0000 7f7114a18640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f71100740b0 con 0x7f7110161d70 2024-05-09T05:54:23.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.115+0000 7f7114a18640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f71100c4cb0 con 0x7f71100c77a0 2024-05-09T05:54:23.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.115+0000 7f7107fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71101537d0 0x7f71101633b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:23.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.115+0000 7f7107fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71101537d0 0x7f71101633b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46304/0 (socket says 172.21.15.72:46304) 2024-05-09T05:54:23.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.115+0000 7f7107fff640 1 -- 172.21.15.72:0/2179584266 learned_addr learned my addr 172.21.15.72:0/2179584266 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:54:23.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.115+0000 7f710ed9d640 1 --2- 172.21.15.72:0/2179584266 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7110161d70 0x7f7110148150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:23.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.115+0000 7f710e59c640 1 --2- 172.21.15.72:0/2179584266 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71100c77a0 0x7f7110143390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:23.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.115+0000 7f7107fff640 1 -- 172.21.15.72:0/2179584266 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71100c77a0 msgr2=0x7f7110143390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:23.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.115+0000 7f7107fff640 1 --2- 172.21.15.72:0/2179584266 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71100c77a0 0x7f7110143390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:23.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.115+0000 7f7107fff640 1 -- 172.21.15.72:0/2179584266 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7110161d70 msgr2=0x7f7110148150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:23.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.115+0000 7f7107fff640 1 --2- 172.21.15.72:0/2179584266 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7110161d70 0x7f7110148150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:23.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.115+0000 7f7107fff640 1 -- 172.21.15.72:0/2179584266 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71101438d0 con 0x7f71101537d0 2024-05-09T05:54:23.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.115+0000 7f710ed9d640 1 --2- 172.21.15.72:0/2179584266 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7110161d70 0x7f7110148150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:54:23.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.115+0000 7f7107fff640 1 --2- 172.21.15.72:0/2179584266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71101537d0 0x7f71101633b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f70f800d600 tx=0x7f70f800dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:23.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.115+0000 7f7106ffd640 1 -- 172.21.15.72:0/2179584266 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f80125f0 con 0x7f71101537d0 2024-05-09T05:54:23.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.115+0000 7f7106ffd640 1 -- 172.21.15.72:0/2179584266 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70f8019070 con 0x7f71101537d0 2024-05-09T05:54:23.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.115+0000 7f7114a18640 1 -- 172.21.15.72:0/2179584266 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71101f1920 con 0x7f71101537d0 2024-05-09T05:54:23.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.115+0000 7f7106ffd640 1 -- 172.21.15.72:0/2179584266 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f80129b0 con 0x7f71101537d0 2024-05-09T05:54:23.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.115+0000 7f7114a18640 1 -- 172.21.15.72:0/2179584266 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71101f1ee0 con 0x7f71101537d0 2024-05-09T05:54:23.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.115+0000 7f7114a18640 1 -- 172.21.15.72:0/2179584266 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f711006a520 con 0x7f71101537d0 2024-05-09T05:54:23.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.115+0000 7f7106ffd640 1 -- 172.21.15.72:0/2179584266 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f70f8012b50 con 0x7f71101537d0 2024-05-09T05:54:23.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.119+0000 7f7106ffd640 1 --2- 172.21.15.72:0/2179584266 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f70f006f400 0x7f70f0071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:23.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.119+0000 7f7106ffd640 1 -- 172.21.15.72:0/2179584266 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f70f808f9f0 con 0x7f71101537d0 2024-05-09T05:54:23.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.119+0000 7f710e59c640 1 --2- 172.21.15.72:0/2179584266 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f70f006f400 0x7f70f0071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:23.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.119+0000 7f710e59c640 1 --2- 172.21.15.72:0/2179584266 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f70f006f400 0x7f70f0071910 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f71100c41c0 tx=0x7f7100008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:23.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.123+0000 7f7106ffd640 1 -- 172.21.15.72:0/2179584266 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f70f805c580 con 0x7f71101537d0 2024-05-09T05:54:23.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.279+0000 7f7114a18640 1 -- 172.21.15.72:0/2179584266 --> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7110142fb0 con 0x7f70f006f400 2024-05-09T05:54:23.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.303+0000 7f7106ffd640 1 -- 172.21.15.72:0/2179584266 <== mgr.4102 v2:172.21.15.110:6832/1113420672 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332684 (secure 0 0 0) 0x7f7110142fb0 con 0x7f70f006f400 2024-05-09T05:54:23.297 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:54:23.299 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2024-05-09T05:54:23.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.307+0000 7f7114a18640 1 -- 172.21.15.72:0/2179584266 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f70f006f400 msgr2=0x7f70f0071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:23.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.307+0000 7f7114a18640 1 --2- 172.21.15.72:0/2179584266 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f70f006f400 0x7f70f0071910 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f71100c41c0 tx=0x7f7100008040 comp rx=0 tx=0).stop 2024-05-09T05:54:23.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.307+0000 7f7114a18640 1 -- 172.21.15.72:0/2179584266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71101537d0 msgr2=0x7f71101633b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:23.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.307+0000 7f7114a18640 1 --2- 172.21.15.72:0/2179584266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71101537d0 0x7f71101633b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f70f800d600 tx=0x7f70f800dac0 comp rx=0 tx=0).stop 2024-05-09T05:54:23.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.307+0000 7f7114a18640 1 -- 172.21.15.72:0/2179584266 shutdown_connections 2024-05-09T05:54:23.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.307+0000 7f7114a18640 1 --2- 172.21.15.72:0/2179584266 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f70f006f400 0x7f70f0071910 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:23.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.307+0000 7f7114a18640 1 --2- 172.21.15.72:0/2179584266 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7110161d70 0x7f7110148150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:23.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.307+0000 7f7114a18640 1 --2- 172.21.15.72:0/2179584266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71101537d0 0x7f71101633b0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:23.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.307+0000 7f7114a18640 1 --2- 172.21.15.72:0/2179584266 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71100c77a0 0x7f7110143390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:23.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.307+0000 7f7114a18640 1 -- 172.21.15.72:0/2179584266 >> 172.21.15.72:0/2179584266 conn(0x7f71100cde90 msgr2=0x7f71100c63c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:23.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.307+0000 7f7114a18640 1 -- 172.21.15.72:0/2179584266 shutdown_connections 2024-05-09T05:54:23.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.307+0000 7f7114a18640 1 -- 172.21.15.72:0/2179584266 wait complete. 2024-05-09T05:54:23.316 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2024-05-09T05:54:22.486196+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":602396,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":316,"num_write_kb":1701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":261,"ondisk_log_size":261,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236392,"kb_used_data":3624,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738328,"statfs":{"total":773094113280,"available":772852047872,"internally_reserved":0,"allocated":3710976,"data_stored":2127847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3170,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005666"},"pg_stats":[{"pgid":"2.1f","version":"27'13","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:10.963308+0000","last_change":"2024-05-09T05:53:23.121824+0000","last_active":"2024-05-09T05:54:10.963308+0000","last_peered":"2024-05-09T05:54:10.963308+0000","last_clean":"2024-05-09T05:54:10.963308+0000","last_became_active":"2024-05-09T05:53:23.121097+0000","last_became_peered":"2024-05-09T05:53:23.121097+0000","last_unstale":"2024-05-09T05:54:10.963308+0000","last_undegraded":"2024-05-09T05:54:10.963308+0000","last_fullsized":"2024-05-09T05:54:10.963308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:50:51.880238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.962614+0000","last_change":"2024-05-09T05:53:24.146985+0000","last_active":"2024-05-09T05:54:05.962614+0000","last_peered":"2024-05-09T05:54:05.962614+0000","last_clean":"2024-05-09T05:54:05.962614+0000","last_became_active":"2024-05-09T05:53:24.146540+0000","last_became_peered":"2024-05-09T05:53:24.146540+0000","last_unstale":"2024-05-09T05:54:05.962614+0000","last_undegraded":"2024-05-09T05:54:05.962614+0000","last_fullsized":"2024-05-09T05:54:05.962614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:02:29.318131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.640920+0000","last_change":"2024-05-09T05:53:28.236386+0000","last_active":"2024-05-09T05:54:06.640920+0000","last_peered":"2024-05-09T05:54:06.640920+0000","last_clean":"2024-05-09T05:54:06.640920+0000","last_became_active":"2024-05-09T05:53:28.235305+0000","last_became_peered":"2024-05-09T05:53:28.235305+0000","last_unstale":"2024-05-09T05:54:06.640920+0000","last_undegraded":"2024-05-09T05:54:06.640920+0000","last_fullsized":"2024-05-09T05:54:06.640920+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:57:57.134819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"25'2","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.962769+0000","last_change":"2024-05-09T05:53:23.139000+0000","last_active":"2024-05-09T05:54:05.962769+0000","last_peered":"2024-05-09T05:54:05.962769+0000","last_clean":"2024-05-09T05:54:05.962769+0000","last_became_active":"2024-05-09T05:53:23.138431+0000","last_became_peered":"2024-05-09T05:53:23.138431+0000","last_unstale":"2024-05-09T05:54:05.962769+0000","last_undegraded":"2024-05-09T05:54:05.962769+0000","last_fullsized":"2024-05-09T05:54:05.962769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:33:56.977263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.962858+0000","last_change":"2024-05-09T05:53:24.151811+0000","last_active":"2024-05-09T05:54:05.962858+0000","last_peered":"2024-05-09T05:54:05.962858+0000","last_clean":"2024-05-09T05:54:05.962858+0000","last_became_active":"2024-05-09T05:53:24.151407+0000","last_became_peered":"2024-05-09T05:53:24.151407+0000","last_unstale":"2024-05-09T05:54:05.962858+0000","last_undegraded":"2024-05-09T05:54:05.962858+0000","last_fullsized":"2024-05-09T05:54:05.962858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:54:17.819787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.913373+0000","last_change":"2024-05-09T05:53:28.213485+0000","last_active":"2024-05-09T05:54:06.913373+0000","last_peered":"2024-05-09T05:54:06.913373+0000","last_clean":"2024-05-09T05:54:06.913373+0000","last_became_active":"2024-05-09T05:53:28.213021+0000","last_became_peered":"2024-05-09T05:53:28.213021+0000","last_unstale":"2024-05-09T05:54:06.913373+0000","last_undegraded":"2024-05-09T05:54:06.913373+0000","last_fullsized":"2024-05-09T05:54:06.913373+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:58:22.493166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"27'12","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:10.967793+0000","last_change":"2024-05-09T05:53:23.095209+0000","last_active":"2024-05-09T05:54:10.967793+0000","last_peered":"2024-05-09T05:54:10.967793+0000","last_clean":"2024-05-09T05:54:10.967793+0000","last_became_active":"2024-05-09T05:53:23.094826+0000","last_became_peered":"2024-05-09T05:53:23.094826+0000","last_unstale":"2024-05-09T05:54:10.967793+0000","last_undegraded":"2024-05-09T05:54:10.967793+0000","last_fullsized":"2024-05-09T05:54:10.967793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:38:47.390311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.954377+0000","last_change":"2024-05-09T05:53:24.135281+0000","last_active":"2024-05-09T05:54:05.954377+0000","last_peered":"2024-05-09T05:54:05.954377+0000","last_clean":"2024-05-09T05:54:05.954377+0000","last_became_active":"2024-05-09T05:53:24.134610+0000","last_became_peered":"2024-05-09T05:53:24.134610+0000","last_unstale":"2024-05-09T05:54:05.954377+0000","last_undegraded":"2024-05-09T05:54:05.954377+0000","last_fullsized":"2024-05-09T05:54:05.954377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:28:03.947961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.913678+0000","last_change":"2024-05-09T05:53:28.205763+0000","last_active":"2024-05-09T05:54:06.913678+0000","last_peered":"2024-05-09T05:54:06.913678+0000","last_clean":"2024-05-09T05:54:06.913678+0000","last_became_active":"2024-05-09T05:53:28.205229+0000","last_became_peered":"2024-05-09T05:53:28.205229+0000","last_unstale":"2024-05-09T05:54:06.913678+0000","last_undegraded":"2024-05-09T05:54:06.913678+0000","last_fullsized":"2024-05-09T05:54:06.913678+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:38:51.267769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"27'5","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:10.966670+0000","last_change":"2024-05-09T05:53:23.097616+0000","last_active":"2024-05-09T05:54:10.966670+0000","last_peered":"2024-05-09T05:54:10.966670+0000","last_clean":"2024-05-09T05:54:10.966670+0000","last_became_active":"2024-05-09T05:53:23.094760+0000","last_became_peered":"2024-05-09T05:53:23.094760+0000","last_unstale":"2024-05-09T05:54:10.966670+0000","last_undegraded":"2024-05-09T05:54:10.966670+0000","last_fullsized":"2024-05-09T05:54:10.966670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:21:32.558852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.964196+0000","last_change":"2024-05-09T05:53:24.139467+0000","last_active":"2024-05-09T05:54:05.964196+0000","last_peered":"2024-05-09T05:54:05.964196+0000","last_clean":"2024-05-09T05:54:05.964196+0000","last_became_active":"2024-05-09T05:53:24.139109+0000","last_became_peered":"2024-05-09T05:53:24.139109+0000","last_unstale":"2024-05-09T05:54:05.964196+0000","last_undegraded":"2024-05-09T05:54:05.964196+0000","last_fullsized":"2024-05-09T05:54:05.964196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:36.783615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.913569+0000","last_change":"2024-05-09T05:53:28.216127+0000","last_active":"2024-05-09T05:54:06.913569+0000","last_peered":"2024-05-09T05:54:06.913569+0000","last_clean":"2024-05-09T05:54:06.913569+0000","last_became_active":"2024-05-09T05:53:28.215482+0000","last_became_peered":"2024-05-09T05:53:28.215482+0000","last_unstale":"2024-05-09T05:54:06.913569+0000","last_undegraded":"2024-05-09T05:54:06.913569+0000","last_fullsized":"2024-05-09T05:54:06.913569+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:48:58.387701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.963569+0000","last_change":"2024-05-09T05:53:24.132483+0000","last_active":"2024-05-09T05:54:05.963569+0000","last_peered":"2024-05-09T05:54:05.963569+0000","last_clean":"2024-05-09T05:54:05.963569+0000","last_became_active":"2024-05-09T05:53:24.132118+0000","last_became_peered":"2024-05-09T05:53:24.132118+0000","last_unstale":"2024-05-09T05:54:05.963569+0000","last_undegraded":"2024-05-09T05:54:05.963569+0000","last_fullsized":"2024-05-09T05:54:05.963569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:06:01.787707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"25'4","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.963718+0000","last_change":"2024-05-09T05:53:23.117460+0000","last_active":"2024-05-09T05:54:05.963718+0000","last_peered":"2024-05-09T05:54:05.963718+0000","last_clean":"2024-05-09T05:54:05.963718+0000","last_became_active":"2024-05-09T05:53:23.114179+0000","last_became_peered":"2024-05-09T05:53:23.114179+0000","last_unstale":"2024-05-09T05:54:05.963718+0000","last_undegraded":"2024-05-09T05:54:05.963718+0000","last_fullsized":"2024-05-09T05:54:05.963718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:44:01.784905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.963442+0000","last_change":"2024-05-09T05:53:28.227135+0000","last_active":"2024-05-09T05:54:05.963442+0000","last_peered":"2024-05-09T05:54:05.963442+0000","last_clean":"2024-05-09T05:54:05.963442+0000","last_became_active":"2024-05-09T05:53:28.226427+0000","last_became_peered":"2024-05-09T05:53:28.226427+0000","last_unstale":"2024-05-09T05:54:05.963442+0000","last_undegraded":"2024-05-09T05:54:05.963442+0000","last_fullsized":"2024-05-09T05:54:05.963442+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:37:04.413804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.642097+0000","last_change":"2024-05-09T05:53:24.135982+0000","last_active":"2024-05-09T05:54:06.642097+0000","last_peered":"2024-05-09T05:54:06.642097+0000","last_clean":"2024-05-09T05:54:06.642097+0000","last_became_active":"2024-05-09T05:53:24.135580+0000","last_became_peered":"2024-05-09T05:53:24.135580+0000","last_unstale":"2024-05-09T05:54:06.642097+0000","last_undegraded":"2024-05-09T05:54:06.642097+0000","last_fullsized":"2024-05-09T05:54:06.642097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:03:04.589608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"27'3","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.957635+0000","last_change":"2024-05-09T05:53:23.142679+0000","last_active":"2024-05-09T05:54:05.957635+0000","last_peered":"2024-05-09T05:54:05.957635+0000","last_clean":"2024-05-09T05:54:05.957635+0000","last_became_active":"2024-05-09T05:53:23.142018+0000","last_became_peered":"2024-05-09T05:53:23.142018+0000","last_unstale":"2024-05-09T05:54:05.957635+0000","last_undegraded":"2024-05-09T05:54:05.957635+0000","last_fullsized":"2024-05-09T05:54:05.957635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:08:29.312049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.918021+0000","last_change":"2024-05-09T05:53:28.214167+0000","last_active":"2024-05-09T05:54:06.918021+0000","last_peered":"2024-05-09T05:54:06.918021+0000","last_clean":"2024-05-09T05:54:06.918021+0000","last_became_active":"2024-05-09T05:53:28.213623+0000","last_became_peered":"2024-05-09T05:53:28.213623+0000","last_unstale":"2024-05-09T05:54:06.918021+0000","last_undegraded":"2024-05-09T05:54:06.918021+0000","last_fullsized":"2024-05-09T05:54:06.918021+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:53:53.976485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.955036+0000","last_change":"2024-05-09T05:53:24.130342+0000","last_active":"2024-05-09T05:54:05.955036+0000","last_peered":"2024-05-09T05:54:05.955036+0000","last_clean":"2024-05-09T05:54:05.955036+0000","last_became_active":"2024-05-09T05:53:24.129938+0000","last_became_peered":"2024-05-09T05:53:24.129938+0000","last_unstale":"2024-05-09T05:54:05.955036+0000","last_undegraded":"2024-05-09T05:54:05.955036+0000","last_fullsized":"2024-05-09T05:54:05.955036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:58:13.879633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"27'7","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:10.962692+0000","last_change":"2024-05-09T05:53:23.111169+0000","last_active":"2024-05-09T05:54:10.962692+0000","last_peered":"2024-05-09T05:54:10.962692+0000","last_clean":"2024-05-09T05:54:10.962692+0000","last_became_active":"2024-05-09T05:53:23.110140+0000","last_became_peered":"2024-05-09T05:53:23.110140+0000","last_unstale":"2024-05-09T05:54:10.962692+0000","last_undegraded":"2024-05-09T05:54:10.962692+0000","last_fullsized":"2024-05-09T05:54:10.962692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:18:55.367553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.642541+0000","last_change":"2024-05-09T05:53:28.233648+0000","last_active":"2024-05-09T05:54:06.642541+0000","last_peered":"2024-05-09T05:54:06.642541+0000","last_clean":"2024-05-09T05:54:06.642541+0000","last_became_active":"2024-05-09T05:53:28.227087+0000","last_became_peered":"2024-05-09T05:53:28.227087+0000","last_unstale":"2024-05-09T05:54:06.642541+0000","last_undegraded":"2024-05-09T05:54:06.642541+0000","last_fullsized":"2024-05-09T05:54:06.642541+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:03:49.709580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.963334+0000","last_change":"2024-05-09T05:53:24.147343+0000","last_active":"2024-05-09T05:54:05.963334+0000","last_peered":"2024-05-09T05:54:05.963334+0000","last_clean":"2024-05-09T05:54:05.963334+0000","last_became_active":"2024-05-09T05:53:24.144596+0000","last_became_peered":"2024-05-09T05:53:24.144596+0000","last_unstale":"2024-05-09T05:54:05.963334+0000","last_undegraded":"2024-05-09T05:54:05.963334+0000","last_fullsized":"2024-05-09T05:54:05.963334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:52:43.052055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"25'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.914631+0000","last_change":"2024-05-09T05:53:23.102976+0000","last_active":"2024-05-09T05:54:06.914631+0000","last_peered":"2024-05-09T05:54:06.914631+0000","last_clean":"2024-05-09T05:54:06.914631+0000","last_became_active":"2024-05-09T05:53:23.102420+0000","last_became_peered":"2024-05-09T05:53:23.102420+0000","last_unstale":"2024-05-09T05:54:06.914631+0000","last_undegraded":"2024-05-09T05:54:06.914631+0000","last_fullsized":"2024-05-09T05:54:06.914631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:45:11.479140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.915193+0000","last_change":"2024-05-09T05:53:28.195537+0000","last_active":"2024-05-09T05:54:06.915193+0000","last_peered":"2024-05-09T05:54:06.915193+0000","last_clean":"2024-05-09T05:54:06.915193+0000","last_became_active":"2024-05-09T05:53:28.194915+0000","last_became_peered":"2024-05-09T05:53:28.194915+0000","last_unstale":"2024-05-09T05:54:06.915193+0000","last_undegraded":"2024-05-09T05:54:06.915193+0000","last_fullsized":"2024-05-09T05:54:06.915193+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:07.554137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.954896+0000","last_change":"2024-05-09T05:53:24.130312+0000","last_active":"2024-05-09T05:54:05.954896+0000","last_peered":"2024-05-09T05:54:05.954896+0000","last_clean":"2024-05-09T05:54:05.954896+0000","last_became_active":"2024-05-09T05:53:24.129953+0000","last_became_peered":"2024-05-09T05:53:24.129953+0000","last_unstale":"2024-05-09T05:54:05.954896+0000","last_undegraded":"2024-05-09T05:54:05.954896+0000","last_fullsized":"2024-05-09T05:54:05.954896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:07:09.368521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"27'7","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:10.966957+0000","last_change":"2024-05-09T05:53:23.127219+0000","last_active":"2024-05-09T05:54:10.966957+0000","last_peered":"2024-05-09T05:54:10.966957+0000","last_clean":"2024-05-09T05:54:10.966957+0000","last_became_active":"2024-05-09T05:53:23.126691+0000","last_became_peered":"2024-05-09T05:53:23.126691+0000","last_unstale":"2024-05-09T05:54:10.966957+0000","last_undegraded":"2024-05-09T05:54:10.966957+0000","last_fullsized":"2024-05-09T05:54:10.966957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:17:26.711941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.915158+0000","last_change":"2024-05-09T05:53:28.191045+0000","last_active":"2024-05-09T05:54:06.915158+0000","last_peered":"2024-05-09T05:54:06.915158+0000","last_clean":"2024-05-09T05:54:06.915158+0000","last_became_active":"2024-05-09T05:53:28.190564+0000","last_became_peered":"2024-05-09T05:53:28.190564+0000","last_unstale":"2024-05-09T05:54:06.915158+0000","last_undegraded":"2024-05-09T05:54:06.915158+0000","last_fullsized":"2024-05-09T05:54:06.915158+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:53:30.541681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.958140+0000","last_change":"2024-05-09T05:53:24.138682+0000","last_active":"2024-05-09T05:54:05.958140+0000","last_peered":"2024-05-09T05:54:05.958140+0000","last_clean":"2024-05-09T05:54:05.958140+0000","last_became_active":"2024-05-09T05:53:24.138417+0000","last_became_peered":"2024-05-09T05:53:24.138417+0000","last_unstale":"2024-05-09T05:54:05.958140+0000","last_undegraded":"2024-05-09T05:54:05.958140+0000","last_fullsized":"2024-05-09T05:54:05.958140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:57:55.403156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"26'7","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.955516+0000","last_change":"2024-05-09T05:53:23.102986+0000","last_active":"2024-05-09T05:54:05.955516+0000","last_peered":"2024-05-09T05:54:05.955516+0000","last_clean":"2024-05-09T05:54:05.955516+0000","last_became_active":"2024-05-09T05:53:23.102020+0000","last_became_peered":"2024-05-09T05:53:23.102020+0000","last_unstale":"2024-05-09T05:54:05.955516+0000","last_undegraded":"2024-05-09T05:54:05.955516+0000","last_fullsized":"2024-05-09T05:54:05.955516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:18:11.582575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.954659+0000","last_change":"2024-05-09T05:53:28.218326+0000","last_active":"2024-05-09T05:54:05.954659+0000","last_peered":"2024-05-09T05:54:05.954659+0000","last_clean":"2024-05-09T05:54:05.954659+0000","last_became_active":"2024-05-09T05:53:28.216634+0000","last_became_peered":"2024-05-09T05:53:28.216634+0000","last_unstale":"2024-05-09T05:54:05.954659+0000","last_undegraded":"2024-05-09T05:54:05.954659+0000","last_fullsized":"2024-05-09T05:54:05.954659+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:13:05.321932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.958917+0000","last_change":"2024-05-09T05:53:24.143161+0000","last_active":"2024-05-09T05:54:05.958917+0000","last_peered":"2024-05-09T05:54:05.958917+0000","last_clean":"2024-05-09T05:54:05.958917+0000","last_became_active":"2024-05-09T05:53:24.139369+0000","last_became_peered":"2024-05-09T05:53:24.139369+0000","last_unstale":"2024-05-09T05:54:05.958917+0000","last_undegraded":"2024-05-09T05:54:05.958917+0000","last_fullsized":"2024-05-09T05:54:05.958917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:25:21.472460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"27'4","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.964751+0000","last_change":"2024-05-09T05:53:23.123560+0000","last_active":"2024-05-09T05:54:05.964751+0000","last_peered":"2024-05-09T05:54:05.964751+0000","last_clean":"2024-05-09T05:54:05.964751+0000","last_became_active":"2024-05-09T05:53:23.123081+0000","last_became_peered":"2024-05-09T05:53:23.123081+0000","last_unstale":"2024-05-09T05:54:05.964751+0000","last_undegraded":"2024-05-09T05:54:05.964751+0000","last_fullsized":"2024-05-09T05:54:05.964751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:15:31.371756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.956026+0000","last_change":"2024-05-09T05:53:28.229352+0000","last_active":"2024-05-09T05:54:05.956026+0000","last_peered":"2024-05-09T05:54:05.956026+0000","last_clean":"2024-05-09T05:54:05.956026+0000","last_became_active":"2024-05-09T05:53:28.225810+0000","last_became_peered":"2024-05-09T05:53:28.225810+0000","last_unstale":"2024-05-09T05:54:05.956026+0000","last_undegraded":"2024-05-09T05:54:05.956026+0000","last_fullsized":"2024-05-09T05:54:05.956026+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:17:07.192105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.914920+0000","last_change":"2024-05-09T05:53:24.130533+0000","last_active":"2024-05-09T05:54:06.914920+0000","last_peered":"2024-05-09T05:54:06.914920+0000","last_clean":"2024-05-09T05:54:06.914920+0000","last_became_active":"2024-05-09T05:53:24.129787+0000","last_became_peered":"2024-05-09T05:53:24.129787+0000","last_unstale":"2024-05-09T05:54:06.914920+0000","last_undegraded":"2024-05-09T05:54:06.914920+0000","last_fullsized":"2024-05-09T05:54:06.914920+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:37:36.036271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"26'1","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.961428+0000","last_change":"2024-05-09T05:53:23.134379+0000","last_active":"2024-05-09T05:54:05.961428+0000","last_peered":"2024-05-09T05:54:05.961428+0000","last_clean":"2024-05-09T05:54:05.961428+0000","last_became_active":"2024-05-09T05:53:23.133587+0000","last_became_peered":"2024-05-09T05:53:23.133587+0000","last_unstale":"2024-05-09T05:54:05.961428+0000","last_undegraded":"2024-05-09T05:54:05.961428+0000","last_fullsized":"2024-05-09T05:54:05.961428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:00:33.973787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.956964+0000","last_change":"2024-05-09T05:53:28.233620+0000","last_active":"2024-05-09T05:54:05.956964+0000","last_peered":"2024-05-09T05:54:05.956964+0000","last_clean":"2024-05-09T05:54:05.956964+0000","last_became_active":"2024-05-09T05:53:28.232539+0000","last_became_peered":"2024-05-09T05:53:28.232539+0000","last_unstale":"2024-05-09T05:54:05.956964+0000","last_undegraded":"2024-05-09T05:54:05.956964+0000","last_fullsized":"2024-05-09T05:54:05.956964+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:13.789448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.918199+0000","last_change":"2024-05-09T05:53:24.132702+0000","last_active":"2024-05-09T05:54:06.918199+0000","last_peered":"2024-05-09T05:54:06.918199+0000","last_clean":"2024-05-09T05:54:06.918199+0000","last_became_active":"2024-05-09T05:53:24.132309+0000","last_became_peered":"2024-05-09T05:53:24.132309+0000","last_unstale":"2024-05-09T05:54:06.918199+0000","last_undegraded":"2024-05-09T05:54:06.918199+0000","last_fullsized":"2024-05-09T05:54:06.918199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:53:13.592038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"27'5","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:10.963975+0000","last_change":"2024-05-09T05:53:23.120384+0000","last_active":"2024-05-09T05:54:10.963975+0000","last_peered":"2024-05-09T05:54:10.963975+0000","last_clean":"2024-05-09T05:54:10.963975+0000","last_became_active":"2024-05-09T05:53:23.118321+0000","last_became_peered":"2024-05-09T05:53:23.118321+0000","last_unstale":"2024-05-09T05:54:10.963975+0000","last_undegraded":"2024-05-09T05:54:10.963975+0000","last_fullsized":"2024-05-09T05:54:10.963975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:15:51.297111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.956427+0000","last_change":"2024-05-09T05:53:28.208383+0000","last_active":"2024-05-09T05:54:05.956427+0000","last_peered":"2024-05-09T05:54:05.956427+0000","last_clean":"2024-05-09T05:54:05.956427+0000","last_became_active":"2024-05-09T05:53:28.199359+0000","last_became_peered":"2024-05-09T05:53:28.199359+0000","last_unstale":"2024-05-09T05:54:05.956427+0000","last_undegraded":"2024-05-09T05:54:05.956427+0000","last_fullsized":"2024-05-09T05:54:05.956427+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:50:19.715242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.959736+0000","last_change":"2024-05-09T05:53:24.142740+0000","last_active":"2024-05-09T05:54:05.959736+0000","last_peered":"2024-05-09T05:54:05.959736+0000","last_clean":"2024-05-09T05:54:05.959736+0000","last_became_active":"2024-05-09T05:53:24.142265+0000","last_became_peered":"2024-05-09T05:53:24.142265+0000","last_unstale":"2024-05-09T05:54:05.959736+0000","last_undegraded":"2024-05-09T05:54:05.959736+0000","last_fullsized":"2024-05-09T05:54:05.959736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:46:53.729151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"27'6","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:10.959088+0000","last_change":"2024-05-09T05:53:23.142455+0000","last_active":"2024-05-09T05:54:10.959088+0000","last_peered":"2024-05-09T05:54:10.959088+0000","last_clean":"2024-05-09T05:54:10.959088+0000","last_became_active":"2024-05-09T05:53:23.141770+0000","last_became_peered":"2024-05-09T05:53:23.141770+0000","last_unstale":"2024-05-09T05:54:10.959088+0000","last_undegraded":"2024-05-09T05:54:10.959088+0000","last_fullsized":"2024-05-09T05:54:10.959088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:30:34.301349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.956600+0000","last_change":"2024-05-09T05:53:28.212176+0000","last_active":"2024-05-09T05:54:05.956600+0000","last_peered":"2024-05-09T05:54:05.956600+0000","last_clean":"2024-05-09T05:54:05.956600+0000","last_became_active":"2024-05-09T05:53:28.210981+0000","last_became_peered":"2024-05-09T05:53:28.210981+0000","last_unstale":"2024-05-09T05:54:05.956600+0000","last_undegraded":"2024-05-09T05:54:05.956600+0000","last_fullsized":"2024-05-09T05:54:05.956600+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:17:24.122805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.955894+0000","last_change":"2024-05-09T05:53:24.132887+0000","last_active":"2024-05-09T05:54:05.955894+0000","last_peered":"2024-05-09T05:54:05.955894+0000","last_clean":"2024-05-09T05:54:05.955894+0000","last_became_active":"2024-05-09T05:53:24.132398+0000","last_became_peered":"2024-05-09T05:53:24.132398+0000","last_unstale":"2024-05-09T05:54:05.955894+0000","last_undegraded":"2024-05-09T05:54:05.955894+0000","last_fullsized":"2024-05-09T05:54:05.955894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:36:49.369162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"27'4","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.963466+0000","last_change":"2024-05-09T05:53:23.126202+0000","last_active":"2024-05-09T05:54:05.963466+0000","last_peered":"2024-05-09T05:54:05.963466+0000","last_clean":"2024-05-09T05:54:05.963466+0000","last_became_active":"2024-05-09T05:53:23.125799+0000","last_became_peered":"2024-05-09T05:53:23.125799+0000","last_unstale":"2024-05-09T05:54:05.963466+0000","last_undegraded":"2024-05-09T05:54:05.963466+0000","last_fullsized":"2024-05-09T05:54:05.963466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:33:12.831705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.916943+0000","last_change":"2024-05-09T05:54:06.916943+0000","last_active":"2024-05-09T05:54:06.916943+0000","last_peered":"2024-05-09T05:54:06.916943+0000","last_clean":"2024-05-09T05:54:06.916943+0000","last_became_active":"2024-05-09T05:54:06.915734+0000","last_became_peered":"2024-05-09T05:54:06.915734+0000","last_unstale":"2024-05-09T05:54:06.916943+0000","last_undegraded":"2024-05-09T05:54:06.916943+0000","last_fullsized":"2024-05-09T05:54:06.916943+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:59:44.265794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,6,1],"acting":[5,0,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.954791+0000","last_change":"2024-05-09T05:53:24.139586+0000","last_active":"2024-05-09T05:54:05.954791+0000","last_peered":"2024-05-09T05:54:05.954791+0000","last_clean":"2024-05-09T05:54:05.954791+0000","last_became_active":"2024-05-09T05:53:24.138835+0000","last_became_peered":"2024-05-09T05:53:24.138835+0000","last_unstale":"2024-05-09T05:54:05.954791+0000","last_undegraded":"2024-05-09T05:54:05.954791+0000","last_fullsized":"2024-05-09T05:54:05.954791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:37:13.012588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"27'6","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.963964+0000","last_change":"2024-05-09T05:53:23.117121+0000","last_active":"2024-05-09T05:54:05.963964+0000","last_peered":"2024-05-09T05:54:05.963964+0000","last_clean":"2024-05-09T05:54:05.963964+0000","last_became_active":"2024-05-09T05:53:23.113294+0000","last_became_peered":"2024-05-09T05:53:23.113294+0000","last_unstale":"2024-05-09T05:54:05.963964+0000","last_undegraded":"2024-05-09T05:54:05.963964+0000","last_fullsized":"2024-05-09T05:54:05.963964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:53:41.591371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":121,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.953773+0000","last_change":"2024-05-09T05:53:12.484358+0000","last_active":"2024-05-09T05:54:05.953773+0000","last_peered":"2024-05-09T05:54:05.953773+0000","last_clean":"2024-05-09T05:54:05.953773+0000","last_became_active":"2024-05-09T05:53:12.481529+0000","last_became_peered":"2024-05-09T05:53:12.481529+0000","last_unstale":"2024-05-09T05:54:05.953773+0000","last_undegraded":"2024-05-09T05:54:05.953773+0000","last_fullsized":"2024-05-09T05:54:05.953773+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:10.902489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:10.902489+0000","last_clean_scrub_stamp":"2024-05-09T05:53:10.902489+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:28:50.650299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.964356+0000","last_change":"2024-05-09T05:53:28.190861+0000","last_active":"2024-05-09T05:54:05.964356+0000","last_peered":"2024-05-09T05:54:05.964356+0000","last_clean":"2024-05-09T05:54:05.964356+0000","last_became_active":"2024-05-09T05:53:28.190393+0000","last_became_peered":"2024-05-09T05:53:28.190393+0000","last_unstale":"2024-05-09T05:54:05.964356+0000","last_undegraded":"2024-05-09T05:54:05.964356+0000","last_fullsized":"2024-05-09T05:54:05.964356+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:05:37.653010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.964283+0000","last_change":"2024-05-09T05:53:24.143283+0000","last_active":"2024-05-09T05:54:05.964283+0000","last_peered":"2024-05-09T05:54:05.964283+0000","last_clean":"2024-05-09T05:54:05.964283+0000","last_became_active":"2024-05-09T05:53:24.139813+0000","last_became_peered":"2024-05-09T05:53:24.139813+0000","last_unstale":"2024-05-09T05:54:05.964283+0000","last_undegraded":"2024-05-09T05:54:05.964283+0000","last_fullsized":"2024-05-09T05:54:05.964283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:07:38.471778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"27'6","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.958661+0000","last_change":"2024-05-09T05:53:23.115534+0000","last_active":"2024-05-09T05:54:05.958661+0000","last_peered":"2024-05-09T05:54:05.958661+0000","last_clean":"2024-05-09T05:54:05.958661+0000","last_became_active":"2024-05-09T05:53:23.112260+0000","last_became_peered":"2024-05-09T05:53:23.112260+0000","last_unstale":"2024-05-09T05:54:05.958661+0000","last_undegraded":"2024-05-09T05:54:05.958661+0000","last_fullsized":"2024-05-09T05:54:05.958661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:46:53.520691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1611,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.913778+0000","last_change":"2024-05-09T05:53:28.195687+0000","last_active":"2024-05-09T05:54:06.913778+0000","last_peered":"2024-05-09T05:54:06.913778+0000","last_clean":"2024-05-09T05:54:06.913778+0000","last_became_active":"2024-05-09T05:53:28.195082+0000","last_became_peered":"2024-05-09T05:53:28.195082+0000","last_unstale":"2024-05-09T05:54:06.913778+0000","last_undegraded":"2024-05-09T05:54:06.913778+0000","last_fullsized":"2024-05-09T05:54:06.913778+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:45:56.633547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.917432+0000","last_change":"2024-05-09T05:53:24.130460+0000","last_active":"2024-05-09T05:54:06.917432+0000","last_peered":"2024-05-09T05:54:06.917432+0000","last_clean":"2024-05-09T05:54:06.917432+0000","last_became_active":"2024-05-09T05:53:24.129808+0000","last_became_peered":"2024-05-09T05:53:24.129808+0000","last_unstale":"2024-05-09T05:54:06.917432+0000","last_undegraded":"2024-05-09T05:54:06.917432+0000","last_fullsized":"2024-05-09T05:54:06.917432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:36:04.881676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"27'3","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.962373+0000","last_change":"2024-05-09T05:53:23.139063+0000","last_active":"2024-05-09T05:54:05.962373+0000","last_peered":"2024-05-09T05:54:05.962373+0000","last_clean":"2024-05-09T05:54:05.962373+0000","last_became_active":"2024-05-09T05:53:23.138303+0000","last_became_peered":"2024-05-09T05:53:23.138303+0000","last_unstale":"2024-05-09T05:54:05.962373+0000","last_undegraded":"2024-05-09T05:54:05.962373+0000","last_fullsized":"2024-05-09T05:54:05.962373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:18:20.172877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.960806+0000","last_change":"2024-05-09T05:53:28.214251+0000","last_active":"2024-05-09T05:54:05.960806+0000","last_peered":"2024-05-09T05:54:05.960806+0000","last_clean":"2024-05-09T05:54:05.960806+0000","last_became_active":"2024-05-09T05:53:28.206229+0000","last_became_peered":"2024-05-09T05:53:28.206229+0000","last_unstale":"2024-05-09T05:54:05.960806+0000","last_undegraded":"2024-05-09T05:54:05.960806+0000","last_fullsized":"2024-05-09T05:54:05.960806+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:12:26.761543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.917899+0000","last_change":"2024-05-09T05:53:24.135578+0000","last_active":"2024-05-09T05:54:06.917899+0000","last_peered":"2024-05-09T05:54:06.917899+0000","last_clean":"2024-05-09T05:54:06.917899+0000","last_became_active":"2024-05-09T05:53:24.135253+0000","last_became_peered":"2024-05-09T05:53:24.135253+0000","last_unstale":"2024-05-09T05:54:06.917899+0000","last_undegraded":"2024-05-09T05:54:06.917899+0000","last_fullsized":"2024-05-09T05:54:06.917899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:20:23.093397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"27'5","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:10.959019+0000","last_change":"2024-05-09T05:53:23.140175+0000","last_active":"2024-05-09T05:54:10.959019+0000","last_peered":"2024-05-09T05:54:10.959019+0000","last_clean":"2024-05-09T05:54:10.959019+0000","last_became_active":"2024-05-09T05:53:23.139516+0000","last_became_peered":"2024-05-09T05:53:23.139516+0000","last_unstale":"2024-05-09T05:54:10.959019+0000","last_undegraded":"2024-05-09T05:54:10.959019+0000","last_fullsized":"2024-05-09T05:54:10.959019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:48:42.473155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.962952+0000","last_change":"2024-05-09T05:53:28.199385+0000","last_active":"2024-05-09T05:54:05.962952+0000","last_peered":"2024-05-09T05:54:05.962952+0000","last_clean":"2024-05-09T05:54:05.962952+0000","last_became_active":"2024-05-09T05:53:28.198825+0000","last_became_peered":"2024-05-09T05:53:28.198825+0000","last_unstale":"2024-05-09T05:54:05.962952+0000","last_undegraded":"2024-05-09T05:54:05.962952+0000","last_fullsized":"2024-05-09T05:54:05.962952+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:48:22.224140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.915450+0000","last_change":"2024-05-09T05:53:24.133293+0000","last_active":"2024-05-09T05:54:06.915450+0000","last_peered":"2024-05-09T05:54:06.915450+0000","last_clean":"2024-05-09T05:54:06.915450+0000","last_became_active":"2024-05-09T05:53:24.131741+0000","last_became_peered":"2024-05-09T05:53:24.131741+0000","last_unstale":"2024-05-09T05:54:06.915450+0000","last_undegraded":"2024-05-09T05:54:06.915450+0000","last_fullsized":"2024-05-09T05:54:06.915450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:01:33.701742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"26'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.918030+0000","last_change":"2024-05-09T05:53:23.112592+0000","last_active":"2024-05-09T05:54:06.918030+0000","last_peered":"2024-05-09T05:54:06.918030+0000","last_clean":"2024-05-09T05:54:06.918030+0000","last_became_active":"2024-05-09T05:53:23.111968+0000","last_became_peered":"2024-05-09T05:53:23.111968+0000","last_unstale":"2024-05-09T05:54:06.918030+0000","last_undegraded":"2024-05-09T05:54:06.918030+0000","last_fullsized":"2024-05-09T05:54:06.918030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:32:54.694588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.953919+0000","last_change":"2024-05-09T05:53:28.227755+0000","last_active":"2024-05-09T05:54:05.953919+0000","last_peered":"2024-05-09T05:54:05.953919+0000","last_clean":"2024-05-09T05:54:05.953919+0000","last_became_active":"2024-05-09T05:53:28.227272+0000","last_became_peered":"2024-05-09T05:53:28.227272+0000","last_unstale":"2024-05-09T05:54:05.953919+0000","last_undegraded":"2024-05-09T05:54:05.953919+0000","last_fullsized":"2024-05-09T05:54:05.953919+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:13:32.020862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.963238+0000","last_change":"2024-05-09T05:53:24.144025+0000","last_active":"2024-05-09T05:54:05.963238+0000","last_peered":"2024-05-09T05:54:05.963238+0000","last_clean":"2024-05-09T05:54:05.963238+0000","last_became_active":"2024-05-09T05:53:24.143540+0000","last_became_peered":"2024-05-09T05:53:24.143540+0000","last_unstale":"2024-05-09T05:54:05.963238+0000","last_undegraded":"2024-05-09T05:54:05.963238+0000","last_fullsized":"2024-05-09T05:54:05.963238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:22:58.062541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"27'17","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.955433+0000","last_change":"2024-05-09T05:53:23.104452+0000","last_active":"2024-05-09T05:54:05.955433+0000","last_peered":"2024-05-09T05:54:05.955433+0000","last_clean":"2024-05-09T05:54:05.955433+0000","last_became_active":"2024-05-09T05:53:23.103471+0000","last_became_peered":"2024-05-09T05:53:23.103471+0000","last_unstale":"2024-05-09T05:54:05.955433+0000","last_undegraded":"2024-05-09T05:54:05.955433+0000","last_fullsized":"2024-05-09T05:54:05.955433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:33:30.508464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.962376+0000","last_change":"2024-05-09T05:53:28.241338+0000","last_active":"2024-05-09T05:54:05.962376+0000","last_peered":"2024-05-09T05:54:05.962376+0000","last_clean":"2024-05-09T05:54:05.962376+0000","last_became_active":"2024-05-09T05:53:28.239841+0000","last_became_peered":"2024-05-09T05:53:28.239841+0000","last_unstale":"2024-05-09T05:54:05.962376+0000","last_undegraded":"2024-05-09T05:54:05.962376+0000","last_fullsized":"2024-05-09T05:54:05.962376+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:44:47.854598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.954501+0000","last_change":"2024-05-09T05:53:24.149958+0000","last_active":"2024-05-09T05:54:05.954501+0000","last_peered":"2024-05-09T05:54:05.954501+0000","last_clean":"2024-05-09T05:54:05.954501+0000","last_became_active":"2024-05-09T05:53:24.149578+0000","last_became_peered":"2024-05-09T05:53:24.149578+0000","last_unstale":"2024-05-09T05:54:05.954501+0000","last_undegraded":"2024-05-09T05:54:05.954501+0000","last_fullsized":"2024-05-09T05:54:05.954501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:27:43.555218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"27'6","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.916143+0000","last_change":"2024-05-09T05:53:23.121266+0000","last_active":"2024-05-09T05:54:06.916143+0000","last_peered":"2024-05-09T05:54:06.916143+0000","last_clean":"2024-05-09T05:54:06.916143+0000","last_became_active":"2024-05-09T05:53:23.120857+0000","last_became_peered":"2024-05-09T05:53:23.120857+0000","last_unstale":"2024-05-09T05:54:06.916143+0000","last_undegraded":"2024-05-09T05:54:06.916143+0000","last_fullsized":"2024-05-09T05:54:06.916143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:03:30.185640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1029,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.962538+0000","last_change":"2024-05-09T05:53:28.240774+0000","last_active":"2024-05-09T05:54:05.962538+0000","last_peered":"2024-05-09T05:54:05.962538+0000","last_clean":"2024-05-09T05:54:05.962538+0000","last_became_active":"2024-05-09T05:53:28.240070+0000","last_became_peered":"2024-05-09T05:53:28.240070+0000","last_unstale":"2024-05-09T05:54:05.962538+0000","last_undegraded":"2024-05-09T05:54:05.962538+0000","last_fullsized":"2024-05-09T05:54:05.962538+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:25:24.019344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.645397+0000","last_change":"2024-05-09T05:54:06.645397+0000","last_active":"2024-05-09T05:54:06.645397+0000","last_peered":"2024-05-09T05:54:06.645397+0000","last_clean":"2024-05-09T05:54:06.645397+0000","last_became_active":"2024-05-09T05:54:06.644437+0000","last_became_peered":"2024-05-09T05:54:06.644437+0000","last_unstale":"2024-05-09T05:54:06.645397+0000","last_undegraded":"2024-05-09T05:54:06.645397+0000","last_fullsized":"2024-05-09T05:54:06.645397+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:41:52.843192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'5","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.963950+0000","last_change":"2024-05-09T05:53:23.120680+0000","last_active":"2024-05-09T05:54:05.963950+0000","last_peered":"2024-05-09T05:54:05.963950+0000","last_clean":"2024-05-09T05:54:05.963950+0000","last_became_active":"2024-05-09T05:53:23.118358+0000","last_became_peered":"2024-05-09T05:53:23.118358+0000","last_unstale":"2024-05-09T05:54:05.963950+0000","last_undegraded":"2024-05-09T05:54:05.963950+0000","last_fullsized":"2024-05-09T05:54:05.963950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:52:52.360128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.956306+0000","last_change":"2024-05-09T05:53:28.222341+0000","last_active":"2024-05-09T05:54:05.956306+0000","last_peered":"2024-05-09T05:54:05.956306+0000","last_clean":"2024-05-09T05:54:05.956306+0000","last_became_active":"2024-05-09T05:53:28.219636+0000","last_became_peered":"2024-05-09T05:53:28.219636+0000","last_unstale":"2024-05-09T05:54:05.956306+0000","last_undegraded":"2024-05-09T05:54:05.956306+0000","last_fullsized":"2024-05-09T05:54:05.956306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:29:03.459851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.957693+0000","last_change":"2024-05-09T05:53:24.143495+0000","last_active":"2024-05-09T05:54:05.957693+0000","last_peered":"2024-05-09T05:54:05.957693+0000","last_clean":"2024-05-09T05:54:05.957693+0000","last_became_active":"2024-05-09T05:53:24.143181+0000","last_became_peered":"2024-05-09T05:53:24.143181+0000","last_unstale":"2024-05-09T05:54:05.957693+0000","last_undegraded":"2024-05-09T05:54:05.957693+0000","last_fullsized":"2024-05-09T05:54:05.957693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:40:20.997659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"27'9","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:10.961271+0000","last_change":"2024-05-09T05:53:23.114815+0000","last_active":"2024-05-09T05:54:10.961271+0000","last_peered":"2024-05-09T05:54:10.961271+0000","last_clean":"2024-05-09T05:54:10.961271+0000","last_became_active":"2024-05-09T05:53:23.113524+0000","last_became_peered":"2024-05-09T05:53:23.113524+0000","last_unstale":"2024-05-09T05:54:10.961271+0000","last_undegraded":"2024-05-09T05:54:10.961271+0000","last_fullsized":"2024-05-09T05:54:10.961271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:35:45.537715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.964093+0000","last_change":"2024-05-09T05:53:28.226682+0000","last_active":"2024-05-09T05:54:05.964093+0000","last_peered":"2024-05-09T05:54:05.964093+0000","last_clean":"2024-05-09T05:54:05.964093+0000","last_became_active":"2024-05-09T05:53:28.226279+0000","last_became_peered":"2024-05-09T05:53:28.226279+0000","last_unstale":"2024-05-09T05:54:05.964093+0000","last_undegraded":"2024-05-09T05:54:05.964093+0000","last_fullsized":"2024-05-09T05:54:05.964093+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:15:55.146695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.916982+0000","last_change":"2024-05-09T05:53:24.135119+0000","last_active":"2024-05-09T05:54:06.916982+0000","last_peered":"2024-05-09T05:54:06.916982+0000","last_clean":"2024-05-09T05:54:06.916982+0000","last_became_active":"2024-05-09T05:53:24.134690+0000","last_became_peered":"2024-05-09T05:53:24.134690+0000","last_unstale":"2024-05-09T05:54:06.916982+0000","last_undegraded":"2024-05-09T05:54:06.916982+0000","last_fullsized":"2024-05-09T05:54:06.916982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:15:36.608441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'15","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:19.278318+0000","last_change":"2024-05-09T05:53:23.119626+0000","last_active":"2024-05-09T05:54:19.278318+0000","last_peered":"2024-05-09T05:54:19.278318+0000","last_clean":"2024-05-09T05:54:19.278318+0000","last_became_active":"2024-05-09T05:53:23.119173+0000","last_became_peered":"2024-05-09T05:53:23.119173+0000","last_unstale":"2024-05-09T05:54:19.278318+0000","last_undegraded":"2024-05-09T05:54:19.278318+0000","last_fullsized":"2024-05-09T05:54:19.278318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:24:03.188897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4283,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.954584+0000","last_change":"2024-05-09T05:53:28.223167+0000","last_active":"2024-05-09T05:54:05.954584+0000","last_peered":"2024-05-09T05:54:05.954584+0000","last_clean":"2024-05-09T05:54:05.954584+0000","last_became_active":"2024-05-09T05:53:28.221846+0000","last_became_peered":"2024-05-09T05:53:28.221846+0000","last_unstale":"2024-05-09T05:54:05.954584+0000","last_undegraded":"2024-05-09T05:54:05.954584+0000","last_fullsized":"2024-05-09T05:54:05.954584+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:47:12.366900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.963707+0000","last_change":"2024-05-09T05:53:24.133007+0000","last_active":"2024-05-09T05:54:05.963707+0000","last_peered":"2024-05-09T05:54:05.963707+0000","last_clean":"2024-05-09T05:54:05.963707+0000","last_became_active":"2024-05-09T05:53:24.132545+0000","last_became_peered":"2024-05-09T05:53:24.132545+0000","last_unstale":"2024-05-09T05:54:05.963707+0000","last_undegraded":"2024-05-09T05:54:05.963707+0000","last_fullsized":"2024-05-09T05:54:05.963707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:10:26.299015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"26'5","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.642545+0000","last_change":"2024-05-09T05:53:23.121124+0000","last_active":"2024-05-09T05:54:06.642545+0000","last_peered":"2024-05-09T05:54:06.642545+0000","last_clean":"2024-05-09T05:54:06.642545+0000","last_became_active":"2024-05-09T05:53:23.120303+0000","last_became_peered":"2024-05-09T05:53:23.120303+0000","last_unstale":"2024-05-09T05:54:06.642545+0000","last_undegraded":"2024-05-09T05:54:06.642545+0000","last_fullsized":"2024-05-09T05:54:06.642545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:36:49.445673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.913982+0000","last_change":"2024-05-09T05:53:28.188712+0000","last_active":"2024-05-09T05:54:06.913982+0000","last_peered":"2024-05-09T05:54:06.913982+0000","last_clean":"2024-05-09T05:54:06.913982+0000","last_became_active":"2024-05-09T05:53:28.184259+0000","last_became_peered":"2024-05-09T05:53:28.184259+0000","last_unstale":"2024-05-09T05:54:06.913982+0000","last_undegraded":"2024-05-09T05:54:06.913982+0000","last_fullsized":"2024-05-09T05:54:06.913982+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:56:39.668106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.963156+0000","last_change":"2024-05-09T05:53:24.146147+0000","last_active":"2024-05-09T05:54:05.963156+0000","last_peered":"2024-05-09T05:54:05.963156+0000","last_clean":"2024-05-09T05:54:05.963156+0000","last_became_active":"2024-05-09T05:53:24.145704+0000","last_became_peered":"2024-05-09T05:53:24.145704+0000","last_unstale":"2024-05-09T05:54:05.963156+0000","last_undegraded":"2024-05-09T05:54:05.963156+0000","last_fullsized":"2024-05-09T05:54:05.963156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:47:03.047479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"27'4","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:10.966228+0000","last_change":"2024-05-09T05:53:23.095689+0000","last_active":"2024-05-09T05:54:10.966228+0000","last_peered":"2024-05-09T05:54:10.966228+0000","last_clean":"2024-05-09T05:54:10.966228+0000","last_became_active":"2024-05-09T05:53:23.094889+0000","last_became_peered":"2024-05-09T05:53:23.094889+0000","last_unstale":"2024-05-09T05:54:10.966228+0000","last_undegraded":"2024-05-09T05:54:10.966228+0000","last_fullsized":"2024-05-09T05:54:10.966228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:25:35.069184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.640733+0000","last_change":"2024-05-09T05:53:28.223954+0000","last_active":"2024-05-09T05:54:06.640733+0000","last_peered":"2024-05-09T05:54:06.640733+0000","last_clean":"2024-05-09T05:54:06.640733+0000","last_became_active":"2024-05-09T05:53:28.222700+0000","last_became_peered":"2024-05-09T05:53:28.222700+0000","last_unstale":"2024-05-09T05:54:06.640733+0000","last_undegraded":"2024-05-09T05:54:06.640733+0000","last_fullsized":"2024-05-09T05:54:06.640733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:17:17.864782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.915376+0000","last_change":"2024-05-09T05:53:24.140698+0000","last_active":"2024-05-09T05:54:06.915376+0000","last_peered":"2024-05-09T05:54:06.915376+0000","last_clean":"2024-05-09T05:54:06.915376+0000","last_became_active":"2024-05-09T05:53:24.139612+0000","last_became_peered":"2024-05-09T05:53:24.139612+0000","last_unstale":"2024-05-09T05:54:06.915376+0000","last_undegraded":"2024-05-09T05:54:06.915376+0000","last_fullsized":"2024-05-09T05:54:06.915376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:09:39.609750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'5","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.955853+0000","last_change":"2024-05-09T05:53:23.106167+0000","last_active":"2024-05-09T05:54:05.955853+0000","last_peered":"2024-05-09T05:54:05.955853+0000","last_clean":"2024-05-09T05:54:05.955853+0000","last_became_active":"2024-05-09T05:53:23.105346+0000","last_became_peered":"2024-05-09T05:53:23.105346+0000","last_unstale":"2024-05-09T05:54:05.955853+0000","last_undegraded":"2024-05-09T05:54:05.955853+0000","last_fullsized":"2024-05-09T05:54:05.955853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:06:46.109056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.955536+0000","last_change":"2024-05-09T05:53:28.194037+0000","last_active":"2024-05-09T05:54:05.955536+0000","last_peered":"2024-05-09T05:54:05.955536+0000","last_clean":"2024-05-09T05:54:05.955536+0000","last_became_active":"2024-05-09T05:53:28.192944+0000","last_became_peered":"2024-05-09T05:53:28.192944+0000","last_unstale":"2024-05-09T05:54:05.955536+0000","last_undegraded":"2024-05-09T05:54:05.955536+0000","last_fullsized":"2024-05-09T05:54:05.955536+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:28:47.664198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.954541+0000","last_change":"2024-05-09T05:53:28.226664+0000","last_active":"2024-05-09T05:54:05.954541+0000","last_peered":"2024-05-09T05:54:05.954541+0000","last_clean":"2024-05-09T05:54:05.954541+0000","last_became_active":"2024-05-09T05:53:28.222225+0000","last_became_peered":"2024-05-09T05:53:28.222225+0000","last_unstale":"2024-05-09T05:54:05.954541+0000","last_undegraded":"2024-05-09T05:54:05.954541+0000","last_fullsized":"2024-05-09T05:54:05.954541+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:24:23.614210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.955804+0000","last_change":"2024-05-09T05:53:24.128343+0000","last_active":"2024-05-09T05:54:05.955804+0000","last_peered":"2024-05-09T05:54:05.955804+0000","last_clean":"2024-05-09T05:54:05.955804+0000","last_became_active":"2024-05-09T05:53:24.127989+0000","last_became_peered":"2024-05-09T05:53:24.127989+0000","last_unstale":"2024-05-09T05:54:05.955804+0000","last_undegraded":"2024-05-09T05:54:05.955804+0000","last_fullsized":"2024-05-09T05:54:05.955804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:56:14.176175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"27'3","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.963317+0000","last_change":"2024-05-09T05:53:23.118882+0000","last_active":"2024-05-09T05:54:05.963317+0000","last_peered":"2024-05-09T05:54:05.963317+0000","last_clean":"2024-05-09T05:54:05.963317+0000","last_became_active":"2024-05-09T05:53:23.118119+0000","last_became_peered":"2024-05-09T05:53:23.118119+0000","last_unstale":"2024-05-09T05:54:05.963317+0000","last_undegraded":"2024-05-09T05:54:05.963317+0000","last_fullsized":"2024-05-09T05:54:05.963317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:06:48.203396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.964343+0000","last_change":"2024-05-09T05:53:28.235313+0000","last_active":"2024-05-09T05:54:05.964343+0000","last_peered":"2024-05-09T05:54:05.964343+0000","last_clean":"2024-05-09T05:54:05.964343+0000","last_became_active":"2024-05-09T05:53:28.234771+0000","last_became_peered":"2024-05-09T05:53:28.234771+0000","last_unstale":"2024-05-09T05:54:05.964343+0000","last_undegraded":"2024-05-09T05:54:05.964343+0000","last_fullsized":"2024-05-09T05:54:05.964343+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:38:46.942863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.959924+0000","last_change":"2024-05-09T05:53:24.141956+0000","last_active":"2024-05-09T05:54:05.959924+0000","last_peered":"2024-05-09T05:54:05.959924+0000","last_clean":"2024-05-09T05:54:05.959924+0000","last_became_active":"2024-05-09T05:53:24.139093+0000","last_became_peered":"2024-05-09T05:53:24.139093+0000","last_unstale":"2024-05-09T05:54:05.959924+0000","last_undegraded":"2024-05-09T05:54:05.959924+0000","last_fullsized":"2024-05-09T05:54:05.959924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:44:32.901168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"27'3","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.956549+0000","last_change":"2024-05-09T05:53:23.113865+0000","last_active":"2024-05-09T05:54:05.956549+0000","last_peered":"2024-05-09T05:54:05.956549+0000","last_clean":"2024-05-09T05:54:05.956549+0000","last_became_active":"2024-05-09T05:53:23.112020+0000","last_became_peered":"2024-05-09T05:53:23.112020+0000","last_unstale":"2024-05-09T05:54:05.956549+0000","last_undegraded":"2024-05-09T05:54:05.956549+0000","last_fullsized":"2024-05-09T05:54:05.956549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:37:04.425229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"26'7","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.963810+0000","last_change":"2024-05-09T05:53:23.127463+0000","last_active":"2024-05-09T05:54:05.963810+0000","last_peered":"2024-05-09T05:54:05.963810+0000","last_clean":"2024-05-09T05:54:05.963810+0000","last_became_active":"2024-05-09T05:53:23.126911+0000","last_became_peered":"2024-05-09T05:53:23.126911+0000","last_unstale":"2024-05-09T05:54:05.963810+0000","last_undegraded":"2024-05-09T05:54:05.963810+0000","last_fullsized":"2024-05-09T05:54:05.963810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:06:28.458926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.954923+0000","last_change":"2024-05-09T05:53:24.134391+0000","last_active":"2024-05-09T05:54:05.954923+0000","last_peered":"2024-05-09T05:54:05.954923+0000","last_clean":"2024-05-09T05:54:05.954923+0000","last_became_active":"2024-05-09T05:53:24.133994+0000","last_became_peered":"2024-05-09T05:53:24.133994+0000","last_unstale":"2024-05-09T05:54:05.954923+0000","last_undegraded":"2024-05-09T05:54:05.954923+0000","last_fullsized":"2024-05-09T05:54:05.954923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:30:32.872657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.955054+0000","last_change":"2024-05-09T05:53:28.223524+0000","last_active":"2024-05-09T05:54:05.955054+0000","last_peered":"2024-05-09T05:54:05.955054+0000","last_clean":"2024-05-09T05:54:05.955054+0000","last_became_active":"2024-05-09T05:53:28.222433+0000","last_became_peered":"2024-05-09T05:53:28.222433+0000","last_unstale":"2024-05-09T05:54:05.955054+0000","last_undegraded":"2024-05-09T05:54:05.955054+0000","last_fullsized":"2024-05-09T05:54:05.955054+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:52:35.361812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"27'6","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.961185+0000","last_change":"2024-05-09T05:53:23.133700+0000","last_active":"2024-05-09T05:54:05.961185+0000","last_peered":"2024-05-09T05:54:05.961185+0000","last_clean":"2024-05-09T05:54:05.961185+0000","last_became_active":"2024-05-09T05:53:23.132946+0000","last_became_peered":"2024-05-09T05:53:23.132946+0000","last_unstale":"2024-05-09T05:54:05.961185+0000","last_undegraded":"2024-05-09T05:54:05.961185+0000","last_fullsized":"2024-05-09T05:54:05.961185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:39:49.829592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1063,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.953860+0000","last_change":"2024-05-09T05:53:24.138174+0000","last_active":"2024-05-09T05:54:05.953860+0000","last_peered":"2024-05-09T05:54:05.953860+0000","last_clean":"2024-05-09T05:54:05.953860+0000","last_became_active":"2024-05-09T05:53:24.137794+0000","last_became_peered":"2024-05-09T05:53:24.137794+0000","last_unstale":"2024-05-09T05:54:05.953860+0000","last_undegraded":"2024-05-09T05:54:05.953860+0000","last_fullsized":"2024-05-09T05:54:05.953860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:57:26.359258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.642109+0000","last_change":"2024-05-09T05:53:28.238375+0000","last_active":"2024-05-09T05:54:06.642109+0000","last_peered":"2024-05-09T05:54:06.642109+0000","last_clean":"2024-05-09T05:54:06.642109+0000","last_became_active":"2024-05-09T05:53:28.237414+0000","last_became_peered":"2024-05-09T05:53:28.237414+0000","last_unstale":"2024-05-09T05:54:06.642109+0000","last_undegraded":"2024-05-09T05:54:06.642109+0000","last_fullsized":"2024-05-09T05:54:06.642109+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:13:50.396951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.913624+0000","last_change":"2024-05-09T05:53:24.130839+0000","last_active":"2024-05-09T05:54:06.913624+0000","last_peered":"2024-05-09T05:54:06.913624+0000","last_clean":"2024-05-09T05:54:06.913624+0000","last_became_active":"2024-05-09T05:53:24.130201+0000","last_became_peered":"2024-05-09T05:53:24.130201+0000","last_unstale":"2024-05-09T05:54:06.913624+0000","last_undegraded":"2024-05-09T05:54:06.913624+0000","last_fullsized":"2024-05-09T05:54:06.913624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:26:03.973553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.641103+0000","last_change":"2024-05-09T05:53:24.138681+0000","last_active":"2024-05-09T05:54:06.641103+0000","last_peered":"2024-05-09T05:54:06.641103+0000","last_clean":"2024-05-09T05:54:06.641103+0000","last_became_active":"2024-05-09T05:53:24.138366+0000","last_became_peered":"2024-05-09T05:53:24.138366+0000","last_unstale":"2024-05-09T05:54:06.641103+0000","last_undegraded":"2024-05-09T05:54:06.641103+0000","last_fullsized":"2024-05-09T05:54:06.641103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:49.856205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.963645+0000","last_change":"2024-05-09T05:53:24.139915+0000","last_active":"2024-05-09T05:54:05.963645+0000","last_peered":"2024-05-09T05:54:05.963645+0000","last_clean":"2024-05-09T05:54:05.963645+0000","last_became_active":"2024-05-09T05:53:24.139058+0000","last_became_peered":"2024-05-09T05:53:24.139058+0000","last_unstale":"2024-05-09T05:54:05.963645+0000","last_undegraded":"2024-05-09T05:54:05.963645+0000","last_fullsized":"2024-05-09T05:54:05.963645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:06:00.768431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.960963+0000","last_change":"2024-05-09T05:53:24.149759+0000","last_active":"2024-05-09T05:54:05.960963+0000","last_peered":"2024-05-09T05:54:05.960963+0000","last_clean":"2024-05-09T05:54:05.960963+0000","last_became_active":"2024-05-09T05:53:24.142812+0000","last_became_peered":"2024-05-09T05:53:24.142812+0000","last_unstale":"2024-05-09T05:54:05.960963+0000","last_undegraded":"2024-05-09T05:54:05.960963+0000","last_fullsized":"2024-05-09T05:54:05.960963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:04.522514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.958194+0000","last_change":"2024-05-09T05:53:24.135373+0000","last_active":"2024-05-09T05:54:05.958194+0000","last_peered":"2024-05-09T05:54:05.958194+0000","last_clean":"2024-05-09T05:54:05.958194+0000","last_became_active":"2024-05-09T05:53:24.135043+0000","last_became_peered":"2024-05-09T05:53:24.135043+0000","last_unstale":"2024-05-09T05:54:05.958194+0000","last_undegraded":"2024-05-09T05:54:05.958194+0000","last_fullsized":"2024-05-09T05:54:05.958194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:20:03.245696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.956646+0000","last_change":"2024-05-09T05:53:24.134712+0000","last_active":"2024-05-09T05:54:05.956646+0000","last_peered":"2024-05-09T05:54:05.956646+0000","last_clean":"2024-05-09T05:54:05.956646+0000","last_became_active":"2024-05-09T05:53:24.132453+0000","last_became_peered":"2024-05-09T05:53:24.132453+0000","last_unstale":"2024-05-09T05:54:05.956646+0000","last_undegraded":"2024-05-09T05:54:05.956646+0000","last_fullsized":"2024-05-09T05:54:05.956646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:47:30.716995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.915325+0000","last_change":"2024-05-09T05:53:24.140714+0000","last_active":"2024-05-09T05:54:06.915325+0000","last_peered":"2024-05-09T05:54:06.915325+0000","last_clean":"2024-05-09T05:54:06.915325+0000","last_became_active":"2024-05-09T05:53:24.140045+0000","last_became_peered":"2024-05-09T05:53:24.140045+0000","last_unstale":"2024-05-09T05:54:06.915325+0000","last_undegraded":"2024-05-09T05:54:06.915325+0000","last_fullsized":"2024-05-09T05:54:06.915325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:36:06.166411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.962249+0000","last_change":"2024-05-09T05:53:24.151591+0000","last_active":"2024-05-09T05:54:05.962249+0000","last_peered":"2024-05-09T05:54:05.962249+0000","last_clean":"2024-05-09T05:54:05.962249+0000","last_became_active":"2024-05-09T05:53:24.151275+0000","last_became_peered":"2024-05-09T05:53:24.151275+0000","last_unstale":"2024-05-09T05:54:05.962249+0000","last_undegraded":"2024-05-09T05:54:05.962249+0000","last_fullsized":"2024-05-09T05:54:05.962249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:28:28.552732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.963146+0000","last_change":"2024-05-09T05:53:24.144315+0000","last_active":"2024-05-09T05:54:05.963146+0000","last_peered":"2024-05-09T05:54:05.963146+0000","last_clean":"2024-05-09T05:54:05.963146+0000","last_became_active":"2024-05-09T05:53:24.144005+0000","last_became_peered":"2024-05-09T05:53:24.144005+0000","last_unstale":"2024-05-09T05:54:05.963146+0000","last_undegraded":"2024-05-09T05:54:05.963146+0000","last_fullsized":"2024-05-09T05:54:05.963146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:06:37.312541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.959800+0000","last_change":"2024-05-09T05:53:24.149852+0000","last_active":"2024-05-09T05:54:05.959800+0000","last_peered":"2024-05-09T05:54:05.959800+0000","last_clean":"2024-05-09T05:54:05.959800+0000","last_became_active":"2024-05-09T05:53:24.146965+0000","last_became_peered":"2024-05-09T05:53:24.146965+0000","last_unstale":"2024-05-09T05:54:05.959800+0000","last_undegraded":"2024-05-09T05:54:05.959800+0000","last_fullsized":"2024-05-09T05:54:05.959800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:02:26.991425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.953846+0000","last_change":"2024-05-09T05:53:24.131735+0000","last_active":"2024-05-09T05:54:05.953846+0000","last_peered":"2024-05-09T05:54:05.953846+0000","last_clean":"2024-05-09T05:54:05.953846+0000","last_became_active":"2024-05-09T05:53:24.131417+0000","last_became_peered":"2024-05-09T05:53:24.131417+0000","last_unstale":"2024-05-09T05:54:05.953846+0000","last_undegraded":"2024-05-09T05:54:05.953846+0000","last_fullsized":"2024-05-09T05:54:05.953846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:59.750972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.954663+0000","last_change":"2024-05-09T05:53:24.140697+0000","last_active":"2024-05-09T05:54:05.954663+0000","last_peered":"2024-05-09T05:54:05.954663+0000","last_clean":"2024-05-09T05:54:05.954663+0000","last_became_active":"2024-05-09T05:53:24.140024+0000","last_became_peered":"2024-05-09T05:53:24.140024+0000","last_unstale":"2024-05-09T05:54:05.954663+0000","last_undegraded":"2024-05-09T05:54:05.954663+0000","last_fullsized":"2024-05-09T05:54:05.954663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:14:14.543827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.917187+0000","last_change":"2024-05-09T05:53:24.136878+0000","last_active":"2024-05-09T05:54:06.917187+0000","last_peered":"2024-05-09T05:54:06.917187+0000","last_clean":"2024-05-09T05:54:06.917187+0000","last_became_active":"2024-05-09T05:53:24.136572+0000","last_became_peered":"2024-05-09T05:53:24.136572+0000","last_unstale":"2024-05-09T05:54:06.917187+0000","last_undegraded":"2024-05-09T05:54:06.917187+0000","last_fullsized":"2024-05-09T05:54:06.917187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:46:47.509355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.964502+0000","last_change":"2024-05-09T05:53:24.147372+0000","last_active":"2024-05-09T05:54:05.964502+0000","last_peered":"2024-05-09T05:54:05.964502+0000","last_clean":"2024-05-09T05:54:05.964502+0000","last_became_active":"2024-05-09T05:53:24.144573+0000","last_became_peered":"2024-05-09T05:53:24.144573+0000","last_unstale":"2024-05-09T05:54:05.964502+0000","last_undegraded":"2024-05-09T05:54:05.964502+0000","last_fullsized":"2024-05-09T05:54:05.964502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:51:09.845748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.643061+0000","last_change":"2024-05-09T05:53:24.135964+0000","last_active":"2024-05-09T05:54:06.643061+0000","last_peered":"2024-05-09T05:54:06.643061+0000","last_clean":"2024-05-09T05:54:06.643061+0000","last_became_active":"2024-05-09T05:53:24.135625+0000","last_became_peered":"2024-05-09T05:53:24.135625+0000","last_unstale":"2024-05-09T05:54:06.643061+0000","last_undegraded":"2024-05-09T05:54:06.643061+0000","last_fullsized":"2024-05-09T05:54:06.643061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:52:02.026146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.964778+0000","last_change":"2024-05-09T05:53:24.133916+0000","last_active":"2024-05-09T05:54:05.964778+0000","last_peered":"2024-05-09T05:54:05.964778+0000","last_clean":"2024-05-09T05:54:05.964778+0000","last_became_active":"2024-05-09T05:53:24.133405+0000","last_became_peered":"2024-05-09T05:53:24.133405+0000","last_unstale":"2024-05-09T05:54:05.964778+0000","last_undegraded":"2024-05-09T05:54:05.964778+0000","last_fullsized":"2024-05-09T05:54:05.964778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:30:16.477715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.963077+0000","last_change":"2024-05-09T05:53:24.139697+0000","last_active":"2024-05-09T05:54:05.963077+0000","last_peered":"2024-05-09T05:54:05.963077+0000","last_clean":"2024-05-09T05:54:05.963077+0000","last_became_active":"2024-05-09T05:53:24.139374+0000","last_became_peered":"2024-05-09T05:53:24.139374+0000","last_unstale":"2024-05-09T05:54:05.963077+0000","last_undegraded":"2024-05-09T05:54:05.963077+0000","last_fullsized":"2024-05-09T05:54:05.963077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:26:28.502867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.959611+0000","last_change":"2024-05-09T05:53:24.147755+0000","last_active":"2024-05-09T05:54:05.959611+0000","last_peered":"2024-05-09T05:54:05.959611+0000","last_clean":"2024-05-09T05:54:05.959611+0000","last_became_active":"2024-05-09T05:53:24.145616+0000","last_became_peered":"2024-05-09T05:53:24.145616+0000","last_unstale":"2024-05-09T05:54:05.959611+0000","last_undegraded":"2024-05-09T05:54:05.959611+0000","last_fullsized":"2024-05-09T05:54:05.959611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:21:10.387393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.957455+0000","last_change":"2024-05-09T05:53:24.131741+0000","last_active":"2024-05-09T05:54:05.957455+0000","last_peered":"2024-05-09T05:54:05.957455+0000","last_clean":"2024-05-09T05:54:05.957455+0000","last_became_active":"2024-05-09T05:53:24.128870+0000","last_became_peered":"2024-05-09T05:53:24.128870+0000","last_unstale":"2024-05-09T05:54:05.957455+0000","last_undegraded":"2024-05-09T05:54:05.957455+0000","last_fullsized":"2024-05-09T05:54:05.957455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:28:25.103524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.956516+0000","last_change":"2024-05-09T05:53:24.133443+0000","last_active":"2024-05-09T05:54:05.956516+0000","last_peered":"2024-05-09T05:54:05.956516+0000","last_clean":"2024-05-09T05:54:05.956516+0000","last_became_active":"2024-05-09T05:53:24.132688+0000","last_became_peered":"2024-05-09T05:53:24.132688+0000","last_unstale":"2024-05-09T05:54:05.956516+0000","last_undegraded":"2024-05-09T05:54:05.956516+0000","last_fullsized":"2024-05-09T05:54:05.956516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:43:24.750805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.916963+0000","last_change":"2024-05-09T05:53:24.142600+0000","last_active":"2024-05-09T05:54:06.916963+0000","last_peered":"2024-05-09T05:54:06.916963+0000","last_clean":"2024-05-09T05:54:06.916963+0000","last_became_active":"2024-05-09T05:53:24.142280+0000","last_became_peered":"2024-05-09T05:53:24.142280+0000","last_unstale":"2024-05-09T05:54:06.916963+0000","last_undegraded":"2024-05-09T05:54:06.916963+0000","last_fullsized":"2024-05-09T05:54:06.916963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:20:58.962379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.916818+0000","last_change":"2024-05-09T05:53:24.144839+0000","last_active":"2024-05-09T05:54:06.916818+0000","last_peered":"2024-05-09T05:54:06.916818+0000","last_clean":"2024-05-09T05:54:06.916818+0000","last_became_active":"2024-05-09T05:53:24.144381+0000","last_became_peered":"2024-05-09T05:53:24.144381+0000","last_unstale":"2024-05-09T05:54:06.916818+0000","last_undegraded":"2024-05-09T05:54:06.916818+0000","last_fullsized":"2024-05-09T05:54:06.916818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:40:46.738053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.917366+0000","last_change":"2024-05-09T05:53:24.131521+0000","last_active":"2024-05-09T05:54:06.917366+0000","last_peered":"2024-05-09T05:54:06.917366+0000","last_clean":"2024-05-09T05:54:06.917366+0000","last_became_active":"2024-05-09T05:53:24.131218+0000","last_became_peered":"2024-05-09T05:53:24.131218+0000","last_unstale":"2024-05-09T05:54:06.917366+0000","last_undegraded":"2024-05-09T05:54:06.917366+0000","last_fullsized":"2024-05-09T05:54:06.917366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:25:59.410270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.955574+0000","last_change":"2024-05-09T05:53:24.139922+0000","last_active":"2024-05-09T05:54:05.955574+0000","last_peered":"2024-05-09T05:54:05.955574+0000","last_clean":"2024-05-09T05:54:05.955574+0000","last_became_active":"2024-05-09T05:53:24.139473+0000","last_became_peered":"2024-05-09T05:53:24.139473+0000","last_unstale":"2024-05-09T05:54:05.955574+0000","last_undegraded":"2024-05-09T05:54:05.955574+0000","last_fullsized":"2024-05-09T05:54:05.955574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:37:50.839899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.959357+0000","last_change":"2024-05-09T05:53:24.143338+0000","last_active":"2024-05-09T05:54:05.959357+0000","last_peered":"2024-05-09T05:54:05.959357+0000","last_clean":"2024-05-09T05:54:05.959357+0000","last_became_active":"2024-05-09T05:53:24.143053+0000","last_became_peered":"2024-05-09T05:53:24.143053+0000","last_unstale":"2024-05-09T05:54:05.959357+0000","last_undegraded":"2024-05-09T05:54:05.959357+0000","last_fullsized":"2024-05-09T05:54:05.959357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:22:16.337090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.915734+0000","last_change":"2024-05-09T05:53:24.145517+0000","last_active":"2024-05-09T05:54:06.915734+0000","last_peered":"2024-05-09T05:54:06.915734+0000","last_clean":"2024-05-09T05:54:06.915734+0000","last_became_active":"2024-05-09T05:53:24.145150+0000","last_became_peered":"2024-05-09T05:53:24.145150+0000","last_unstale":"2024-05-09T05:54:06.915734+0000","last_undegraded":"2024-05-09T05:54:06.915734+0000","last_fullsized":"2024-05-09T05:54:06.915734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:19:53.947349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.914063+0000","last_change":"2024-05-09T05:53:24.129669+0000","last_active":"2024-05-09T05:54:06.914063+0000","last_peered":"2024-05-09T05:54:06.914063+0000","last_clean":"2024-05-09T05:54:06.914063+0000","last_became_active":"2024-05-09T05:53:24.129339+0000","last_became_peered":"2024-05-09T05:53:24.129339+0000","last_unstale":"2024-05-09T05:54:06.914063+0000","last_undegraded":"2024-05-09T05:54:06.914063+0000","last_fullsized":"2024-05-09T05:54:06.914063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:05:51.845643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.916222+0000","last_change":"2024-05-09T05:53:24.138914+0000","last_active":"2024-05-09T05:54:06.916222+0000","last_peered":"2024-05-09T05:54:06.916222+0000","last_clean":"2024-05-09T05:54:06.916222+0000","last_became_active":"2024-05-09T05:53:24.138499+0000","last_became_peered":"2024-05-09T05:53:24.138499+0000","last_unstale":"2024-05-09T05:54:06.916222+0000","last_undegraded":"2024-05-09T05:54:06.916222+0000","last_fullsized":"2024-05-09T05:54:06.916222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:29:00.338046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.914572+0000","last_change":"2024-05-09T05:53:24.144296+0000","last_active":"2024-05-09T05:54:06.914572+0000","last_peered":"2024-05-09T05:54:06.914572+0000","last_clean":"2024-05-09T05:54:06.914572+0000","last_became_active":"2024-05-09T05:53:24.143890+0000","last_became_peered":"2024-05-09T05:53:24.143890+0000","last_unstale":"2024-05-09T05:54:06.914572+0000","last_undegraded":"2024-05-09T05:54:06.914572+0000","last_fullsized":"2024-05-09T05:54:06.914572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:34:56.860849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.962005+0000","last_change":"2024-05-09T05:53:24.152635+0000","last_active":"2024-05-09T05:54:05.962005+0000","last_peered":"2024-05-09T05:54:05.962005+0000","last_clean":"2024-05-09T05:54:05.962005+0000","last_became_active":"2024-05-09T05:53:24.151674+0000","last_became_peered":"2024-05-09T05:53:24.151674+0000","last_unstale":"2024-05-09T05:54:05.962005+0000","last_undegraded":"2024-05-09T05:54:05.962005+0000","last_fullsized":"2024-05-09T05:54:05.962005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:18:47.495857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.961971+0000","last_change":"2024-05-09T05:53:24.152746+0000","last_active":"2024-05-09T05:54:05.961971+0000","last_peered":"2024-05-09T05:54:05.961971+0000","last_clean":"2024-05-09T05:54:05.961971+0000","last_became_active":"2024-05-09T05:53:24.151418+0000","last_became_peered":"2024-05-09T05:53:24.151418+0000","last_unstale":"2024-05-09T05:54:05.961971+0000","last_undegraded":"2024-05-09T05:54:05.961971+0000","last_fullsized":"2024-05-09T05:54:05.961971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:27:19.121790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.917763+0000","last_change":"2024-05-09T05:53:24.140908+0000","last_active":"2024-05-09T05:54:06.917763+0000","last_peered":"2024-05-09T05:54:06.917763+0000","last_clean":"2024-05-09T05:54:06.917763+0000","last_became_active":"2024-05-09T05:53:24.140589+0000","last_became_peered":"2024-05-09T05:53:24.140589+0000","last_unstale":"2024-05-09T05:54:06.917763+0000","last_undegraded":"2024-05-09T05:54:06.917763+0000","last_fullsized":"2024-05-09T05:54:06.917763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:51:03.458547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":12028,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":215,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":23615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":189,"ondisk_log_size":189,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509456,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":319488,"data_stored":116491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509459,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31472,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340368,"statfs":{"total":96636764160,"available":96604536832,"internally_reserved":0,"allocated":303104,"data_stored":118699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509459,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31508,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340332,"statfs":{"total":96636764160,"available":96604499968,"internally_reserved":0,"allocated":339968,"data_stored":121558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509456,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":119788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509458,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":897024,"data_stored":707219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509458,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":118861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32056,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339784,"statfs":{"total":96636764160,"available":96603938816,"internally_reserved":0,"allocated":901120,"data_stored":707072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":327680,"data_stored":118159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":3424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":6121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T05:54:23.321 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T05:54:23.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.523+0000 7f38bc972640 1 Processor -- start 2024-05-09T05:54:23.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.523+0000 7f38bc972640 1 -- start start 2024-05-09T05:54:23.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.527+0000 7f38bc972640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f38b8152ed0 0x7f38b806fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:23.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.527+0000 7f38bc972640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38b815c5b0 con 0x7f38b8159770 2024-05-09T05:54:23.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.527+0000 7f38bc972640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38b8159b80 con 0x7f38b8070140 2024-05-09T05:54:23.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.527+0000 7f38bc972640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f38b8073270 con 0x7f38b8152ed0 2024-05-09T05:54:23.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.527+0000 7f38add9b640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f38b8152ed0 0x7f38b806fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:23.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.527+0000 7f38b659c640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f38b8159770 0x7f38b80723a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33276/0 (socket says 172.21.15.72:33276) 2024-05-09T05:54:23.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.527+0000 7f38b659c640 1 -- 172.21.15.72:0/1513032804 learned_addr learned my addr 172.21.15.72:0/1513032804 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:54:23.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.527+0000 7f38add9b640 1 -- 172.21.15.72:0/1513032804 >> v1:172.21.15.110:6789/0 conn(0x7f38b8070140 legacy=0x7f38b8163500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:23.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.527+0000 7f38add9b640 1 -- 172.21.15.72:0/1513032804 >> v1:172.21.15.72:6789/0 conn(0x7f38b8159770 legacy=0x7f38b80723a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:23.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.527+0000 7f38b5d9b640 1 -- 172.21.15.72:0/1513032804 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4199240636 0 0) 0x7f38b815c5b0 con 0x7f38b8159770 2024-05-09T05:54:23.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.527+0000 7f38add9b640 1 -- 172.21.15.72:0/1513032804 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38b8073530 con 0x7f38b8152ed0 2024-05-09T05:54:23.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.527+0000 7f38add9b640 1 --2- 172.21.15.72:0/1513032804 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38b8152ed0 0x7f38b806fc00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f38a00097c0 tx=0x7f38a001ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1237a654be33e7e9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:23.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.527+0000 7f38b5d9b640 1 -- 172.21.15.72:0/1513032804 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a00b5070 con 0x7f38b8152ed0 2024-05-09T05:54:23.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.527+0000 7f38b5d9b640 1 -- 172.21.15.72:0/1513032804 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38a00a8990 con 0x7f38b8152ed0 2024-05-09T05:54:23.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.527+0000 7f38b5d9b640 1 -- 172.21.15.72:0/1513032804 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a00a8d60 con 0x7f38b8152ed0 2024-05-09T05:54:23.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.531+0000 7f38bc972640 1 -- 172.21.15.72:0/1513032804 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38b8152ed0 msgr2=0x7f38b806fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:23.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.531+0000 7f38bc972640 1 --2- 172.21.15.72:0/1513032804 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38b8152ed0 0x7f38b806fc00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f38a00097c0 tx=0x7f38a001ec90 comp rx=0 tx=0).stop 2024-05-09T05:54:23.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.531+0000 7f38bc972640 1 -- 172.21.15.72:0/1513032804 shutdown_connections 2024-05-09T05:54:23.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.531+0000 7f38bc972640 1 --2- 172.21.15.72:0/1513032804 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38b8152ed0 0x7f38b806fc00 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:23.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.531+0000 7f38bc972640 1 -- 172.21.15.72:0/1513032804 >> 172.21.15.72:0/1513032804 conn(0x7f38b80cde90 msgr2=0x7f38b80ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:23.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.531+0000 7f38bc972640 1 -- 172.21.15.72:0/1513032804 shutdown_connections 2024-05-09T05:54:23.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.531+0000 7f38bc972640 1 -- 172.21.15.72:0/1513032804 wait complete. 2024-05-09T05:54:23.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.531+0000 7f38bc972640 1 Processor -- start 2024-05-09T05:54:23.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.531+0000 7f38bc972640 1 -- start start 2024-05-09T05:54:23.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.531+0000 7f38bc972640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38b8070140 0x7f38b814c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:23.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.531+0000 7f38bc972640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38b8152ed0 0x7f38b814dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:23.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.531+0000 7f38bc972640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f38b8159770 0x7f38b80cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:23.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.531+0000 7f38bc972640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f38b8158f70 con 0x7f38b8152ed0 2024-05-09T05:54:23.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.531+0000 7f38bc972640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f38b8073af0 con 0x7f38b8070140 2024-05-09T05:54:23.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.531+0000 7f38bc972640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f38b8159250 con 0x7f38b8159770 2024-05-09T05:54:23.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.531+0000 7f38add9b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38b8152ed0 0x7f38b814dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:23.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.531+0000 7f38add9b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38b8152ed0 0x7f38b814dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46326/0 (socket says 172.21.15.72:46326) 2024-05-09T05:54:23.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.531+0000 7f38add9b640 1 -- 172.21.15.72:0/99677641 learned_addr learned my addr 172.21.15.72:0/99677641 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:54:23.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.535+0000 7f38b659c640 1 --2- 172.21.15.72:0/99677641 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38b8070140 0x7f38b814c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:23.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.535+0000 7f38add9b640 1 -- 172.21.15.72:0/99677641 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f38b8159770 msgr2=0x7f38b80cc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:23.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.535+0000 7f38b6d9d640 1 --2- 172.21.15.72:0/99677641 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f38b8159770 0x7f38b80cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:23.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.535+0000 7f38add9b640 1 --2- 172.21.15.72:0/99677641 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f38b8159770 0x7f38b80cc8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:23.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.535+0000 7f38add9b640 1 -- 172.21.15.72:0/99677641 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38b8070140 msgr2=0x7f38b814c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:23.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.535+0000 7f38add9b640 1 --2- 172.21.15.72:0/99677641 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38b8070140 0x7f38b814c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:23.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.535+0000 7f38add9b640 1 -- 172.21.15.72:0/99677641 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38b814e1a0 con 0x7f38b8152ed0 2024-05-09T05:54:23.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.535+0000 7f38b659c640 1 --2- 172.21.15.72:0/99677641 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38b8070140 0x7f38b814c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:54:23.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.535+0000 7f38add9b640 1 --2- 172.21.15.72:0/99677641 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38b8152ed0 0x7f38b814dc60 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f38a001b8a0 tx=0x7f38a001ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:23.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.535+0000 7f38af7fe640 1 -- 172.21.15.72:0/99677641 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a00bf070 con 0x7f38b8152ed0 2024-05-09T05:54:23.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.535+0000 7f38af7fe640 1 -- 172.21.15.72:0/99677641 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38a00b0820 con 0x7f38b8152ed0 2024-05-09T05:54:23.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.535+0000 7f38af7fe640 1 -- 172.21.15.72:0/99677641 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a00b5040 con 0x7f38b8152ed0 2024-05-09T05:54:23.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.535+0000 7f38bc972640 1 -- 172.21.15.72:0/99677641 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38b814b740 con 0x7f38b8152ed0 2024-05-09T05:54:23.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.535+0000 7f38bc972640 1 -- 172.21.15.72:0/99677641 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38b814d460 con 0x7f38b8152ed0 2024-05-09T05:54:23.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.535+0000 7f38bc972640 1 -- 172.21.15.72:0/99677641 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38b806a520 con 0x7f38b8152ed0 2024-05-09T05:54:23.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.535+0000 7f38af7fe640 1 -- 172.21.15.72:0/99677641 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f38a00c2070 con 0x7f38b8152ed0 2024-05-09T05:54:23.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.535+0000 7f38af7fe640 1 --2- 172.21.15.72:0/99677641 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f389806f400 0x7f3898071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:23.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.535+0000 7f38af7fe640 1 -- 172.21.15.72:0/99677641 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f38a012be50 con 0x7f38b8152ed0 2024-05-09T05:54:23.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.535+0000 7f38b659c640 1 --2- 172.21.15.72:0/99677641 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f389806f400 0x7f3898071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:23.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.535+0000 7f38b659c640 1 --2- 172.21.15.72:0/99677641 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f389806f400 0x7f3898071910 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f38a8000f70 tx=0x7f38a8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:23.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.539+0000 7f38af7fe640 1 -- 172.21.15.72:0/99677641 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f38a00187f0 con 0x7f38b8152ed0 2024-05-09T05:54:23.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.699+0000 7f38bc972640 1 -- 172.21.15.72:0/99677641 --> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f38b814b4f0 con 0x7f389806f400 2024-05-09T05:54:23.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.727+0000 7f38af7fe640 1 -- 172.21.15.72:0/99677641 <== mgr.4102 v2:172.21.15.110:6832/1113420672 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332684 (secure 0 0 0) 0x7f38b814b4f0 con 0x7f389806f400 2024-05-09T05:54:23.718 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:54:23.720 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2024-05-09T05:54:23.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.727+0000 7f38bc972640 1 -- 172.21.15.72:0/99677641 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f389806f400 msgr2=0x7f3898071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:23.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.727+0000 7f38bc972640 1 --2- 172.21.15.72:0/99677641 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f389806f400 0x7f3898071910 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f38a8000f70 tx=0x7f38a8009040 comp rx=0 tx=0).stop 2024-05-09T05:54:23.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.727+0000 7f38bc972640 1 -- 172.21.15.72:0/99677641 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38b8152ed0 msgr2=0x7f38b814dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:23.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.727+0000 7f38bc972640 1 --2- 172.21.15.72:0/99677641 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38b8152ed0 0x7f38b814dc60 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f38a001b8a0 tx=0x7f38a001ba30 comp rx=0 tx=0).stop 2024-05-09T05:54:23.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.727+0000 7f38bc972640 1 -- 172.21.15.72:0/99677641 shutdown_connections 2024-05-09T05:54:23.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.727+0000 7f38bc972640 1 --2- 172.21.15.72:0/99677641 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f389806f400 0x7f3898071910 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:23.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.727+0000 7f38bc972640 1 --2- 172.21.15.72:0/99677641 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f38b8159770 0x7f38b80cc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:23.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.727+0000 7f38bc972640 1 --2- 172.21.15.72:0/99677641 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38b8152ed0 0x7f38b814dc60 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:23.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.727+0000 7f38bc972640 1 --2- 172.21.15.72:0/99677641 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38b8070140 0x7f38b814c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:23.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.727+0000 7f38bc972640 1 -- 172.21.15.72:0/99677641 >> 172.21.15.72:0/99677641 conn(0x7f38b80cde90 msgr2=0x7f38b80762b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:23.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.727+0000 7f38bc972640 1 -- 172.21.15.72:0/99677641 shutdown_connections 2024-05-09T05:54:23.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.727+0000 7f38bc972640 1 -- 172.21.15.72:0/99677641 wait complete. 2024-05-09T05:54:23.738 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2024-05-09T05:54:22.486196+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":602396,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":316,"num_write_kb":1701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":261,"ondisk_log_size":261,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236392,"kb_used_data":3624,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738328,"statfs":{"total":773094113280,"available":772852047872,"internally_reserved":0,"allocated":3710976,"data_stored":2127847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3170,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005666"},"pg_stats":[{"pgid":"2.1f","version":"27'13","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:10.963308+0000","last_change":"2024-05-09T05:53:23.121824+0000","last_active":"2024-05-09T05:54:10.963308+0000","last_peered":"2024-05-09T05:54:10.963308+0000","last_clean":"2024-05-09T05:54:10.963308+0000","last_became_active":"2024-05-09T05:53:23.121097+0000","last_became_peered":"2024-05-09T05:53:23.121097+0000","last_unstale":"2024-05-09T05:54:10.963308+0000","last_undegraded":"2024-05-09T05:54:10.963308+0000","last_fullsized":"2024-05-09T05:54:10.963308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:50:51.880238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.962614+0000","last_change":"2024-05-09T05:53:24.146985+0000","last_active":"2024-05-09T05:54:05.962614+0000","last_peered":"2024-05-09T05:54:05.962614+0000","last_clean":"2024-05-09T05:54:05.962614+0000","last_became_active":"2024-05-09T05:53:24.146540+0000","last_became_peered":"2024-05-09T05:53:24.146540+0000","last_unstale":"2024-05-09T05:54:05.962614+0000","last_undegraded":"2024-05-09T05:54:05.962614+0000","last_fullsized":"2024-05-09T05:54:05.962614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:02:29.318131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.640920+0000","last_change":"2024-05-09T05:53:28.236386+0000","last_active":"2024-05-09T05:54:06.640920+0000","last_peered":"2024-05-09T05:54:06.640920+0000","last_clean":"2024-05-09T05:54:06.640920+0000","last_became_active":"2024-05-09T05:53:28.235305+0000","last_became_peered":"2024-05-09T05:53:28.235305+0000","last_unstale":"2024-05-09T05:54:06.640920+0000","last_undegraded":"2024-05-09T05:54:06.640920+0000","last_fullsized":"2024-05-09T05:54:06.640920+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:57:57.134819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"25'2","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.962769+0000","last_change":"2024-05-09T05:53:23.139000+0000","last_active":"2024-05-09T05:54:05.962769+0000","last_peered":"2024-05-09T05:54:05.962769+0000","last_clean":"2024-05-09T05:54:05.962769+0000","last_became_active":"2024-05-09T05:53:23.138431+0000","last_became_peered":"2024-05-09T05:53:23.138431+0000","last_unstale":"2024-05-09T05:54:05.962769+0000","last_undegraded":"2024-05-09T05:54:05.962769+0000","last_fullsized":"2024-05-09T05:54:05.962769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:33:56.977263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.962858+0000","last_change":"2024-05-09T05:53:24.151811+0000","last_active":"2024-05-09T05:54:05.962858+0000","last_peered":"2024-05-09T05:54:05.962858+0000","last_clean":"2024-05-09T05:54:05.962858+0000","last_became_active":"2024-05-09T05:53:24.151407+0000","last_became_peered":"2024-05-09T05:53:24.151407+0000","last_unstale":"2024-05-09T05:54:05.962858+0000","last_undegraded":"2024-05-09T05:54:05.962858+0000","last_fullsized":"2024-05-09T05:54:05.962858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:54:17.819787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.913373+0000","last_change":"2024-05-09T05:53:28.213485+0000","last_active":"2024-05-09T05:54:06.913373+0000","last_peered":"2024-05-09T05:54:06.913373+0000","last_clean":"2024-05-09T05:54:06.913373+0000","last_became_active":"2024-05-09T05:53:28.213021+0000","last_became_peered":"2024-05-09T05:53:28.213021+0000","last_unstale":"2024-05-09T05:54:06.913373+0000","last_undegraded":"2024-05-09T05:54:06.913373+0000","last_fullsized":"2024-05-09T05:54:06.913373+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:58:22.493166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"27'12","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:10.967793+0000","last_change":"2024-05-09T05:53:23.095209+0000","last_active":"2024-05-09T05:54:10.967793+0000","last_peered":"2024-05-09T05:54:10.967793+0000","last_clean":"2024-05-09T05:54:10.967793+0000","last_became_active":"2024-05-09T05:53:23.094826+0000","last_became_peered":"2024-05-09T05:53:23.094826+0000","last_unstale":"2024-05-09T05:54:10.967793+0000","last_undegraded":"2024-05-09T05:54:10.967793+0000","last_fullsized":"2024-05-09T05:54:10.967793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:38:47.390311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.954377+0000","last_change":"2024-05-09T05:53:24.135281+0000","last_active":"2024-05-09T05:54:05.954377+0000","last_peered":"2024-05-09T05:54:05.954377+0000","last_clean":"2024-05-09T05:54:05.954377+0000","last_became_active":"2024-05-09T05:53:24.134610+0000","last_became_peered":"2024-05-09T05:53:24.134610+0000","last_unstale":"2024-05-09T05:54:05.954377+0000","last_undegraded":"2024-05-09T05:54:05.954377+0000","last_fullsized":"2024-05-09T05:54:05.954377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:28:03.947961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.913678+0000","last_change":"2024-05-09T05:53:28.205763+0000","last_active":"2024-05-09T05:54:06.913678+0000","last_peered":"2024-05-09T05:54:06.913678+0000","last_clean":"2024-05-09T05:54:06.913678+0000","last_became_active":"2024-05-09T05:53:28.205229+0000","last_became_peered":"2024-05-09T05:53:28.205229+0000","last_unstale":"2024-05-09T05:54:06.913678+0000","last_undegraded":"2024-05-09T05:54:06.913678+0000","last_fullsized":"2024-05-09T05:54:06.913678+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:38:51.267769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"27'5","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:10.966670+0000","last_change":"2024-05-09T05:53:23.097616+0000","last_active":"2024-05-09T05:54:10.966670+0000","last_peered":"2024-05-09T05:54:10.966670+0000","last_clean":"2024-05-09T05:54:10.966670+0000","last_became_active":"2024-05-09T05:53:23.094760+0000","last_became_peered":"2024-05-09T05:53:23.094760+0000","last_unstale":"2024-05-09T05:54:10.966670+0000","last_undegraded":"2024-05-09T05:54:10.966670+0000","last_fullsized":"2024-05-09T05:54:10.966670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:21:32.558852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.964196+0000","last_change":"2024-05-09T05:53:24.139467+0000","last_active":"2024-05-09T05:54:05.964196+0000","last_peered":"2024-05-09T05:54:05.964196+0000","last_clean":"2024-05-09T05:54:05.964196+0000","last_became_active":"2024-05-09T05:53:24.139109+0000","last_became_peered":"2024-05-09T05:53:24.139109+0000","last_unstale":"2024-05-09T05:54:05.964196+0000","last_undegraded":"2024-05-09T05:54:05.964196+0000","last_fullsized":"2024-05-09T05:54:05.964196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:36.783615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.913569+0000","last_change":"2024-05-09T05:53:28.216127+0000","last_active":"2024-05-09T05:54:06.913569+0000","last_peered":"2024-05-09T05:54:06.913569+0000","last_clean":"2024-05-09T05:54:06.913569+0000","last_became_active":"2024-05-09T05:53:28.215482+0000","last_became_peered":"2024-05-09T05:53:28.215482+0000","last_unstale":"2024-05-09T05:54:06.913569+0000","last_undegraded":"2024-05-09T05:54:06.913569+0000","last_fullsized":"2024-05-09T05:54:06.913569+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:48:58.387701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.963569+0000","last_change":"2024-05-09T05:53:24.132483+0000","last_active":"2024-05-09T05:54:05.963569+0000","last_peered":"2024-05-09T05:54:05.963569+0000","last_clean":"2024-05-09T05:54:05.963569+0000","last_became_active":"2024-05-09T05:53:24.132118+0000","last_became_peered":"2024-05-09T05:53:24.132118+0000","last_unstale":"2024-05-09T05:54:05.963569+0000","last_undegraded":"2024-05-09T05:54:05.963569+0000","last_fullsized":"2024-05-09T05:54:05.963569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:06:01.787707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"25'4","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.963718+0000","last_change":"2024-05-09T05:53:23.117460+0000","last_active":"2024-05-09T05:54:05.963718+0000","last_peered":"2024-05-09T05:54:05.963718+0000","last_clean":"2024-05-09T05:54:05.963718+0000","last_became_active":"2024-05-09T05:53:23.114179+0000","last_became_peered":"2024-05-09T05:53:23.114179+0000","last_unstale":"2024-05-09T05:54:05.963718+0000","last_undegraded":"2024-05-09T05:54:05.963718+0000","last_fullsized":"2024-05-09T05:54:05.963718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:44:01.784905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.963442+0000","last_change":"2024-05-09T05:53:28.227135+0000","last_active":"2024-05-09T05:54:05.963442+0000","last_peered":"2024-05-09T05:54:05.963442+0000","last_clean":"2024-05-09T05:54:05.963442+0000","last_became_active":"2024-05-09T05:53:28.226427+0000","last_became_peered":"2024-05-09T05:53:28.226427+0000","last_unstale":"2024-05-09T05:54:05.963442+0000","last_undegraded":"2024-05-09T05:54:05.963442+0000","last_fullsized":"2024-05-09T05:54:05.963442+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:37:04.413804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.642097+0000","last_change":"2024-05-09T05:53:24.135982+0000","last_active":"2024-05-09T05:54:06.642097+0000","last_peered":"2024-05-09T05:54:06.642097+0000","last_clean":"2024-05-09T05:54:06.642097+0000","last_became_active":"2024-05-09T05:53:24.135580+0000","last_became_peered":"2024-05-09T05:53:24.135580+0000","last_unstale":"2024-05-09T05:54:06.642097+0000","last_undegraded":"2024-05-09T05:54:06.642097+0000","last_fullsized":"2024-05-09T05:54:06.642097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:03:04.589608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"27'3","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.957635+0000","last_change":"2024-05-09T05:53:23.142679+0000","last_active":"2024-05-09T05:54:05.957635+0000","last_peered":"2024-05-09T05:54:05.957635+0000","last_clean":"2024-05-09T05:54:05.957635+0000","last_became_active":"2024-05-09T05:53:23.142018+0000","last_became_peered":"2024-05-09T05:53:23.142018+0000","last_unstale":"2024-05-09T05:54:05.957635+0000","last_undegraded":"2024-05-09T05:54:05.957635+0000","last_fullsized":"2024-05-09T05:54:05.957635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:08:29.312049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.918021+0000","last_change":"2024-05-09T05:53:28.214167+0000","last_active":"2024-05-09T05:54:06.918021+0000","last_peered":"2024-05-09T05:54:06.918021+0000","last_clean":"2024-05-09T05:54:06.918021+0000","last_became_active":"2024-05-09T05:53:28.213623+0000","last_became_peered":"2024-05-09T05:53:28.213623+0000","last_unstale":"2024-05-09T05:54:06.918021+0000","last_undegraded":"2024-05-09T05:54:06.918021+0000","last_fullsized":"2024-05-09T05:54:06.918021+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:53:53.976485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.955036+0000","last_change":"2024-05-09T05:53:24.130342+0000","last_active":"2024-05-09T05:54:05.955036+0000","last_peered":"2024-05-09T05:54:05.955036+0000","last_clean":"2024-05-09T05:54:05.955036+0000","last_became_active":"2024-05-09T05:53:24.129938+0000","last_became_peered":"2024-05-09T05:53:24.129938+0000","last_unstale":"2024-05-09T05:54:05.955036+0000","last_undegraded":"2024-05-09T05:54:05.955036+0000","last_fullsized":"2024-05-09T05:54:05.955036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:58:13.879633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"27'7","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:10.962692+0000","last_change":"2024-05-09T05:53:23.111169+0000","last_active":"2024-05-09T05:54:10.962692+0000","last_peered":"2024-05-09T05:54:10.962692+0000","last_clean":"2024-05-09T05:54:10.962692+0000","last_became_active":"2024-05-09T05:53:23.110140+0000","last_became_peered":"2024-05-09T05:53:23.110140+0000","last_unstale":"2024-05-09T05:54:10.962692+0000","last_undegraded":"2024-05-09T05:54:10.962692+0000","last_fullsized":"2024-05-09T05:54:10.962692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:18:55.367553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.642541+0000","last_change":"2024-05-09T05:53:28.233648+0000","last_active":"2024-05-09T05:54:06.642541+0000","last_peered":"2024-05-09T05:54:06.642541+0000","last_clean":"2024-05-09T05:54:06.642541+0000","last_became_active":"2024-05-09T05:53:28.227087+0000","last_became_peered":"2024-05-09T05:53:28.227087+0000","last_unstale":"2024-05-09T05:54:06.642541+0000","last_undegraded":"2024-05-09T05:54:06.642541+0000","last_fullsized":"2024-05-09T05:54:06.642541+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:03:49.709580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.963334+0000","last_change":"2024-05-09T05:53:24.147343+0000","last_active":"2024-05-09T05:54:05.963334+0000","last_peered":"2024-05-09T05:54:05.963334+0000","last_clean":"2024-05-09T05:54:05.963334+0000","last_became_active":"2024-05-09T05:53:24.144596+0000","last_became_peered":"2024-05-09T05:53:24.144596+0000","last_unstale":"2024-05-09T05:54:05.963334+0000","last_undegraded":"2024-05-09T05:54:05.963334+0000","last_fullsized":"2024-05-09T05:54:05.963334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:52:43.052055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"25'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.914631+0000","last_change":"2024-05-09T05:53:23.102976+0000","last_active":"2024-05-09T05:54:06.914631+0000","last_peered":"2024-05-09T05:54:06.914631+0000","last_clean":"2024-05-09T05:54:06.914631+0000","last_became_active":"2024-05-09T05:53:23.102420+0000","last_became_peered":"2024-05-09T05:53:23.102420+0000","last_unstale":"2024-05-09T05:54:06.914631+0000","last_undegraded":"2024-05-09T05:54:06.914631+0000","last_fullsized":"2024-05-09T05:54:06.914631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:45:11.479140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.915193+0000","last_change":"2024-05-09T05:53:28.195537+0000","last_active":"2024-05-09T05:54:06.915193+0000","last_peered":"2024-05-09T05:54:06.915193+0000","last_clean":"2024-05-09T05:54:06.915193+0000","last_became_active":"2024-05-09T05:53:28.194915+0000","last_became_peered":"2024-05-09T05:53:28.194915+0000","last_unstale":"2024-05-09T05:54:06.915193+0000","last_undegraded":"2024-05-09T05:54:06.915193+0000","last_fullsized":"2024-05-09T05:54:06.915193+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:07.554137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.954896+0000","last_change":"2024-05-09T05:53:24.130312+0000","last_active":"2024-05-09T05:54:05.954896+0000","last_peered":"2024-05-09T05:54:05.954896+0000","last_clean":"2024-05-09T05:54:05.954896+0000","last_became_active":"2024-05-09T05:53:24.129953+0000","last_became_peered":"2024-05-09T05:53:24.129953+0000","last_unstale":"2024-05-09T05:54:05.954896+0000","last_undegraded":"2024-05-09T05:54:05.954896+0000","last_fullsized":"2024-05-09T05:54:05.954896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:07:09.368521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"27'7","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:10.966957+0000","last_change":"2024-05-09T05:53:23.127219+0000","last_active":"2024-05-09T05:54:10.966957+0000","last_peered":"2024-05-09T05:54:10.966957+0000","last_clean":"2024-05-09T05:54:10.966957+0000","last_became_active":"2024-05-09T05:53:23.126691+0000","last_became_peered":"2024-05-09T05:53:23.126691+0000","last_unstale":"2024-05-09T05:54:10.966957+0000","last_undegraded":"2024-05-09T05:54:10.966957+0000","last_fullsized":"2024-05-09T05:54:10.966957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:17:26.711941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.915158+0000","last_change":"2024-05-09T05:53:28.191045+0000","last_active":"2024-05-09T05:54:06.915158+0000","last_peered":"2024-05-09T05:54:06.915158+0000","last_clean":"2024-05-09T05:54:06.915158+0000","last_became_active":"2024-05-09T05:53:28.190564+0000","last_became_peered":"2024-05-09T05:53:28.190564+0000","last_unstale":"2024-05-09T05:54:06.915158+0000","last_undegraded":"2024-05-09T05:54:06.915158+0000","last_fullsized":"2024-05-09T05:54:06.915158+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:53:30.541681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.958140+0000","last_change":"2024-05-09T05:53:24.138682+0000","last_active":"2024-05-09T05:54:05.958140+0000","last_peered":"2024-05-09T05:54:05.958140+0000","last_clean":"2024-05-09T05:54:05.958140+0000","last_became_active":"2024-05-09T05:53:24.138417+0000","last_became_peered":"2024-05-09T05:53:24.138417+0000","last_unstale":"2024-05-09T05:54:05.958140+0000","last_undegraded":"2024-05-09T05:54:05.958140+0000","last_fullsized":"2024-05-09T05:54:05.958140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:57:55.403156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"26'7","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.955516+0000","last_change":"2024-05-09T05:53:23.102986+0000","last_active":"2024-05-09T05:54:05.955516+0000","last_peered":"2024-05-09T05:54:05.955516+0000","last_clean":"2024-05-09T05:54:05.955516+0000","last_became_active":"2024-05-09T05:53:23.102020+0000","last_became_peered":"2024-05-09T05:53:23.102020+0000","last_unstale":"2024-05-09T05:54:05.955516+0000","last_undegraded":"2024-05-09T05:54:05.955516+0000","last_fullsized":"2024-05-09T05:54:05.955516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:18:11.582575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.954659+0000","last_change":"2024-05-09T05:53:28.218326+0000","last_active":"2024-05-09T05:54:05.954659+0000","last_peered":"2024-05-09T05:54:05.954659+0000","last_clean":"2024-05-09T05:54:05.954659+0000","last_became_active":"2024-05-09T05:53:28.216634+0000","last_became_peered":"2024-05-09T05:53:28.216634+0000","last_unstale":"2024-05-09T05:54:05.954659+0000","last_undegraded":"2024-05-09T05:54:05.954659+0000","last_fullsized":"2024-05-09T05:54:05.954659+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:13:05.321932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.958917+0000","last_change":"2024-05-09T05:53:24.143161+0000","last_active":"2024-05-09T05:54:05.958917+0000","last_peered":"2024-05-09T05:54:05.958917+0000","last_clean":"2024-05-09T05:54:05.958917+0000","last_became_active":"2024-05-09T05:53:24.139369+0000","last_became_peered":"2024-05-09T05:53:24.139369+0000","last_unstale":"2024-05-09T05:54:05.958917+0000","last_undegraded":"2024-05-09T05:54:05.958917+0000","last_fullsized":"2024-05-09T05:54:05.958917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:25:21.472460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"27'4","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.964751+0000","last_change":"2024-05-09T05:53:23.123560+0000","last_active":"2024-05-09T05:54:05.964751+0000","last_peered":"2024-05-09T05:54:05.964751+0000","last_clean":"2024-05-09T05:54:05.964751+0000","last_became_active":"2024-05-09T05:53:23.123081+0000","last_became_peered":"2024-05-09T05:53:23.123081+0000","last_unstale":"2024-05-09T05:54:05.964751+0000","last_undegraded":"2024-05-09T05:54:05.964751+0000","last_fullsized":"2024-05-09T05:54:05.964751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:15:31.371756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.956026+0000","last_change":"2024-05-09T05:53:28.229352+0000","last_active":"2024-05-09T05:54:05.956026+0000","last_peered":"2024-05-09T05:54:05.956026+0000","last_clean":"2024-05-09T05:54:05.956026+0000","last_became_active":"2024-05-09T05:53:28.225810+0000","last_became_peered":"2024-05-09T05:53:28.225810+0000","last_unstale":"2024-05-09T05:54:05.956026+0000","last_undegraded":"2024-05-09T05:54:05.956026+0000","last_fullsized":"2024-05-09T05:54:05.956026+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:17:07.192105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.914920+0000","last_change":"2024-05-09T05:53:24.130533+0000","last_active":"2024-05-09T05:54:06.914920+0000","last_peered":"2024-05-09T05:54:06.914920+0000","last_clean":"2024-05-09T05:54:06.914920+0000","last_became_active":"2024-05-09T05:53:24.129787+0000","last_became_peered":"2024-05-09T05:53:24.129787+0000","last_unstale":"2024-05-09T05:54:06.914920+0000","last_undegraded":"2024-05-09T05:54:06.914920+0000","last_fullsized":"2024-05-09T05:54:06.914920+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:37:36.036271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"26'1","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.961428+0000","last_change":"2024-05-09T05:53:23.134379+0000","last_active":"2024-05-09T05:54:05.961428+0000","last_peered":"2024-05-09T05:54:05.961428+0000","last_clean":"2024-05-09T05:54:05.961428+0000","last_became_active":"2024-05-09T05:53:23.133587+0000","last_became_peered":"2024-05-09T05:53:23.133587+0000","last_unstale":"2024-05-09T05:54:05.961428+0000","last_undegraded":"2024-05-09T05:54:05.961428+0000","last_fullsized":"2024-05-09T05:54:05.961428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:00:33.973787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.956964+0000","last_change":"2024-05-09T05:53:28.233620+0000","last_active":"2024-05-09T05:54:05.956964+0000","last_peered":"2024-05-09T05:54:05.956964+0000","last_clean":"2024-05-09T05:54:05.956964+0000","last_became_active":"2024-05-09T05:53:28.232539+0000","last_became_peered":"2024-05-09T05:53:28.232539+0000","last_unstale":"2024-05-09T05:54:05.956964+0000","last_undegraded":"2024-05-09T05:54:05.956964+0000","last_fullsized":"2024-05-09T05:54:05.956964+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:13.789448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.918199+0000","last_change":"2024-05-09T05:53:24.132702+0000","last_active":"2024-05-09T05:54:06.918199+0000","last_peered":"2024-05-09T05:54:06.918199+0000","last_clean":"2024-05-09T05:54:06.918199+0000","last_became_active":"2024-05-09T05:53:24.132309+0000","last_became_peered":"2024-05-09T05:53:24.132309+0000","last_unstale":"2024-05-09T05:54:06.918199+0000","last_undegraded":"2024-05-09T05:54:06.918199+0000","last_fullsized":"2024-05-09T05:54:06.918199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:53:13.592038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"27'5","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:10.963975+0000","last_change":"2024-05-09T05:53:23.120384+0000","last_active":"2024-05-09T05:54:10.963975+0000","last_peered":"2024-05-09T05:54:10.963975+0000","last_clean":"2024-05-09T05:54:10.963975+0000","last_became_active":"2024-05-09T05:53:23.118321+0000","last_became_peered":"2024-05-09T05:53:23.118321+0000","last_unstale":"2024-05-09T05:54:10.963975+0000","last_undegraded":"2024-05-09T05:54:10.963975+0000","last_fullsized":"2024-05-09T05:54:10.963975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:15:51.297111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.956427+0000","last_change":"2024-05-09T05:53:28.208383+0000","last_active":"2024-05-09T05:54:05.956427+0000","last_peered":"2024-05-09T05:54:05.956427+0000","last_clean":"2024-05-09T05:54:05.956427+0000","last_became_active":"2024-05-09T05:53:28.199359+0000","last_became_peered":"2024-05-09T05:53:28.199359+0000","last_unstale":"2024-05-09T05:54:05.956427+0000","last_undegraded":"2024-05-09T05:54:05.956427+0000","last_fullsized":"2024-05-09T05:54:05.956427+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:50:19.715242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.959736+0000","last_change":"2024-05-09T05:53:24.142740+0000","last_active":"2024-05-09T05:54:05.959736+0000","last_peered":"2024-05-09T05:54:05.959736+0000","last_clean":"2024-05-09T05:54:05.959736+0000","last_became_active":"2024-05-09T05:53:24.142265+0000","last_became_peered":"2024-05-09T05:53:24.142265+0000","last_unstale":"2024-05-09T05:54:05.959736+0000","last_undegraded":"2024-05-09T05:54:05.959736+0000","last_fullsized":"2024-05-09T05:54:05.959736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:46:53.729151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"27'6","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:10.959088+0000","last_change":"2024-05-09T05:53:23.142455+0000","last_active":"2024-05-09T05:54:10.959088+0000","last_peered":"2024-05-09T05:54:10.959088+0000","last_clean":"2024-05-09T05:54:10.959088+0000","last_became_active":"2024-05-09T05:53:23.141770+0000","last_became_peered":"2024-05-09T05:53:23.141770+0000","last_unstale":"2024-05-09T05:54:10.959088+0000","last_undegraded":"2024-05-09T05:54:10.959088+0000","last_fullsized":"2024-05-09T05:54:10.959088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:30:34.301349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.956600+0000","last_change":"2024-05-09T05:53:28.212176+0000","last_active":"2024-05-09T05:54:05.956600+0000","last_peered":"2024-05-09T05:54:05.956600+0000","last_clean":"2024-05-09T05:54:05.956600+0000","last_became_active":"2024-05-09T05:53:28.210981+0000","last_became_peered":"2024-05-09T05:53:28.210981+0000","last_unstale":"2024-05-09T05:54:05.956600+0000","last_undegraded":"2024-05-09T05:54:05.956600+0000","last_fullsized":"2024-05-09T05:54:05.956600+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:17:24.122805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.955894+0000","last_change":"2024-05-09T05:53:24.132887+0000","last_active":"2024-05-09T05:54:05.955894+0000","last_peered":"2024-05-09T05:54:05.955894+0000","last_clean":"2024-05-09T05:54:05.955894+0000","last_became_active":"2024-05-09T05:53:24.132398+0000","last_became_peered":"2024-05-09T05:53:24.132398+0000","last_unstale":"2024-05-09T05:54:05.955894+0000","last_undegraded":"2024-05-09T05:54:05.955894+0000","last_fullsized":"2024-05-09T05:54:05.955894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:36:49.369162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"27'4","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.963466+0000","last_change":"2024-05-09T05:53:23.126202+0000","last_active":"2024-05-09T05:54:05.963466+0000","last_peered":"2024-05-09T05:54:05.963466+0000","last_clean":"2024-05-09T05:54:05.963466+0000","last_became_active":"2024-05-09T05:53:23.125799+0000","last_became_peered":"2024-05-09T05:53:23.125799+0000","last_unstale":"2024-05-09T05:54:05.963466+0000","last_undegraded":"2024-05-09T05:54:05.963466+0000","last_fullsized":"2024-05-09T05:54:05.963466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:33:12.831705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.916943+0000","last_change":"2024-05-09T05:54:06.916943+0000","last_active":"2024-05-09T05:54:06.916943+0000","last_peered":"2024-05-09T05:54:06.916943+0000","last_clean":"2024-05-09T05:54:06.916943+0000","last_became_active":"2024-05-09T05:54:06.915734+0000","last_became_peered":"2024-05-09T05:54:06.915734+0000","last_unstale":"2024-05-09T05:54:06.916943+0000","last_undegraded":"2024-05-09T05:54:06.916943+0000","last_fullsized":"2024-05-09T05:54:06.916943+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:59:44.265794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,6,1],"acting":[5,0,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.954791+0000","last_change":"2024-05-09T05:53:24.139586+0000","last_active":"2024-05-09T05:54:05.954791+0000","last_peered":"2024-05-09T05:54:05.954791+0000","last_clean":"2024-05-09T05:54:05.954791+0000","last_became_active":"2024-05-09T05:53:24.138835+0000","last_became_peered":"2024-05-09T05:53:24.138835+0000","last_unstale":"2024-05-09T05:54:05.954791+0000","last_undegraded":"2024-05-09T05:54:05.954791+0000","last_fullsized":"2024-05-09T05:54:05.954791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:37:13.012588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"27'6","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.963964+0000","last_change":"2024-05-09T05:53:23.117121+0000","last_active":"2024-05-09T05:54:05.963964+0000","last_peered":"2024-05-09T05:54:05.963964+0000","last_clean":"2024-05-09T05:54:05.963964+0000","last_became_active":"2024-05-09T05:53:23.113294+0000","last_became_peered":"2024-05-09T05:53:23.113294+0000","last_unstale":"2024-05-09T05:54:05.963964+0000","last_undegraded":"2024-05-09T05:54:05.963964+0000","last_fullsized":"2024-05-09T05:54:05.963964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:53:41.591371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":121,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.953773+0000","last_change":"2024-05-09T05:53:12.484358+0000","last_active":"2024-05-09T05:54:05.953773+0000","last_peered":"2024-05-09T05:54:05.953773+0000","last_clean":"2024-05-09T05:54:05.953773+0000","last_became_active":"2024-05-09T05:53:12.481529+0000","last_became_peered":"2024-05-09T05:53:12.481529+0000","last_unstale":"2024-05-09T05:54:05.953773+0000","last_undegraded":"2024-05-09T05:54:05.953773+0000","last_fullsized":"2024-05-09T05:54:05.953773+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:10.902489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:10.902489+0000","last_clean_scrub_stamp":"2024-05-09T05:53:10.902489+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:28:50.650299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.964356+0000","last_change":"2024-05-09T05:53:28.190861+0000","last_active":"2024-05-09T05:54:05.964356+0000","last_peered":"2024-05-09T05:54:05.964356+0000","last_clean":"2024-05-09T05:54:05.964356+0000","last_became_active":"2024-05-09T05:53:28.190393+0000","last_became_peered":"2024-05-09T05:53:28.190393+0000","last_unstale":"2024-05-09T05:54:05.964356+0000","last_undegraded":"2024-05-09T05:54:05.964356+0000","last_fullsized":"2024-05-09T05:54:05.964356+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:05:37.653010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.964283+0000","last_change":"2024-05-09T05:53:24.143283+0000","last_active":"2024-05-09T05:54:05.964283+0000","last_peered":"2024-05-09T05:54:05.964283+0000","last_clean":"2024-05-09T05:54:05.964283+0000","last_became_active":"2024-05-09T05:53:24.139813+0000","last_became_peered":"2024-05-09T05:53:24.139813+0000","last_unstale":"2024-05-09T05:54:05.964283+0000","last_undegraded":"2024-05-09T05:54:05.964283+0000","last_fullsized":"2024-05-09T05:54:05.964283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:07:38.471778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"27'6","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.958661+0000","last_change":"2024-05-09T05:53:23.115534+0000","last_active":"2024-05-09T05:54:05.958661+0000","last_peered":"2024-05-09T05:54:05.958661+0000","last_clean":"2024-05-09T05:54:05.958661+0000","last_became_active":"2024-05-09T05:53:23.112260+0000","last_became_peered":"2024-05-09T05:53:23.112260+0000","last_unstale":"2024-05-09T05:54:05.958661+0000","last_undegraded":"2024-05-09T05:54:05.958661+0000","last_fullsized":"2024-05-09T05:54:05.958661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:46:53.520691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1611,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.913778+0000","last_change":"2024-05-09T05:53:28.195687+0000","last_active":"2024-05-09T05:54:06.913778+0000","last_peered":"2024-05-09T05:54:06.913778+0000","last_clean":"2024-05-09T05:54:06.913778+0000","last_became_active":"2024-05-09T05:53:28.195082+0000","last_became_peered":"2024-05-09T05:53:28.195082+0000","last_unstale":"2024-05-09T05:54:06.913778+0000","last_undegraded":"2024-05-09T05:54:06.913778+0000","last_fullsized":"2024-05-09T05:54:06.913778+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:45:56.633547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.917432+0000","last_change":"2024-05-09T05:53:24.130460+0000","last_active":"2024-05-09T05:54:06.917432+0000","last_peered":"2024-05-09T05:54:06.917432+0000","last_clean":"2024-05-09T05:54:06.917432+0000","last_became_active":"2024-05-09T05:53:24.129808+0000","last_became_peered":"2024-05-09T05:53:24.129808+0000","last_unstale":"2024-05-09T05:54:06.917432+0000","last_undegraded":"2024-05-09T05:54:06.917432+0000","last_fullsized":"2024-05-09T05:54:06.917432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:36:04.881676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"27'3","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.962373+0000","last_change":"2024-05-09T05:53:23.139063+0000","last_active":"2024-05-09T05:54:05.962373+0000","last_peered":"2024-05-09T05:54:05.962373+0000","last_clean":"2024-05-09T05:54:05.962373+0000","last_became_active":"2024-05-09T05:53:23.138303+0000","last_became_peered":"2024-05-09T05:53:23.138303+0000","last_unstale":"2024-05-09T05:54:05.962373+0000","last_undegraded":"2024-05-09T05:54:05.962373+0000","last_fullsized":"2024-05-09T05:54:05.962373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:18:20.172877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.960806+0000","last_change":"2024-05-09T05:53:28.214251+0000","last_active":"2024-05-09T05:54:05.960806+0000","last_peered":"2024-05-09T05:54:05.960806+0000","last_clean":"2024-05-09T05:54:05.960806+0000","last_became_active":"2024-05-09T05:53:28.206229+0000","last_became_peered":"2024-05-09T05:53:28.206229+0000","last_unstale":"2024-05-09T05:54:05.960806+0000","last_undegraded":"2024-05-09T05:54:05.960806+0000","last_fullsized":"2024-05-09T05:54:05.960806+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:12:26.761543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.917899+0000","last_change":"2024-05-09T05:53:24.135578+0000","last_active":"2024-05-09T05:54:06.917899+0000","last_peered":"2024-05-09T05:54:06.917899+0000","last_clean":"2024-05-09T05:54:06.917899+0000","last_became_active":"2024-05-09T05:53:24.135253+0000","last_became_peered":"2024-05-09T05:53:24.135253+0000","last_unstale":"2024-05-09T05:54:06.917899+0000","last_undegraded":"2024-05-09T05:54:06.917899+0000","last_fullsized":"2024-05-09T05:54:06.917899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:20:23.093397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"27'5","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:10.959019+0000","last_change":"2024-05-09T05:53:23.140175+0000","last_active":"2024-05-09T05:54:10.959019+0000","last_peered":"2024-05-09T05:54:10.959019+0000","last_clean":"2024-05-09T05:54:10.959019+0000","last_became_active":"2024-05-09T05:53:23.139516+0000","last_became_peered":"2024-05-09T05:53:23.139516+0000","last_unstale":"2024-05-09T05:54:10.959019+0000","last_undegraded":"2024-05-09T05:54:10.959019+0000","last_fullsized":"2024-05-09T05:54:10.959019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:48:42.473155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.962952+0000","last_change":"2024-05-09T05:53:28.199385+0000","last_active":"2024-05-09T05:54:05.962952+0000","last_peered":"2024-05-09T05:54:05.962952+0000","last_clean":"2024-05-09T05:54:05.962952+0000","last_became_active":"2024-05-09T05:53:28.198825+0000","last_became_peered":"2024-05-09T05:53:28.198825+0000","last_unstale":"2024-05-09T05:54:05.962952+0000","last_undegraded":"2024-05-09T05:54:05.962952+0000","last_fullsized":"2024-05-09T05:54:05.962952+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:48:22.224140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.915450+0000","last_change":"2024-05-09T05:53:24.133293+0000","last_active":"2024-05-09T05:54:06.915450+0000","last_peered":"2024-05-09T05:54:06.915450+0000","last_clean":"2024-05-09T05:54:06.915450+0000","last_became_active":"2024-05-09T05:53:24.131741+0000","last_became_peered":"2024-05-09T05:53:24.131741+0000","last_unstale":"2024-05-09T05:54:06.915450+0000","last_undegraded":"2024-05-09T05:54:06.915450+0000","last_fullsized":"2024-05-09T05:54:06.915450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:01:33.701742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"26'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.918030+0000","last_change":"2024-05-09T05:53:23.112592+0000","last_active":"2024-05-09T05:54:06.918030+0000","last_peered":"2024-05-09T05:54:06.918030+0000","last_clean":"2024-05-09T05:54:06.918030+0000","last_became_active":"2024-05-09T05:53:23.111968+0000","last_became_peered":"2024-05-09T05:53:23.111968+0000","last_unstale":"2024-05-09T05:54:06.918030+0000","last_undegraded":"2024-05-09T05:54:06.918030+0000","last_fullsized":"2024-05-09T05:54:06.918030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:32:54.694588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.953919+0000","last_change":"2024-05-09T05:53:28.227755+0000","last_active":"2024-05-09T05:54:05.953919+0000","last_peered":"2024-05-09T05:54:05.953919+0000","last_clean":"2024-05-09T05:54:05.953919+0000","last_became_active":"2024-05-09T05:53:28.227272+0000","last_became_peered":"2024-05-09T05:53:28.227272+0000","last_unstale":"2024-05-09T05:54:05.953919+0000","last_undegraded":"2024-05-09T05:54:05.953919+0000","last_fullsized":"2024-05-09T05:54:05.953919+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:13:32.020862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.963238+0000","last_change":"2024-05-09T05:53:24.144025+0000","last_active":"2024-05-09T05:54:05.963238+0000","last_peered":"2024-05-09T05:54:05.963238+0000","last_clean":"2024-05-09T05:54:05.963238+0000","last_became_active":"2024-05-09T05:53:24.143540+0000","last_became_peered":"2024-05-09T05:53:24.143540+0000","last_unstale":"2024-05-09T05:54:05.963238+0000","last_undegraded":"2024-05-09T05:54:05.963238+0000","last_fullsized":"2024-05-09T05:54:05.963238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:22:58.062541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"27'17","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.955433+0000","last_change":"2024-05-09T05:53:23.104452+0000","last_active":"2024-05-09T05:54:05.955433+0000","last_peered":"2024-05-09T05:54:05.955433+0000","last_clean":"2024-05-09T05:54:05.955433+0000","last_became_active":"2024-05-09T05:53:23.103471+0000","last_became_peered":"2024-05-09T05:53:23.103471+0000","last_unstale":"2024-05-09T05:54:05.955433+0000","last_undegraded":"2024-05-09T05:54:05.955433+0000","last_fullsized":"2024-05-09T05:54:05.955433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:33:30.508464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.962376+0000","last_change":"2024-05-09T05:53:28.241338+0000","last_active":"2024-05-09T05:54:05.962376+0000","last_peered":"2024-05-09T05:54:05.962376+0000","last_clean":"2024-05-09T05:54:05.962376+0000","last_became_active":"2024-05-09T05:53:28.239841+0000","last_became_peered":"2024-05-09T05:53:28.239841+0000","last_unstale":"2024-05-09T05:54:05.962376+0000","last_undegraded":"2024-05-09T05:54:05.962376+0000","last_fullsized":"2024-05-09T05:54:05.962376+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:44:47.854598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.954501+0000","last_change":"2024-05-09T05:53:24.149958+0000","last_active":"2024-05-09T05:54:05.954501+0000","last_peered":"2024-05-09T05:54:05.954501+0000","last_clean":"2024-05-09T05:54:05.954501+0000","last_became_active":"2024-05-09T05:53:24.149578+0000","last_became_peered":"2024-05-09T05:53:24.149578+0000","last_unstale":"2024-05-09T05:54:05.954501+0000","last_undegraded":"2024-05-09T05:54:05.954501+0000","last_fullsized":"2024-05-09T05:54:05.954501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:27:43.555218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"27'6","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.916143+0000","last_change":"2024-05-09T05:53:23.121266+0000","last_active":"2024-05-09T05:54:06.916143+0000","last_peered":"2024-05-09T05:54:06.916143+0000","last_clean":"2024-05-09T05:54:06.916143+0000","last_became_active":"2024-05-09T05:53:23.120857+0000","last_became_peered":"2024-05-09T05:53:23.120857+0000","last_unstale":"2024-05-09T05:54:06.916143+0000","last_undegraded":"2024-05-09T05:54:06.916143+0000","last_fullsized":"2024-05-09T05:54:06.916143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:03:30.185640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1029,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.962538+0000","last_change":"2024-05-09T05:53:28.240774+0000","last_active":"2024-05-09T05:54:05.962538+0000","last_peered":"2024-05-09T05:54:05.962538+0000","last_clean":"2024-05-09T05:54:05.962538+0000","last_became_active":"2024-05-09T05:53:28.240070+0000","last_became_peered":"2024-05-09T05:53:28.240070+0000","last_unstale":"2024-05-09T05:54:05.962538+0000","last_undegraded":"2024-05-09T05:54:05.962538+0000","last_fullsized":"2024-05-09T05:54:05.962538+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:25:24.019344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.645397+0000","last_change":"2024-05-09T05:54:06.645397+0000","last_active":"2024-05-09T05:54:06.645397+0000","last_peered":"2024-05-09T05:54:06.645397+0000","last_clean":"2024-05-09T05:54:06.645397+0000","last_became_active":"2024-05-09T05:54:06.644437+0000","last_became_peered":"2024-05-09T05:54:06.644437+0000","last_unstale":"2024-05-09T05:54:06.645397+0000","last_undegraded":"2024-05-09T05:54:06.645397+0000","last_fullsized":"2024-05-09T05:54:06.645397+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:41:52.843192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'5","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.963950+0000","last_change":"2024-05-09T05:53:23.120680+0000","last_active":"2024-05-09T05:54:05.963950+0000","last_peered":"2024-05-09T05:54:05.963950+0000","last_clean":"2024-05-09T05:54:05.963950+0000","last_became_active":"2024-05-09T05:53:23.118358+0000","last_became_peered":"2024-05-09T05:53:23.118358+0000","last_unstale":"2024-05-09T05:54:05.963950+0000","last_undegraded":"2024-05-09T05:54:05.963950+0000","last_fullsized":"2024-05-09T05:54:05.963950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:52:52.360128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.956306+0000","last_change":"2024-05-09T05:53:28.222341+0000","last_active":"2024-05-09T05:54:05.956306+0000","last_peered":"2024-05-09T05:54:05.956306+0000","last_clean":"2024-05-09T05:54:05.956306+0000","last_became_active":"2024-05-09T05:53:28.219636+0000","last_became_peered":"2024-05-09T05:53:28.219636+0000","last_unstale":"2024-05-09T05:54:05.956306+0000","last_undegraded":"2024-05-09T05:54:05.956306+0000","last_fullsized":"2024-05-09T05:54:05.956306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:29:03.459851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.957693+0000","last_change":"2024-05-09T05:53:24.143495+0000","last_active":"2024-05-09T05:54:05.957693+0000","last_peered":"2024-05-09T05:54:05.957693+0000","last_clean":"2024-05-09T05:54:05.957693+0000","last_became_active":"2024-05-09T05:53:24.143181+0000","last_became_peered":"2024-05-09T05:53:24.143181+0000","last_unstale":"2024-05-09T05:54:05.957693+0000","last_undegraded":"2024-05-09T05:54:05.957693+0000","last_fullsized":"2024-05-09T05:54:05.957693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:40:20.997659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"27'9","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:10.961271+0000","last_change":"2024-05-09T05:53:23.114815+0000","last_active":"2024-05-09T05:54:10.961271+0000","last_peered":"2024-05-09T05:54:10.961271+0000","last_clean":"2024-05-09T05:54:10.961271+0000","last_became_active":"2024-05-09T05:53:23.113524+0000","last_became_peered":"2024-05-09T05:53:23.113524+0000","last_unstale":"2024-05-09T05:54:10.961271+0000","last_undegraded":"2024-05-09T05:54:10.961271+0000","last_fullsized":"2024-05-09T05:54:10.961271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:35:45.537715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.964093+0000","last_change":"2024-05-09T05:53:28.226682+0000","last_active":"2024-05-09T05:54:05.964093+0000","last_peered":"2024-05-09T05:54:05.964093+0000","last_clean":"2024-05-09T05:54:05.964093+0000","last_became_active":"2024-05-09T05:53:28.226279+0000","last_became_peered":"2024-05-09T05:53:28.226279+0000","last_unstale":"2024-05-09T05:54:05.964093+0000","last_undegraded":"2024-05-09T05:54:05.964093+0000","last_fullsized":"2024-05-09T05:54:05.964093+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:15:55.146695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.916982+0000","last_change":"2024-05-09T05:53:24.135119+0000","last_active":"2024-05-09T05:54:06.916982+0000","last_peered":"2024-05-09T05:54:06.916982+0000","last_clean":"2024-05-09T05:54:06.916982+0000","last_became_active":"2024-05-09T05:53:24.134690+0000","last_became_peered":"2024-05-09T05:53:24.134690+0000","last_unstale":"2024-05-09T05:54:06.916982+0000","last_undegraded":"2024-05-09T05:54:06.916982+0000","last_fullsized":"2024-05-09T05:54:06.916982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:15:36.608441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'15","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:19.278318+0000","last_change":"2024-05-09T05:53:23.119626+0000","last_active":"2024-05-09T05:54:19.278318+0000","last_peered":"2024-05-09T05:54:19.278318+0000","last_clean":"2024-05-09T05:54:19.278318+0000","last_became_active":"2024-05-09T05:53:23.119173+0000","last_became_peered":"2024-05-09T05:53:23.119173+0000","last_unstale":"2024-05-09T05:54:19.278318+0000","last_undegraded":"2024-05-09T05:54:19.278318+0000","last_fullsized":"2024-05-09T05:54:19.278318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:24:03.188897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4283,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.954584+0000","last_change":"2024-05-09T05:53:28.223167+0000","last_active":"2024-05-09T05:54:05.954584+0000","last_peered":"2024-05-09T05:54:05.954584+0000","last_clean":"2024-05-09T05:54:05.954584+0000","last_became_active":"2024-05-09T05:53:28.221846+0000","last_became_peered":"2024-05-09T05:53:28.221846+0000","last_unstale":"2024-05-09T05:54:05.954584+0000","last_undegraded":"2024-05-09T05:54:05.954584+0000","last_fullsized":"2024-05-09T05:54:05.954584+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:47:12.366900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.963707+0000","last_change":"2024-05-09T05:53:24.133007+0000","last_active":"2024-05-09T05:54:05.963707+0000","last_peered":"2024-05-09T05:54:05.963707+0000","last_clean":"2024-05-09T05:54:05.963707+0000","last_became_active":"2024-05-09T05:53:24.132545+0000","last_became_peered":"2024-05-09T05:53:24.132545+0000","last_unstale":"2024-05-09T05:54:05.963707+0000","last_undegraded":"2024-05-09T05:54:05.963707+0000","last_fullsized":"2024-05-09T05:54:05.963707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:10:26.299015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"26'5","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.642545+0000","last_change":"2024-05-09T05:53:23.121124+0000","last_active":"2024-05-09T05:54:06.642545+0000","last_peered":"2024-05-09T05:54:06.642545+0000","last_clean":"2024-05-09T05:54:06.642545+0000","last_became_active":"2024-05-09T05:53:23.120303+0000","last_became_peered":"2024-05-09T05:53:23.120303+0000","last_unstale":"2024-05-09T05:54:06.642545+0000","last_undegraded":"2024-05-09T05:54:06.642545+0000","last_fullsized":"2024-05-09T05:54:06.642545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:36:49.445673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.913982+0000","last_change":"2024-05-09T05:53:28.188712+0000","last_active":"2024-05-09T05:54:06.913982+0000","last_peered":"2024-05-09T05:54:06.913982+0000","last_clean":"2024-05-09T05:54:06.913982+0000","last_became_active":"2024-05-09T05:53:28.184259+0000","last_became_peered":"2024-05-09T05:53:28.184259+0000","last_unstale":"2024-05-09T05:54:06.913982+0000","last_undegraded":"2024-05-09T05:54:06.913982+0000","last_fullsized":"2024-05-09T05:54:06.913982+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:56:39.668106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.963156+0000","last_change":"2024-05-09T05:53:24.146147+0000","last_active":"2024-05-09T05:54:05.963156+0000","last_peered":"2024-05-09T05:54:05.963156+0000","last_clean":"2024-05-09T05:54:05.963156+0000","last_became_active":"2024-05-09T05:53:24.145704+0000","last_became_peered":"2024-05-09T05:53:24.145704+0000","last_unstale":"2024-05-09T05:54:05.963156+0000","last_undegraded":"2024-05-09T05:54:05.963156+0000","last_fullsized":"2024-05-09T05:54:05.963156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:47:03.047479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"27'4","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:10.966228+0000","last_change":"2024-05-09T05:53:23.095689+0000","last_active":"2024-05-09T05:54:10.966228+0000","last_peered":"2024-05-09T05:54:10.966228+0000","last_clean":"2024-05-09T05:54:10.966228+0000","last_became_active":"2024-05-09T05:53:23.094889+0000","last_became_peered":"2024-05-09T05:53:23.094889+0000","last_unstale":"2024-05-09T05:54:10.966228+0000","last_undegraded":"2024-05-09T05:54:10.966228+0000","last_fullsized":"2024-05-09T05:54:10.966228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:25:35.069184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.640733+0000","last_change":"2024-05-09T05:53:28.223954+0000","last_active":"2024-05-09T05:54:06.640733+0000","last_peered":"2024-05-09T05:54:06.640733+0000","last_clean":"2024-05-09T05:54:06.640733+0000","last_became_active":"2024-05-09T05:53:28.222700+0000","last_became_peered":"2024-05-09T05:53:28.222700+0000","last_unstale":"2024-05-09T05:54:06.640733+0000","last_undegraded":"2024-05-09T05:54:06.640733+0000","last_fullsized":"2024-05-09T05:54:06.640733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:17:17.864782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.915376+0000","last_change":"2024-05-09T05:53:24.140698+0000","last_active":"2024-05-09T05:54:06.915376+0000","last_peered":"2024-05-09T05:54:06.915376+0000","last_clean":"2024-05-09T05:54:06.915376+0000","last_became_active":"2024-05-09T05:53:24.139612+0000","last_became_peered":"2024-05-09T05:53:24.139612+0000","last_unstale":"2024-05-09T05:54:06.915376+0000","last_undegraded":"2024-05-09T05:54:06.915376+0000","last_fullsized":"2024-05-09T05:54:06.915376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:09:39.609750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'5","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.955853+0000","last_change":"2024-05-09T05:53:23.106167+0000","last_active":"2024-05-09T05:54:05.955853+0000","last_peered":"2024-05-09T05:54:05.955853+0000","last_clean":"2024-05-09T05:54:05.955853+0000","last_became_active":"2024-05-09T05:53:23.105346+0000","last_became_peered":"2024-05-09T05:53:23.105346+0000","last_unstale":"2024-05-09T05:54:05.955853+0000","last_undegraded":"2024-05-09T05:54:05.955853+0000","last_fullsized":"2024-05-09T05:54:05.955853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:06:46.109056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.955536+0000","last_change":"2024-05-09T05:53:28.194037+0000","last_active":"2024-05-09T05:54:05.955536+0000","last_peered":"2024-05-09T05:54:05.955536+0000","last_clean":"2024-05-09T05:54:05.955536+0000","last_became_active":"2024-05-09T05:53:28.192944+0000","last_became_peered":"2024-05-09T05:53:28.192944+0000","last_unstale":"2024-05-09T05:54:05.955536+0000","last_undegraded":"2024-05-09T05:54:05.955536+0000","last_fullsized":"2024-05-09T05:54:05.955536+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:28:47.664198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.954541+0000","last_change":"2024-05-09T05:53:28.226664+0000","last_active":"2024-05-09T05:54:05.954541+0000","last_peered":"2024-05-09T05:54:05.954541+0000","last_clean":"2024-05-09T05:54:05.954541+0000","last_became_active":"2024-05-09T05:53:28.222225+0000","last_became_peered":"2024-05-09T05:53:28.222225+0000","last_unstale":"2024-05-09T05:54:05.954541+0000","last_undegraded":"2024-05-09T05:54:05.954541+0000","last_fullsized":"2024-05-09T05:54:05.954541+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:24:23.614210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.955804+0000","last_change":"2024-05-09T05:53:24.128343+0000","last_active":"2024-05-09T05:54:05.955804+0000","last_peered":"2024-05-09T05:54:05.955804+0000","last_clean":"2024-05-09T05:54:05.955804+0000","last_became_active":"2024-05-09T05:53:24.127989+0000","last_became_peered":"2024-05-09T05:53:24.127989+0000","last_unstale":"2024-05-09T05:54:05.955804+0000","last_undegraded":"2024-05-09T05:54:05.955804+0000","last_fullsized":"2024-05-09T05:54:05.955804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:56:14.176175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"27'3","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.963317+0000","last_change":"2024-05-09T05:53:23.118882+0000","last_active":"2024-05-09T05:54:05.963317+0000","last_peered":"2024-05-09T05:54:05.963317+0000","last_clean":"2024-05-09T05:54:05.963317+0000","last_became_active":"2024-05-09T05:53:23.118119+0000","last_became_peered":"2024-05-09T05:53:23.118119+0000","last_unstale":"2024-05-09T05:54:05.963317+0000","last_undegraded":"2024-05-09T05:54:05.963317+0000","last_fullsized":"2024-05-09T05:54:05.963317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:06:48.203396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.964343+0000","last_change":"2024-05-09T05:53:28.235313+0000","last_active":"2024-05-09T05:54:05.964343+0000","last_peered":"2024-05-09T05:54:05.964343+0000","last_clean":"2024-05-09T05:54:05.964343+0000","last_became_active":"2024-05-09T05:53:28.234771+0000","last_became_peered":"2024-05-09T05:53:28.234771+0000","last_unstale":"2024-05-09T05:54:05.964343+0000","last_undegraded":"2024-05-09T05:54:05.964343+0000","last_fullsized":"2024-05-09T05:54:05.964343+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:38:46.942863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.959924+0000","last_change":"2024-05-09T05:53:24.141956+0000","last_active":"2024-05-09T05:54:05.959924+0000","last_peered":"2024-05-09T05:54:05.959924+0000","last_clean":"2024-05-09T05:54:05.959924+0000","last_became_active":"2024-05-09T05:53:24.139093+0000","last_became_peered":"2024-05-09T05:53:24.139093+0000","last_unstale":"2024-05-09T05:54:05.959924+0000","last_undegraded":"2024-05-09T05:54:05.959924+0000","last_fullsized":"2024-05-09T05:54:05.959924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:44:32.901168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"27'3","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.956549+0000","last_change":"2024-05-09T05:53:23.113865+0000","last_active":"2024-05-09T05:54:05.956549+0000","last_peered":"2024-05-09T05:54:05.956549+0000","last_clean":"2024-05-09T05:54:05.956549+0000","last_became_active":"2024-05-09T05:53:23.112020+0000","last_became_peered":"2024-05-09T05:53:23.112020+0000","last_unstale":"2024-05-09T05:54:05.956549+0000","last_undegraded":"2024-05-09T05:54:05.956549+0000","last_fullsized":"2024-05-09T05:54:05.956549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:37:04.425229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"26'7","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.963810+0000","last_change":"2024-05-09T05:53:23.127463+0000","last_active":"2024-05-09T05:54:05.963810+0000","last_peered":"2024-05-09T05:54:05.963810+0000","last_clean":"2024-05-09T05:54:05.963810+0000","last_became_active":"2024-05-09T05:53:23.126911+0000","last_became_peered":"2024-05-09T05:53:23.126911+0000","last_unstale":"2024-05-09T05:54:05.963810+0000","last_undegraded":"2024-05-09T05:54:05.963810+0000","last_fullsized":"2024-05-09T05:54:05.963810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:06:28.458926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.954923+0000","last_change":"2024-05-09T05:53:24.134391+0000","last_active":"2024-05-09T05:54:05.954923+0000","last_peered":"2024-05-09T05:54:05.954923+0000","last_clean":"2024-05-09T05:54:05.954923+0000","last_became_active":"2024-05-09T05:53:24.133994+0000","last_became_peered":"2024-05-09T05:53:24.133994+0000","last_unstale":"2024-05-09T05:54:05.954923+0000","last_undegraded":"2024-05-09T05:54:05.954923+0000","last_fullsized":"2024-05-09T05:54:05.954923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:30:32.872657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.955054+0000","last_change":"2024-05-09T05:53:28.223524+0000","last_active":"2024-05-09T05:54:05.955054+0000","last_peered":"2024-05-09T05:54:05.955054+0000","last_clean":"2024-05-09T05:54:05.955054+0000","last_became_active":"2024-05-09T05:53:28.222433+0000","last_became_peered":"2024-05-09T05:53:28.222433+0000","last_unstale":"2024-05-09T05:54:05.955054+0000","last_undegraded":"2024-05-09T05:54:05.955054+0000","last_fullsized":"2024-05-09T05:54:05.955054+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:52:35.361812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"27'6","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.961185+0000","last_change":"2024-05-09T05:53:23.133700+0000","last_active":"2024-05-09T05:54:05.961185+0000","last_peered":"2024-05-09T05:54:05.961185+0000","last_clean":"2024-05-09T05:54:05.961185+0000","last_became_active":"2024-05-09T05:53:23.132946+0000","last_became_peered":"2024-05-09T05:53:23.132946+0000","last_unstale":"2024-05-09T05:54:05.961185+0000","last_undegraded":"2024-05-09T05:54:05.961185+0000","last_fullsized":"2024-05-09T05:54:05.961185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:39:49.829592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1063,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.953860+0000","last_change":"2024-05-09T05:53:24.138174+0000","last_active":"2024-05-09T05:54:05.953860+0000","last_peered":"2024-05-09T05:54:05.953860+0000","last_clean":"2024-05-09T05:54:05.953860+0000","last_became_active":"2024-05-09T05:53:24.137794+0000","last_became_peered":"2024-05-09T05:53:24.137794+0000","last_unstale":"2024-05-09T05:54:05.953860+0000","last_undegraded":"2024-05-09T05:54:05.953860+0000","last_fullsized":"2024-05-09T05:54:05.953860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:57:26.359258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.642109+0000","last_change":"2024-05-09T05:53:28.238375+0000","last_active":"2024-05-09T05:54:06.642109+0000","last_peered":"2024-05-09T05:54:06.642109+0000","last_clean":"2024-05-09T05:54:06.642109+0000","last_became_active":"2024-05-09T05:53:28.237414+0000","last_became_peered":"2024-05-09T05:53:28.237414+0000","last_unstale":"2024-05-09T05:54:06.642109+0000","last_undegraded":"2024-05-09T05:54:06.642109+0000","last_fullsized":"2024-05-09T05:54:06.642109+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:13:50.396951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.913624+0000","last_change":"2024-05-09T05:53:24.130839+0000","last_active":"2024-05-09T05:54:06.913624+0000","last_peered":"2024-05-09T05:54:06.913624+0000","last_clean":"2024-05-09T05:54:06.913624+0000","last_became_active":"2024-05-09T05:53:24.130201+0000","last_became_peered":"2024-05-09T05:53:24.130201+0000","last_unstale":"2024-05-09T05:54:06.913624+0000","last_undegraded":"2024-05-09T05:54:06.913624+0000","last_fullsized":"2024-05-09T05:54:06.913624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:26:03.973553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.641103+0000","last_change":"2024-05-09T05:53:24.138681+0000","last_active":"2024-05-09T05:54:06.641103+0000","last_peered":"2024-05-09T05:54:06.641103+0000","last_clean":"2024-05-09T05:54:06.641103+0000","last_became_active":"2024-05-09T05:53:24.138366+0000","last_became_peered":"2024-05-09T05:53:24.138366+0000","last_unstale":"2024-05-09T05:54:06.641103+0000","last_undegraded":"2024-05-09T05:54:06.641103+0000","last_fullsized":"2024-05-09T05:54:06.641103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:49.856205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.963645+0000","last_change":"2024-05-09T05:53:24.139915+0000","last_active":"2024-05-09T05:54:05.963645+0000","last_peered":"2024-05-09T05:54:05.963645+0000","last_clean":"2024-05-09T05:54:05.963645+0000","last_became_active":"2024-05-09T05:53:24.139058+0000","last_became_peered":"2024-05-09T05:53:24.139058+0000","last_unstale":"2024-05-09T05:54:05.963645+0000","last_undegraded":"2024-05-09T05:54:05.963645+0000","last_fullsized":"2024-05-09T05:54:05.963645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:06:00.768431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.960963+0000","last_change":"2024-05-09T05:53:24.149759+0000","last_active":"2024-05-09T05:54:05.960963+0000","last_peered":"2024-05-09T05:54:05.960963+0000","last_clean":"2024-05-09T05:54:05.960963+0000","last_became_active":"2024-05-09T05:53:24.142812+0000","last_became_peered":"2024-05-09T05:53:24.142812+0000","last_unstale":"2024-05-09T05:54:05.960963+0000","last_undegraded":"2024-05-09T05:54:05.960963+0000","last_fullsized":"2024-05-09T05:54:05.960963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:04.522514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.958194+0000","last_change":"2024-05-09T05:53:24.135373+0000","last_active":"2024-05-09T05:54:05.958194+0000","last_peered":"2024-05-09T05:54:05.958194+0000","last_clean":"2024-05-09T05:54:05.958194+0000","last_became_active":"2024-05-09T05:53:24.135043+0000","last_became_peered":"2024-05-09T05:53:24.135043+0000","last_unstale":"2024-05-09T05:54:05.958194+0000","last_undegraded":"2024-05-09T05:54:05.958194+0000","last_fullsized":"2024-05-09T05:54:05.958194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:20:03.245696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.956646+0000","last_change":"2024-05-09T05:53:24.134712+0000","last_active":"2024-05-09T05:54:05.956646+0000","last_peered":"2024-05-09T05:54:05.956646+0000","last_clean":"2024-05-09T05:54:05.956646+0000","last_became_active":"2024-05-09T05:53:24.132453+0000","last_became_peered":"2024-05-09T05:53:24.132453+0000","last_unstale":"2024-05-09T05:54:05.956646+0000","last_undegraded":"2024-05-09T05:54:05.956646+0000","last_fullsized":"2024-05-09T05:54:05.956646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:47:30.716995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.915325+0000","last_change":"2024-05-09T05:53:24.140714+0000","last_active":"2024-05-09T05:54:06.915325+0000","last_peered":"2024-05-09T05:54:06.915325+0000","last_clean":"2024-05-09T05:54:06.915325+0000","last_became_active":"2024-05-09T05:53:24.140045+0000","last_became_peered":"2024-05-09T05:53:24.140045+0000","last_unstale":"2024-05-09T05:54:06.915325+0000","last_undegraded":"2024-05-09T05:54:06.915325+0000","last_fullsized":"2024-05-09T05:54:06.915325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:36:06.166411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.962249+0000","last_change":"2024-05-09T05:53:24.151591+0000","last_active":"2024-05-09T05:54:05.962249+0000","last_peered":"2024-05-09T05:54:05.962249+0000","last_clean":"2024-05-09T05:54:05.962249+0000","last_became_active":"2024-05-09T05:53:24.151275+0000","last_became_peered":"2024-05-09T05:53:24.151275+0000","last_unstale":"2024-05-09T05:54:05.962249+0000","last_undegraded":"2024-05-09T05:54:05.962249+0000","last_fullsized":"2024-05-09T05:54:05.962249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:28:28.552732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.963146+0000","last_change":"2024-05-09T05:53:24.144315+0000","last_active":"2024-05-09T05:54:05.963146+0000","last_peered":"2024-05-09T05:54:05.963146+0000","last_clean":"2024-05-09T05:54:05.963146+0000","last_became_active":"2024-05-09T05:53:24.144005+0000","last_became_peered":"2024-05-09T05:53:24.144005+0000","last_unstale":"2024-05-09T05:54:05.963146+0000","last_undegraded":"2024-05-09T05:54:05.963146+0000","last_fullsized":"2024-05-09T05:54:05.963146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:06:37.312541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.959800+0000","last_change":"2024-05-09T05:53:24.149852+0000","last_active":"2024-05-09T05:54:05.959800+0000","last_peered":"2024-05-09T05:54:05.959800+0000","last_clean":"2024-05-09T05:54:05.959800+0000","last_became_active":"2024-05-09T05:53:24.146965+0000","last_became_peered":"2024-05-09T05:53:24.146965+0000","last_unstale":"2024-05-09T05:54:05.959800+0000","last_undegraded":"2024-05-09T05:54:05.959800+0000","last_fullsized":"2024-05-09T05:54:05.959800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:02:26.991425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.953846+0000","last_change":"2024-05-09T05:53:24.131735+0000","last_active":"2024-05-09T05:54:05.953846+0000","last_peered":"2024-05-09T05:54:05.953846+0000","last_clean":"2024-05-09T05:54:05.953846+0000","last_became_active":"2024-05-09T05:53:24.131417+0000","last_became_peered":"2024-05-09T05:53:24.131417+0000","last_unstale":"2024-05-09T05:54:05.953846+0000","last_undegraded":"2024-05-09T05:54:05.953846+0000","last_fullsized":"2024-05-09T05:54:05.953846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:59.750972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.954663+0000","last_change":"2024-05-09T05:53:24.140697+0000","last_active":"2024-05-09T05:54:05.954663+0000","last_peered":"2024-05-09T05:54:05.954663+0000","last_clean":"2024-05-09T05:54:05.954663+0000","last_became_active":"2024-05-09T05:53:24.140024+0000","last_became_peered":"2024-05-09T05:53:24.140024+0000","last_unstale":"2024-05-09T05:54:05.954663+0000","last_undegraded":"2024-05-09T05:54:05.954663+0000","last_fullsized":"2024-05-09T05:54:05.954663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:14:14.543827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.917187+0000","last_change":"2024-05-09T05:53:24.136878+0000","last_active":"2024-05-09T05:54:06.917187+0000","last_peered":"2024-05-09T05:54:06.917187+0000","last_clean":"2024-05-09T05:54:06.917187+0000","last_became_active":"2024-05-09T05:53:24.136572+0000","last_became_peered":"2024-05-09T05:53:24.136572+0000","last_unstale":"2024-05-09T05:54:06.917187+0000","last_undegraded":"2024-05-09T05:54:06.917187+0000","last_fullsized":"2024-05-09T05:54:06.917187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:46:47.509355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.964502+0000","last_change":"2024-05-09T05:53:24.147372+0000","last_active":"2024-05-09T05:54:05.964502+0000","last_peered":"2024-05-09T05:54:05.964502+0000","last_clean":"2024-05-09T05:54:05.964502+0000","last_became_active":"2024-05-09T05:53:24.144573+0000","last_became_peered":"2024-05-09T05:53:24.144573+0000","last_unstale":"2024-05-09T05:54:05.964502+0000","last_undegraded":"2024-05-09T05:54:05.964502+0000","last_fullsized":"2024-05-09T05:54:05.964502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:51:09.845748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.643061+0000","last_change":"2024-05-09T05:53:24.135964+0000","last_active":"2024-05-09T05:54:06.643061+0000","last_peered":"2024-05-09T05:54:06.643061+0000","last_clean":"2024-05-09T05:54:06.643061+0000","last_became_active":"2024-05-09T05:53:24.135625+0000","last_became_peered":"2024-05-09T05:53:24.135625+0000","last_unstale":"2024-05-09T05:54:06.643061+0000","last_undegraded":"2024-05-09T05:54:06.643061+0000","last_fullsized":"2024-05-09T05:54:06.643061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:52:02.026146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.964778+0000","last_change":"2024-05-09T05:53:24.133916+0000","last_active":"2024-05-09T05:54:05.964778+0000","last_peered":"2024-05-09T05:54:05.964778+0000","last_clean":"2024-05-09T05:54:05.964778+0000","last_became_active":"2024-05-09T05:53:24.133405+0000","last_became_peered":"2024-05-09T05:53:24.133405+0000","last_unstale":"2024-05-09T05:54:05.964778+0000","last_undegraded":"2024-05-09T05:54:05.964778+0000","last_fullsized":"2024-05-09T05:54:05.964778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:30:16.477715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.963077+0000","last_change":"2024-05-09T05:53:24.139697+0000","last_active":"2024-05-09T05:54:05.963077+0000","last_peered":"2024-05-09T05:54:05.963077+0000","last_clean":"2024-05-09T05:54:05.963077+0000","last_became_active":"2024-05-09T05:53:24.139374+0000","last_became_peered":"2024-05-09T05:53:24.139374+0000","last_unstale":"2024-05-09T05:54:05.963077+0000","last_undegraded":"2024-05-09T05:54:05.963077+0000","last_fullsized":"2024-05-09T05:54:05.963077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:26:28.502867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.959611+0000","last_change":"2024-05-09T05:53:24.147755+0000","last_active":"2024-05-09T05:54:05.959611+0000","last_peered":"2024-05-09T05:54:05.959611+0000","last_clean":"2024-05-09T05:54:05.959611+0000","last_became_active":"2024-05-09T05:53:24.145616+0000","last_became_peered":"2024-05-09T05:53:24.145616+0000","last_unstale":"2024-05-09T05:54:05.959611+0000","last_undegraded":"2024-05-09T05:54:05.959611+0000","last_fullsized":"2024-05-09T05:54:05.959611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:21:10.387393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.957455+0000","last_change":"2024-05-09T05:53:24.131741+0000","last_active":"2024-05-09T05:54:05.957455+0000","last_peered":"2024-05-09T05:54:05.957455+0000","last_clean":"2024-05-09T05:54:05.957455+0000","last_became_active":"2024-05-09T05:53:24.128870+0000","last_became_peered":"2024-05-09T05:53:24.128870+0000","last_unstale":"2024-05-09T05:54:05.957455+0000","last_undegraded":"2024-05-09T05:54:05.957455+0000","last_fullsized":"2024-05-09T05:54:05.957455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:28:25.103524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.956516+0000","last_change":"2024-05-09T05:53:24.133443+0000","last_active":"2024-05-09T05:54:05.956516+0000","last_peered":"2024-05-09T05:54:05.956516+0000","last_clean":"2024-05-09T05:54:05.956516+0000","last_became_active":"2024-05-09T05:53:24.132688+0000","last_became_peered":"2024-05-09T05:53:24.132688+0000","last_unstale":"2024-05-09T05:54:05.956516+0000","last_undegraded":"2024-05-09T05:54:05.956516+0000","last_fullsized":"2024-05-09T05:54:05.956516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:43:24.750805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.916963+0000","last_change":"2024-05-09T05:53:24.142600+0000","last_active":"2024-05-09T05:54:06.916963+0000","last_peered":"2024-05-09T05:54:06.916963+0000","last_clean":"2024-05-09T05:54:06.916963+0000","last_became_active":"2024-05-09T05:53:24.142280+0000","last_became_peered":"2024-05-09T05:53:24.142280+0000","last_unstale":"2024-05-09T05:54:06.916963+0000","last_undegraded":"2024-05-09T05:54:06.916963+0000","last_fullsized":"2024-05-09T05:54:06.916963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:20:58.962379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.916818+0000","last_change":"2024-05-09T05:53:24.144839+0000","last_active":"2024-05-09T05:54:06.916818+0000","last_peered":"2024-05-09T05:54:06.916818+0000","last_clean":"2024-05-09T05:54:06.916818+0000","last_became_active":"2024-05-09T05:53:24.144381+0000","last_became_peered":"2024-05-09T05:53:24.144381+0000","last_unstale":"2024-05-09T05:54:06.916818+0000","last_undegraded":"2024-05-09T05:54:06.916818+0000","last_fullsized":"2024-05-09T05:54:06.916818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:40:46.738053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.917366+0000","last_change":"2024-05-09T05:53:24.131521+0000","last_active":"2024-05-09T05:54:06.917366+0000","last_peered":"2024-05-09T05:54:06.917366+0000","last_clean":"2024-05-09T05:54:06.917366+0000","last_became_active":"2024-05-09T05:53:24.131218+0000","last_became_peered":"2024-05-09T05:53:24.131218+0000","last_unstale":"2024-05-09T05:54:06.917366+0000","last_undegraded":"2024-05-09T05:54:06.917366+0000","last_fullsized":"2024-05-09T05:54:06.917366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:25:59.410270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.955574+0000","last_change":"2024-05-09T05:53:24.139922+0000","last_active":"2024-05-09T05:54:05.955574+0000","last_peered":"2024-05-09T05:54:05.955574+0000","last_clean":"2024-05-09T05:54:05.955574+0000","last_became_active":"2024-05-09T05:53:24.139473+0000","last_became_peered":"2024-05-09T05:53:24.139473+0000","last_unstale":"2024-05-09T05:54:05.955574+0000","last_undegraded":"2024-05-09T05:54:05.955574+0000","last_fullsized":"2024-05-09T05:54:05.955574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:37:50.839899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.959357+0000","last_change":"2024-05-09T05:53:24.143338+0000","last_active":"2024-05-09T05:54:05.959357+0000","last_peered":"2024-05-09T05:54:05.959357+0000","last_clean":"2024-05-09T05:54:05.959357+0000","last_became_active":"2024-05-09T05:53:24.143053+0000","last_became_peered":"2024-05-09T05:53:24.143053+0000","last_unstale":"2024-05-09T05:54:05.959357+0000","last_undegraded":"2024-05-09T05:54:05.959357+0000","last_fullsized":"2024-05-09T05:54:05.959357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:22:16.337090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.915734+0000","last_change":"2024-05-09T05:53:24.145517+0000","last_active":"2024-05-09T05:54:06.915734+0000","last_peered":"2024-05-09T05:54:06.915734+0000","last_clean":"2024-05-09T05:54:06.915734+0000","last_became_active":"2024-05-09T05:53:24.145150+0000","last_became_peered":"2024-05-09T05:53:24.145150+0000","last_unstale":"2024-05-09T05:54:06.915734+0000","last_undegraded":"2024-05-09T05:54:06.915734+0000","last_fullsized":"2024-05-09T05:54:06.915734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:19:53.947349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.914063+0000","last_change":"2024-05-09T05:53:24.129669+0000","last_active":"2024-05-09T05:54:06.914063+0000","last_peered":"2024-05-09T05:54:06.914063+0000","last_clean":"2024-05-09T05:54:06.914063+0000","last_became_active":"2024-05-09T05:53:24.129339+0000","last_became_peered":"2024-05-09T05:53:24.129339+0000","last_unstale":"2024-05-09T05:54:06.914063+0000","last_undegraded":"2024-05-09T05:54:06.914063+0000","last_fullsized":"2024-05-09T05:54:06.914063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:05:51.845643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.916222+0000","last_change":"2024-05-09T05:53:24.138914+0000","last_active":"2024-05-09T05:54:06.916222+0000","last_peered":"2024-05-09T05:54:06.916222+0000","last_clean":"2024-05-09T05:54:06.916222+0000","last_became_active":"2024-05-09T05:53:24.138499+0000","last_became_peered":"2024-05-09T05:53:24.138499+0000","last_unstale":"2024-05-09T05:54:06.916222+0000","last_undegraded":"2024-05-09T05:54:06.916222+0000","last_fullsized":"2024-05-09T05:54:06.916222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:29:00.338046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.914572+0000","last_change":"2024-05-09T05:53:24.144296+0000","last_active":"2024-05-09T05:54:06.914572+0000","last_peered":"2024-05-09T05:54:06.914572+0000","last_clean":"2024-05-09T05:54:06.914572+0000","last_became_active":"2024-05-09T05:53:24.143890+0000","last_became_peered":"2024-05-09T05:53:24.143890+0000","last_unstale":"2024-05-09T05:54:06.914572+0000","last_undegraded":"2024-05-09T05:54:06.914572+0000","last_fullsized":"2024-05-09T05:54:06.914572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:34:56.860849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.962005+0000","last_change":"2024-05-09T05:53:24.152635+0000","last_active":"2024-05-09T05:54:05.962005+0000","last_peered":"2024-05-09T05:54:05.962005+0000","last_clean":"2024-05-09T05:54:05.962005+0000","last_became_active":"2024-05-09T05:53:24.151674+0000","last_became_peered":"2024-05-09T05:53:24.151674+0000","last_unstale":"2024-05-09T05:54:05.962005+0000","last_undegraded":"2024-05-09T05:54:05.962005+0000","last_fullsized":"2024-05-09T05:54:05.962005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:18:47.495857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.961971+0000","last_change":"2024-05-09T05:53:24.152746+0000","last_active":"2024-05-09T05:54:05.961971+0000","last_peered":"2024-05-09T05:54:05.961971+0000","last_clean":"2024-05-09T05:54:05.961971+0000","last_became_active":"2024-05-09T05:53:24.151418+0000","last_became_peered":"2024-05-09T05:53:24.151418+0000","last_unstale":"2024-05-09T05:54:05.961971+0000","last_undegraded":"2024-05-09T05:54:05.961971+0000","last_fullsized":"2024-05-09T05:54:05.961971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:27:19.121790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.917763+0000","last_change":"2024-05-09T05:53:24.140908+0000","last_active":"2024-05-09T05:54:06.917763+0000","last_peered":"2024-05-09T05:54:06.917763+0000","last_clean":"2024-05-09T05:54:06.917763+0000","last_became_active":"2024-05-09T05:53:24.140589+0000","last_became_peered":"2024-05-09T05:53:24.140589+0000","last_unstale":"2024-05-09T05:54:06.917763+0000","last_undegraded":"2024-05-09T05:54:06.917763+0000","last_fullsized":"2024-05-09T05:54:06.917763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:51:03.458547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":12028,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":215,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":23615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":189,"ondisk_log_size":189,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509456,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":319488,"data_stored":116491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509459,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31472,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340368,"statfs":{"total":96636764160,"available":96604536832,"internally_reserved":0,"allocated":303104,"data_stored":118699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509459,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31508,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340332,"statfs":{"total":96636764160,"available":96604499968,"internally_reserved":0,"allocated":339968,"data_stored":121558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509456,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":119788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509458,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":897024,"data_stored":707219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509458,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":118861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32056,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339784,"statfs":{"total":96636764160,"available":96603938816,"internally_reserved":0,"allocated":901120,"data_stored":707072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":327680,"data_stored":118159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":3424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":6121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T05:54:23.742 INFO:tasks.mds_thrash.ceph_manager:clean! 2024-05-09T05:54:23.743 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T05:54:23.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.935+0000 7f375417b640 1 Processor -- start 2024-05-09T05:54:23.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.935+0000 7f375417b640 1 -- start start 2024-05-09T05:54:23.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.935+0000 7f375417b640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f374c156b50 0x7f374c073ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:23.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.935+0000 7f375417b640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f374c074410 0x7f374c0cc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:23.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.935+0000 7f375417b640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f374c0cda30 con 0x7f374c0cca30 2024-05-09T05:54:23.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.935+0000 7f375417b640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f374c0cc020 con 0x7f374c074410 2024-05-09T05:54:23.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.935+0000 7f375417b640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f374c15dfe0 con 0x7f374c156b50 2024-05-09T05:54:23.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.935+0000 7f3751716640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f374c074410 0x7f374c0cc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:23.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.935+0000 7f3751716640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f374c074410 0x7f374c0cc4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46334/0 (socket says 172.21.15.72:46334) 2024-05-09T05:54:23.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.935+0000 7f3751716640 1 -- 172.21.15.72:0/812058869 learned_addr learned my addr 172.21.15.72:0/812058869 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:54:23.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.935+0000 7f3751f17640 1 --2- 172.21.15.72:0/812058869 >> v2:172.21.15.110:3300/0 conn(0x7f374c156b50 0x7f374c073ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:23.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.935+0000 7f3751716640 1 -- 172.21.15.72:0/812058869 >> v2:172.21.15.110:3300/0 conn(0x7f374c156b50 msgr2=0x7f374c073ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:23.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.935+0000 7f3751716640 1 --2- 172.21.15.72:0/812058869 >> v2:172.21.15.110:3300/0 conn(0x7f374c156b50 0x7f374c073ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:23.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.935+0000 7f3751716640 1 -- 172.21.15.72:0/812058869 >> v1:172.21.15.110:6789/0 conn(0x7f374c0cca30 legacy=0x7f374c0cce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:23.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.935+0000 7f3751716640 1 -- 172.21.15.72:0/812058869 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f374c15cdd0 con 0x7f374c074410 2024-05-09T05:54:23.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.939+0000 7f3751716640 1 --2- 172.21.15.72:0/812058869 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f374c074410 0x7f374c0cc4f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f374c06f9a0 tx=0x7f373c01c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4116db7d8315306 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:23.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.939+0000 7f3750f15640 1 -- 172.21.15.72:0/812058869 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f373c0b0070 con 0x7f374c074410 2024-05-09T05:54:23.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.939+0000 7f3750f15640 1 -- 172.21.15.72:0/812058869 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f373c0ab600 con 0x7f374c074410 2024-05-09T05:54:23.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.939+0000 7f3750f15640 1 -- 172.21.15.72:0/812058869 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f373c0ab9d0 con 0x7f374c074410 2024-05-09T05:54:23.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.939+0000 7f375417b640 1 -- 172.21.15.72:0/812058869 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f374c074410 msgr2=0x7f374c0cc4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:23.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.939+0000 7f375417b640 1 --2- 172.21.15.72:0/812058869 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f374c074410 0x7f374c0cc4f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f374c06f9a0 tx=0x7f373c01c340 comp rx=0 tx=0).stop 2024-05-09T05:54:23.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.939+0000 7f375417b640 1 -- 172.21.15.72:0/812058869 shutdown_connections 2024-05-09T05:54:23.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.939+0000 7f375417b640 1 --2- 172.21.15.72:0/812058869 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f374c074410 0x7f374c0cc4f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:23.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.939+0000 7f375417b640 1 --2- 172.21.15.72:0/812058869 >> v2:172.21.15.110:3300/0 conn(0x7f374c156b50 0x7f374c073ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:23.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.939+0000 7f375417b640 1 -- 172.21.15.72:0/812058869 >> 172.21.15.72:0/812058869 conn(0x7f374c0d1b70 msgr2=0x7f374c0d1f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:23.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.939+0000 7f375417b640 1 -- 172.21.15.72:0/812058869 shutdown_connections 2024-05-09T05:54:23.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.939+0000 7f375417b640 1 -- 172.21.15.72:0/812058869 wait complete. 2024-05-09T05:54:23.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.943+0000 7f375417b640 1 Processor -- start 2024-05-09T05:54:23.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.943+0000 7f375417b640 1 -- start start 2024-05-09T05:54:23.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.943+0000 7f375417b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f374c074410 0x7f374c14e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:23.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.943+0000 7f375417b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f374c0cca30 0x7f374c14a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:23.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.943+0000 7f375417b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f374c156b50 0x7f374c0ca580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:23.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.943+0000 7f375417b640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f374c074cf0 con 0x7f374c0cca30 2024-05-09T05:54:23.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.943+0000 7f375417b640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f374c15d950 con 0x7f374c156b50 2024-05-09T05:54:23.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.943+0000 7f375417b640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f374c0cd550 con 0x7f374c074410 2024-05-09T05:54:23.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.943+0000 7f3751716640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f374c0cca30 0x7f374c14a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:23.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.943+0000 7f3751716640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f374c0cca30 0x7f374c14a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46336/0 (socket says 172.21.15.72:46336) 2024-05-09T05:54:23.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.943+0000 7f3751716640 1 -- 172.21.15.72:0/3283953679 learned_addr learned my addr 172.21.15.72:0/3283953679 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:54:23.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.943+0000 7f3751f17640 1 --2- 172.21.15.72:0/3283953679 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f374c074410 0x7f374c14e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:23.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.943+0000 7f3752718640 1 --2- 172.21.15.72:0/3283953679 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f374c156b50 0x7f374c0ca580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:23.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.943+0000 7f3751716640 1 -- 172.21.15.72:0/3283953679 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f374c074410 msgr2=0x7f374c14e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:23.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.943+0000 7f3751716640 1 --2- 172.21.15.72:0/3283953679 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f374c074410 0x7f374c14e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:23.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.943+0000 7f3751716640 1 -- 172.21.15.72:0/3283953679 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f374c156b50 msgr2=0x7f374c0ca580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:23.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.943+0000 7f3751716640 1 --2- 172.21.15.72:0/3283953679 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f374c156b50 0x7f374c0ca580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:23.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.943+0000 7f3751716640 1 -- 172.21.15.72:0/3283953679 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f374c14d430 con 0x7f374c0cca30 2024-05-09T05:54:23.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.947+0000 7f3751716640 1 --2- 172.21.15.72:0/3283953679 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f374c0cca30 0x7f374c14a8c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f373c0ae040 tx=0x7f373c0190e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:23.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.947+0000 7f37427fc640 1 -- 172.21.15.72:0/3283953679 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f373c0b0040 con 0x7f374c0cca30 2024-05-09T05:54:23.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.947+0000 7f37427fc640 1 -- 172.21.15.72:0/3283953679 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f373c0b9070 con 0x7f374c0cca30 2024-05-09T05:54:23.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.947+0000 7f375417b640 1 -- 172.21.15.72:0/3283953679 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f374c1eef80 con 0x7f374c0cca30 2024-05-09T05:54:23.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.947+0000 7f37427fc640 1 -- 172.21.15.72:0/3283953679 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f373c0b46a0 con 0x7f374c0cca30 2024-05-09T05:54:23.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.947+0000 7f375417b640 1 -- 172.21.15.72:0/3283953679 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f374c1ef540 con 0x7f374c0cca30 2024-05-09T05:54:23.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.947+0000 7f375417b640 1 -- 172.21.15.72:0/3283953679 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f374c06a520 con 0x7f374c0cca30 2024-05-09T05:54:23.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.947+0000 7f37427fc640 1 -- 172.21.15.72:0/3283953679 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f373c0b4840 con 0x7f374c0cca30 2024-05-09T05:54:23.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.947+0000 7f37427fc640 1 --2- 172.21.15.72:0/3283953679 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f373006f430 0x7f3730071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:23.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.947+0000 7f37427fc640 1 -- 172.21.15.72:0/3283953679 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f373c128ab0 con 0x7f374c0cca30 2024-05-09T05:54:23.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.947+0000 7f3751f17640 1 --2- 172.21.15.72:0/3283953679 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f373006f430 0x7f3730071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:23.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.947+0000 7f3751f17640 1 --2- 172.21.15.72:0/3283953679 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f373006f430 0x7f3730071940 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f374800b930 tx=0x7f3748008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:23.943 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:23.951+0000 7f37427fc640 1 -- 172.21.15.72:0/3283953679 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f374c0cda30 con 0x7f374c0cca30 2024-05-09T05:54:24.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.099+0000 7f375417b640 1 -- 172.21.15.72:0/3283953679 --> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f374c0cdcb0 con 0x7f373006f430 2024-05-09T05:54:24.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.123+0000 7f37427fc640 1 -- 172.21.15.72:0/3283953679 <== mgr.4102 v2:172.21.15.110:6832/1113420672 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332684 (secure 0 0 0) 0x7f374c0cdcb0 con 0x7f373006f430 2024-05-09T05:54:24.116 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:54:24.118 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2024-05-09T05:54:24.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.127+0000 7f375417b640 1 -- 172.21.15.72:0/3283953679 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f373006f430 msgr2=0x7f3730071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:24.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.127+0000 7f375417b640 1 --2- 172.21.15.72:0/3283953679 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f373006f430 0x7f3730071940 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f374800b930 tx=0x7f3748008040 comp rx=0 tx=0).stop 2024-05-09T05:54:24.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.127+0000 7f375417b640 1 -- 172.21.15.72:0/3283953679 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f374c0cca30 msgr2=0x7f374c14a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:24.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.127+0000 7f375417b640 1 --2- 172.21.15.72:0/3283953679 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f374c0cca30 0x7f374c14a8c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f373c0ae040 tx=0x7f373c0190e0 comp rx=0 tx=0).stop 2024-05-09T05:54:24.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.127+0000 7f375417b640 1 -- 172.21.15.72:0/3283953679 shutdown_connections 2024-05-09T05:54:24.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.127+0000 7f375417b640 1 --2- 172.21.15.72:0/3283953679 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f373006f430 0x7f3730071940 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:24.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.127+0000 7f375417b640 1 --2- 172.21.15.72:0/3283953679 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f374c156b50 0x7f374c0ca580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:24.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.127+0000 7f375417b640 1 --2- 172.21.15.72:0/3283953679 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f374c0cca30 0x7f374c14a8c0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:24.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.127+0000 7f375417b640 1 --2- 172.21.15.72:0/3283953679 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f374c074410 0x7f374c14e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:24.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.127+0000 7f375417b640 1 -- 172.21.15.72:0/3283953679 >> 172.21.15.72:0/3283953679 conn(0x7f374c0d1b70 msgr2=0x7f374c0cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:24.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.127+0000 7f375417b640 1 -- 172.21.15.72:0/3283953679 shutdown_connections 2024-05-09T05:54:24.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.127+0000 7f375417b640 1 -- 172.21.15.72:0/3283953679 wait complete. 2024-05-09T05:54:24.137 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2024-05-09T05:54:22.486196+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":602396,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":316,"num_write_kb":1701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":261,"ondisk_log_size":261,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236392,"kb_used_data":3624,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738328,"statfs":{"total":773094113280,"available":772852047872,"internally_reserved":0,"allocated":3710976,"data_stored":2127847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3170,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005666"},"pg_stats":[{"pgid":"2.1f","version":"27'13","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:10.963308+0000","last_change":"2024-05-09T05:53:23.121824+0000","last_active":"2024-05-09T05:54:10.963308+0000","last_peered":"2024-05-09T05:54:10.963308+0000","last_clean":"2024-05-09T05:54:10.963308+0000","last_became_active":"2024-05-09T05:53:23.121097+0000","last_became_peered":"2024-05-09T05:53:23.121097+0000","last_unstale":"2024-05-09T05:54:10.963308+0000","last_undegraded":"2024-05-09T05:54:10.963308+0000","last_fullsized":"2024-05-09T05:54:10.963308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:50:51.880238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.962614+0000","last_change":"2024-05-09T05:53:24.146985+0000","last_active":"2024-05-09T05:54:05.962614+0000","last_peered":"2024-05-09T05:54:05.962614+0000","last_clean":"2024-05-09T05:54:05.962614+0000","last_became_active":"2024-05-09T05:53:24.146540+0000","last_became_peered":"2024-05-09T05:53:24.146540+0000","last_unstale":"2024-05-09T05:54:05.962614+0000","last_undegraded":"2024-05-09T05:54:05.962614+0000","last_fullsized":"2024-05-09T05:54:05.962614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:02:29.318131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.640920+0000","last_change":"2024-05-09T05:53:28.236386+0000","last_active":"2024-05-09T05:54:06.640920+0000","last_peered":"2024-05-09T05:54:06.640920+0000","last_clean":"2024-05-09T05:54:06.640920+0000","last_became_active":"2024-05-09T05:53:28.235305+0000","last_became_peered":"2024-05-09T05:53:28.235305+0000","last_unstale":"2024-05-09T05:54:06.640920+0000","last_undegraded":"2024-05-09T05:54:06.640920+0000","last_fullsized":"2024-05-09T05:54:06.640920+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:57:57.134819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"25'2","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.962769+0000","last_change":"2024-05-09T05:53:23.139000+0000","last_active":"2024-05-09T05:54:05.962769+0000","last_peered":"2024-05-09T05:54:05.962769+0000","last_clean":"2024-05-09T05:54:05.962769+0000","last_became_active":"2024-05-09T05:53:23.138431+0000","last_became_peered":"2024-05-09T05:53:23.138431+0000","last_unstale":"2024-05-09T05:54:05.962769+0000","last_undegraded":"2024-05-09T05:54:05.962769+0000","last_fullsized":"2024-05-09T05:54:05.962769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:33:56.977263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.962858+0000","last_change":"2024-05-09T05:53:24.151811+0000","last_active":"2024-05-09T05:54:05.962858+0000","last_peered":"2024-05-09T05:54:05.962858+0000","last_clean":"2024-05-09T05:54:05.962858+0000","last_became_active":"2024-05-09T05:53:24.151407+0000","last_became_peered":"2024-05-09T05:53:24.151407+0000","last_unstale":"2024-05-09T05:54:05.962858+0000","last_undegraded":"2024-05-09T05:54:05.962858+0000","last_fullsized":"2024-05-09T05:54:05.962858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:54:17.819787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.913373+0000","last_change":"2024-05-09T05:53:28.213485+0000","last_active":"2024-05-09T05:54:06.913373+0000","last_peered":"2024-05-09T05:54:06.913373+0000","last_clean":"2024-05-09T05:54:06.913373+0000","last_became_active":"2024-05-09T05:53:28.213021+0000","last_became_peered":"2024-05-09T05:53:28.213021+0000","last_unstale":"2024-05-09T05:54:06.913373+0000","last_undegraded":"2024-05-09T05:54:06.913373+0000","last_fullsized":"2024-05-09T05:54:06.913373+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:58:22.493166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"27'12","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:10.967793+0000","last_change":"2024-05-09T05:53:23.095209+0000","last_active":"2024-05-09T05:54:10.967793+0000","last_peered":"2024-05-09T05:54:10.967793+0000","last_clean":"2024-05-09T05:54:10.967793+0000","last_became_active":"2024-05-09T05:53:23.094826+0000","last_became_peered":"2024-05-09T05:53:23.094826+0000","last_unstale":"2024-05-09T05:54:10.967793+0000","last_undegraded":"2024-05-09T05:54:10.967793+0000","last_fullsized":"2024-05-09T05:54:10.967793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:38:47.390311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.954377+0000","last_change":"2024-05-09T05:53:24.135281+0000","last_active":"2024-05-09T05:54:05.954377+0000","last_peered":"2024-05-09T05:54:05.954377+0000","last_clean":"2024-05-09T05:54:05.954377+0000","last_became_active":"2024-05-09T05:53:24.134610+0000","last_became_peered":"2024-05-09T05:53:24.134610+0000","last_unstale":"2024-05-09T05:54:05.954377+0000","last_undegraded":"2024-05-09T05:54:05.954377+0000","last_fullsized":"2024-05-09T05:54:05.954377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:28:03.947961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.913678+0000","last_change":"2024-05-09T05:53:28.205763+0000","last_active":"2024-05-09T05:54:06.913678+0000","last_peered":"2024-05-09T05:54:06.913678+0000","last_clean":"2024-05-09T05:54:06.913678+0000","last_became_active":"2024-05-09T05:53:28.205229+0000","last_became_peered":"2024-05-09T05:53:28.205229+0000","last_unstale":"2024-05-09T05:54:06.913678+0000","last_undegraded":"2024-05-09T05:54:06.913678+0000","last_fullsized":"2024-05-09T05:54:06.913678+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:38:51.267769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"27'5","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:10.966670+0000","last_change":"2024-05-09T05:53:23.097616+0000","last_active":"2024-05-09T05:54:10.966670+0000","last_peered":"2024-05-09T05:54:10.966670+0000","last_clean":"2024-05-09T05:54:10.966670+0000","last_became_active":"2024-05-09T05:53:23.094760+0000","last_became_peered":"2024-05-09T05:53:23.094760+0000","last_unstale":"2024-05-09T05:54:10.966670+0000","last_undegraded":"2024-05-09T05:54:10.966670+0000","last_fullsized":"2024-05-09T05:54:10.966670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:21:32.558852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.964196+0000","last_change":"2024-05-09T05:53:24.139467+0000","last_active":"2024-05-09T05:54:05.964196+0000","last_peered":"2024-05-09T05:54:05.964196+0000","last_clean":"2024-05-09T05:54:05.964196+0000","last_became_active":"2024-05-09T05:53:24.139109+0000","last_became_peered":"2024-05-09T05:53:24.139109+0000","last_unstale":"2024-05-09T05:54:05.964196+0000","last_undegraded":"2024-05-09T05:54:05.964196+0000","last_fullsized":"2024-05-09T05:54:05.964196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:36.783615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.913569+0000","last_change":"2024-05-09T05:53:28.216127+0000","last_active":"2024-05-09T05:54:06.913569+0000","last_peered":"2024-05-09T05:54:06.913569+0000","last_clean":"2024-05-09T05:54:06.913569+0000","last_became_active":"2024-05-09T05:53:28.215482+0000","last_became_peered":"2024-05-09T05:53:28.215482+0000","last_unstale":"2024-05-09T05:54:06.913569+0000","last_undegraded":"2024-05-09T05:54:06.913569+0000","last_fullsized":"2024-05-09T05:54:06.913569+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:48:58.387701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.963569+0000","last_change":"2024-05-09T05:53:24.132483+0000","last_active":"2024-05-09T05:54:05.963569+0000","last_peered":"2024-05-09T05:54:05.963569+0000","last_clean":"2024-05-09T05:54:05.963569+0000","last_became_active":"2024-05-09T05:53:24.132118+0000","last_became_peered":"2024-05-09T05:53:24.132118+0000","last_unstale":"2024-05-09T05:54:05.963569+0000","last_undegraded":"2024-05-09T05:54:05.963569+0000","last_fullsized":"2024-05-09T05:54:05.963569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:06:01.787707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"25'4","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.963718+0000","last_change":"2024-05-09T05:53:23.117460+0000","last_active":"2024-05-09T05:54:05.963718+0000","last_peered":"2024-05-09T05:54:05.963718+0000","last_clean":"2024-05-09T05:54:05.963718+0000","last_became_active":"2024-05-09T05:53:23.114179+0000","last_became_peered":"2024-05-09T05:53:23.114179+0000","last_unstale":"2024-05-09T05:54:05.963718+0000","last_undegraded":"2024-05-09T05:54:05.963718+0000","last_fullsized":"2024-05-09T05:54:05.963718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:44:01.784905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.963442+0000","last_change":"2024-05-09T05:53:28.227135+0000","last_active":"2024-05-09T05:54:05.963442+0000","last_peered":"2024-05-09T05:54:05.963442+0000","last_clean":"2024-05-09T05:54:05.963442+0000","last_became_active":"2024-05-09T05:53:28.226427+0000","last_became_peered":"2024-05-09T05:53:28.226427+0000","last_unstale":"2024-05-09T05:54:05.963442+0000","last_undegraded":"2024-05-09T05:54:05.963442+0000","last_fullsized":"2024-05-09T05:54:05.963442+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:37:04.413804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.642097+0000","last_change":"2024-05-09T05:53:24.135982+0000","last_active":"2024-05-09T05:54:06.642097+0000","last_peered":"2024-05-09T05:54:06.642097+0000","last_clean":"2024-05-09T05:54:06.642097+0000","last_became_active":"2024-05-09T05:53:24.135580+0000","last_became_peered":"2024-05-09T05:53:24.135580+0000","last_unstale":"2024-05-09T05:54:06.642097+0000","last_undegraded":"2024-05-09T05:54:06.642097+0000","last_fullsized":"2024-05-09T05:54:06.642097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:03:04.589608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"27'3","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.957635+0000","last_change":"2024-05-09T05:53:23.142679+0000","last_active":"2024-05-09T05:54:05.957635+0000","last_peered":"2024-05-09T05:54:05.957635+0000","last_clean":"2024-05-09T05:54:05.957635+0000","last_became_active":"2024-05-09T05:53:23.142018+0000","last_became_peered":"2024-05-09T05:53:23.142018+0000","last_unstale":"2024-05-09T05:54:05.957635+0000","last_undegraded":"2024-05-09T05:54:05.957635+0000","last_fullsized":"2024-05-09T05:54:05.957635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:08:29.312049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.918021+0000","last_change":"2024-05-09T05:53:28.214167+0000","last_active":"2024-05-09T05:54:06.918021+0000","last_peered":"2024-05-09T05:54:06.918021+0000","last_clean":"2024-05-09T05:54:06.918021+0000","last_became_active":"2024-05-09T05:53:28.213623+0000","last_became_peered":"2024-05-09T05:53:28.213623+0000","last_unstale":"2024-05-09T05:54:06.918021+0000","last_undegraded":"2024-05-09T05:54:06.918021+0000","last_fullsized":"2024-05-09T05:54:06.918021+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:53:53.976485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.955036+0000","last_change":"2024-05-09T05:53:24.130342+0000","last_active":"2024-05-09T05:54:05.955036+0000","last_peered":"2024-05-09T05:54:05.955036+0000","last_clean":"2024-05-09T05:54:05.955036+0000","last_became_active":"2024-05-09T05:53:24.129938+0000","last_became_peered":"2024-05-09T05:53:24.129938+0000","last_unstale":"2024-05-09T05:54:05.955036+0000","last_undegraded":"2024-05-09T05:54:05.955036+0000","last_fullsized":"2024-05-09T05:54:05.955036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:58:13.879633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"27'7","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:10.962692+0000","last_change":"2024-05-09T05:53:23.111169+0000","last_active":"2024-05-09T05:54:10.962692+0000","last_peered":"2024-05-09T05:54:10.962692+0000","last_clean":"2024-05-09T05:54:10.962692+0000","last_became_active":"2024-05-09T05:53:23.110140+0000","last_became_peered":"2024-05-09T05:53:23.110140+0000","last_unstale":"2024-05-09T05:54:10.962692+0000","last_undegraded":"2024-05-09T05:54:10.962692+0000","last_fullsized":"2024-05-09T05:54:10.962692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:18:55.367553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.642541+0000","last_change":"2024-05-09T05:53:28.233648+0000","last_active":"2024-05-09T05:54:06.642541+0000","last_peered":"2024-05-09T05:54:06.642541+0000","last_clean":"2024-05-09T05:54:06.642541+0000","last_became_active":"2024-05-09T05:53:28.227087+0000","last_became_peered":"2024-05-09T05:53:28.227087+0000","last_unstale":"2024-05-09T05:54:06.642541+0000","last_undegraded":"2024-05-09T05:54:06.642541+0000","last_fullsized":"2024-05-09T05:54:06.642541+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:03:49.709580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.963334+0000","last_change":"2024-05-09T05:53:24.147343+0000","last_active":"2024-05-09T05:54:05.963334+0000","last_peered":"2024-05-09T05:54:05.963334+0000","last_clean":"2024-05-09T05:54:05.963334+0000","last_became_active":"2024-05-09T05:53:24.144596+0000","last_became_peered":"2024-05-09T05:53:24.144596+0000","last_unstale":"2024-05-09T05:54:05.963334+0000","last_undegraded":"2024-05-09T05:54:05.963334+0000","last_fullsized":"2024-05-09T05:54:05.963334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:52:43.052055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"25'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.914631+0000","last_change":"2024-05-09T05:53:23.102976+0000","last_active":"2024-05-09T05:54:06.914631+0000","last_peered":"2024-05-09T05:54:06.914631+0000","last_clean":"2024-05-09T05:54:06.914631+0000","last_became_active":"2024-05-09T05:53:23.102420+0000","last_became_peered":"2024-05-09T05:53:23.102420+0000","last_unstale":"2024-05-09T05:54:06.914631+0000","last_undegraded":"2024-05-09T05:54:06.914631+0000","last_fullsized":"2024-05-09T05:54:06.914631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:45:11.479140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.915193+0000","last_change":"2024-05-09T05:53:28.195537+0000","last_active":"2024-05-09T05:54:06.915193+0000","last_peered":"2024-05-09T05:54:06.915193+0000","last_clean":"2024-05-09T05:54:06.915193+0000","last_became_active":"2024-05-09T05:53:28.194915+0000","last_became_peered":"2024-05-09T05:53:28.194915+0000","last_unstale":"2024-05-09T05:54:06.915193+0000","last_undegraded":"2024-05-09T05:54:06.915193+0000","last_fullsized":"2024-05-09T05:54:06.915193+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:07.554137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.954896+0000","last_change":"2024-05-09T05:53:24.130312+0000","last_active":"2024-05-09T05:54:05.954896+0000","last_peered":"2024-05-09T05:54:05.954896+0000","last_clean":"2024-05-09T05:54:05.954896+0000","last_became_active":"2024-05-09T05:53:24.129953+0000","last_became_peered":"2024-05-09T05:53:24.129953+0000","last_unstale":"2024-05-09T05:54:05.954896+0000","last_undegraded":"2024-05-09T05:54:05.954896+0000","last_fullsized":"2024-05-09T05:54:05.954896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:07:09.368521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"27'7","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:10.966957+0000","last_change":"2024-05-09T05:53:23.127219+0000","last_active":"2024-05-09T05:54:10.966957+0000","last_peered":"2024-05-09T05:54:10.966957+0000","last_clean":"2024-05-09T05:54:10.966957+0000","last_became_active":"2024-05-09T05:53:23.126691+0000","last_became_peered":"2024-05-09T05:53:23.126691+0000","last_unstale":"2024-05-09T05:54:10.966957+0000","last_undegraded":"2024-05-09T05:54:10.966957+0000","last_fullsized":"2024-05-09T05:54:10.966957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:17:26.711941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.915158+0000","last_change":"2024-05-09T05:53:28.191045+0000","last_active":"2024-05-09T05:54:06.915158+0000","last_peered":"2024-05-09T05:54:06.915158+0000","last_clean":"2024-05-09T05:54:06.915158+0000","last_became_active":"2024-05-09T05:53:28.190564+0000","last_became_peered":"2024-05-09T05:53:28.190564+0000","last_unstale":"2024-05-09T05:54:06.915158+0000","last_undegraded":"2024-05-09T05:54:06.915158+0000","last_fullsized":"2024-05-09T05:54:06.915158+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:53:30.541681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.958140+0000","last_change":"2024-05-09T05:53:24.138682+0000","last_active":"2024-05-09T05:54:05.958140+0000","last_peered":"2024-05-09T05:54:05.958140+0000","last_clean":"2024-05-09T05:54:05.958140+0000","last_became_active":"2024-05-09T05:53:24.138417+0000","last_became_peered":"2024-05-09T05:53:24.138417+0000","last_unstale":"2024-05-09T05:54:05.958140+0000","last_undegraded":"2024-05-09T05:54:05.958140+0000","last_fullsized":"2024-05-09T05:54:05.958140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:57:55.403156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"26'7","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.955516+0000","last_change":"2024-05-09T05:53:23.102986+0000","last_active":"2024-05-09T05:54:05.955516+0000","last_peered":"2024-05-09T05:54:05.955516+0000","last_clean":"2024-05-09T05:54:05.955516+0000","last_became_active":"2024-05-09T05:53:23.102020+0000","last_became_peered":"2024-05-09T05:53:23.102020+0000","last_unstale":"2024-05-09T05:54:05.955516+0000","last_undegraded":"2024-05-09T05:54:05.955516+0000","last_fullsized":"2024-05-09T05:54:05.955516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:18:11.582575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.954659+0000","last_change":"2024-05-09T05:53:28.218326+0000","last_active":"2024-05-09T05:54:05.954659+0000","last_peered":"2024-05-09T05:54:05.954659+0000","last_clean":"2024-05-09T05:54:05.954659+0000","last_became_active":"2024-05-09T05:53:28.216634+0000","last_became_peered":"2024-05-09T05:53:28.216634+0000","last_unstale":"2024-05-09T05:54:05.954659+0000","last_undegraded":"2024-05-09T05:54:05.954659+0000","last_fullsized":"2024-05-09T05:54:05.954659+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:13:05.321932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.958917+0000","last_change":"2024-05-09T05:53:24.143161+0000","last_active":"2024-05-09T05:54:05.958917+0000","last_peered":"2024-05-09T05:54:05.958917+0000","last_clean":"2024-05-09T05:54:05.958917+0000","last_became_active":"2024-05-09T05:53:24.139369+0000","last_became_peered":"2024-05-09T05:53:24.139369+0000","last_unstale":"2024-05-09T05:54:05.958917+0000","last_undegraded":"2024-05-09T05:54:05.958917+0000","last_fullsized":"2024-05-09T05:54:05.958917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:25:21.472460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"27'4","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.964751+0000","last_change":"2024-05-09T05:53:23.123560+0000","last_active":"2024-05-09T05:54:05.964751+0000","last_peered":"2024-05-09T05:54:05.964751+0000","last_clean":"2024-05-09T05:54:05.964751+0000","last_became_active":"2024-05-09T05:53:23.123081+0000","last_became_peered":"2024-05-09T05:53:23.123081+0000","last_unstale":"2024-05-09T05:54:05.964751+0000","last_undegraded":"2024-05-09T05:54:05.964751+0000","last_fullsized":"2024-05-09T05:54:05.964751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:15:31.371756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.956026+0000","last_change":"2024-05-09T05:53:28.229352+0000","last_active":"2024-05-09T05:54:05.956026+0000","last_peered":"2024-05-09T05:54:05.956026+0000","last_clean":"2024-05-09T05:54:05.956026+0000","last_became_active":"2024-05-09T05:53:28.225810+0000","last_became_peered":"2024-05-09T05:53:28.225810+0000","last_unstale":"2024-05-09T05:54:05.956026+0000","last_undegraded":"2024-05-09T05:54:05.956026+0000","last_fullsized":"2024-05-09T05:54:05.956026+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:17:07.192105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.914920+0000","last_change":"2024-05-09T05:53:24.130533+0000","last_active":"2024-05-09T05:54:06.914920+0000","last_peered":"2024-05-09T05:54:06.914920+0000","last_clean":"2024-05-09T05:54:06.914920+0000","last_became_active":"2024-05-09T05:53:24.129787+0000","last_became_peered":"2024-05-09T05:53:24.129787+0000","last_unstale":"2024-05-09T05:54:06.914920+0000","last_undegraded":"2024-05-09T05:54:06.914920+0000","last_fullsized":"2024-05-09T05:54:06.914920+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:37:36.036271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"26'1","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.961428+0000","last_change":"2024-05-09T05:53:23.134379+0000","last_active":"2024-05-09T05:54:05.961428+0000","last_peered":"2024-05-09T05:54:05.961428+0000","last_clean":"2024-05-09T05:54:05.961428+0000","last_became_active":"2024-05-09T05:53:23.133587+0000","last_became_peered":"2024-05-09T05:53:23.133587+0000","last_unstale":"2024-05-09T05:54:05.961428+0000","last_undegraded":"2024-05-09T05:54:05.961428+0000","last_fullsized":"2024-05-09T05:54:05.961428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:00:33.973787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.956964+0000","last_change":"2024-05-09T05:53:28.233620+0000","last_active":"2024-05-09T05:54:05.956964+0000","last_peered":"2024-05-09T05:54:05.956964+0000","last_clean":"2024-05-09T05:54:05.956964+0000","last_became_active":"2024-05-09T05:53:28.232539+0000","last_became_peered":"2024-05-09T05:53:28.232539+0000","last_unstale":"2024-05-09T05:54:05.956964+0000","last_undegraded":"2024-05-09T05:54:05.956964+0000","last_fullsized":"2024-05-09T05:54:05.956964+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:13.789448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.918199+0000","last_change":"2024-05-09T05:53:24.132702+0000","last_active":"2024-05-09T05:54:06.918199+0000","last_peered":"2024-05-09T05:54:06.918199+0000","last_clean":"2024-05-09T05:54:06.918199+0000","last_became_active":"2024-05-09T05:53:24.132309+0000","last_became_peered":"2024-05-09T05:53:24.132309+0000","last_unstale":"2024-05-09T05:54:06.918199+0000","last_undegraded":"2024-05-09T05:54:06.918199+0000","last_fullsized":"2024-05-09T05:54:06.918199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:53:13.592038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"27'5","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:10.963975+0000","last_change":"2024-05-09T05:53:23.120384+0000","last_active":"2024-05-09T05:54:10.963975+0000","last_peered":"2024-05-09T05:54:10.963975+0000","last_clean":"2024-05-09T05:54:10.963975+0000","last_became_active":"2024-05-09T05:53:23.118321+0000","last_became_peered":"2024-05-09T05:53:23.118321+0000","last_unstale":"2024-05-09T05:54:10.963975+0000","last_undegraded":"2024-05-09T05:54:10.963975+0000","last_fullsized":"2024-05-09T05:54:10.963975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:15:51.297111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.956427+0000","last_change":"2024-05-09T05:53:28.208383+0000","last_active":"2024-05-09T05:54:05.956427+0000","last_peered":"2024-05-09T05:54:05.956427+0000","last_clean":"2024-05-09T05:54:05.956427+0000","last_became_active":"2024-05-09T05:53:28.199359+0000","last_became_peered":"2024-05-09T05:53:28.199359+0000","last_unstale":"2024-05-09T05:54:05.956427+0000","last_undegraded":"2024-05-09T05:54:05.956427+0000","last_fullsized":"2024-05-09T05:54:05.956427+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:50:19.715242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.959736+0000","last_change":"2024-05-09T05:53:24.142740+0000","last_active":"2024-05-09T05:54:05.959736+0000","last_peered":"2024-05-09T05:54:05.959736+0000","last_clean":"2024-05-09T05:54:05.959736+0000","last_became_active":"2024-05-09T05:53:24.142265+0000","last_became_peered":"2024-05-09T05:53:24.142265+0000","last_unstale":"2024-05-09T05:54:05.959736+0000","last_undegraded":"2024-05-09T05:54:05.959736+0000","last_fullsized":"2024-05-09T05:54:05.959736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:46:53.729151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"27'6","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:10.959088+0000","last_change":"2024-05-09T05:53:23.142455+0000","last_active":"2024-05-09T05:54:10.959088+0000","last_peered":"2024-05-09T05:54:10.959088+0000","last_clean":"2024-05-09T05:54:10.959088+0000","last_became_active":"2024-05-09T05:53:23.141770+0000","last_became_peered":"2024-05-09T05:53:23.141770+0000","last_unstale":"2024-05-09T05:54:10.959088+0000","last_undegraded":"2024-05-09T05:54:10.959088+0000","last_fullsized":"2024-05-09T05:54:10.959088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:30:34.301349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.956600+0000","last_change":"2024-05-09T05:53:28.212176+0000","last_active":"2024-05-09T05:54:05.956600+0000","last_peered":"2024-05-09T05:54:05.956600+0000","last_clean":"2024-05-09T05:54:05.956600+0000","last_became_active":"2024-05-09T05:53:28.210981+0000","last_became_peered":"2024-05-09T05:53:28.210981+0000","last_unstale":"2024-05-09T05:54:05.956600+0000","last_undegraded":"2024-05-09T05:54:05.956600+0000","last_fullsized":"2024-05-09T05:54:05.956600+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:17:24.122805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.955894+0000","last_change":"2024-05-09T05:53:24.132887+0000","last_active":"2024-05-09T05:54:05.955894+0000","last_peered":"2024-05-09T05:54:05.955894+0000","last_clean":"2024-05-09T05:54:05.955894+0000","last_became_active":"2024-05-09T05:53:24.132398+0000","last_became_peered":"2024-05-09T05:53:24.132398+0000","last_unstale":"2024-05-09T05:54:05.955894+0000","last_undegraded":"2024-05-09T05:54:05.955894+0000","last_fullsized":"2024-05-09T05:54:05.955894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:36:49.369162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"27'4","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.963466+0000","last_change":"2024-05-09T05:53:23.126202+0000","last_active":"2024-05-09T05:54:05.963466+0000","last_peered":"2024-05-09T05:54:05.963466+0000","last_clean":"2024-05-09T05:54:05.963466+0000","last_became_active":"2024-05-09T05:53:23.125799+0000","last_became_peered":"2024-05-09T05:53:23.125799+0000","last_unstale":"2024-05-09T05:54:05.963466+0000","last_undegraded":"2024-05-09T05:54:05.963466+0000","last_fullsized":"2024-05-09T05:54:05.963466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:33:12.831705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.916943+0000","last_change":"2024-05-09T05:54:06.916943+0000","last_active":"2024-05-09T05:54:06.916943+0000","last_peered":"2024-05-09T05:54:06.916943+0000","last_clean":"2024-05-09T05:54:06.916943+0000","last_became_active":"2024-05-09T05:54:06.915734+0000","last_became_peered":"2024-05-09T05:54:06.915734+0000","last_unstale":"2024-05-09T05:54:06.916943+0000","last_undegraded":"2024-05-09T05:54:06.916943+0000","last_fullsized":"2024-05-09T05:54:06.916943+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:59:44.265794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,6,1],"acting":[5,0,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.954791+0000","last_change":"2024-05-09T05:53:24.139586+0000","last_active":"2024-05-09T05:54:05.954791+0000","last_peered":"2024-05-09T05:54:05.954791+0000","last_clean":"2024-05-09T05:54:05.954791+0000","last_became_active":"2024-05-09T05:53:24.138835+0000","last_became_peered":"2024-05-09T05:53:24.138835+0000","last_unstale":"2024-05-09T05:54:05.954791+0000","last_undegraded":"2024-05-09T05:54:05.954791+0000","last_fullsized":"2024-05-09T05:54:05.954791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:37:13.012588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"27'6","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.963964+0000","last_change":"2024-05-09T05:53:23.117121+0000","last_active":"2024-05-09T05:54:05.963964+0000","last_peered":"2024-05-09T05:54:05.963964+0000","last_clean":"2024-05-09T05:54:05.963964+0000","last_became_active":"2024-05-09T05:53:23.113294+0000","last_became_peered":"2024-05-09T05:53:23.113294+0000","last_unstale":"2024-05-09T05:54:05.963964+0000","last_undegraded":"2024-05-09T05:54:05.963964+0000","last_fullsized":"2024-05-09T05:54:05.963964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:53:41.591371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":121,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.953773+0000","last_change":"2024-05-09T05:53:12.484358+0000","last_active":"2024-05-09T05:54:05.953773+0000","last_peered":"2024-05-09T05:54:05.953773+0000","last_clean":"2024-05-09T05:54:05.953773+0000","last_became_active":"2024-05-09T05:53:12.481529+0000","last_became_peered":"2024-05-09T05:53:12.481529+0000","last_unstale":"2024-05-09T05:54:05.953773+0000","last_undegraded":"2024-05-09T05:54:05.953773+0000","last_fullsized":"2024-05-09T05:54:05.953773+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:10.902489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:10.902489+0000","last_clean_scrub_stamp":"2024-05-09T05:53:10.902489+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:28:50.650299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.964356+0000","last_change":"2024-05-09T05:53:28.190861+0000","last_active":"2024-05-09T05:54:05.964356+0000","last_peered":"2024-05-09T05:54:05.964356+0000","last_clean":"2024-05-09T05:54:05.964356+0000","last_became_active":"2024-05-09T05:53:28.190393+0000","last_became_peered":"2024-05-09T05:53:28.190393+0000","last_unstale":"2024-05-09T05:54:05.964356+0000","last_undegraded":"2024-05-09T05:54:05.964356+0000","last_fullsized":"2024-05-09T05:54:05.964356+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:05:37.653010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.964283+0000","last_change":"2024-05-09T05:53:24.143283+0000","last_active":"2024-05-09T05:54:05.964283+0000","last_peered":"2024-05-09T05:54:05.964283+0000","last_clean":"2024-05-09T05:54:05.964283+0000","last_became_active":"2024-05-09T05:53:24.139813+0000","last_became_peered":"2024-05-09T05:53:24.139813+0000","last_unstale":"2024-05-09T05:54:05.964283+0000","last_undegraded":"2024-05-09T05:54:05.964283+0000","last_fullsized":"2024-05-09T05:54:05.964283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:07:38.471778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"27'6","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.958661+0000","last_change":"2024-05-09T05:53:23.115534+0000","last_active":"2024-05-09T05:54:05.958661+0000","last_peered":"2024-05-09T05:54:05.958661+0000","last_clean":"2024-05-09T05:54:05.958661+0000","last_became_active":"2024-05-09T05:53:23.112260+0000","last_became_peered":"2024-05-09T05:53:23.112260+0000","last_unstale":"2024-05-09T05:54:05.958661+0000","last_undegraded":"2024-05-09T05:54:05.958661+0000","last_fullsized":"2024-05-09T05:54:05.958661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:46:53.520691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1611,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.913778+0000","last_change":"2024-05-09T05:53:28.195687+0000","last_active":"2024-05-09T05:54:06.913778+0000","last_peered":"2024-05-09T05:54:06.913778+0000","last_clean":"2024-05-09T05:54:06.913778+0000","last_became_active":"2024-05-09T05:53:28.195082+0000","last_became_peered":"2024-05-09T05:53:28.195082+0000","last_unstale":"2024-05-09T05:54:06.913778+0000","last_undegraded":"2024-05-09T05:54:06.913778+0000","last_fullsized":"2024-05-09T05:54:06.913778+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:45:56.633547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.917432+0000","last_change":"2024-05-09T05:53:24.130460+0000","last_active":"2024-05-09T05:54:06.917432+0000","last_peered":"2024-05-09T05:54:06.917432+0000","last_clean":"2024-05-09T05:54:06.917432+0000","last_became_active":"2024-05-09T05:53:24.129808+0000","last_became_peered":"2024-05-09T05:53:24.129808+0000","last_unstale":"2024-05-09T05:54:06.917432+0000","last_undegraded":"2024-05-09T05:54:06.917432+0000","last_fullsized":"2024-05-09T05:54:06.917432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:36:04.881676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"27'3","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.962373+0000","last_change":"2024-05-09T05:53:23.139063+0000","last_active":"2024-05-09T05:54:05.962373+0000","last_peered":"2024-05-09T05:54:05.962373+0000","last_clean":"2024-05-09T05:54:05.962373+0000","last_became_active":"2024-05-09T05:53:23.138303+0000","last_became_peered":"2024-05-09T05:53:23.138303+0000","last_unstale":"2024-05-09T05:54:05.962373+0000","last_undegraded":"2024-05-09T05:54:05.962373+0000","last_fullsized":"2024-05-09T05:54:05.962373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:18:20.172877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.960806+0000","last_change":"2024-05-09T05:53:28.214251+0000","last_active":"2024-05-09T05:54:05.960806+0000","last_peered":"2024-05-09T05:54:05.960806+0000","last_clean":"2024-05-09T05:54:05.960806+0000","last_became_active":"2024-05-09T05:53:28.206229+0000","last_became_peered":"2024-05-09T05:53:28.206229+0000","last_unstale":"2024-05-09T05:54:05.960806+0000","last_undegraded":"2024-05-09T05:54:05.960806+0000","last_fullsized":"2024-05-09T05:54:05.960806+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:12:26.761543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.917899+0000","last_change":"2024-05-09T05:53:24.135578+0000","last_active":"2024-05-09T05:54:06.917899+0000","last_peered":"2024-05-09T05:54:06.917899+0000","last_clean":"2024-05-09T05:54:06.917899+0000","last_became_active":"2024-05-09T05:53:24.135253+0000","last_became_peered":"2024-05-09T05:53:24.135253+0000","last_unstale":"2024-05-09T05:54:06.917899+0000","last_undegraded":"2024-05-09T05:54:06.917899+0000","last_fullsized":"2024-05-09T05:54:06.917899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:20:23.093397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"27'5","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:10.959019+0000","last_change":"2024-05-09T05:53:23.140175+0000","last_active":"2024-05-09T05:54:10.959019+0000","last_peered":"2024-05-09T05:54:10.959019+0000","last_clean":"2024-05-09T05:54:10.959019+0000","last_became_active":"2024-05-09T05:53:23.139516+0000","last_became_peered":"2024-05-09T05:53:23.139516+0000","last_unstale":"2024-05-09T05:54:10.959019+0000","last_undegraded":"2024-05-09T05:54:10.959019+0000","last_fullsized":"2024-05-09T05:54:10.959019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:48:42.473155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.962952+0000","last_change":"2024-05-09T05:53:28.199385+0000","last_active":"2024-05-09T05:54:05.962952+0000","last_peered":"2024-05-09T05:54:05.962952+0000","last_clean":"2024-05-09T05:54:05.962952+0000","last_became_active":"2024-05-09T05:53:28.198825+0000","last_became_peered":"2024-05-09T05:53:28.198825+0000","last_unstale":"2024-05-09T05:54:05.962952+0000","last_undegraded":"2024-05-09T05:54:05.962952+0000","last_fullsized":"2024-05-09T05:54:05.962952+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:48:22.224140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.915450+0000","last_change":"2024-05-09T05:53:24.133293+0000","last_active":"2024-05-09T05:54:06.915450+0000","last_peered":"2024-05-09T05:54:06.915450+0000","last_clean":"2024-05-09T05:54:06.915450+0000","last_became_active":"2024-05-09T05:53:24.131741+0000","last_became_peered":"2024-05-09T05:53:24.131741+0000","last_unstale":"2024-05-09T05:54:06.915450+0000","last_undegraded":"2024-05-09T05:54:06.915450+0000","last_fullsized":"2024-05-09T05:54:06.915450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:01:33.701742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"26'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.918030+0000","last_change":"2024-05-09T05:53:23.112592+0000","last_active":"2024-05-09T05:54:06.918030+0000","last_peered":"2024-05-09T05:54:06.918030+0000","last_clean":"2024-05-09T05:54:06.918030+0000","last_became_active":"2024-05-09T05:53:23.111968+0000","last_became_peered":"2024-05-09T05:53:23.111968+0000","last_unstale":"2024-05-09T05:54:06.918030+0000","last_undegraded":"2024-05-09T05:54:06.918030+0000","last_fullsized":"2024-05-09T05:54:06.918030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:32:54.694588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.953919+0000","last_change":"2024-05-09T05:53:28.227755+0000","last_active":"2024-05-09T05:54:05.953919+0000","last_peered":"2024-05-09T05:54:05.953919+0000","last_clean":"2024-05-09T05:54:05.953919+0000","last_became_active":"2024-05-09T05:53:28.227272+0000","last_became_peered":"2024-05-09T05:53:28.227272+0000","last_unstale":"2024-05-09T05:54:05.953919+0000","last_undegraded":"2024-05-09T05:54:05.953919+0000","last_fullsized":"2024-05-09T05:54:05.953919+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:13:32.020862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.963238+0000","last_change":"2024-05-09T05:53:24.144025+0000","last_active":"2024-05-09T05:54:05.963238+0000","last_peered":"2024-05-09T05:54:05.963238+0000","last_clean":"2024-05-09T05:54:05.963238+0000","last_became_active":"2024-05-09T05:53:24.143540+0000","last_became_peered":"2024-05-09T05:53:24.143540+0000","last_unstale":"2024-05-09T05:54:05.963238+0000","last_undegraded":"2024-05-09T05:54:05.963238+0000","last_fullsized":"2024-05-09T05:54:05.963238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:22:58.062541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"27'17","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.955433+0000","last_change":"2024-05-09T05:53:23.104452+0000","last_active":"2024-05-09T05:54:05.955433+0000","last_peered":"2024-05-09T05:54:05.955433+0000","last_clean":"2024-05-09T05:54:05.955433+0000","last_became_active":"2024-05-09T05:53:23.103471+0000","last_became_peered":"2024-05-09T05:53:23.103471+0000","last_unstale":"2024-05-09T05:54:05.955433+0000","last_undegraded":"2024-05-09T05:54:05.955433+0000","last_fullsized":"2024-05-09T05:54:05.955433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:33:30.508464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.962376+0000","last_change":"2024-05-09T05:53:28.241338+0000","last_active":"2024-05-09T05:54:05.962376+0000","last_peered":"2024-05-09T05:54:05.962376+0000","last_clean":"2024-05-09T05:54:05.962376+0000","last_became_active":"2024-05-09T05:53:28.239841+0000","last_became_peered":"2024-05-09T05:53:28.239841+0000","last_unstale":"2024-05-09T05:54:05.962376+0000","last_undegraded":"2024-05-09T05:54:05.962376+0000","last_fullsized":"2024-05-09T05:54:05.962376+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:44:47.854598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.954501+0000","last_change":"2024-05-09T05:53:24.149958+0000","last_active":"2024-05-09T05:54:05.954501+0000","last_peered":"2024-05-09T05:54:05.954501+0000","last_clean":"2024-05-09T05:54:05.954501+0000","last_became_active":"2024-05-09T05:53:24.149578+0000","last_became_peered":"2024-05-09T05:53:24.149578+0000","last_unstale":"2024-05-09T05:54:05.954501+0000","last_undegraded":"2024-05-09T05:54:05.954501+0000","last_fullsized":"2024-05-09T05:54:05.954501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:27:43.555218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"27'6","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.916143+0000","last_change":"2024-05-09T05:53:23.121266+0000","last_active":"2024-05-09T05:54:06.916143+0000","last_peered":"2024-05-09T05:54:06.916143+0000","last_clean":"2024-05-09T05:54:06.916143+0000","last_became_active":"2024-05-09T05:53:23.120857+0000","last_became_peered":"2024-05-09T05:53:23.120857+0000","last_unstale":"2024-05-09T05:54:06.916143+0000","last_undegraded":"2024-05-09T05:54:06.916143+0000","last_fullsized":"2024-05-09T05:54:06.916143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:03:30.185640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1029,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.962538+0000","last_change":"2024-05-09T05:53:28.240774+0000","last_active":"2024-05-09T05:54:05.962538+0000","last_peered":"2024-05-09T05:54:05.962538+0000","last_clean":"2024-05-09T05:54:05.962538+0000","last_became_active":"2024-05-09T05:53:28.240070+0000","last_became_peered":"2024-05-09T05:53:28.240070+0000","last_unstale":"2024-05-09T05:54:05.962538+0000","last_undegraded":"2024-05-09T05:54:05.962538+0000","last_fullsized":"2024-05-09T05:54:05.962538+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:25:24.019344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.645397+0000","last_change":"2024-05-09T05:54:06.645397+0000","last_active":"2024-05-09T05:54:06.645397+0000","last_peered":"2024-05-09T05:54:06.645397+0000","last_clean":"2024-05-09T05:54:06.645397+0000","last_became_active":"2024-05-09T05:54:06.644437+0000","last_became_peered":"2024-05-09T05:54:06.644437+0000","last_unstale":"2024-05-09T05:54:06.645397+0000","last_undegraded":"2024-05-09T05:54:06.645397+0000","last_fullsized":"2024-05-09T05:54:06.645397+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:41:52.843192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'5","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.963950+0000","last_change":"2024-05-09T05:53:23.120680+0000","last_active":"2024-05-09T05:54:05.963950+0000","last_peered":"2024-05-09T05:54:05.963950+0000","last_clean":"2024-05-09T05:54:05.963950+0000","last_became_active":"2024-05-09T05:53:23.118358+0000","last_became_peered":"2024-05-09T05:53:23.118358+0000","last_unstale":"2024-05-09T05:54:05.963950+0000","last_undegraded":"2024-05-09T05:54:05.963950+0000","last_fullsized":"2024-05-09T05:54:05.963950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:52:52.360128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.956306+0000","last_change":"2024-05-09T05:53:28.222341+0000","last_active":"2024-05-09T05:54:05.956306+0000","last_peered":"2024-05-09T05:54:05.956306+0000","last_clean":"2024-05-09T05:54:05.956306+0000","last_became_active":"2024-05-09T05:53:28.219636+0000","last_became_peered":"2024-05-09T05:53:28.219636+0000","last_unstale":"2024-05-09T05:54:05.956306+0000","last_undegraded":"2024-05-09T05:54:05.956306+0000","last_fullsized":"2024-05-09T05:54:05.956306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:29:03.459851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.957693+0000","last_change":"2024-05-09T05:53:24.143495+0000","last_active":"2024-05-09T05:54:05.957693+0000","last_peered":"2024-05-09T05:54:05.957693+0000","last_clean":"2024-05-09T05:54:05.957693+0000","last_became_active":"2024-05-09T05:53:24.143181+0000","last_became_peered":"2024-05-09T05:53:24.143181+0000","last_unstale":"2024-05-09T05:54:05.957693+0000","last_undegraded":"2024-05-09T05:54:05.957693+0000","last_fullsized":"2024-05-09T05:54:05.957693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:40:20.997659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"27'9","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:10.961271+0000","last_change":"2024-05-09T05:53:23.114815+0000","last_active":"2024-05-09T05:54:10.961271+0000","last_peered":"2024-05-09T05:54:10.961271+0000","last_clean":"2024-05-09T05:54:10.961271+0000","last_became_active":"2024-05-09T05:53:23.113524+0000","last_became_peered":"2024-05-09T05:53:23.113524+0000","last_unstale":"2024-05-09T05:54:10.961271+0000","last_undegraded":"2024-05-09T05:54:10.961271+0000","last_fullsized":"2024-05-09T05:54:10.961271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:35:45.537715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.964093+0000","last_change":"2024-05-09T05:53:28.226682+0000","last_active":"2024-05-09T05:54:05.964093+0000","last_peered":"2024-05-09T05:54:05.964093+0000","last_clean":"2024-05-09T05:54:05.964093+0000","last_became_active":"2024-05-09T05:53:28.226279+0000","last_became_peered":"2024-05-09T05:53:28.226279+0000","last_unstale":"2024-05-09T05:54:05.964093+0000","last_undegraded":"2024-05-09T05:54:05.964093+0000","last_fullsized":"2024-05-09T05:54:05.964093+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:15:55.146695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.916982+0000","last_change":"2024-05-09T05:53:24.135119+0000","last_active":"2024-05-09T05:54:06.916982+0000","last_peered":"2024-05-09T05:54:06.916982+0000","last_clean":"2024-05-09T05:54:06.916982+0000","last_became_active":"2024-05-09T05:53:24.134690+0000","last_became_peered":"2024-05-09T05:53:24.134690+0000","last_unstale":"2024-05-09T05:54:06.916982+0000","last_undegraded":"2024-05-09T05:54:06.916982+0000","last_fullsized":"2024-05-09T05:54:06.916982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:15:36.608441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'15","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:19.278318+0000","last_change":"2024-05-09T05:53:23.119626+0000","last_active":"2024-05-09T05:54:19.278318+0000","last_peered":"2024-05-09T05:54:19.278318+0000","last_clean":"2024-05-09T05:54:19.278318+0000","last_became_active":"2024-05-09T05:53:23.119173+0000","last_became_peered":"2024-05-09T05:53:23.119173+0000","last_unstale":"2024-05-09T05:54:19.278318+0000","last_undegraded":"2024-05-09T05:54:19.278318+0000","last_fullsized":"2024-05-09T05:54:19.278318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:24:03.188897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4283,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.954584+0000","last_change":"2024-05-09T05:53:28.223167+0000","last_active":"2024-05-09T05:54:05.954584+0000","last_peered":"2024-05-09T05:54:05.954584+0000","last_clean":"2024-05-09T05:54:05.954584+0000","last_became_active":"2024-05-09T05:53:28.221846+0000","last_became_peered":"2024-05-09T05:53:28.221846+0000","last_unstale":"2024-05-09T05:54:05.954584+0000","last_undegraded":"2024-05-09T05:54:05.954584+0000","last_fullsized":"2024-05-09T05:54:05.954584+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:47:12.366900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.963707+0000","last_change":"2024-05-09T05:53:24.133007+0000","last_active":"2024-05-09T05:54:05.963707+0000","last_peered":"2024-05-09T05:54:05.963707+0000","last_clean":"2024-05-09T05:54:05.963707+0000","last_became_active":"2024-05-09T05:53:24.132545+0000","last_became_peered":"2024-05-09T05:53:24.132545+0000","last_unstale":"2024-05-09T05:54:05.963707+0000","last_undegraded":"2024-05-09T05:54:05.963707+0000","last_fullsized":"2024-05-09T05:54:05.963707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:10:26.299015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"26'5","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.642545+0000","last_change":"2024-05-09T05:53:23.121124+0000","last_active":"2024-05-09T05:54:06.642545+0000","last_peered":"2024-05-09T05:54:06.642545+0000","last_clean":"2024-05-09T05:54:06.642545+0000","last_became_active":"2024-05-09T05:53:23.120303+0000","last_became_peered":"2024-05-09T05:53:23.120303+0000","last_unstale":"2024-05-09T05:54:06.642545+0000","last_undegraded":"2024-05-09T05:54:06.642545+0000","last_fullsized":"2024-05-09T05:54:06.642545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:36:49.445673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.913982+0000","last_change":"2024-05-09T05:53:28.188712+0000","last_active":"2024-05-09T05:54:06.913982+0000","last_peered":"2024-05-09T05:54:06.913982+0000","last_clean":"2024-05-09T05:54:06.913982+0000","last_became_active":"2024-05-09T05:53:28.184259+0000","last_became_peered":"2024-05-09T05:53:28.184259+0000","last_unstale":"2024-05-09T05:54:06.913982+0000","last_undegraded":"2024-05-09T05:54:06.913982+0000","last_fullsized":"2024-05-09T05:54:06.913982+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:56:39.668106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.963156+0000","last_change":"2024-05-09T05:53:24.146147+0000","last_active":"2024-05-09T05:54:05.963156+0000","last_peered":"2024-05-09T05:54:05.963156+0000","last_clean":"2024-05-09T05:54:05.963156+0000","last_became_active":"2024-05-09T05:53:24.145704+0000","last_became_peered":"2024-05-09T05:53:24.145704+0000","last_unstale":"2024-05-09T05:54:05.963156+0000","last_undegraded":"2024-05-09T05:54:05.963156+0000","last_fullsized":"2024-05-09T05:54:05.963156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:47:03.047479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"27'4","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:10.966228+0000","last_change":"2024-05-09T05:53:23.095689+0000","last_active":"2024-05-09T05:54:10.966228+0000","last_peered":"2024-05-09T05:54:10.966228+0000","last_clean":"2024-05-09T05:54:10.966228+0000","last_became_active":"2024-05-09T05:53:23.094889+0000","last_became_peered":"2024-05-09T05:53:23.094889+0000","last_unstale":"2024-05-09T05:54:10.966228+0000","last_undegraded":"2024-05-09T05:54:10.966228+0000","last_fullsized":"2024-05-09T05:54:10.966228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:25:35.069184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.640733+0000","last_change":"2024-05-09T05:53:28.223954+0000","last_active":"2024-05-09T05:54:06.640733+0000","last_peered":"2024-05-09T05:54:06.640733+0000","last_clean":"2024-05-09T05:54:06.640733+0000","last_became_active":"2024-05-09T05:53:28.222700+0000","last_became_peered":"2024-05-09T05:53:28.222700+0000","last_unstale":"2024-05-09T05:54:06.640733+0000","last_undegraded":"2024-05-09T05:54:06.640733+0000","last_fullsized":"2024-05-09T05:54:06.640733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:17:17.864782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.915376+0000","last_change":"2024-05-09T05:53:24.140698+0000","last_active":"2024-05-09T05:54:06.915376+0000","last_peered":"2024-05-09T05:54:06.915376+0000","last_clean":"2024-05-09T05:54:06.915376+0000","last_became_active":"2024-05-09T05:53:24.139612+0000","last_became_peered":"2024-05-09T05:53:24.139612+0000","last_unstale":"2024-05-09T05:54:06.915376+0000","last_undegraded":"2024-05-09T05:54:06.915376+0000","last_fullsized":"2024-05-09T05:54:06.915376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:09:39.609750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'5","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.955853+0000","last_change":"2024-05-09T05:53:23.106167+0000","last_active":"2024-05-09T05:54:05.955853+0000","last_peered":"2024-05-09T05:54:05.955853+0000","last_clean":"2024-05-09T05:54:05.955853+0000","last_became_active":"2024-05-09T05:53:23.105346+0000","last_became_peered":"2024-05-09T05:53:23.105346+0000","last_unstale":"2024-05-09T05:54:05.955853+0000","last_undegraded":"2024-05-09T05:54:05.955853+0000","last_fullsized":"2024-05-09T05:54:05.955853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:06:46.109056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.955536+0000","last_change":"2024-05-09T05:53:28.194037+0000","last_active":"2024-05-09T05:54:05.955536+0000","last_peered":"2024-05-09T05:54:05.955536+0000","last_clean":"2024-05-09T05:54:05.955536+0000","last_became_active":"2024-05-09T05:53:28.192944+0000","last_became_peered":"2024-05-09T05:53:28.192944+0000","last_unstale":"2024-05-09T05:54:05.955536+0000","last_undegraded":"2024-05-09T05:54:05.955536+0000","last_fullsized":"2024-05-09T05:54:05.955536+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:28:47.664198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.954541+0000","last_change":"2024-05-09T05:53:28.226664+0000","last_active":"2024-05-09T05:54:05.954541+0000","last_peered":"2024-05-09T05:54:05.954541+0000","last_clean":"2024-05-09T05:54:05.954541+0000","last_became_active":"2024-05-09T05:53:28.222225+0000","last_became_peered":"2024-05-09T05:53:28.222225+0000","last_unstale":"2024-05-09T05:54:05.954541+0000","last_undegraded":"2024-05-09T05:54:05.954541+0000","last_fullsized":"2024-05-09T05:54:05.954541+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:24:23.614210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.955804+0000","last_change":"2024-05-09T05:53:24.128343+0000","last_active":"2024-05-09T05:54:05.955804+0000","last_peered":"2024-05-09T05:54:05.955804+0000","last_clean":"2024-05-09T05:54:05.955804+0000","last_became_active":"2024-05-09T05:53:24.127989+0000","last_became_peered":"2024-05-09T05:53:24.127989+0000","last_unstale":"2024-05-09T05:54:05.955804+0000","last_undegraded":"2024-05-09T05:54:05.955804+0000","last_fullsized":"2024-05-09T05:54:05.955804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:56:14.176175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"27'3","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.963317+0000","last_change":"2024-05-09T05:53:23.118882+0000","last_active":"2024-05-09T05:54:05.963317+0000","last_peered":"2024-05-09T05:54:05.963317+0000","last_clean":"2024-05-09T05:54:05.963317+0000","last_became_active":"2024-05-09T05:53:23.118119+0000","last_became_peered":"2024-05-09T05:53:23.118119+0000","last_unstale":"2024-05-09T05:54:05.963317+0000","last_undegraded":"2024-05-09T05:54:05.963317+0000","last_fullsized":"2024-05-09T05:54:05.963317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:06:48.203396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.964343+0000","last_change":"2024-05-09T05:53:28.235313+0000","last_active":"2024-05-09T05:54:05.964343+0000","last_peered":"2024-05-09T05:54:05.964343+0000","last_clean":"2024-05-09T05:54:05.964343+0000","last_became_active":"2024-05-09T05:53:28.234771+0000","last_became_peered":"2024-05-09T05:53:28.234771+0000","last_unstale":"2024-05-09T05:54:05.964343+0000","last_undegraded":"2024-05-09T05:54:05.964343+0000","last_fullsized":"2024-05-09T05:54:05.964343+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:38:46.942863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.959924+0000","last_change":"2024-05-09T05:53:24.141956+0000","last_active":"2024-05-09T05:54:05.959924+0000","last_peered":"2024-05-09T05:54:05.959924+0000","last_clean":"2024-05-09T05:54:05.959924+0000","last_became_active":"2024-05-09T05:53:24.139093+0000","last_became_peered":"2024-05-09T05:53:24.139093+0000","last_unstale":"2024-05-09T05:54:05.959924+0000","last_undegraded":"2024-05-09T05:54:05.959924+0000","last_fullsized":"2024-05-09T05:54:05.959924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:44:32.901168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"27'3","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.956549+0000","last_change":"2024-05-09T05:53:23.113865+0000","last_active":"2024-05-09T05:54:05.956549+0000","last_peered":"2024-05-09T05:54:05.956549+0000","last_clean":"2024-05-09T05:54:05.956549+0000","last_became_active":"2024-05-09T05:53:23.112020+0000","last_became_peered":"2024-05-09T05:53:23.112020+0000","last_unstale":"2024-05-09T05:54:05.956549+0000","last_undegraded":"2024-05-09T05:54:05.956549+0000","last_fullsized":"2024-05-09T05:54:05.956549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:37:04.425229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"26'7","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.963810+0000","last_change":"2024-05-09T05:53:23.127463+0000","last_active":"2024-05-09T05:54:05.963810+0000","last_peered":"2024-05-09T05:54:05.963810+0000","last_clean":"2024-05-09T05:54:05.963810+0000","last_became_active":"2024-05-09T05:53:23.126911+0000","last_became_peered":"2024-05-09T05:53:23.126911+0000","last_unstale":"2024-05-09T05:54:05.963810+0000","last_undegraded":"2024-05-09T05:54:05.963810+0000","last_fullsized":"2024-05-09T05:54:05.963810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:06:28.458926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.954923+0000","last_change":"2024-05-09T05:53:24.134391+0000","last_active":"2024-05-09T05:54:05.954923+0000","last_peered":"2024-05-09T05:54:05.954923+0000","last_clean":"2024-05-09T05:54:05.954923+0000","last_became_active":"2024-05-09T05:53:24.133994+0000","last_became_peered":"2024-05-09T05:53:24.133994+0000","last_unstale":"2024-05-09T05:54:05.954923+0000","last_undegraded":"2024-05-09T05:54:05.954923+0000","last_fullsized":"2024-05-09T05:54:05.954923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:30:32.872657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.955054+0000","last_change":"2024-05-09T05:53:28.223524+0000","last_active":"2024-05-09T05:54:05.955054+0000","last_peered":"2024-05-09T05:54:05.955054+0000","last_clean":"2024-05-09T05:54:05.955054+0000","last_became_active":"2024-05-09T05:53:28.222433+0000","last_became_peered":"2024-05-09T05:53:28.222433+0000","last_unstale":"2024-05-09T05:54:05.955054+0000","last_undegraded":"2024-05-09T05:54:05.955054+0000","last_fullsized":"2024-05-09T05:54:05.955054+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:52:35.361812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"27'6","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.961185+0000","last_change":"2024-05-09T05:53:23.133700+0000","last_active":"2024-05-09T05:54:05.961185+0000","last_peered":"2024-05-09T05:54:05.961185+0000","last_clean":"2024-05-09T05:54:05.961185+0000","last_became_active":"2024-05-09T05:53:23.132946+0000","last_became_peered":"2024-05-09T05:53:23.132946+0000","last_unstale":"2024-05-09T05:54:05.961185+0000","last_undegraded":"2024-05-09T05:54:05.961185+0000","last_fullsized":"2024-05-09T05:54:05.961185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:39:49.829592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1063,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.953860+0000","last_change":"2024-05-09T05:53:24.138174+0000","last_active":"2024-05-09T05:54:05.953860+0000","last_peered":"2024-05-09T05:54:05.953860+0000","last_clean":"2024-05-09T05:54:05.953860+0000","last_became_active":"2024-05-09T05:53:24.137794+0000","last_became_peered":"2024-05-09T05:53:24.137794+0000","last_unstale":"2024-05-09T05:54:05.953860+0000","last_undegraded":"2024-05-09T05:54:05.953860+0000","last_fullsized":"2024-05-09T05:54:05.953860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:57:26.359258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.642109+0000","last_change":"2024-05-09T05:53:28.238375+0000","last_active":"2024-05-09T05:54:06.642109+0000","last_peered":"2024-05-09T05:54:06.642109+0000","last_clean":"2024-05-09T05:54:06.642109+0000","last_became_active":"2024-05-09T05:53:28.237414+0000","last_became_peered":"2024-05-09T05:53:28.237414+0000","last_unstale":"2024-05-09T05:54:06.642109+0000","last_undegraded":"2024-05-09T05:54:06.642109+0000","last_fullsized":"2024-05-09T05:54:06.642109+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:13:50.396951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.913624+0000","last_change":"2024-05-09T05:53:24.130839+0000","last_active":"2024-05-09T05:54:06.913624+0000","last_peered":"2024-05-09T05:54:06.913624+0000","last_clean":"2024-05-09T05:54:06.913624+0000","last_became_active":"2024-05-09T05:53:24.130201+0000","last_became_peered":"2024-05-09T05:53:24.130201+0000","last_unstale":"2024-05-09T05:54:06.913624+0000","last_undegraded":"2024-05-09T05:54:06.913624+0000","last_fullsized":"2024-05-09T05:54:06.913624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:26:03.973553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.641103+0000","last_change":"2024-05-09T05:53:24.138681+0000","last_active":"2024-05-09T05:54:06.641103+0000","last_peered":"2024-05-09T05:54:06.641103+0000","last_clean":"2024-05-09T05:54:06.641103+0000","last_became_active":"2024-05-09T05:53:24.138366+0000","last_became_peered":"2024-05-09T05:53:24.138366+0000","last_unstale":"2024-05-09T05:54:06.641103+0000","last_undegraded":"2024-05-09T05:54:06.641103+0000","last_fullsized":"2024-05-09T05:54:06.641103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:49.856205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.963645+0000","last_change":"2024-05-09T05:53:24.139915+0000","last_active":"2024-05-09T05:54:05.963645+0000","last_peered":"2024-05-09T05:54:05.963645+0000","last_clean":"2024-05-09T05:54:05.963645+0000","last_became_active":"2024-05-09T05:53:24.139058+0000","last_became_peered":"2024-05-09T05:53:24.139058+0000","last_unstale":"2024-05-09T05:54:05.963645+0000","last_undegraded":"2024-05-09T05:54:05.963645+0000","last_fullsized":"2024-05-09T05:54:05.963645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:06:00.768431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.960963+0000","last_change":"2024-05-09T05:53:24.149759+0000","last_active":"2024-05-09T05:54:05.960963+0000","last_peered":"2024-05-09T05:54:05.960963+0000","last_clean":"2024-05-09T05:54:05.960963+0000","last_became_active":"2024-05-09T05:53:24.142812+0000","last_became_peered":"2024-05-09T05:53:24.142812+0000","last_unstale":"2024-05-09T05:54:05.960963+0000","last_undegraded":"2024-05-09T05:54:05.960963+0000","last_fullsized":"2024-05-09T05:54:05.960963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:04.522514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.958194+0000","last_change":"2024-05-09T05:53:24.135373+0000","last_active":"2024-05-09T05:54:05.958194+0000","last_peered":"2024-05-09T05:54:05.958194+0000","last_clean":"2024-05-09T05:54:05.958194+0000","last_became_active":"2024-05-09T05:53:24.135043+0000","last_became_peered":"2024-05-09T05:53:24.135043+0000","last_unstale":"2024-05-09T05:54:05.958194+0000","last_undegraded":"2024-05-09T05:54:05.958194+0000","last_fullsized":"2024-05-09T05:54:05.958194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:20:03.245696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.956646+0000","last_change":"2024-05-09T05:53:24.134712+0000","last_active":"2024-05-09T05:54:05.956646+0000","last_peered":"2024-05-09T05:54:05.956646+0000","last_clean":"2024-05-09T05:54:05.956646+0000","last_became_active":"2024-05-09T05:53:24.132453+0000","last_became_peered":"2024-05-09T05:53:24.132453+0000","last_unstale":"2024-05-09T05:54:05.956646+0000","last_undegraded":"2024-05-09T05:54:05.956646+0000","last_fullsized":"2024-05-09T05:54:05.956646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:47:30.716995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.915325+0000","last_change":"2024-05-09T05:53:24.140714+0000","last_active":"2024-05-09T05:54:06.915325+0000","last_peered":"2024-05-09T05:54:06.915325+0000","last_clean":"2024-05-09T05:54:06.915325+0000","last_became_active":"2024-05-09T05:53:24.140045+0000","last_became_peered":"2024-05-09T05:53:24.140045+0000","last_unstale":"2024-05-09T05:54:06.915325+0000","last_undegraded":"2024-05-09T05:54:06.915325+0000","last_fullsized":"2024-05-09T05:54:06.915325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:36:06.166411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.962249+0000","last_change":"2024-05-09T05:53:24.151591+0000","last_active":"2024-05-09T05:54:05.962249+0000","last_peered":"2024-05-09T05:54:05.962249+0000","last_clean":"2024-05-09T05:54:05.962249+0000","last_became_active":"2024-05-09T05:53:24.151275+0000","last_became_peered":"2024-05-09T05:53:24.151275+0000","last_unstale":"2024-05-09T05:54:05.962249+0000","last_undegraded":"2024-05-09T05:54:05.962249+0000","last_fullsized":"2024-05-09T05:54:05.962249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:28:28.552732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.963146+0000","last_change":"2024-05-09T05:53:24.144315+0000","last_active":"2024-05-09T05:54:05.963146+0000","last_peered":"2024-05-09T05:54:05.963146+0000","last_clean":"2024-05-09T05:54:05.963146+0000","last_became_active":"2024-05-09T05:53:24.144005+0000","last_became_peered":"2024-05-09T05:53:24.144005+0000","last_unstale":"2024-05-09T05:54:05.963146+0000","last_undegraded":"2024-05-09T05:54:05.963146+0000","last_fullsized":"2024-05-09T05:54:05.963146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:06:37.312541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.959800+0000","last_change":"2024-05-09T05:53:24.149852+0000","last_active":"2024-05-09T05:54:05.959800+0000","last_peered":"2024-05-09T05:54:05.959800+0000","last_clean":"2024-05-09T05:54:05.959800+0000","last_became_active":"2024-05-09T05:53:24.146965+0000","last_became_peered":"2024-05-09T05:53:24.146965+0000","last_unstale":"2024-05-09T05:54:05.959800+0000","last_undegraded":"2024-05-09T05:54:05.959800+0000","last_fullsized":"2024-05-09T05:54:05.959800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:02:26.991425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.953846+0000","last_change":"2024-05-09T05:53:24.131735+0000","last_active":"2024-05-09T05:54:05.953846+0000","last_peered":"2024-05-09T05:54:05.953846+0000","last_clean":"2024-05-09T05:54:05.953846+0000","last_became_active":"2024-05-09T05:53:24.131417+0000","last_became_peered":"2024-05-09T05:53:24.131417+0000","last_unstale":"2024-05-09T05:54:05.953846+0000","last_undegraded":"2024-05-09T05:54:05.953846+0000","last_fullsized":"2024-05-09T05:54:05.953846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:59.750972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.954663+0000","last_change":"2024-05-09T05:53:24.140697+0000","last_active":"2024-05-09T05:54:05.954663+0000","last_peered":"2024-05-09T05:54:05.954663+0000","last_clean":"2024-05-09T05:54:05.954663+0000","last_became_active":"2024-05-09T05:53:24.140024+0000","last_became_peered":"2024-05-09T05:53:24.140024+0000","last_unstale":"2024-05-09T05:54:05.954663+0000","last_undegraded":"2024-05-09T05:54:05.954663+0000","last_fullsized":"2024-05-09T05:54:05.954663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:14:14.543827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.917187+0000","last_change":"2024-05-09T05:53:24.136878+0000","last_active":"2024-05-09T05:54:06.917187+0000","last_peered":"2024-05-09T05:54:06.917187+0000","last_clean":"2024-05-09T05:54:06.917187+0000","last_became_active":"2024-05-09T05:53:24.136572+0000","last_became_peered":"2024-05-09T05:53:24.136572+0000","last_unstale":"2024-05-09T05:54:06.917187+0000","last_undegraded":"2024-05-09T05:54:06.917187+0000","last_fullsized":"2024-05-09T05:54:06.917187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:46:47.509355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.964502+0000","last_change":"2024-05-09T05:53:24.147372+0000","last_active":"2024-05-09T05:54:05.964502+0000","last_peered":"2024-05-09T05:54:05.964502+0000","last_clean":"2024-05-09T05:54:05.964502+0000","last_became_active":"2024-05-09T05:53:24.144573+0000","last_became_peered":"2024-05-09T05:53:24.144573+0000","last_unstale":"2024-05-09T05:54:05.964502+0000","last_undegraded":"2024-05-09T05:54:05.964502+0000","last_fullsized":"2024-05-09T05:54:05.964502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:51:09.845748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.643061+0000","last_change":"2024-05-09T05:53:24.135964+0000","last_active":"2024-05-09T05:54:06.643061+0000","last_peered":"2024-05-09T05:54:06.643061+0000","last_clean":"2024-05-09T05:54:06.643061+0000","last_became_active":"2024-05-09T05:53:24.135625+0000","last_became_peered":"2024-05-09T05:53:24.135625+0000","last_unstale":"2024-05-09T05:54:06.643061+0000","last_undegraded":"2024-05-09T05:54:06.643061+0000","last_fullsized":"2024-05-09T05:54:06.643061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:52:02.026146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.964778+0000","last_change":"2024-05-09T05:53:24.133916+0000","last_active":"2024-05-09T05:54:05.964778+0000","last_peered":"2024-05-09T05:54:05.964778+0000","last_clean":"2024-05-09T05:54:05.964778+0000","last_became_active":"2024-05-09T05:53:24.133405+0000","last_became_peered":"2024-05-09T05:53:24.133405+0000","last_unstale":"2024-05-09T05:54:05.964778+0000","last_undegraded":"2024-05-09T05:54:05.964778+0000","last_fullsized":"2024-05-09T05:54:05.964778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:30:16.477715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.963077+0000","last_change":"2024-05-09T05:53:24.139697+0000","last_active":"2024-05-09T05:54:05.963077+0000","last_peered":"2024-05-09T05:54:05.963077+0000","last_clean":"2024-05-09T05:54:05.963077+0000","last_became_active":"2024-05-09T05:53:24.139374+0000","last_became_peered":"2024-05-09T05:53:24.139374+0000","last_unstale":"2024-05-09T05:54:05.963077+0000","last_undegraded":"2024-05-09T05:54:05.963077+0000","last_fullsized":"2024-05-09T05:54:05.963077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:26:28.502867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.959611+0000","last_change":"2024-05-09T05:53:24.147755+0000","last_active":"2024-05-09T05:54:05.959611+0000","last_peered":"2024-05-09T05:54:05.959611+0000","last_clean":"2024-05-09T05:54:05.959611+0000","last_became_active":"2024-05-09T05:53:24.145616+0000","last_became_peered":"2024-05-09T05:53:24.145616+0000","last_unstale":"2024-05-09T05:54:05.959611+0000","last_undegraded":"2024-05-09T05:54:05.959611+0000","last_fullsized":"2024-05-09T05:54:05.959611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:21:10.387393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.957455+0000","last_change":"2024-05-09T05:53:24.131741+0000","last_active":"2024-05-09T05:54:05.957455+0000","last_peered":"2024-05-09T05:54:05.957455+0000","last_clean":"2024-05-09T05:54:05.957455+0000","last_became_active":"2024-05-09T05:53:24.128870+0000","last_became_peered":"2024-05-09T05:53:24.128870+0000","last_unstale":"2024-05-09T05:54:05.957455+0000","last_undegraded":"2024-05-09T05:54:05.957455+0000","last_fullsized":"2024-05-09T05:54:05.957455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:28:25.103524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.956516+0000","last_change":"2024-05-09T05:53:24.133443+0000","last_active":"2024-05-09T05:54:05.956516+0000","last_peered":"2024-05-09T05:54:05.956516+0000","last_clean":"2024-05-09T05:54:05.956516+0000","last_became_active":"2024-05-09T05:53:24.132688+0000","last_became_peered":"2024-05-09T05:53:24.132688+0000","last_unstale":"2024-05-09T05:54:05.956516+0000","last_undegraded":"2024-05-09T05:54:05.956516+0000","last_fullsized":"2024-05-09T05:54:05.956516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:43:24.750805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.916963+0000","last_change":"2024-05-09T05:53:24.142600+0000","last_active":"2024-05-09T05:54:06.916963+0000","last_peered":"2024-05-09T05:54:06.916963+0000","last_clean":"2024-05-09T05:54:06.916963+0000","last_became_active":"2024-05-09T05:53:24.142280+0000","last_became_peered":"2024-05-09T05:53:24.142280+0000","last_unstale":"2024-05-09T05:54:06.916963+0000","last_undegraded":"2024-05-09T05:54:06.916963+0000","last_fullsized":"2024-05-09T05:54:06.916963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:20:58.962379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.916818+0000","last_change":"2024-05-09T05:53:24.144839+0000","last_active":"2024-05-09T05:54:06.916818+0000","last_peered":"2024-05-09T05:54:06.916818+0000","last_clean":"2024-05-09T05:54:06.916818+0000","last_became_active":"2024-05-09T05:53:24.144381+0000","last_became_peered":"2024-05-09T05:53:24.144381+0000","last_unstale":"2024-05-09T05:54:06.916818+0000","last_undegraded":"2024-05-09T05:54:06.916818+0000","last_fullsized":"2024-05-09T05:54:06.916818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:40:46.738053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.917366+0000","last_change":"2024-05-09T05:53:24.131521+0000","last_active":"2024-05-09T05:54:06.917366+0000","last_peered":"2024-05-09T05:54:06.917366+0000","last_clean":"2024-05-09T05:54:06.917366+0000","last_became_active":"2024-05-09T05:53:24.131218+0000","last_became_peered":"2024-05-09T05:53:24.131218+0000","last_unstale":"2024-05-09T05:54:06.917366+0000","last_undegraded":"2024-05-09T05:54:06.917366+0000","last_fullsized":"2024-05-09T05:54:06.917366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:25:59.410270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.955574+0000","last_change":"2024-05-09T05:53:24.139922+0000","last_active":"2024-05-09T05:54:05.955574+0000","last_peered":"2024-05-09T05:54:05.955574+0000","last_clean":"2024-05-09T05:54:05.955574+0000","last_became_active":"2024-05-09T05:53:24.139473+0000","last_became_peered":"2024-05-09T05:53:24.139473+0000","last_unstale":"2024-05-09T05:54:05.955574+0000","last_undegraded":"2024-05-09T05:54:05.955574+0000","last_fullsized":"2024-05-09T05:54:05.955574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:37:50.839899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.959357+0000","last_change":"2024-05-09T05:53:24.143338+0000","last_active":"2024-05-09T05:54:05.959357+0000","last_peered":"2024-05-09T05:54:05.959357+0000","last_clean":"2024-05-09T05:54:05.959357+0000","last_became_active":"2024-05-09T05:53:24.143053+0000","last_became_peered":"2024-05-09T05:53:24.143053+0000","last_unstale":"2024-05-09T05:54:05.959357+0000","last_undegraded":"2024-05-09T05:54:05.959357+0000","last_fullsized":"2024-05-09T05:54:05.959357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:22:16.337090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.915734+0000","last_change":"2024-05-09T05:53:24.145517+0000","last_active":"2024-05-09T05:54:06.915734+0000","last_peered":"2024-05-09T05:54:06.915734+0000","last_clean":"2024-05-09T05:54:06.915734+0000","last_became_active":"2024-05-09T05:53:24.145150+0000","last_became_peered":"2024-05-09T05:53:24.145150+0000","last_unstale":"2024-05-09T05:54:06.915734+0000","last_undegraded":"2024-05-09T05:54:06.915734+0000","last_fullsized":"2024-05-09T05:54:06.915734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:19:53.947349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.914063+0000","last_change":"2024-05-09T05:53:24.129669+0000","last_active":"2024-05-09T05:54:06.914063+0000","last_peered":"2024-05-09T05:54:06.914063+0000","last_clean":"2024-05-09T05:54:06.914063+0000","last_became_active":"2024-05-09T05:53:24.129339+0000","last_became_peered":"2024-05-09T05:53:24.129339+0000","last_unstale":"2024-05-09T05:54:06.914063+0000","last_undegraded":"2024-05-09T05:54:06.914063+0000","last_fullsized":"2024-05-09T05:54:06.914063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:05:51.845643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.916222+0000","last_change":"2024-05-09T05:53:24.138914+0000","last_active":"2024-05-09T05:54:06.916222+0000","last_peered":"2024-05-09T05:54:06.916222+0000","last_clean":"2024-05-09T05:54:06.916222+0000","last_became_active":"2024-05-09T05:53:24.138499+0000","last_became_peered":"2024-05-09T05:53:24.138499+0000","last_unstale":"2024-05-09T05:54:06.916222+0000","last_undegraded":"2024-05-09T05:54:06.916222+0000","last_fullsized":"2024-05-09T05:54:06.916222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:29:00.338046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.914572+0000","last_change":"2024-05-09T05:53:24.144296+0000","last_active":"2024-05-09T05:54:06.914572+0000","last_peered":"2024-05-09T05:54:06.914572+0000","last_clean":"2024-05-09T05:54:06.914572+0000","last_became_active":"2024-05-09T05:53:24.143890+0000","last_became_peered":"2024-05-09T05:53:24.143890+0000","last_unstale":"2024-05-09T05:54:06.914572+0000","last_undegraded":"2024-05-09T05:54:06.914572+0000","last_fullsized":"2024-05-09T05:54:06.914572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:34:56.860849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.962005+0000","last_change":"2024-05-09T05:53:24.152635+0000","last_active":"2024-05-09T05:54:05.962005+0000","last_peered":"2024-05-09T05:54:05.962005+0000","last_clean":"2024-05-09T05:54:05.962005+0000","last_became_active":"2024-05-09T05:53:24.151674+0000","last_became_peered":"2024-05-09T05:53:24.151674+0000","last_unstale":"2024-05-09T05:54:05.962005+0000","last_undegraded":"2024-05-09T05:54:05.962005+0000","last_fullsized":"2024-05-09T05:54:05.962005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:18:47.495857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:05.961971+0000","last_change":"2024-05-09T05:53:24.152746+0000","last_active":"2024-05-09T05:54:05.961971+0000","last_peered":"2024-05-09T05:54:05.961971+0000","last_clean":"2024-05-09T05:54:05.961971+0000","last_became_active":"2024-05-09T05:53:24.151418+0000","last_became_peered":"2024-05-09T05:53:24.151418+0000","last_unstale":"2024-05-09T05:54:05.961971+0000","last_undegraded":"2024-05-09T05:54:05.961971+0000","last_fullsized":"2024-05-09T05:54:05.961971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:27:19.121790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-09T05:54:06.917763+0000","last_change":"2024-05-09T05:53:24.140908+0000","last_active":"2024-05-09T05:54:06.917763+0000","last_peered":"2024-05-09T05:54:06.917763+0000","last_clean":"2024-05-09T05:54:06.917763+0000","last_became_active":"2024-05-09T05:53:24.140589+0000","last_became_peered":"2024-05-09T05:53:24.140589+0000","last_unstale":"2024-05-09T05:54:06.917763+0000","last_undegraded":"2024-05-09T05:54:06.917763+0000","last_fullsized":"2024-05-09T05:54:06.917763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:51:03.458547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":12028,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":215,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":23615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":189,"ondisk_log_size":189,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509456,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":319488,"data_stored":116491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509459,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31472,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340368,"statfs":{"total":96636764160,"available":96604536832,"internally_reserved":0,"allocated":303104,"data_stored":118699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509459,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31508,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340332,"statfs":{"total":96636764160,"available":96604499968,"internally_reserved":0,"allocated":339968,"data_stored":121558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509456,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":119788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509458,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":897024,"data_stored":707219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509458,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":118861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32056,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339784,"statfs":{"total":96636764160,"available":96603938816,"internally_reserved":0,"allocated":901120,"data_stored":707072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":327680,"data_stored":118159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":3424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":6121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T05:54:24.142 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:54:24.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.339+0000 7f3db7d31640 1 Processor -- start 2024-05-09T05:54:24.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.339+0000 7f3db7d31640 1 -- start start 2024-05-09T05:54:24.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.339+0000 7f3db7d31640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3db00c89e0 0x7f3db01538d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:24.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.339+0000 7f3db7d31640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3db00c5ea0 con 0x7f3db006d8b0 2024-05-09T05:54:24.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.339+0000 7f3db7d31640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3db0159530 con 0x7f3db015a140 2024-05-09T05:54:24.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.339+0000 7f3db7d31640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f3db00c7ed0 con 0x7f3db00c89e0 2024-05-09T05:54:24.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.339+0000 7f3db52cc640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f3db006d8b0 0x7f3db0159a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33292/0 (socket says 172.21.15.72:33292) 2024-05-09T05:54:24.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.339+0000 7f3db52cc640 1 -- 172.21.15.72:0/3256733561 learned_addr learned my addr 172.21.15.72:0/3256733561 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:54:24.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.339+0000 7f3db5acd640 1 --2- 172.21.15.72:0/3256733561 >> v2:172.21.15.110:3300/0 conn(0x7f3db00c89e0 0x7f3db01538d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:24.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.339+0000 7f3db4acb640 1 -- 172.21.15.72:0/3256733561 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 569385282 0 0) 0x7f3db00c5ea0 con 0x7f3db006d8b0 2024-05-09T05:54:24.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.339+0000 7f3db4acb640 1 -- 172.21.15.72:0/3256733561 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d9c003530 con 0x7f3db006d8b0 2024-05-09T05:54:24.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.339+0000 7f3db4acb640 1 -- 172.21.15.72:0/3256733561 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3156525574 0 0) 0x7f3d9c003530 con 0x7f3db006d8b0 2024-05-09T05:54:24.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.339+0000 7f3db4acb640 1 -- 172.21.15.72:0/3256733561 >> v2:172.21.15.110:3300/0 conn(0x7f3db00c89e0 msgr2=0x7f3db01538d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:24.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.339+0000 7f3db4acb640 1 --2- 172.21.15.72:0/3256733561 >> v2:172.21.15.110:3300/0 conn(0x7f3db00c89e0 0x7f3db01538d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:24.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.339+0000 7f3db4acb640 1 -- 172.21.15.72:0/3256733561 >> v1:172.21.15.110:6789/0 conn(0x7f3db015a140 legacy=0x7f3db0163dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:24.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.343+0000 7f3db4acb640 1 -- 172.21.15.72:0/3256733561 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3db00c8610 con 0x7f3db006d8b0 2024-05-09T05:54:24.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.343+0000 7f3db4acb640 1 -- 172.21.15.72:0/3256733561 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2749052815 0 0) 0x7f3da4001700 con 0x7f3db006d8b0 2024-05-09T05:54:24.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.343+0000 7f3db4acb640 1 -- 172.21.15.72:0/3256733561 >> v1:172.21.15.72:6789/0 conn(0x7f3db006d8b0 legacy=0x7f3db0159a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:24.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.343+0000 7f3db4acb640 1 --2- 172.21.15.72:0/3256733561 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d9c003a60 0x7f3d9c003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:24.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.343+0000 7f3db4acb640 1 --2- 172.21.15.72:0/3256733561 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d9c004810 0x7f3d9c004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:24.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.343+0000 7f3db4acb640 1 --2- 172.21.15.72:0/3256733561 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d9c005260 0x7f3d9c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:24.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.343+0000 7f3db4acb640 1 -- 172.21.15.72:0/3256733561 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f3db00c7ed0 con 0x7f3d9c003a60 2024-05-09T05:54:24.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.343+0000 7f3db4acb640 1 -- 172.21.15.72:0/3256733561 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f3d9c00c1f0 con 0x7f3d9c005260 2024-05-09T05:54:24.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.343+0000 7f3db4acb640 1 -- 172.21.15.72:0/3256733561 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f3d9c00e600 con 0x7f3d9c004810 2024-05-09T05:54:24.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.343+0000 7f3db5acd640 1 --2- 172.21.15.72:0/3256733561 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d9c003a60 0x7f3d9c003ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:24.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.343+0000 7f3db52cc640 1 --2- 172.21.15.72:0/3256733561 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d9c004810 0x7f3d9c004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:24.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.343+0000 7f3db5acd640 1 -- 172.21.15.72:0/3256733561 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d9c004810 msgr2=0x7f3d9c004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:24.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.343+0000 7f3db5acd640 1 --2- 172.21.15.72:0/3256733561 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d9c004810 0x7f3d9c004c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:24.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.343+0000 7f3db5acd640 1 -- 172.21.15.72:0/3256733561 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d9c005260 msgr2=0x7f3d9c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:24.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.343+0000 7f3db62ce640 1 --2- 172.21.15.72:0/3256733561 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d9c005260 0x7f3d9c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:24.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.343+0000 7f3db5acd640 1 --2- 172.21.15.72:0/3256733561 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d9c005260 0x7f3d9c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:24.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.343+0000 7f3db5acd640 1 -- 172.21.15.72:0/3256733561 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d9c003530 con 0x7f3d9c003a60 2024-05-09T05:54:24.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.343+0000 7f3db62ce640 1 --2- 172.21.15.72:0/3256733561 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d9c005260 0x7f3d9c00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:54:24.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.343+0000 7f3db62ce640 1 -- 172.21.15.72:0/3256733561 reap_dead start 2024-05-09T05:54:24.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.343+0000 7f3db5acd640 1 --2- 172.21.15.72:0/3256733561 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d9c003a60 0x7f3d9c003ed0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3da8009fc0 tx=0x7f3da801cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7ea00a667fd3410 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:24.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.343+0000 7f3db4acb640 1 -- 172.21.15.72:0/3256733561 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da80b2070 con 0x7f3d9c003a60 2024-05-09T05:54:24.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.343+0000 7f3db4acb640 1 -- 172.21.15.72:0/3256733561 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3da80a5b40 con 0x7f3d9c003a60 2024-05-09T05:54:24.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.343+0000 7f3db4acb640 1 -- 172.21.15.72:0/3256733561 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da8009c10 con 0x7f3d9c003a60 2024-05-09T05:54:24.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.347+0000 7f3db7d31640 1 -- 172.21.15.72:0/3256733561 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d9c003a60 msgr2=0x7f3d9c003ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:24.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.347+0000 7f3db7d31640 1 --2- 172.21.15.72:0/3256733561 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d9c003a60 0x7f3d9c003ed0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3da8009fc0 tx=0x7f3da801cc20 comp rx=0 tx=0).stop 2024-05-09T05:54:24.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.347+0000 7f3db7d31640 1 -- 172.21.15.72:0/3256733561 shutdown_connections 2024-05-09T05:54:24.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.347+0000 7f3db7d31640 1 --2- 172.21.15.72:0/3256733561 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d9c003a60 0x7f3d9c003ed0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:24.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.347+0000 7f3db7d31640 1 -- 172.21.15.72:0/3256733561 >> 172.21.15.72:0/3256733561 conn(0x7f3db00cb3c0 msgr2=0x7f3db00cb7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:24.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.347+0000 7f3db7d31640 1 -- 172.21.15.72:0/3256733561 shutdown_connections 2024-05-09T05:54:24.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.347+0000 7f3db7d31640 1 -- 172.21.15.72:0/3256733561 wait complete. 2024-05-09T05:54:24.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.347+0000 7f3db7d31640 1 Processor -- start 2024-05-09T05:54:24.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.347+0000 7f3db7d31640 1 -- start start 2024-05-09T05:54:24.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.347+0000 7f3db7d31640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d9c003a60 0x7f3db01f2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:24.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.347+0000 7f3db7d31640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3db014a570 0x7f3db01440e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:24.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.347+0000 7f3db7d31640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3db00cc7a0 0x7f3db00ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:24.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.347+0000 7f3db7d31640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f3db006e0d0 con 0x7f3db014a570 2024-05-09T05:54:24.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.347+0000 7f3db7d31640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f3db0073730 con 0x7f3db00cc7a0 2024-05-09T05:54:24.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.347+0000 7f3db7d31640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f3db00c5970 con 0x7f3d9c003a60 2024-05-09T05:54:24.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.347+0000 7f3db52cc640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3db014a570 0x7f3db01440e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:24.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.347+0000 7f3db52cc640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3db014a570 0x7f3db01440e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46366/0 (socket says 172.21.15.72:46366) 2024-05-09T05:54:24.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.347+0000 7f3db52cc640 1 -- 172.21.15.72:0/3474500388 learned_addr learned my addr 172.21.15.72:0/3474500388 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:54:24.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.351+0000 7f3db5acd640 1 --2- 172.21.15.72:0/3474500388 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d9c003a60 0x7f3db01f2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:24.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.351+0000 7f3db62ce640 1 --2- 172.21.15.72:0/3474500388 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3db00cc7a0 0x7f3db00ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:24.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.351+0000 7f3db52cc640 1 -- 172.21.15.72:0/3474500388 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d9c003a60 msgr2=0x7f3db01f2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:24.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.351+0000 7f3db52cc640 1 --2- 172.21.15.72:0/3474500388 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d9c003a60 0x7f3db01f2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:24.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.351+0000 7f3db52cc640 1 -- 172.21.15.72:0/3474500388 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3db00cc7a0 msgr2=0x7f3db00ccbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:24.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.351+0000 7f3db52cc640 1 --2- 172.21.15.72:0/3474500388 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3db00cc7a0 0x7f3db00ccbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:24.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.351+0000 7f3db52cc640 1 -- 172.21.15.72:0/3474500388 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3db01f2d80 con 0x7f3db014a570 2024-05-09T05:54:24.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.351+0000 7f3db52cc640 1 --2- 172.21.15.72:0/3474500388 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3db014a570 0x7f3db01440e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3da4007fd0 tx=0x7f3da400dc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:24.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.351+0000 7f3da27fc640 1 -- 172.21.15.72:0/3474500388 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da40074e0 con 0x7f3db014a570 2024-05-09T05:54:24.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.351+0000 7f3da27fc640 1 -- 172.21.15.72:0/3474500388 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3da40047f0 con 0x7f3db014a570 2024-05-09T05:54:24.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.351+0000 7f3da27fc640 1 -- 172.21.15.72:0/3474500388 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da4007680 con 0x7f3db014a570 2024-05-09T05:54:24.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.351+0000 7f3db7d31640 1 -- 172.21.15.72:0/3474500388 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3db01f2060 con 0x7f3db014a570 2024-05-09T05:54:24.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.351+0000 7f3db7d31640 1 -- 172.21.15.72:0/3474500388 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3db014c0c0 con 0x7f3db014a570 2024-05-09T05:54:24.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.351+0000 7f3db7d31640 1 -- 172.21.15.72:0/3474500388 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3db006a520 con 0x7f3db014a570 2024-05-09T05:54:24.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.351+0000 7f3da27fc640 1 -- 172.21.15.72:0/3474500388 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f3da401b020 con 0x7f3db014a570 2024-05-09T05:54:24.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.351+0000 7f3da27fc640 1 --2- 172.21.15.72:0/3474500388 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f3d9406f400 0x7f3d94071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:24.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.351+0000 7f3da27fc640 1 -- 172.21.15.72:0/3474500388 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f3da408f530 con 0x7f3db014a570 2024-05-09T05:54:24.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.355+0000 7f3db5acd640 1 --2- 172.21.15.72:0/3474500388 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f3d9406f400 0x7f3d94071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:24.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.355+0000 7f3db5acd640 1 --2- 172.21.15.72:0/3474500388 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f3d9406f400 0x7f3d94071910 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3da80af000 tx=0x7f3da8004ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:24.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.359+0000 7f3da27fc640 1 -- 172.21.15.72:0/3474500388 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f3da405c0b0 con 0x7f3db014a570 2024-05-09T05:54:24.546 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.555+0000 7f3db7d31640 1 -- 172.21.15.72:0/3474500388 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3db0156f40 con 0x7f3db014a570 2024-05-09T05:54:24.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.555+0000 7f3da27fc640 1 -- 172.21.15.72:0/3474500388 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6915 (secure 0 0 0) 0x7f3da405b9b0 con 0x7f3db014a570 2024-05-09T05:54:24.548 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:54:24.548 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6834/1142956298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1142956298},{"type":"v1","addr":"172.21.15.72:6834","nonce":1142956298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:53:23.494975+0000","modified":"2024-05-09T05:54:11.535513+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4297,"mds_1":4287,"mds_2":4263,"mds_3":4259,"mds_4":4257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4257":{"gid":4257,"name":"a","rank":4,"incarnation":18,"state":"up:active","state_seq":15,"addr":"172.21.15.72:6835/3946563056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":3946563056},{"type":"v1","addr":"172.21.15.72:6835","nonce":3946563056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4259":{"gid":4259,"name":"f","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.110:6838/840351907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":840351907},{"type":"v1","addr":"172.21.15.110:6838","nonce":840351907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4263":{"gid":4263,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.72:6837/1048256382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":1048256382},{"type":"v1","addr":"172.21.15.72:6837","nonce":1048256382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.110:6839/966325499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6837","nonce":966325499},{"type":"v1","addr":"172.21.15.110:6839","nonce":966325499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6836/4134424941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":4134424941},{"type":"v1","addr":"172.21.15.110:6836","nonce":4134424941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4257,4259,4263,4287,4297]},"id":1}]} 2024-05-09T05:54:24.548 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 19 2024-05-09T05:54:24.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.559+0000 7f3db7d31640 1 -- 172.21.15.72:0/3474500388 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f3d9406f400 msgr2=0x7f3d94071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:24.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.559+0000 7f3db7d31640 1 --2- 172.21.15.72:0/3474500388 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f3d9406f400 0x7f3d94071910 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3da80af000 tx=0x7f3da8004ac0 comp rx=0 tx=0).stop 2024-05-09T05:54:24.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.559+0000 7f3db7d31640 1 -- 172.21.15.72:0/3474500388 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3db014a570 msgr2=0x7f3db01440e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:24.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.559+0000 7f3db7d31640 1 --2- 172.21.15.72:0/3474500388 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3db014a570 0x7f3db01440e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3da4007fd0 tx=0x7f3da400dc70 comp rx=0 tx=0).stop 2024-05-09T05:54:24.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.559+0000 7f3db7d31640 1 -- 172.21.15.72:0/3474500388 shutdown_connections 2024-05-09T05:54:24.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.559+0000 7f3db7d31640 1 --2- 172.21.15.72:0/3474500388 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f3d9406f400 0x7f3d94071910 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:24.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.559+0000 7f3db7d31640 1 --2- 172.21.15.72:0/3474500388 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3db00cc7a0 0x7f3db00ccbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:24.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.559+0000 7f3db7d31640 1 --2- 172.21.15.72:0/3474500388 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3db014a570 0x7f3db01440e0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:24.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.559+0000 7f3db7d31640 1 --2- 172.21.15.72:0/3474500388 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d9c003a60 0x7f3db01f2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:24.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.559+0000 7f3db7d31640 1 -- 172.21.15.72:0/3474500388 >> 172.21.15.72:0/3474500388 conn(0x7f3db00cb3c0 msgr2=0x7f3db00c7710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:24.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.559+0000 7f3db7d31640 1 -- 172.21.15.72:0/3474500388 shutdown_connections 2024-05-09T05:54:24.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.559+0000 7f3db7d31640 1 -- 172.21.15.72:0/3474500388 wait complete. 2024-05-09T05:54:24.570 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T05:54:24.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.727+0000 7facc5b85640 1 Processor -- start 2024-05-09T05:54:24.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.727+0000 7facc5b85640 1 -- start start 2024-05-09T05:54:24.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.727+0000 7facc5b85640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7facc0156b50 0x7facc0073ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:24.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.727+0000 7facc5b85640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7facc0074410 0x7facc00cc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:24.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.727+0000 7facc5b85640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facc00cda30 con 0x7facc00cca30 2024-05-09T05:54:24.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.727+0000 7facc5b85640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7facc00cc020 con 0x7facc0156b50 2024-05-09T05:54:24.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.727+0000 7facc5b85640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7facc015dfe0 con 0x7facc0074410 2024-05-09T05:54:24.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.727+0000 7facbf7fe640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7facc0156b50 0x7facc0073ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:24.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.727+0000 7facbf7fe640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7facc0156b50 0x7facc0073ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46368/0 (socket says 172.21.15.72:46368) 2024-05-09T05:54:24.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.727+0000 7facbf7fe640 1 -- 172.21.15.72:0/3914271697 learned_addr learned my addr 172.21.15.72:0/3914271697 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:54:24.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.727+0000 7facbeffd640 1 --2- 172.21.15.72:0/3914271697 >> v2:172.21.15.110:3300/0 conn(0x7facc0074410 0x7facc00cc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:24.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.727+0000 7facbf7fe640 1 -- 172.21.15.72:0/3914271697 >> v2:172.21.15.110:3300/0 conn(0x7facc0074410 msgr2=0x7facc00cc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:24.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.727+0000 7facbf7fe640 1 --2- 172.21.15.72:0/3914271697 >> v2:172.21.15.110:3300/0 conn(0x7facc0074410 0x7facc00cc4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:24.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.727+0000 7facbf7fe640 1 -- 172.21.15.72:0/3914271697 >> v1:172.21.15.110:6789/0 conn(0x7facc00cca30 legacy=0x7facc00cce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:54:24.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.727+0000 7facbf7fe640 1 -- 172.21.15.72:0/3914271697 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facc015cdd0 con 0x7facc0156b50 2024-05-09T05:54:24.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.731+0000 7facbf7fe640 1 --2- 172.21.15.72:0/3914271697 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facc0156b50 0x7facc0073ed0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7facc008f980 tx=0x7facb401c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcef452b4d92b430 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:24.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.731+0000 7facbe7fc640 1 -- 172.21.15.72:0/3914271697 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb40b0070 con 0x7facc0156b50 2024-05-09T05:54:24.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.731+0000 7facbe7fc640 1 -- 172.21.15.72:0/3914271697 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facb40ab600 con 0x7facc0156b50 2024-05-09T05:54:24.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.731+0000 7facbe7fc640 1 -- 172.21.15.72:0/3914271697 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb40ab9d0 con 0x7facc0156b50 2024-05-09T05:54:24.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.731+0000 7facc5b85640 1 -- 172.21.15.72:0/3914271697 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facc0156b50 msgr2=0x7facc0073ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:24.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.731+0000 7facc5b85640 1 --2- 172.21.15.72:0/3914271697 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facc0156b50 0x7facc0073ed0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7facc008f980 tx=0x7facb401c340 comp rx=0 tx=0).stop 2024-05-09T05:54:24.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.731+0000 7facc5b85640 1 -- 172.21.15.72:0/3914271697 shutdown_connections 2024-05-09T05:54:24.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.731+0000 7facc5b85640 1 --2- 172.21.15.72:0/3914271697 >> v2:172.21.15.110:3300/0 conn(0x7facc0074410 0x7facc00cc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:24.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.731+0000 7facc5b85640 1 --2- 172.21.15.72:0/3914271697 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facc0156b50 0x7facc0073ed0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:24.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.731+0000 7facc5b85640 1 -- 172.21.15.72:0/3914271697 >> 172.21.15.72:0/3914271697 conn(0x7facc00d1b70 msgr2=0x7facc00d1f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:24.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.731+0000 7facc5b85640 1 -- 172.21.15.72:0/3914271697 shutdown_connections 2024-05-09T05:54:24.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.731+0000 7facc5b85640 1 -- 172.21.15.72:0/3914271697 wait complete. 2024-05-09T05:54:24.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.735+0000 7facc5b85640 1 Processor -- start 2024-05-09T05:54:24.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.735+0000 7facc5b85640 1 -- start start 2024-05-09T05:54:24.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.735+0000 7facc5b85640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7facc0074410 0x7facc01f9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:24.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.735+0000 7facc5b85640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facc00cca30 0x7facc01498b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:24.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.735+0000 7facc5b85640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7facc0156b50 0x7facc00ca580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:24.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.735+0000 7facc5b85640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7facc0074cf0 con 0x7facc00cca30 2024-05-09T05:54:24.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.735+0000 7facc5b85640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7facc015d950 con 0x7facc0074410 2024-05-09T05:54:24.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.735+0000 7facc5b85640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7facc00cd550 con 0x7facc0156b50 2024-05-09T05:54:24.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.735+0000 7facbeffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facc00cca30 0x7facc01498b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:24.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.735+0000 7facbeffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facc00cca30 0x7facc01498b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46376/0 (socket says 172.21.15.72:46376) 2024-05-09T05:54:24.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.735+0000 7facbeffd640 1 -- 172.21.15.72:0/3502317970 learned_addr learned my addr 172.21.15.72:0/3502317970 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:54:24.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.735+0000 7facbf7fe640 1 --2- 172.21.15.72:0/3502317970 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7facc0074410 0x7facc01f9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:24.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.735+0000 7facbffff640 1 --2- 172.21.15.72:0/3502317970 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7facc0156b50 0x7facc00ca580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:24.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.735+0000 7facbeffd640 1 -- 172.21.15.72:0/3502317970 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7facc0156b50 msgr2=0x7facc00ca580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:24.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.735+0000 7facbeffd640 1 --2- 172.21.15.72:0/3502317970 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7facc0156b50 0x7facc00ca580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:24.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.735+0000 7facbeffd640 1 -- 172.21.15.72:0/3502317970 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7facc0074410 msgr2=0x7facc01f9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:24.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.735+0000 7facbeffd640 1 --2- 172.21.15.72:0/3502317970 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7facc0074410 0x7facc01f9bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:24.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.735+0000 7facbeffd640 1 -- 172.21.15.72:0/3502317970 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facc00cba00 con 0x7facc00cca30 2024-05-09T05:54:24.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.735+0000 7facbeffd640 1 --2- 172.21.15.72:0/3502317970 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facc00cca30 0x7facc01498b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7facb000d5f0 tx=0x7facb000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:24.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.735+0000 7faca7fff640 1 -- 172.21.15.72:0/3502317970 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb00125f0 con 0x7facc00cca30 2024-05-09T05:54:24.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.735+0000 7faca7fff640 1 -- 172.21.15.72:0/3502317970 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facb0019070 con 0x7facc00cca30 2024-05-09T05:54:24.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.735+0000 7facc5b85640 1 -- 172.21.15.72:0/3502317970 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facc01fa130 con 0x7facc00cca30 2024-05-09T05:54:24.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.735+0000 7faca7fff640 1 -- 172.21.15.72:0/3502317970 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb00129b0 con 0x7facc00cca30 2024-05-09T05:54:24.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.735+0000 7facc5b85640 1 -- 172.21.15.72:0/3502317970 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facc014ec30 con 0x7facc00cca30 2024-05-09T05:54:24.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.735+0000 7facc5b85640 1 -- 172.21.15.72:0/3502317970 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facc014e9a0 con 0x7facc00cca30 2024-05-09T05:54:24.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.735+0000 7faca7fff640 1 -- 172.21.15.72:0/3502317970 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7facb0012b50 con 0x7facc00cca30 2024-05-09T05:54:24.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.739+0000 7faca7fff640 1 --2- 172.21.15.72:0/3502317970 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7facac06f400 0x7facac071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:54:24.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.739+0000 7faca7fff640 1 -- 172.21.15.72:0/3502317970 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7facb008fa70 con 0x7facc00cca30 2024-05-09T05:54:24.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.739+0000 7facbf7fe640 1 --2- 172.21.15.72:0/3502317970 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7facac06f400 0x7facac071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:54:24.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.739+0000 7facbf7fe640 1 --2- 172.21.15.72:0/3502317970 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7facac06f400 0x7facac071910 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7facb40ad000 tx=0x7facb40a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:54:24.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.743+0000 7faca7fff640 1 -- 172.21.15.72:0/3502317970 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7facb005c5f0 con 0x7facc00cca30 2024-05-09T05:54:24.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.891+0000 7facc5b85640 1 -- 172.21.15.72:0/3502317970 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7facc006a520 con 0x7facc00cca30 2024-05-09T05:54:24.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.891+0000 7faca7fff640 1 -- 172.21.15.72:0/3502317970 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18589 (secure 0 0 0) 0x7facb005bef0 con 0x7facc00cca30 2024-05-09T05:54:24.884 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:54:24.884 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":27,"fsid":"44c88cb9-b39b-4787-a871-80ddf0ad6292","created":"2024-05-09T05:52:59.591187+0000","modified":"2024-05-09T05:54:05.939506+0000","last_up_change":"2024-05-09T05:53:10.902489+0000","last_in_change":"2024-05-09T05:53:02.200254+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T05:53:10.503537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T05:53:21.364958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T05:53:22.461477+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-09T05:53:26.171144+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e4af2aa1-ba5c-4411-a72a-a0e38e589a74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":331913921},{"type":"v1","addr":"172.21.15.72:6817","nonce":331913921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":331913921},{"type":"v1","addr":"172.21.15.72:6819","nonce":331913921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":331913921},{"type":"v1","addr":"172.21.15.72:6823","nonce":331913921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":331913921},{"type":"v1","addr":"172.21.15.72:6821","nonce":331913921}]},"public_addr":"172.21.15.72:6817/331913921","cluster_addr":"172.21.15.72:6819/331913921","heartbeat_back_addr":"172.21.15.72:6823/331913921","heartbeat_front_addr":"172.21.15.72:6821/331913921","state":["exists","up"]},{"osd":1,"uuid":"052504f5-a523-4922-bdc7-ce2890faa5ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2197151836},{"type":"v1","addr":"172.21.15.72:6801","nonce":2197151836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2197151836},{"type":"v1","addr":"172.21.15.72:6803","nonce":2197151836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2197151836},{"type":"v1","addr":"172.21.15.72:6811","nonce":2197151836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2197151836},{"type":"v1","addr":"172.21.15.72:6807","nonce":2197151836}]},"public_addr":"172.21.15.72:6801/2197151836","cluster_addr":"172.21.15.72:6803/2197151836","heartbeat_back_addr":"172.21.15.72:6811/2197151836","heartbeat_front_addr":"172.21.15.72:6807/2197151836","state":["exists","up"]},{"osd":2,"uuid":"28bc1c95-6d0d-4263-baad-314d86e6a670","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1273581990},{"type":"v1","addr":"172.21.15.72:6825","nonce":1273581990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":1273581990},{"type":"v1","addr":"172.21.15.72:6827","nonce":1273581990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1273581990},{"type":"v1","addr":"172.21.15.72:6831","nonce":1273581990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1273581990},{"type":"v1","addr":"172.21.15.72:6829","nonce":1273581990}]},"public_addr":"172.21.15.72:6825/1273581990","cluster_addr":"172.21.15.72:6827/1273581990","heartbeat_back_addr":"172.21.15.72:6831/1273581990","heartbeat_front_addr":"172.21.15.72:6829/1273581990","state":["exists","up"]},{"osd":3,"uuid":"edcc86cb-f178-4533-8069-de9d781531ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2180866263},{"type":"v1","addr":"172.21.15.72:6806","nonce":2180866263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2180866263},{"type":"v1","addr":"172.21.15.72:6810","nonce":2180866263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2180866263},{"type":"v1","addr":"172.21.15.72:6815","nonce":2180866263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2180866263},{"type":"v1","addr":"172.21.15.72:6813","nonce":2180866263}]},"public_addr":"172.21.15.72:6806/2180866263","cluster_addr":"172.21.15.72:6810/2180866263","heartbeat_back_addr":"172.21.15.72:6815/2180866263","heartbeat_front_addr":"172.21.15.72:6813/2180866263","state":["exists","up"]},{"osd":4,"uuid":"8d138128-4829-4109-87a1-25f339f3e953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3437318248},{"type":"v1","addr":"172.21.15.110:6817","nonce":3437318248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3437318248},{"type":"v1","addr":"172.21.15.110:6819","nonce":3437318248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3437318248},{"type":"v1","addr":"172.21.15.110:6823","nonce":3437318248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3437318248},{"type":"v1","addr":"172.21.15.110:6821","nonce":3437318248}]},"public_addr":"172.21.15.110:6817/3437318248","cluster_addr":"172.21.15.110:6819/3437318248","heartbeat_back_addr":"172.21.15.110:6823/3437318248","heartbeat_front_addr":"172.21.15.110:6821/3437318248","state":["exists","up"]},{"osd":5,"uuid":"99a4a914-0a0e-4d25-94ae-3e86b8b1aa4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":977576181},{"type":"v1","addr":"172.21.15.110:6825","nonce":977576181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":977576181},{"type":"v1","addr":"172.21.15.110:6827","nonce":977576181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":977576181},{"type":"v1","addr":"172.21.15.110:6831","nonce":977576181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":977576181},{"type":"v1","addr":"172.21.15.110:6829","nonce":977576181}]},"public_addr":"172.21.15.110:6825/977576181","cluster_addr":"172.21.15.110:6827/977576181","heartbeat_back_addr":"172.21.15.110:6831/977576181","heartbeat_front_addr":"172.21.15.110:6829/977576181","state":["exists","up"]},{"osd":6,"uuid":"6e04b295-afc9-4f80-80f7-3df1f5168608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":1817638786},{"type":"v1","addr":"172.21.15.110:6809","nonce":1817638786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":1817638786},{"type":"v1","addr":"172.21.15.110:6811","nonce":1817638786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":1817638786},{"type":"v1","addr":"172.21.15.110:6815","nonce":1817638786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":1817638786},{"type":"v1","addr":"172.21.15.110:6813","nonce":1817638786}]},"public_addr":"172.21.15.110:6809/1817638786","cluster_addr":"172.21.15.110:6811/1817638786","heartbeat_back_addr":"172.21.15.110:6815/1817638786","heartbeat_front_addr":"172.21.15.110:6813/1817638786","state":["exists","up"]},{"osd":7,"uuid":"835de5c9-1e2c-41d8-bd28-d7ffe5ad8fdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":214675920},{"type":"v1","addr":"172.21.15.110:6801","nonce":214675920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":214675920},{"type":"v1","addr":"172.21.15.110:6803","nonce":214675920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":214675920},{"type":"v1","addr":"172.21.15.110:6807","nonce":214675920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":214675920},{"type":"v1","addr":"172.21.15.110:6805","nonce":214675920}]},"public_addr":"172.21.15.110:6801/214675920","cluster_addr":"172.21.15.110:6803/214675920","heartbeat_back_addr":"172.21.15.110:6807/214675920","heartbeat_front_addr":"172.21.15.110:6805/214675920","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.849761+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.670554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.743789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:08.516367+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.665550+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.518775+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.786468+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.794984+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":0,"to":7}]},{"pgid":"4.6","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T05:54:24.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.895+0000 7facc5b85640 1 -- 172.21.15.72:0/3502317970 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7facac06f400 msgr2=0x7facac071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:24.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.895+0000 7facc5b85640 1 --2- 172.21.15.72:0/3502317970 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7facac06f400 0x7facac071910 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7facb40ad000 tx=0x7facb40a6000 comp rx=0 tx=0).stop 2024-05-09T05:54:24.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.895+0000 7facc5b85640 1 -- 172.21.15.72:0/3502317970 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facc00cca30 msgr2=0x7facc01498b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:54:24.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.895+0000 7facc5b85640 1 --2- 172.21.15.72:0/3502317970 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facc00cca30 0x7facc01498b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7facb000d5f0 tx=0x7facb000dab0 comp rx=0 tx=0).stop 2024-05-09T05:54:24.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.895+0000 7facc5b85640 1 -- 172.21.15.72:0/3502317970 shutdown_connections 2024-05-09T05:54:24.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.895+0000 7facc5b85640 1 --2- 172.21.15.72:0/3502317970 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7facac06f400 0x7facac071910 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:24.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.895+0000 7facc5b85640 1 --2- 172.21.15.72:0/3502317970 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7facc0156b50 0x7facc00ca580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:24.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.895+0000 7facc5b85640 1 --2- 172.21.15.72:0/3502317970 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facc00cca30 0x7facc01498b0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:24.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.895+0000 7facc5b85640 1 --2- 172.21.15.72:0/3502317970 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7facc0074410 0x7facc01f9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:54:24.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.895+0000 7facc5b85640 1 -- 172.21.15.72:0/3502317970 >> 172.21.15.72:0/3502317970 conn(0x7facc00d1b70 msgr2=0x7facc00cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:54:24.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.895+0000 7facc5b85640 1 -- 172.21.15.72:0/3502317970 shutdown_connections 2024-05-09T05:54:24.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:54:24.895+0000 7facc5b85640 1 -- 172.21.15.72:0/3502317970 wait complete. 2024-05-09T05:54:24.904 DEBUG:tasks.mds_thrash:Yielding 2024-05-09T05:54:24.905 INFO:teuthology.run_tasks:Running task workunit... 2024-05-09T05:54:24.917 INFO:tasks.workunit:Pulling workunits from ref c9da4049f638c0f84bdd9b4e33c42e86046ac554 2024-05-09T05:54:24.917 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-05-09T05:54:24.917 INFO:tasks.workunit:timeout=3h 2024-05-09T05:54:24.917 INFO:tasks.workunit:cleanup=True 2024-05-09T05:54:24.917 DEBUG:teuthology.orchestra.run.smithi072:> stat -- /home/ubuntu/cephtest/mnt.0 2024-05-09T05:54:24.918 INFO:tasks.mds_thrash.fs.[cephfs]:starting mds_do_thrash for fs cephfs 2024-05-09T05:54:24.918 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 35 secs before thrashing 2024-05-09T05:54:24.923 INFO:teuthology.orchestra.run.smithi072.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-05-09T05:54:24.923 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-05-09T05:54:24.923 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 2dh/45d Inode: 1 Links: 2 2024-05-09T05:54:24.923 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T05:54:24.923 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-05-09T05:54:24.923 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2024-05-09 05:53:29.116594285 +0000 2024-05-09T05:54:24.923 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2024-05-09 05:53:38.733859735 +0000 2024-05-09T05:54:24.923 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: - 2024-05-09T05:54:24.923 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-05-09T05:54:24.924 DEBUG:teuthology.orchestra.run.smithi072:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-05-09T05:54:24.987 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T05:54:24.990 DEBUG:teuthology.orchestra.run.smithi072:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout c9da4049f638c0f84bdd9b4e33c42e86046ac554 2024-05-09T05:54:25.032 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T05:54:25.039 INFO:tasks.workunit.client.0.smithi072.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-05-09T05:54:55.259 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T05:54:55.263 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T05:54:59.919 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:55:00.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.090+0000 7f51e7c6d640 1 Processor -- start 2024-05-09T05:55:00.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.090+0000 7f51e7c6d640 1 -- start start 2024-05-09T05:55:00.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.090+0000 7f51e7c6d640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f51e015e470 0x7f51e015e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:00.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.090+0000 7f51e7c6d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f51e015edc0 0x7f51e015f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:00.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.090+0000 7f51e7c6d640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51e00cda30 con 0x7f51e0156b50 2024-05-09T05:55:00.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.090+0000 7f51e7c6d640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f51e00cc020 con 0x7f51e015e470 2024-05-09T05:55:00.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.090+0000 7f51e7c6d640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f51e015dfe0 con 0x7f51e015edc0 2024-05-09T05:55:00.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.090+0000 7f51e5208640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f51e015e470 0x7f51e015e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:00.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.090+0000 7f51e5208640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f51e015e470 0x7f51e015e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56262/0 (socket says 172.21.15.72:56262) 2024-05-09T05:55:00.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.090+0000 7f51e5208640 1 -- 172.21.15.72:0/1010121811 learned_addr learned my addr 172.21.15.72:0/1010121811 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:55:00.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.090+0000 7f51e620a640 1 --2- 172.21.15.72:0/1010121811 >> v2:172.21.15.110:3300/0 conn(0x7f51e015edc0 0x7f51e015f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:00.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.090+0000 7f51e5208640 1 -- 172.21.15.72:0/1010121811 >> v2:172.21.15.110:3300/0 conn(0x7f51e015edc0 msgr2=0x7f51e015f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:55:00.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.090+0000 7f51e5208640 1 --2- 172.21.15.72:0/1010121811 >> v2:172.21.15.110:3300/0 conn(0x7f51e015edc0 0x7f51e015f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:00.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.090+0000 7f51e5208640 1 -- 172.21.15.72:0/1010121811 >> v1:172.21.15.110:6789/0 conn(0x7f51e0156b50 legacy=0x7f51e0073ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:55:00.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.090+0000 7f51e5208640 1 -- 172.21.15.72:0/1010121811 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51e015cdd0 con 0x7f51e015e470 2024-05-09T05:55:00.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.094+0000 7f51e5208640 1 --2- 172.21.15.72:0/1010121811 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51e015e470 0x7f51e015e880 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f51e008f4a0 tx=0x7f51d401c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f04c09785eeec6a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:55:00.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.094+0000 7f51e4a07640 1 -- 172.21.15.72:0/1010121811 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d40b0070 con 0x7f51e015e470 2024-05-09T05:55:00.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.094+0000 7f51e4a07640 1 -- 172.21.15.72:0/1010121811 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51d40ab600 con 0x7f51e015e470 2024-05-09T05:55:00.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.094+0000 7f51e4a07640 1 -- 172.21.15.72:0/1010121811 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d40ab9d0 con 0x7f51e015e470 2024-05-09T05:55:00.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.094+0000 7f51e7c6d640 1 -- 172.21.15.72:0/1010121811 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51e015e470 msgr2=0x7f51e015e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:00.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.094+0000 7f51e7c6d640 1 --2- 172.21.15.72:0/1010121811 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51e015e470 0x7f51e015e880 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f51e008f4a0 tx=0x7f51d401c340 comp rx=0 tx=0).stop 2024-05-09T05:55:00.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.094+0000 7f51e7c6d640 1 -- 172.21.15.72:0/1010121811 shutdown_connections 2024-05-09T05:55:00.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.094+0000 7f51e7c6d640 1 --2- 172.21.15.72:0/1010121811 >> v2:172.21.15.110:3300/0 conn(0x7f51e015edc0 0x7f51e015f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:00.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.094+0000 7f51e7c6d640 1 --2- 172.21.15.72:0/1010121811 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51e015e470 0x7f51e015e880 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:00.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.094+0000 7f51e7c6d640 1 -- 172.21.15.72:0/1010121811 >> 172.21.15.72:0/1010121811 conn(0x7f51e00d1b70 msgr2=0x7f51e00d1f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:55:00.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.094+0000 7f51e7c6d640 1 -- 172.21.15.72:0/1010121811 shutdown_connections 2024-05-09T05:55:00.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.094+0000 7f51e7c6d640 1 -- 172.21.15.72:0/1010121811 wait complete. 2024-05-09T05:55:00.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.098+0000 7f51e7c6d640 1 Processor -- start 2024-05-09T05:55:00.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.098+0000 7f51e7c6d640 1 -- start start 2024-05-09T05:55:00.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.098+0000 7f51e7c6d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51e0156b50 0x7f51e01505d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:00.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.098+0000 7f51e7c6d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51e015e470 0x7f51e014a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:00.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.098+0000 7f51e7c6d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51e015edc0 0x7f51e014e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:00.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.098+0000 7f51e7c6d640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f51e015c9b0 con 0x7f51e0156b50 2024-05-09T05:55:00.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.098+0000 7f51e7c6d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f51e0074cf0 con 0x7f51e015e470 2024-05-09T05:55:00.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.098+0000 7f51e7c6d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f51e015cb30 con 0x7f51e015edc0 2024-05-09T05:55:00.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.098+0000 7f51e5a09640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51e0156b50 0x7f51e01505d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:00.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.098+0000 7f51e5a09640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51e0156b50 0x7f51e01505d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56264/0 (socket says 172.21.15.72:56264) 2024-05-09T05:55:00.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.098+0000 7f51e5a09640 1 -- 172.21.15.72:0/2411206731 learned_addr learned my addr 172.21.15.72:0/2411206731 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:55:00.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.098+0000 7f51e5208640 1 --2- 172.21.15.72:0/2411206731 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51e015e470 0x7f51e014a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:00.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.098+0000 7f51e620a640 1 --2- 172.21.15.72:0/2411206731 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51e015edc0 0x7f51e014e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:00.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.098+0000 7f51e5a09640 1 -- 172.21.15.72:0/2411206731 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51e015edc0 msgr2=0x7f51e014e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:00.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.098+0000 7f51e5a09640 1 --2- 172.21.15.72:0/2411206731 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51e015edc0 0x7f51e014e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:00.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.098+0000 7f51e5a09640 1 -- 172.21.15.72:0/2411206731 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51e015e470 msgr2=0x7f51e014a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:00.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.098+0000 7f51e5a09640 1 --2- 172.21.15.72:0/2411206731 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51e015e470 0x7f51e014a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:00.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.098+0000 7f51e5a09640 1 -- 172.21.15.72:0/2411206731 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51e006ac60 con 0x7f51e0156b50 2024-05-09T05:55:00.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.098+0000 7f51e5a09640 1 --2- 172.21.15.72:0/2411206731 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51e0156b50 0x7f51e01505d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f51d000ba80 tx=0x7f51d000bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:55:00.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.098+0000 7f51de7fc640 1 -- 172.21.15.72:0/2411206731 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d000cc00 con 0x7f51e0156b50 2024-05-09T05:55:00.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.098+0000 7f51de7fc640 1 -- 172.21.15.72:0/2411206731 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51d000cda0 con 0x7f51e0156b50 2024-05-09T05:55:00.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.098+0000 7f51e7c6d640 1 -- 172.21.15.72:0/2411206731 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51e0150b10 con 0x7f51e0156b50 2024-05-09T05:55:00.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.098+0000 7f51de7fc640 1 -- 172.21.15.72:0/2411206731 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d0003bc0 con 0x7f51e0156b50 2024-05-09T05:55:00.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.098+0000 7f51e7c6d640 1 -- 172.21.15.72:0/2411206731 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51e014f790 con 0x7f51e0156b50 2024-05-09T05:55:00.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.098+0000 7f51e7c6d640 1 -- 172.21.15.72:0/2411206731 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51e006a520 con 0x7f51e0156b50 2024-05-09T05:55:00.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.102+0000 7f51de7fc640 1 -- 172.21.15.72:0/2411206731 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f51d0006d10 con 0x7f51e0156b50 2024-05-09T05:55:00.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.102+0000 7f51de7fc640 1 --2- 172.21.15.72:0/2411206731 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f51cc06f400 0x7f51cc071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:00.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.102+0000 7f51de7fc640 1 -- 172.21.15.72:0/2411206731 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f51d008f180 con 0x7f51e0156b50 2024-05-09T05:55:00.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.102+0000 7f51e5208640 1 --2- 172.21.15.72:0/2411206731 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f51cc06f400 0x7f51cc071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:00.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.102+0000 7f51e5208640 1 --2- 172.21.15.72:0/2411206731 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f51cc06f400 0x7f51cc071910 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f51d40ad000 tx=0x7f51d40a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:55:00.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.106+0000 7f51de7fc640 1 -- 172.21.15.72:0/2411206731 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f51d005be20 con 0x7f51e0156b50 2024-05-09T05:55:00.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.306+0000 7f51e7c6d640 1 -- 172.21.15.72:0/2411206731 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f51e00cdcb0 con 0x7f51e0156b50 2024-05-09T05:55:00.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.306+0000 7f51de7fc640 1 -- 172.21.15.72:0/2411206731 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6915 (secure 0 0 0) 0x7f51d005b720 con 0x7f51e0156b50 2024-05-09T05:55:00.294 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:55:00.294 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6834/1142956298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1142956298},{"type":"v1","addr":"172.21.15.72:6834","nonce":1142956298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:53:23.494975+0000","modified":"2024-05-09T05:54:11.535513+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4297,"mds_1":4287,"mds_2":4263,"mds_3":4259,"mds_4":4257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4257":{"gid":4257,"name":"a","rank":4,"incarnation":18,"state":"up:active","state_seq":15,"addr":"172.21.15.72:6835/3946563056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":3946563056},{"type":"v1","addr":"172.21.15.72:6835","nonce":3946563056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4259":{"gid":4259,"name":"f","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.110:6838/840351907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":840351907},{"type":"v1","addr":"172.21.15.110:6838","nonce":840351907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4263":{"gid":4263,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.72:6837/1048256382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":1048256382},{"type":"v1","addr":"172.21.15.72:6837","nonce":1048256382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.110:6839/966325499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6837","nonce":966325499},{"type":"v1","addr":"172.21.15.110:6839","nonce":966325499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6836/4134424941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":4134424941},{"type":"v1","addr":"172.21.15.110:6836","nonce":4134424941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4257,4259,4263,4287,4297]},"id":1}]} 2024-05-09T05:55:00.294 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 19 2024-05-09T05:55:00.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.310+0000 7f51e7c6d640 1 -- 172.21.15.72:0/2411206731 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f51cc06f400 msgr2=0x7f51cc071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:00.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.310+0000 7f51e7c6d640 1 --2- 172.21.15.72:0/2411206731 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f51cc06f400 0x7f51cc071910 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f51d40ad000 tx=0x7f51d40a6000 comp rx=0 tx=0).stop 2024-05-09T05:55:00.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.310+0000 7f51e7c6d640 1 -- 172.21.15.72:0/2411206731 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51e0156b50 msgr2=0x7f51e01505d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:00.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.310+0000 7f51e7c6d640 1 --2- 172.21.15.72:0/2411206731 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51e0156b50 0x7f51e01505d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f51d000ba80 tx=0x7f51d000bf40 comp rx=0 tx=0).stop 2024-05-09T05:55:00.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.310+0000 7f51e7c6d640 1 -- 172.21.15.72:0/2411206731 shutdown_connections 2024-05-09T05:55:00.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.310+0000 7f51e7c6d640 1 --2- 172.21.15.72:0/2411206731 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f51cc06f400 0x7f51cc071910 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:00.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.310+0000 7f51e7c6d640 1 --2- 172.21.15.72:0/2411206731 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51e015edc0 0x7f51e014e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:00.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.310+0000 7f51e7c6d640 1 --2- 172.21.15.72:0/2411206731 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51e015e470 0x7f51e014a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:00.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.310+0000 7f51e7c6d640 1 --2- 172.21.15.72:0/2411206731 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51e0156b50 0x7f51e01505d0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:00.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.310+0000 7f51e7c6d640 1 -- 172.21.15.72:0/2411206731 >> 172.21.15.72:0/2411206731 conn(0x7f51e00d1b70 msgr2=0x7f51e015bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:55:00.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.310+0000 7f51e7c6d640 1 -- 172.21.15.72:0/2411206731 shutdown_connections 2024-05-09T05:55:00.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.310+0000 7f51e7c6d640 1 -- 172.21.15.72:0/2411206731 wait complete. 2024-05-09T05:55:00.315 INFO:tasks.mds_thrash.fs.[cephfs]:kill mds.a (rank=4) 2024-05-09T05:55:00.316 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-09T05:55:00.316 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T05:55:00.328 INFO:tasks.ceph.mds.a:Stopped 2024-05-09T05:55:00.328 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:55:00.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.534+0000 7f0c88ba7640 1 Processor -- start 2024-05-09T05:55:00.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.534+0000 7f0c88ba7640 1 -- start start 2024-05-09T05:55:00.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.534+0000 7f0c88ba7640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c84156910 0x7f0c8415d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:00.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.534+0000 7f0c88ba7640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0c840cf1f0 0x7f0c84167250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:00.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.534+0000 7f0c88ba7640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c8415d890 con 0x7f0c840cede0 2024-05-09T05:55:00.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.534+0000 7f0c88ba7640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f0c840ce0b0 con 0x7f0c840cf1f0 2024-05-09T05:55:00.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.534+0000 7f0c88ba7640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f0c840cd460 con 0x7f0c84156910 2024-05-09T05:55:00.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.534+0000 7f0c81d9b640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f0c840cede0 0x7f0c840d1ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41718/0 (socket says 172.21.15.72:41718) 2024-05-09T05:55:00.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.534+0000 7f0c81d9b640 1 -- 172.21.15.72:0/1959728639 learned_addr learned my addr 172.21.15.72:0/1959728639 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:55:00.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.534+0000 7f0c8259c640 1 --2- 172.21.15.72:0/1959728639 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c84156910 0x7f0c8415d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:00.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.534+0000 7f0c82d9d640 1 --2- 172.21.15.72:0/1959728639 >> v2:172.21.15.110:3300/0 conn(0x7f0c840cf1f0 0x7f0c84167250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:00.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.534+0000 7f0c8159a640 1 -- 172.21.15.72:0/1959728639 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3617261159 0 0) 0x7f0c6c0014a0 con 0x7f0c840cede0 2024-05-09T05:55:00.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.534+0000 7f0c8159a640 1 -- 172.21.15.72:0/1959728639 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c64003530 con 0x7f0c840cede0 2024-05-09T05:55:00.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.534+0000 7f0c8159a640 1 -- 172.21.15.72:0/1959728639 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2971203767 0 0) 0x7f0c64003530 con 0x7f0c840cede0 2024-05-09T05:55:00.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.534+0000 7f0c8159a640 1 -- 172.21.15.72:0/1959728639 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c84156910 msgr2=0x7f0c8415d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:55:00.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.534+0000 7f0c8159a640 1 --2- 172.21.15.72:0/1959728639 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c84156910 0x7f0c8415d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:00.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.534+0000 7f0c8159a640 1 -- 172.21.15.72:0/1959728639 >> v2:172.21.15.110:3300/0 conn(0x7f0c840cf1f0 msgr2=0x7f0c84167250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:55:00.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.534+0000 7f0c8159a640 1 --2- 172.21.15.72:0/1959728639 >> v2:172.21.15.110:3300/0 conn(0x7f0c840cf1f0 0x7f0c84167250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:00.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.534+0000 7f0c8159a640 1 -- 172.21.15.72:0/1959728639 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c840cd720 con 0x7f0c840cede0 2024-05-09T05:55:00.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.534+0000 7f0c8159a640 1 -- 172.21.15.72:0/1959728639 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2749052815 0 0) 0x7f0c6c001c50 con 0x7f0c840cede0 2024-05-09T05:55:00.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.534+0000 7f0c8159a640 1 -- 172.21.15.72:0/1959728639 >> v1:172.21.15.72:6789/0 conn(0x7f0c840cede0 legacy=0x7f0c840d1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:00.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.534+0000 7f0c8159a640 1 --2- 172.21.15.72:0/1959728639 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c64003a10 0x7f0c64003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:00.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.534+0000 7f0c8159a640 1 --2- 172.21.15.72:0/1959728639 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c84156910 0x7f0c64004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:00.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.534+0000 7f0c8159a640 1 --2- 172.21.15.72:0/1959728639 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c64004d50 0x7f0c64005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:00.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.534+0000 7f0c8159a640 1 -- 172.21.15.72:0/1959728639 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f0c840ce0b0 con 0x7f0c64004d50 2024-05-09T05:55:00.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.534+0000 7f0c8159a640 1 -- 172.21.15.72:0/1959728639 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f0c840cd460 con 0x7f0c64003a10 2024-05-09T05:55:00.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.534+0000 7f0c8159a640 1 -- 172.21.15.72:0/1959728639 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f0c6400ba80 con 0x7f0c84156910 2024-05-09T05:55:00.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.534+0000 7f0c82d9d640 1 --2- 172.21.15.72:0/1959728639 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c64004d50 0x7f0c64005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:00.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.534+0000 7f0c81d9b640 1 --2- 172.21.15.72:0/1959728639 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c84156910 0x7f0c64004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:00.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.534+0000 7f0c8259c640 1 --2- 172.21.15.72:0/1959728639 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c64003a10 0x7f0c64003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:00.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.534+0000 7f0c82d9d640 1 -- 172.21.15.72:0/1959728639 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c84156910 msgr2=0x7f0c64004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:55:00.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.534+0000 7f0c82d9d640 1 --2- 172.21.15.72:0/1959728639 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c84156910 0x7f0c64004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:00.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.534+0000 7f0c82d9d640 1 -- 172.21.15.72:0/1959728639 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c64003a10 msgr2=0x7f0c64003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:55:00.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.534+0000 7f0c82d9d640 1 --2- 172.21.15.72:0/1959728639 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c64003a10 0x7f0c64003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:00.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.534+0000 7f0c82d9d640 1 -- 172.21.15.72:0/1959728639 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c64003530 con 0x7f0c64004d50 2024-05-09T05:55:00.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.538+0000 7f0c82d9d640 1 --2- 172.21.15.72:0/1959728639 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c64004d50 0x7f0c64005160 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0c74009ab0 tx=0x7f0c7401ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2486d2358c8accbb server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:55:00.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.538+0000 7f0c8159a640 1 -- 172.21.15.72:0/1959728639 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c740b2070 con 0x7f0c64004d50 2024-05-09T05:55:00.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.538+0000 7f0c8159a640 1 -- 172.21.15.72:0/1959728639 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c740a5680 con 0x7f0c64004d50 2024-05-09T05:55:00.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.538+0000 7f0c8159a640 1 -- 172.21.15.72:0/1959728639 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c740096b0 con 0x7f0c64004d50 2024-05-09T05:55:00.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.538+0000 7f0c88ba7640 1 -- 172.21.15.72:0/1959728639 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c64004d50 msgr2=0x7f0c64005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:00.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.538+0000 7f0c88ba7640 1 --2- 172.21.15.72:0/1959728639 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c64004d50 0x7f0c64005160 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0c74009ab0 tx=0x7f0c7401ca90 comp rx=0 tx=0).stop 2024-05-09T05:55:00.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.538+0000 7f0c82d9d640 1 -- 172.21.15.72:0/1959728639 reap_dead start 2024-05-09T05:55:00.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.538+0000 7f0c88ba7640 1 -- 172.21.15.72:0/1959728639 shutdown_connections 2024-05-09T05:55:00.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.538+0000 7f0c88ba7640 1 -- 172.21.15.72:0/1959728639 >> 172.21.15.72:0/1959728639 conn(0x7f0c840740a0 msgr2=0x7f0c840744e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:55:00.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.538+0000 7f0c88ba7640 1 -- 172.21.15.72:0/1959728639 shutdown_connections 2024-05-09T05:55:00.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.538+0000 7f0c88ba7640 1 -- 172.21.15.72:0/1959728639 wait complete. 2024-05-09T05:55:00.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.542+0000 7f0c88ba7640 1 Processor -- start 2024-05-09T05:55:00.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.542+0000 7f0c88ba7640 1 -- start start 2024-05-09T05:55:00.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.542+0000 7f0c88ba7640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c64004d50 0x7f0c841e80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:00.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.542+0000 7f0c88ba7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c841f7450 0x7f0c841e5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:00.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.542+0000 7f0c88ba7640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c841607b0 0x7f0c8415fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:00.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.542+0000 7f0c88ba7640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f0c840ce8c0 con 0x7f0c841607b0 2024-05-09T05:55:00.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.542+0000 7f0c88ba7640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f0c840ce5e0 con 0x7f0c841f7450 2024-05-09T05:55:00.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.542+0000 7f0c88ba7640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f0c84156d20 con 0x7f0c64004d50 2024-05-09T05:55:00.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.542+0000 7f0c82d9d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c841607b0 0x7f0c8415fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:00.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.542+0000 7f0c82d9d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c841607b0 0x7f0c8415fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56276/0 (socket says 172.21.15.72:56276) 2024-05-09T05:55:00.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.542+0000 7f0c82d9d640 1 -- 172.21.15.72:0/804813344 learned_addr learned my addr 172.21.15.72:0/804813344 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:55:00.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.542+0000 7f0c8259c640 1 --2- 172.21.15.72:0/804813344 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c64004d50 0x7f0c841e80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:00.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.542+0000 7f0c81d9b640 1 --2- 172.21.15.72:0/804813344 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c841f7450 0x7f0c841e5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:00.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.542+0000 7f0c82d9d640 1 -- 172.21.15.72:0/804813344 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c64004d50 msgr2=0x7f0c841e80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:00.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.542+0000 7f0c82d9d640 1 --2- 172.21.15.72:0/804813344 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c64004d50 0x7f0c841e80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:00.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.542+0000 7f0c82d9d640 1 -- 172.21.15.72:0/804813344 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c841f7450 msgr2=0x7f0c841e5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:00.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.542+0000 7f0c82d9d640 1 --2- 172.21.15.72:0/804813344 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c841f7450 0x7f0c841e5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:00.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.542+0000 7f0c82d9d640 1 -- 172.21.15.72:0/804813344 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c8415e5b0 con 0x7f0c841607b0 2024-05-09T05:55:00.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.542+0000 7f0c8259c640 1 --2- 172.21.15.72:0/804813344 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c64004d50 0x7f0c841e80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:55:00.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.542+0000 7f0c81d9b640 1 --2- 172.21.15.72:0/804813344 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c841f7450 0x7f0c841e5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:55:00.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.542+0000 7f0c82d9d640 1 --2- 172.21.15.72:0/804813344 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c841607b0 0x7f0c8415fa00 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0c7401c8c0 tx=0x7f0c64005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:55:00.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.542+0000 7f0c7affd640 1 -- 172.21.15.72:0/804813344 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c740bd070 con 0x7f0c841607b0 2024-05-09T05:55:00.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.542+0000 7f0c7affd640 1 -- 172.21.15.72:0/804813344 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c74000e50 con 0x7f0c841607b0 2024-05-09T05:55:00.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.542+0000 7f0c88ba7640 1 -- 172.21.15.72:0/804813344 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c841e6bb0 con 0x7f0c841607b0 2024-05-09T05:55:00.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.542+0000 7f0c7affd640 1 -- 172.21.15.72:0/804813344 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c740b2040 con 0x7f0c841607b0 2024-05-09T05:55:00.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.542+0000 7f0c88ba7640 1 -- 172.21.15.72:0/804813344 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c841f6c50 con 0x7f0c841607b0 2024-05-09T05:55:00.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.542+0000 7f0c88ba7640 1 -- 172.21.15.72:0/804813344 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c8406a520 con 0x7f0c841607b0 2024-05-09T05:55:00.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.546+0000 7f0c7affd640 1 -- 172.21.15.72:0/804813344 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f0c740c0070 con 0x7f0c841607b0 2024-05-09T05:55:00.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.546+0000 7f0c7affd640 1 --2- 172.21.15.72:0/804813344 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f0c6806f400 0x7f0c68071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:00.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.546+0000 7f0c7affd640 1 -- 172.21.15.72:0/804813344 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f0c74129ad0 con 0x7f0c841607b0 2024-05-09T05:55:00.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.546+0000 7f0c8259c640 1 --2- 172.21.15.72:0/804813344 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f0c6806f400 0x7f0c68071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:00.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.546+0000 7f0c8259c640 1 --2- 172.21.15.72:0/804813344 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f0c6806f400 0x7f0c68071910 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c009a20 tx=0x7f0c7c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:55:00.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.550+0000 7f0c7affd640 1 -- 172.21.15.72:0/804813344 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f0c74129e20 con 0x7f0c841607b0 2024-05-09T05:55:00.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.750+0000 7f0c88ba7640 1 -- 172.21.15.72:0/804813344 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0c840cde90 con 0x7f0c841607b0 2024-05-09T05:55:00.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.750+0000 7f0c7affd640 1 -- 172.21.15.72:0/804813344 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6915 (secure 0 0 0) 0x7f0c740c7070 con 0x7f0c841607b0 2024-05-09T05:55:00.737 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:55:00.737 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6834/1142956298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1142956298},{"type":"v1","addr":"172.21.15.72:6834","nonce":1142956298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:53:23.494975+0000","modified":"2024-05-09T05:54:11.535513+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4297,"mds_1":4287,"mds_2":4263,"mds_3":4259,"mds_4":4257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4257":{"gid":4257,"name":"a","rank":4,"incarnation":18,"state":"up:active","state_seq":15,"addr":"172.21.15.72:6835/3946563056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":3946563056},{"type":"v1","addr":"172.21.15.72:6835","nonce":3946563056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4259":{"gid":4259,"name":"f","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.110:6838/840351907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":840351907},{"type":"v1","addr":"172.21.15.110:6838","nonce":840351907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4263":{"gid":4263,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.72:6837/1048256382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":1048256382},{"type":"v1","addr":"172.21.15.72:6837","nonce":1048256382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.110:6839/966325499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6837","nonce":966325499},{"type":"v1","addr":"172.21.15.110:6839","nonce":966325499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6836/4134424941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":4134424941},{"type":"v1","addr":"172.21.15.110:6836","nonce":4134424941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4257,4259,4263,4287,4297]},"id":1}]} 2024-05-09T05:55:00.738 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 19 2024-05-09T05:55:00.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.754+0000 7f0c88ba7640 1 -- 172.21.15.72:0/804813344 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f0c6806f400 msgr2=0x7f0c68071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:00.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.754+0000 7f0c88ba7640 1 --2- 172.21.15.72:0/804813344 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f0c6806f400 0x7f0c68071910 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c009a20 tx=0x7f0c7c008040 comp rx=0 tx=0).stop 2024-05-09T05:55:00.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.754+0000 7f0c88ba7640 1 -- 172.21.15.72:0/804813344 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c841607b0 msgr2=0x7f0c8415fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:00.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.754+0000 7f0c88ba7640 1 --2- 172.21.15.72:0/804813344 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c841607b0 0x7f0c8415fa00 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0c7401c8c0 tx=0x7f0c64005840 comp rx=0 tx=0).stop 2024-05-09T05:55:00.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.754+0000 7f0c88ba7640 1 -- 172.21.15.72:0/804813344 shutdown_connections 2024-05-09T05:55:00.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.754+0000 7f0c88ba7640 1 --2- 172.21.15.72:0/804813344 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f0c6806f400 0x7f0c68071910 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:00.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.754+0000 7f0c88ba7640 1 --2- 172.21.15.72:0/804813344 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c841607b0 0x7f0c8415fa00 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:00.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.754+0000 7f0c88ba7640 1 --2- 172.21.15.72:0/804813344 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c841f7450 0x7f0c841e5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:00.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.754+0000 7f0c88ba7640 1 --2- 172.21.15.72:0/804813344 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c64004d50 0x7f0c841e80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:00.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.754+0000 7f0c88ba7640 1 -- 172.21.15.72:0/804813344 >> 172.21.15.72:0/804813344 conn(0x7f0c840740a0 msgr2=0x7f0c840744e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:55:00.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.754+0000 7f0c88ba7640 1 -- 172.21.15.72:0/804813344 shutdown_connections 2024-05-09T05:55:00.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:00.754+0000 7f0c88ba7640 1 -- 172.21.15.72:0/804813344 wait complete. 2024-05-09T05:55:00.759 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-05-09T05:55:02.760 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:55:02.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:02.930+0000 7faa6a732640 1 Processor -- start 2024-05-09T05:55:02.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:02.930+0000 7faa6a732640 1 -- start start 2024-05-09T05:55:02.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:02.934+0000 7faa6a732640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7faa6415da90 0x7faa640c7570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:02.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:02.934+0000 7faa6a732640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7faa6415dea0 0x7faa640745b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:02.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:02.934+0000 7faa6a732640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa6415a4f0 con 0x7faa64074af0 2024-05-09T05:55:02.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:02.934+0000 7faa6a732640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7faa641513f0 con 0x7faa6415dea0 2024-05-09T05:55:02.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:02.934+0000 7faa6a732640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7faa640c84f0 con 0x7faa6415da90 2024-05-09T05:55:02.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:02.934+0000 7faa637fe640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7faa6415dea0 0x7faa640745b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:02.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:02.934+0000 7faa637fe640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7faa6415dea0 0x7faa640745b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45618/0 (socket says 172.21.15.72:45618) 2024-05-09T05:55:02.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:02.934+0000 7faa637fe640 1 -- 172.21.15.72:0/3057794999 learned_addr learned my addr 172.21.15.72:0/3057794999 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:55:02.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:02.934+0000 7faa63fff640 1 --2- 172.21.15.72:0/3057794999 >> v2:172.21.15.110:3300/0 conn(0x7faa6415da90 0x7faa640c7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:02.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:02.934+0000 7faa637fe640 1 -- 172.21.15.72:0/3057794999 >> v2:172.21.15.110:3300/0 conn(0x7faa6415da90 msgr2=0x7faa640c7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:55:02.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:02.934+0000 7faa637fe640 1 --2- 172.21.15.72:0/3057794999 >> v2:172.21.15.110:3300/0 conn(0x7faa6415da90 0x7faa640c7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:02.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:02.934+0000 7faa637fe640 1 -- 172.21.15.72:0/3057794999 >> v1:172.21.15.110:6789/0 conn(0x7faa64074af0 legacy=0x7faa6406fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:02.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:02.934+0000 7faa637fe640 1 -- 172.21.15.72:0/3057794999 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa640c87d0 con 0x7faa6415dea0 2024-05-09T05:55:02.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:02.938+0000 7faa637fe640 1 --2- 172.21.15.72:0/3057794999 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa6415dea0 0x7faa640745b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7faa64071b70 tx=0x7faa5801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0a59f1b104e3550 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:55:02.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:02.938+0000 7faa62ffd640 1 -- 172.21.15.72:0/3057794999 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa580b0070 con 0x7faa6415dea0 2024-05-09T05:55:02.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:02.938+0000 7faa62ffd640 1 -- 172.21.15.72:0/3057794999 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa580ab600 con 0x7faa6415dea0 2024-05-09T05:55:02.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:02.938+0000 7faa62ffd640 1 -- 172.21.15.72:0/3057794999 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa580ab9d0 con 0x7faa6415dea0 2024-05-09T05:55:02.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:02.938+0000 7faa6a732640 1 -- 172.21.15.72:0/3057794999 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa6415dea0 msgr2=0x7faa640745b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:02.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:02.938+0000 7faa6a732640 1 --2- 172.21.15.72:0/3057794999 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa6415dea0 0x7faa640745b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7faa64071b70 tx=0x7faa5801c520 comp rx=0 tx=0).stop 2024-05-09T05:55:02.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:02.938+0000 7faa6a732640 1 -- 172.21.15.72:0/3057794999 shutdown_connections 2024-05-09T05:55:02.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:02.938+0000 7faa6a732640 1 --2- 172.21.15.72:0/3057794999 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa6415dea0 0x7faa640745b0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:02.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:02.938+0000 7faa6a732640 1 --2- 172.21.15.72:0/3057794999 >> v2:172.21.15.110:3300/0 conn(0x7faa6415da90 0x7faa640c7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:02.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:02.938+0000 7faa6a732640 1 -- 172.21.15.72:0/3057794999 >> 172.21.15.72:0/3057794999 conn(0x7faa640cde90 msgr2=0x7faa640ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:55:02.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:02.938+0000 7faa6a732640 1 -- 172.21.15.72:0/3057794999 shutdown_connections 2024-05-09T05:55:02.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:02.938+0000 7faa6a732640 1 -- 172.21.15.72:0/3057794999 wait complete. 2024-05-09T05:55:02.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:02.938+0000 7faa6a732640 1 Processor -- start 2024-05-09T05:55:02.927 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:02.938+0000 7faa6a732640 1 -- start start 2024-05-09T05:55:02.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:02.942+0000 7faa6a732640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa64074af0 0x7faa641424c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:02.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:02.942+0000 7faa6a732640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa6415da90 0x7faa6415ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:02.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:02.942+0000 7faa6a732640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa6415dea0 0x7faa6413d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:02.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:02.942+0000 7faa6a732640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7faa640c81b0 con 0x7faa6415dea0 2024-05-09T05:55:02.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:02.942+0000 7faa6a732640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7faa640c70e0 con 0x7faa6415da90 2024-05-09T05:55:02.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:02.942+0000 7faa6a732640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7faa64154ab0 con 0x7faa64074af0 2024-05-09T05:55:02.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:02.942+0000 7faa68ccf640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa6415dea0 0x7faa6413d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:02.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:02.942+0000 7faa68ccf640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa6415dea0 0x7faa6413d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45632/0 (socket says 172.21.15.72:45632) 2024-05-09T05:55:02.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:02.942+0000 7faa68ccf640 1 -- 172.21.15.72:0/2344357378 learned_addr learned my addr 172.21.15.72:0/2344357378 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:55:02.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:02.942+0000 7faa637fe640 1 --2- 172.21.15.72:0/2344357378 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa6415da90 0x7faa6415ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:02.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:02.942+0000 7faa63fff640 1 --2- 172.21.15.72:0/2344357378 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa64074af0 0x7faa641424c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:02.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:02.942+0000 7faa68ccf640 1 -- 172.21.15.72:0/2344357378 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa64074af0 msgr2=0x7faa641424c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:02.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:02.942+0000 7faa68ccf640 1 --2- 172.21.15.72:0/2344357378 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa64074af0 0x7faa641424c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:02.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:02.942+0000 7faa68ccf640 1 -- 172.21.15.72:0/2344357378 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa6415da90 msgr2=0x7faa6415ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:02.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:02.942+0000 7faa68ccf640 1 --2- 172.21.15.72:0/2344357378 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa6415da90 0x7faa6415ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:02.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:02.942+0000 7faa68ccf640 1 -- 172.21.15.72:0/2344357378 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa64142a00 con 0x7faa6415dea0 2024-05-09T05:55:02.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:02.942+0000 7faa63fff640 1 --2- 172.21.15.72:0/2344357378 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa64074af0 0x7faa641424c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:55:02.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:02.942+0000 7faa68ccf640 1 --2- 172.21.15.72:0/2344357378 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa6415dea0 0x7faa6413d210 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7faa5c00c6b0 tx=0x7faa5c00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:55:02.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:02.942+0000 7faa60ff9640 1 -- 172.21.15.72:0/2344357378 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa5c003b80 con 0x7faa6415dea0 2024-05-09T05:55:02.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:02.942+0000 7faa60ff9640 1 -- 172.21.15.72:0/2344357378 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa5c003d40 con 0x7faa6415dea0 2024-05-09T05:55:02.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:02.942+0000 7faa6a732640 1 -- 172.21.15.72:0/2344357378 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa641439d0 con 0x7faa6415dea0 2024-05-09T05:55:02.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:02.942+0000 7faa60ff9640 1 -- 172.21.15.72:0/2344357378 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa5c005310 con 0x7faa6415dea0 2024-05-09T05:55:02.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:02.942+0000 7faa6a732640 1 -- 172.21.15.72:0/2344357378 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa640ca5b0 con 0x7faa6415dea0 2024-05-09T05:55:02.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:02.942+0000 7faa6a732640 1 -- 172.21.15.72:0/2344357378 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa6406a520 con 0x7faa6415dea0 2024-05-09T05:55:02.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:02.942+0000 7faa60ff9640 1 -- 172.21.15.72:0/2344357378 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7faa5c0054b0 con 0x7faa6415dea0 2024-05-09T05:55:02.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:02.942+0000 7faa60ff9640 1 --2- 172.21.15.72:0/2344357378 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7faa5006f400 0x7faa50071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:02.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:02.946+0000 7faa60ff9640 1 -- 172.21.15.72:0/2344357378 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7faa5c08fed0 con 0x7faa6415dea0 2024-05-09T05:55:02.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:02.946+0000 7faa63fff640 1 --2- 172.21.15.72:0/2344357378 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7faa5006f400 0x7faa50071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:02.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:02.946+0000 7faa63fff640 1 --2- 172.21.15.72:0/2344357378 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7faa5006f400 0x7faa50071910 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7faa640754b0 tx=0x7faa54008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:55:02.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:02.946+0000 7faa60ff9640 1 -- 172.21.15.72:0/2344357378 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7faa5c05cbc0 con 0x7faa6415dea0 2024-05-09T05:55:03.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:03.146+0000 7faa6a732640 1 -- 172.21.15.72:0/2344357378 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faa640cab30 con 0x7faa6415dea0 2024-05-09T05:55:03.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:03.146+0000 7faa60ff9640 1 -- 172.21.15.72:0/2344357378 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6915 (secure 0 0 0) 0x7faa5c05c4c0 con 0x7faa6415dea0 2024-05-09T05:55:03.133 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:55:03.133 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6834/1142956298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1142956298},{"type":"v1","addr":"172.21.15.72:6834","nonce":1142956298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:53:23.494975+0000","modified":"2024-05-09T05:54:11.535513+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4297,"mds_1":4287,"mds_2":4263,"mds_3":4259,"mds_4":4257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4257":{"gid":4257,"name":"a","rank":4,"incarnation":18,"state":"up:active","state_seq":15,"addr":"172.21.15.72:6835/3946563056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":3946563056},{"type":"v1","addr":"172.21.15.72:6835","nonce":3946563056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4259":{"gid":4259,"name":"f","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.110:6838/840351907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":840351907},{"type":"v1","addr":"172.21.15.110:6838","nonce":840351907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4263":{"gid":4263,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.72:6837/1048256382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":1048256382},{"type":"v1","addr":"172.21.15.72:6837","nonce":1048256382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.110:6839/966325499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6837","nonce":966325499},{"type":"v1","addr":"172.21.15.110:6839","nonce":966325499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6836/4134424941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":4134424941},{"type":"v1","addr":"172.21.15.110:6836","nonce":4134424941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4257,4259,4263,4287,4297]},"id":1}]} 2024-05-09T05:55:03.134 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 19 2024-05-09T05:55:03.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:03.146+0000 7faa6a732640 1 -- 172.21.15.72:0/2344357378 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7faa5006f400 msgr2=0x7faa50071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:03.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:03.146+0000 7faa6a732640 1 --2- 172.21.15.72:0/2344357378 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7faa5006f400 0x7faa50071910 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7faa640754b0 tx=0x7faa54008040 comp rx=0 tx=0).stop 2024-05-09T05:55:03.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:03.146+0000 7faa6a732640 1 -- 172.21.15.72:0/2344357378 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa6415dea0 msgr2=0x7faa6413d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:03.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:03.146+0000 7faa6a732640 1 --2- 172.21.15.72:0/2344357378 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa6415dea0 0x7faa6413d210 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7faa5c00c6b0 tx=0x7faa5c00cb70 comp rx=0 tx=0).stop 2024-05-09T05:55:03.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:03.146+0000 7faa6a732640 1 -- 172.21.15.72:0/2344357378 shutdown_connections 2024-05-09T05:55:03.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:03.146+0000 7faa6a732640 1 --2- 172.21.15.72:0/2344357378 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7faa5006f400 0x7faa50071910 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:03.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:03.146+0000 7faa6a732640 1 --2- 172.21.15.72:0/2344357378 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa6415dea0 0x7faa6413d210 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:03.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:03.146+0000 7faa6a732640 1 --2- 172.21.15.72:0/2344357378 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa6415da90 0x7faa6415ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:03.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:03.146+0000 7faa6a732640 1 --2- 172.21.15.72:0/2344357378 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa64074af0 0x7faa641424c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:03.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:03.146+0000 7faa6a732640 1 -- 172.21.15.72:0/2344357378 >> 172.21.15.72:0/2344357378 conn(0x7faa640cde90 msgr2=0x7faa64149340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:55:03.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:03.150+0000 7faa6a732640 1 -- 172.21.15.72:0/2344357378 shutdown_connections 2024-05-09T05:55:03.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:03.150+0000 7faa6a732640 1 -- 172.21.15.72:0/2344357378 wait complete. 2024-05-09T05:55:03.155 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-05-09T05:55:05.156 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:55:05.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.330+0000 7faba7387640 1 Processor -- start 2024-05-09T05:55:05.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.330+0000 7faba7387640 1 -- start start 2024-05-09T05:55:05.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.330+0000 7faba7387640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7faba0159ed0 0x7faba0153860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:05.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.330+0000 7faba7387640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7faba0072f40 0x7faba0073350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:05.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.330+0000 7faba7387640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faba0072b00 con 0x7faba00c6cd0 2024-05-09T05:55:05.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.330+0000 7faba7387640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7faba0072540 con 0x7faba0159ed0 2024-05-09T05:55:05.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.330+0000 7faba7387640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7faba0072820 con 0x7faba0072f40 2024-05-09T05:55:05.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.330+0000 7faba5123640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7faba0159ed0 0x7faba0153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:05.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.330+0000 7faba5924640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7faba00c6cd0 0x7faba00c70e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51310/0 (socket says 172.21.15.72:51310) 2024-05-09T05:55:05.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.330+0000 7faba5924640 1 -- 172.21.15.72:0/3092369174 learned_addr learned my addr 172.21.15.72:0/3092369174 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:55:05.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.330+0000 7faba4922640 1 --2- 172.21.15.72:0/3092369174 >> v2:172.21.15.110:3300/0 conn(0x7faba0072f40 0x7faba0073350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:05.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.330+0000 7faba5123640 1 -- 172.21.15.72:0/3092369174 >> v2:172.21.15.110:3300/0 conn(0x7faba0072f40 msgr2=0x7faba0073350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:55:05.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.330+0000 7faba5123640 1 --2- 172.21.15.72:0/3092369174 >> v2:172.21.15.110:3300/0 conn(0x7faba0072f40 0x7faba0073350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:05.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.330+0000 7faba5123640 1 -- 172.21.15.72:0/3092369174 >> v1:172.21.15.72:6789/0 conn(0x7faba00c6cd0 legacy=0x7faba00c70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:05.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.330+0000 7faba5123640 1 -- 172.21.15.72:0/3092369174 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faba00c64d0 con 0x7faba0159ed0 2024-05-09T05:55:05.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.334+0000 7faba5123640 1 --2- 172.21.15.72:0/3092369174 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faba0159ed0 0x7faba0153860 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7faba0071e50 tx=0x7fab9c01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ce58df391ffa64c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:55:05.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.334+0000 7fab97fff640 1 -- 172.21.15.72:0/3092369174 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab9c0b5070 con 0x7faba0159ed0 2024-05-09T05:55:05.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.334+0000 7fab97fff640 1 -- 172.21.15.72:0/3092369174 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab9c0a8970 con 0x7faba0159ed0 2024-05-09T05:55:05.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.334+0000 7fab97fff640 1 -- 172.21.15.72:0/3092369174 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab9c0a8d40 con 0x7faba0159ed0 2024-05-09T05:55:05.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.334+0000 7faba7387640 1 -- 172.21.15.72:0/3092369174 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faba0159ed0 msgr2=0x7faba0153860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:05.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.334+0000 7faba7387640 1 --2- 172.21.15.72:0/3092369174 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faba0159ed0 0x7faba0153860 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7faba0071e50 tx=0x7fab9c01ec70 comp rx=0 tx=0).stop 2024-05-09T05:55:05.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.334+0000 7faba7387640 1 -- 172.21.15.72:0/3092369174 shutdown_connections 2024-05-09T05:55:05.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.334+0000 7faba7387640 1 --2- 172.21.15.72:0/3092369174 >> v2:172.21.15.110:3300/0 conn(0x7faba0072f40 0x7faba0073350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:05.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.334+0000 7faba7387640 1 --2- 172.21.15.72:0/3092369174 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faba0159ed0 0x7faba0153860 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:05.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.334+0000 7faba7387640 1 -- 172.21.15.72:0/3092369174 >> 172.21.15.72:0/3092369174 conn(0x7faba00cde90 msgr2=0x7faba00ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:55:05.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.334+0000 7faba7387640 1 -- 172.21.15.72:0/3092369174 shutdown_connections 2024-05-09T05:55:05.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.334+0000 7faba7387640 1 -- 172.21.15.72:0/3092369174 wait complete. 2024-05-09T05:55:05.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.338+0000 7faba7387640 1 Processor -- start 2024-05-09T05:55:05.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.338+0000 7faba7387640 1 -- start start 2024-05-09T05:55:05.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.338+0000 7faba7387640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faba0072f40 0x7faba01f6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:05.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.338+0000 7faba7387640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faba00c6cd0 0x7faba0152160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:05.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.338+0000 7faba7387640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faba0159ed0 0x7faba00c8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:05.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.338+0000 7faba7387640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7faba00c4e30 con 0x7faba0159ed0 2024-05-09T05:55:05.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.338+0000 7faba7387640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7faba00c4cb0 con 0x7faba0072f40 2024-05-09T05:55:05.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.338+0000 7faba7387640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7faba0163d80 con 0x7faba00c6cd0 2024-05-09T05:55:05.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.338+0000 7faba5924640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faba0159ed0 0x7faba00c8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:05.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.338+0000 7faba5924640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faba0159ed0 0x7faba00c8ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45646/0 (socket says 172.21.15.72:45646) 2024-05-09T05:55:05.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.338+0000 7faba5123640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faba0072f40 0x7faba01f6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:05.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.338+0000 7faba5924640 1 -- 172.21.15.72:0/3243141715 learned_addr learned my addr 172.21.15.72:0/3243141715 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:55:05.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.338+0000 7faba4922640 1 --2- 172.21.15.72:0/3243141715 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faba00c6cd0 0x7faba0152160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:05.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.338+0000 7faba5924640 1 -- 172.21.15.72:0/3243141715 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faba00c6cd0 msgr2=0x7faba0152160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:05.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.338+0000 7faba5924640 1 --2- 172.21.15.72:0/3243141715 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faba00c6cd0 0x7faba0152160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:05.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.338+0000 7faba5924640 1 -- 172.21.15.72:0/3243141715 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faba0072f40 msgr2=0x7faba01f6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:05.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.338+0000 7faba5924640 1 --2- 172.21.15.72:0/3243141715 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faba0072f40 0x7faba01f6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:05.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.338+0000 7faba5924640 1 -- 172.21.15.72:0/3243141715 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faba0152ad0 con 0x7faba0159ed0 2024-05-09T05:55:05.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.338+0000 7faba5924640 1 --2- 172.21.15.72:0/3243141715 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faba0159ed0 0x7faba00c8ac0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fab9800cab0 tx=0x7fab9800cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:55:05.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.338+0000 7fab95ffb640 1 -- 172.21.15.72:0/3243141715 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab98017070 con 0x7faba0159ed0 2024-05-09T05:55:05.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.338+0000 7fab95ffb640 1 -- 172.21.15.72:0/3243141715 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab9800ac30 con 0x7faba0159ed0 2024-05-09T05:55:05.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.338+0000 7faba7387640 1 -- 172.21.15.72:0/3243141715 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faba014bc70 con 0x7faba0159ed0 2024-05-09T05:55:05.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.338+0000 7fab95ffb640 1 -- 172.21.15.72:0/3243141715 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab98012400 con 0x7faba0159ed0 2024-05-09T05:55:05.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.338+0000 7faba7387640 1 -- 172.21.15.72:0/3243141715 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faba014c230 con 0x7faba0159ed0 2024-05-09T05:55:05.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.338+0000 7faba7387640 1 -- 172.21.15.72:0/3243141715 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faba006a520 con 0x7faba0159ed0 2024-05-09T05:55:05.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.342+0000 7fab95ffb640 1 -- 172.21.15.72:0/3243141715 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fab9801a070 con 0x7faba0159ed0 2024-05-09T05:55:05.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.342+0000 7fab95ffb640 1 --2- 172.21.15.72:0/3243141715 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fab8406f400 0x7fab84071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:05.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.342+0000 7fab95ffb640 1 -- 172.21.15.72:0/3243141715 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7fab9808f970 con 0x7faba0159ed0 2024-05-09T05:55:05.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.342+0000 7faba5123640 1 --2- 172.21.15.72:0/3243141715 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fab8406f400 0x7fab84071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:05.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.342+0000 7faba5123640 1 --2- 172.21.15.72:0/3243141715 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fab8406f400 0x7fab84071910 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fab9c0b2000 tx=0x7fab9c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:55:05.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.346+0000 7fab95ffb640 1 -- 172.21.15.72:0/3243141715 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fab9805c010 con 0x7faba0159ed0 2024-05-09T05:55:05.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.538+0000 7faba7387640 1 -- 172.21.15.72:0/3243141715 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faba0163470 con 0x7faba0159ed0 2024-05-09T05:55:05.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.542+0000 7fab95ffb640 1 -- 172.21.15.72:0/3243141715 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6915 (secure 0 0 0) 0x7fab98060310 con 0x7faba0159ed0 2024-05-09T05:55:05.528 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:55:05.528 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6834/1142956298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1142956298},{"type":"v1","addr":"172.21.15.72:6834","nonce":1142956298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:53:23.494975+0000","modified":"2024-05-09T05:54:11.535513+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4297,"mds_1":4287,"mds_2":4263,"mds_3":4259,"mds_4":4257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4257":{"gid":4257,"name":"a","rank":4,"incarnation":18,"state":"up:active","state_seq":15,"addr":"172.21.15.72:6835/3946563056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":3946563056},{"type":"v1","addr":"172.21.15.72:6835","nonce":3946563056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4259":{"gid":4259,"name":"f","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.110:6838/840351907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":840351907},{"type":"v1","addr":"172.21.15.110:6838","nonce":840351907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4263":{"gid":4263,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.72:6837/1048256382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":1048256382},{"type":"v1","addr":"172.21.15.72:6837","nonce":1048256382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.110:6839/966325499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6837","nonce":966325499},{"type":"v1","addr":"172.21.15.110:6839","nonce":966325499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6836/4134424941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":4134424941},{"type":"v1","addr":"172.21.15.110:6836","nonce":4134424941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4257,4259,4263,4287,4297]},"id":1}]} 2024-05-09T05:55:05.528 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 19 2024-05-09T05:55:05.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.542+0000 7faba7387640 1 -- 172.21.15.72:0/3243141715 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fab8406f400 msgr2=0x7fab84071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:05.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.542+0000 7faba7387640 1 --2- 172.21.15.72:0/3243141715 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fab8406f400 0x7fab84071910 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fab9c0b2000 tx=0x7fab9c008040 comp rx=0 tx=0).stop 2024-05-09T05:55:05.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.542+0000 7faba7387640 1 -- 172.21.15.72:0/3243141715 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faba0159ed0 msgr2=0x7faba00c8ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:05.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.542+0000 7faba7387640 1 --2- 172.21.15.72:0/3243141715 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faba0159ed0 0x7faba00c8ac0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fab9800cab0 tx=0x7fab9800cf70 comp rx=0 tx=0).stop 2024-05-09T05:55:05.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.542+0000 7faba7387640 1 -- 172.21.15.72:0/3243141715 shutdown_connections 2024-05-09T05:55:05.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.542+0000 7faba7387640 1 --2- 172.21.15.72:0/3243141715 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fab8406f400 0x7fab84071910 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:05.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.542+0000 7faba7387640 1 --2- 172.21.15.72:0/3243141715 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faba0159ed0 0x7faba00c8ac0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:05.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.542+0000 7faba7387640 1 --2- 172.21.15.72:0/3243141715 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faba00c6cd0 0x7faba0152160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:05.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.542+0000 7faba7387640 1 --2- 172.21.15.72:0/3243141715 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faba0072f40 0x7faba01f6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:05.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.542+0000 7faba7387640 1 -- 172.21.15.72:0/3243141715 >> 172.21.15.72:0/3243141715 conn(0x7faba00cde90 msgr2=0x7faba0074ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:55:05.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.542+0000 7faba7387640 1 -- 172.21.15.72:0/3243141715 shutdown_connections 2024-05-09T05:55:05.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:05.542+0000 7faba7387640 1 -- 172.21.15.72:0/3243141715 wait complete. 2024-05-09T05:55:05.547 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-05-09T05:55:07.548 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:55:07.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.722+0000 7fc260f01640 1 Processor -- start 2024-05-09T05:55:07.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.722+0000 7fc260f01640 1 -- start start 2024-05-09T05:55:07.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.726+0000 7fc260f01640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc25c0c77a0 0x7fc25c1537d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:07.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.726+0000 7fc260f01640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc25c161d70 0x7fc25c164190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:07.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.726+0000 7fc260f01640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc25c0c72c0 con 0x7fc25c074740 2024-05-09T05:55:07.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.726+0000 7fc260f01640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fc25c0c7bb0 con 0x7fc25c161d70 2024-05-09T05:55:07.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.726+0000 7fc260f01640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fc25c074460 con 0x7fc25c0c77a0 2024-05-09T05:55:07.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.726+0000 7fc25ad9d640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc25c161d70 0x7fc25c164190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:07.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.726+0000 7fc253fff640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc25c074740 0x7fc25c072e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51326/0 (socket says 172.21.15.72:51326) 2024-05-09T05:55:07.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.726+0000 7fc253fff640 1 -- 172.21.15.72:0/2576320728 learned_addr learned my addr 172.21.15.72:0/2576320728 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:55:07.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.726+0000 7fc25a59c640 1 --2- 172.21.15.72:0/2576320728 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc25c0c77a0 0x7fc25c1537d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:07.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.726+0000 7fc25ad9d640 1 -- 172.21.15.72:0/2576320728 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc25c0c77a0 msgr2=0x7fc25c1537d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:55:07.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.726+0000 7fc25ad9d640 1 --2- 172.21.15.72:0/2576320728 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc25c0c77a0 0x7fc25c1537d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:07.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.726+0000 7fc25ad9d640 1 -- 172.21.15.72:0/2576320728 >> v1:172.21.15.72:6789/0 conn(0x7fc25c074740 legacy=0x7fc25c072e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:07.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.726+0000 7fc259d9b640 1 -- 172.21.15.72:0/2576320728 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2313248982 0 0) 0x7fc25c0c72c0 con 0x7fc25c074740 2024-05-09T05:55:07.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.726+0000 7fc25ad9d640 1 -- 172.21.15.72:0/2576320728 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc25c073af0 con 0x7fc25c161d70 2024-05-09T05:55:07.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.730+0000 7fc25ad9d640 1 --2- 172.21.15.72:0/2576320728 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc25c161d70 0x7fc25c164190 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc254009d90 tx=0x7fc25401c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d18a34464ab6974e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:55:07.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.730+0000 7fc259d9b640 1 -- 172.21.15.72:0/2576320728 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2540b2070 con 0x7fc25c161d70 2024-05-09T05:55:07.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.730+0000 7fc259d9b640 1 -- 172.21.15.72:0/2576320728 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2540a5a40 con 0x7fc25c161d70 2024-05-09T05:55:07.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.730+0000 7fc259d9b640 1 -- 172.21.15.72:0/2576320728 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2540a5e10 con 0x7fc25c161d70 2024-05-09T05:55:07.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.730+0000 7fc260f01640 1 -- 172.21.15.72:0/2576320728 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc25c161d70 msgr2=0x7fc25c164190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:07.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.730+0000 7fc260f01640 1 --2- 172.21.15.72:0/2576320728 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc25c161d70 0x7fc25c164190 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc254009d90 tx=0x7fc25401c960 comp rx=0 tx=0).stop 2024-05-09T05:55:07.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.730+0000 7fc260f01640 1 -- 172.21.15.72:0/2576320728 shutdown_connections 2024-05-09T05:55:07.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.730+0000 7fc260f01640 1 --2- 172.21.15.72:0/2576320728 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc25c161d70 0x7fc25c164190 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:07.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.730+0000 7fc260f01640 1 --2- 172.21.15.72:0/2576320728 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc25c0c77a0 0x7fc25c1537d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:07.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.730+0000 7fc260f01640 1 -- 172.21.15.72:0/2576320728 >> 172.21.15.72:0/2576320728 conn(0x7fc25c0cde90 msgr2=0x7fc25c0ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:55:07.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.730+0000 7fc260f01640 1 -- 172.21.15.72:0/2576320728 shutdown_connections 2024-05-09T05:55:07.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.730+0000 7fc260f01640 1 -- 172.21.15.72:0/2576320728 wait complete. 2024-05-09T05:55:07.718 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.730+0000 7fc260f01640 1 Processor -- start 2024-05-09T05:55:07.718 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.730+0000 7fc260f01640 1 -- start start 2024-05-09T05:55:07.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.734+0000 7fc260f01640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc25c074740 0x7fc25c1629f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:07.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.734+0000 7fc260f01640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc25c0c77a0 0x7fc25c15c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:07.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.734+0000 7fc260f01640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc25c161d70 0x7fc25c1f2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:07.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.734+0000 7fc260f01640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fc25c0c4cb0 con 0x7fc25c0c77a0 2024-05-09T05:55:07.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.734+0000 7fc260f01640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fc25c072940 con 0x7fc25c074740 2024-05-09T05:55:07.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.734+0000 7fc260f01640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fc25c0c4e30 con 0x7fc25c161d70 2024-05-09T05:55:07.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.734+0000 7fc253fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc25c0c77a0 0x7fc25c15c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:07.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.734+0000 7fc253fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc25c0c77a0 0x7fc25c15c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45658/0 (socket says 172.21.15.72:45658) 2024-05-09T05:55:07.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.734+0000 7fc253fff640 1 -- 172.21.15.72:0/1007052379 learned_addr learned my addr 172.21.15.72:0/1007052379 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:55:07.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.734+0000 7fc25a59c640 1 --2- 172.21.15.72:0/1007052379 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc25c074740 0x7fc25c1629f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:07.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.734+0000 7fc25ad9d640 1 --2- 172.21.15.72:0/1007052379 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc25c161d70 0x7fc25c1f2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:07.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.734+0000 7fc253fff640 1 -- 172.21.15.72:0/1007052379 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc25c161d70 msgr2=0x7fc25c1f2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:07.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.734+0000 7fc253fff640 1 --2- 172.21.15.72:0/1007052379 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc25c161d70 0x7fc25c1f2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:07.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.734+0000 7fc253fff640 1 -- 172.21.15.72:0/1007052379 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc25c074740 msgr2=0x7fc25c1629f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:07.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.734+0000 7fc253fff640 1 --2- 172.21.15.72:0/1007052379 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc25c074740 0x7fc25c1629f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:07.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.734+0000 7fc253fff640 1 -- 172.21.15.72:0/1007052379 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc25c1f2f70 con 0x7fc25c0c77a0 2024-05-09T05:55:07.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.734+0000 7fc25a59c640 1 --2- 172.21.15.72:0/1007052379 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc25c074740 0x7fc25c1629f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:55:07.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.734+0000 7fc25ad9d640 1 --2- 172.21.15.72:0/1007052379 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc25c161d70 0x7fc25c1f2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:55:07.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.734+0000 7fc253fff640 1 --2- 172.21.15.72:0/1007052379 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc25c0c77a0 0x7fc25c15c760 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc24400c3c0 tx=0x7fc24400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:55:07.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.734+0000 7fc252ffd640 1 -- 172.21.15.72:0/1007052379 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc244017070 con 0x7fc25c0c77a0 2024-05-09T05:55:07.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.734+0000 7fc252ffd640 1 -- 172.21.15.72:0/1007052379 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc244005d10 con 0x7fc25c0c77a0 2024-05-09T05:55:07.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.734+0000 7fc252ffd640 1 -- 172.21.15.72:0/1007052379 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc244007310 con 0x7fc25c0c77a0 2024-05-09T05:55:07.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.734+0000 7fc260f01640 1 -- 172.21.15.72:0/1007052379 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc25c162f30 con 0x7fc25c0c77a0 2024-05-09T05:55:07.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.734+0000 7fc260f01640 1 -- 172.21.15.72:0/1007052379 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc25c1624a0 con 0x7fc25c0c77a0 2024-05-09T05:55:07.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.734+0000 7fc260f01640 1 -- 172.21.15.72:0/1007052379 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc25c06a520 con 0x7fc25c0c77a0 2024-05-09T05:55:07.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.738+0000 7fc252ffd640 1 -- 172.21.15.72:0/1007052379 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fc24401a070 con 0x7fc25c0c77a0 2024-05-09T05:55:07.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.738+0000 7fc252ffd640 1 --2- 172.21.15.72:0/1007052379 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fc23c06f400 0x7fc23c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:07.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.738+0000 7fc252ffd640 1 -- 172.21.15.72:0/1007052379 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7fc24408e910 con 0x7fc25c0c77a0 2024-05-09T05:55:07.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.738+0000 7fc25a59c640 1 --2- 172.21.15.72:0/1007052379 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fc23c06f400 0x7fc23c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:07.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.738+0000 7fc25a59c640 1 --2- 172.21.15.72:0/1007052379 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fc23c06f400 0x7fc23c071910 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc25c0c41c0 tx=0x7fc24c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:55:07.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.742+0000 7fc252ffd640 1 -- 172.21.15.72:0/1007052379 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fc24405b520 con 0x7fc25c0c77a0 2024-05-09T05:55:07.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.938+0000 7fc260f01640 1 -- 172.21.15.72:0/1007052379 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc25c072c50 con 0x7fc25c0c77a0 2024-05-09T05:55:07.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.938+0000 7fc252ffd640 1 -- 172.21.15.72:0/1007052379 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6915 (secure 0 0 0) 0x7fc24405ae20 con 0x7fc25c0c77a0 2024-05-09T05:55:07.926 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:55:07.927 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6834/1142956298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1142956298},{"type":"v1","addr":"172.21.15.72:6834","nonce":1142956298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:53:23.494975+0000","modified":"2024-05-09T05:54:11.535513+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4297,"mds_1":4287,"mds_2":4263,"mds_3":4259,"mds_4":4257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4257":{"gid":4257,"name":"a","rank":4,"incarnation":18,"state":"up:active","state_seq":15,"addr":"172.21.15.72:6835/3946563056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":3946563056},{"type":"v1","addr":"172.21.15.72:6835","nonce":3946563056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4259":{"gid":4259,"name":"f","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.110:6838/840351907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":840351907},{"type":"v1","addr":"172.21.15.110:6838","nonce":840351907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4263":{"gid":4263,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.72:6837/1048256382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":1048256382},{"type":"v1","addr":"172.21.15.72:6837","nonce":1048256382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.110:6839/966325499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6837","nonce":966325499},{"type":"v1","addr":"172.21.15.110:6839","nonce":966325499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6836/4134424941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":4134424941},{"type":"v1","addr":"172.21.15.110:6836","nonce":4134424941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4257,4259,4263,4287,4297]},"id":1}]} 2024-05-09T05:55:07.927 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 19 2024-05-09T05:55:07.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.942+0000 7fc260f01640 1 -- 172.21.15.72:0/1007052379 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fc23c06f400 msgr2=0x7fc23c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:07.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.942+0000 7fc260f01640 1 --2- 172.21.15.72:0/1007052379 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fc23c06f400 0x7fc23c071910 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc25c0c41c0 tx=0x7fc24c008040 comp rx=0 tx=0).stop 2024-05-09T05:55:07.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.942+0000 7fc260f01640 1 -- 172.21.15.72:0/1007052379 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc25c0c77a0 msgr2=0x7fc25c15c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:07.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.942+0000 7fc260f01640 1 --2- 172.21.15.72:0/1007052379 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc25c0c77a0 0x7fc25c15c760 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc24400c3c0 tx=0x7fc24400c880 comp rx=0 tx=0).stop 2024-05-09T05:55:07.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.942+0000 7fc260f01640 1 -- 172.21.15.72:0/1007052379 shutdown_connections 2024-05-09T05:55:07.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.942+0000 7fc260f01640 1 --2- 172.21.15.72:0/1007052379 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fc23c06f400 0x7fc23c071910 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:07.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.942+0000 7fc260f01640 1 --2- 172.21.15.72:0/1007052379 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc25c161d70 0x7fc25c1f2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:07.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.942+0000 7fc260f01640 1 --2- 172.21.15.72:0/1007052379 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc25c0c77a0 0x7fc25c15c760 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:07.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.942+0000 7fc260f01640 1 --2- 172.21.15.72:0/1007052379 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc25c074740 0x7fc25c1629f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:07.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.942+0000 7fc260f01640 1 -- 172.21.15.72:0/1007052379 >> 172.21.15.72:0/1007052379 conn(0x7fc25c0cde90 msgr2=0x7fc25c0c8fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:55:07.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.942+0000 7fc260f01640 1 -- 172.21.15.72:0/1007052379 shutdown_connections 2024-05-09T05:55:07.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:07.942+0000 7fc260f01640 1 -- 172.21.15.72:0/1007052379 wait complete. 2024-05-09T05:55:07.948 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-05-09T05:55:09.949 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:55:10.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.122+0000 7f68f1c46640 1 Processor -- start 2024-05-09T05:55:10.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.122+0000 7f68f1c46640 1 -- start start 2024-05-09T05:55:10.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.126+0000 7f68f1c46640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f68ec15dea0 0x7f68ec0745b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:10.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.126+0000 7f68f1c46640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f68ec074af0 0x7f68ec164e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:10.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.126+0000 7f68f1c46640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68ec0c7c80 con 0x7f68ec15da90 2024-05-09T05:55:10.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.126+0000 7f68f1c46640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f68ec1513f0 con 0x7f68ec15dea0 2024-05-09T05:55:10.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.126+0000 7f68f1c46640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f68ec15a4f0 con 0x7f68ec074af0 2024-05-09T05:55:10.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.126+0000 7f68eaffd640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f68ec15dea0 0x7f68ec0745b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:10.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.126+0000 7f68eb7fe640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f68ec15da90 0x7f68ec0c7570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51330/0 (socket says 172.21.15.72:51330) 2024-05-09T05:55:10.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.126+0000 7f68eb7fe640 1 -- 172.21.15.72:0/312792940 learned_addr learned my addr 172.21.15.72:0/312792940 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:55:10.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.126+0000 7f68ebfff640 1 --2- 172.21.15.72:0/312792940 >> v2:172.21.15.110:3300/0 conn(0x7f68ec074af0 0x7f68ec164e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:10.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.126+0000 7f68eaffd640 1 -- 172.21.15.72:0/312792940 >> v2:172.21.15.110:3300/0 conn(0x7f68ec074af0 msgr2=0x7f68ec164e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:55:10.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.126+0000 7f68eaffd640 1 --2- 172.21.15.72:0/312792940 >> v2:172.21.15.110:3300/0 conn(0x7f68ec074af0 0x7f68ec164e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:10.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.126+0000 7f68eaffd640 1 -- 172.21.15.72:0/312792940 >> v1:172.21.15.72:6789/0 conn(0x7f68ec15da90 legacy=0x7f68ec0c7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:10.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.126+0000 7f68eaffd640 1 -- 172.21.15.72:0/312792940 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68ec0c84f0 con 0x7f68ec15dea0 2024-05-09T05:55:10.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.126+0000 7f68ea7fc640 1 -- 172.21.15.72:0/312792940 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1320832152 0 0) 0x7f68ec0c7c80 con 0x7f68ec15da90 2024-05-09T05:55:10.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.130+0000 7f68eaffd640 1 --2- 172.21.15.72:0/312792940 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68ec15dea0 0x7f68ec0745b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f68ec0c7490 tx=0x7f68e001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6663c3caa63bafc server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:55:10.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.130+0000 7f68ea7fc640 1 -- 172.21.15.72:0/312792940 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e00b0070 con 0x7f68ec15dea0 2024-05-09T05:55:10.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.130+0000 7f68ea7fc640 1 -- 172.21.15.72:0/312792940 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68e00ab600 con 0x7f68ec15dea0 2024-05-09T05:55:10.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.130+0000 7f68ea7fc640 1 -- 172.21.15.72:0/312792940 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e00ab9d0 con 0x7f68ec15dea0 2024-05-09T05:55:10.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.130+0000 7f68f1c46640 1 -- 172.21.15.72:0/312792940 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68ec15dea0 msgr2=0x7f68ec0745b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:10.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.130+0000 7f68f1c46640 1 --2- 172.21.15.72:0/312792940 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68ec15dea0 0x7f68ec0745b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f68ec0c7490 tx=0x7f68e001c480 comp rx=0 tx=0).stop 2024-05-09T05:55:10.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.130+0000 7f68f1c46640 1 -- 172.21.15.72:0/312792940 shutdown_connections 2024-05-09T05:55:10.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.130+0000 7f68f1c46640 1 --2- 172.21.15.72:0/312792940 >> v2:172.21.15.110:3300/0 conn(0x7f68ec074af0 0x7f68ec164e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:10.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.130+0000 7f68f1c46640 1 --2- 172.21.15.72:0/312792940 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68ec15dea0 0x7f68ec0745b0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:10.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.130+0000 7f68f1c46640 1 -- 172.21.15.72:0/312792940 >> 172.21.15.72:0/312792940 conn(0x7f68ec0cde90 msgr2=0x7f68ec0ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:55:10.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.130+0000 7f68f1c46640 1 -- 172.21.15.72:0/312792940 shutdown_connections 2024-05-09T05:55:10.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.130+0000 7f68f1c46640 1 -- 172.21.15.72:0/312792940 wait complete. 2024-05-09T05:55:10.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.130+0000 7f68f1c46640 1 Processor -- start 2024-05-09T05:55:10.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.130+0000 7f68f1c46640 1 -- start start 2024-05-09T05:55:10.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.134+0000 7f68f1c46640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f68ec074af0 0x7f68ec15ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:10.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.134+0000 7f68f1c46640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68ec15da90 0x7f68ec14b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:10.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.134+0000 7f68f1c46640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68ec15dea0 0x7f68ec140fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:10.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.134+0000 7f68f1c46640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f68ec0c70e0 con 0x7f68ec15dea0 2024-05-09T05:55:10.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.134+0000 7f68f1c46640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f68ec15ad70 con 0x7f68ec15da90 2024-05-09T05:55:10.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.134+0000 7f68f1c46640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f68ec0c81b0 con 0x7f68ec074af0 2024-05-09T05:55:10.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.134+0000 7f68ebfff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68ec15dea0 0x7f68ec140fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:10.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.134+0000 7f68ebfff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68ec15dea0 0x7f68ec140fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45684/0 (socket says 172.21.15.72:45684) 2024-05-09T05:55:10.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.134+0000 7f68ebfff640 1 -- 172.21.15.72:0/3501594904 learned_addr learned my addr 172.21.15.72:0/3501594904 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:55:10.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.134+0000 7f68eb7fe640 1 --2- 172.21.15.72:0/3501594904 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f68ec074af0 0x7f68ec15ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:10.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.134+0000 7f68eaffd640 1 --2- 172.21.15.72:0/3501594904 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68ec15da90 0x7f68ec14b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:10.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.134+0000 7f68ebfff640 1 -- 172.21.15.72:0/3501594904 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f68ec074af0 msgr2=0x7f68ec15ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:10.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.134+0000 7f68ebfff640 1 --2- 172.21.15.72:0/3501594904 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f68ec074af0 0x7f68ec15ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:10.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.134+0000 7f68ebfff640 1 -- 172.21.15.72:0/3501594904 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68ec15da90 msgr2=0x7f68ec14b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:10.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.134+0000 7f68ebfff640 1 --2- 172.21.15.72:0/3501594904 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68ec15da90 0x7f68ec14b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:10.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.134+0000 7f68ebfff640 1 -- 172.21.15.72:0/3501594904 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68ec15bf60 con 0x7f68ec15dea0 2024-05-09T05:55:10.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.134+0000 7f68eaffd640 1 --2- 172.21.15.72:0/3501594904 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68ec15da90 0x7f68ec14b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:55:10.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.134+0000 7f68ebfff640 1 --2- 172.21.15.72:0/3501594904 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68ec15dea0 0x7f68ec140fb0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f68e4007e90 tx=0x7f68e400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:55:10.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.134+0000 7f68d3fff640 1 -- 172.21.15.72:0/3501594904 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e4014420 con 0x7f68ec15dea0 2024-05-09T05:55:10.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.134+0000 7f68d3fff640 1 -- 172.21.15.72:0/3501594904 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68e4019070 con 0x7f68ec15dea0 2024-05-09T05:55:10.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.134+0000 7f68f1c46640 1 -- 172.21.15.72:0/3501594904 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68ec1509f0 con 0x7f68ec15dea0 2024-05-09T05:55:10.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.134+0000 7f68d3fff640 1 -- 172.21.15.72:0/3501594904 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e4014800 con 0x7f68ec15dea0 2024-05-09T05:55:10.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.134+0000 7f68f1c46640 1 -- 172.21.15.72:0/3501594904 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68ec148f10 con 0x7f68ec15dea0 2024-05-09T05:55:10.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.134+0000 7f68f1c46640 1 -- 172.21.15.72:0/3501594904 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68ec06a520 con 0x7f68ec15dea0 2024-05-09T05:55:10.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.134+0000 7f68d3fff640 1 -- 172.21.15.72:0/3501594904 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f68e40149a0 con 0x7f68ec15dea0 2024-05-09T05:55:10.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.134+0000 7f68d3fff640 1 --2- 172.21.15.72:0/3501594904 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f68d806f400 0x7f68d8071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:10.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.134+0000 7f68d3fff640 1 -- 172.21.15.72:0/3501594904 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f68e408fd50 con 0x7f68ec15dea0 2024-05-09T05:55:10.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.134+0000 7f68eb7fe640 1 --2- 172.21.15.72:0/3501594904 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f68d806f400 0x7f68d8071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:10.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.138+0000 7f68eb7fe640 1 --2- 172.21.15.72:0/3501594904 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f68d806f400 0x7f68d8071910 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f68dc000f70 tx=0x7f68dc007c10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:55:10.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.142+0000 7f68d3fff640 1 -- 172.21.15.72:0/3501594904 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f68e4093030 con 0x7f68ec15dea0 2024-05-09T05:55:10.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.330+0000 7f68f1c46640 1 -- 172.21.15.72:0/3501594904 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f68ec0cc290 con 0x7f68ec15dea0 2024-05-09T05:55:10.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.334+0000 7f68d3fff640 1 -- 172.21.15.72:0/3501594904 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6915 (secure 0 0 0) 0x7f68e405c3a0 con 0x7f68ec15dea0 2024-05-09T05:55:10.320 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:55:10.320 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6834/1142956298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1142956298},{"type":"v1","addr":"172.21.15.72:6834","nonce":1142956298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:53:23.494975+0000","modified":"2024-05-09T05:54:11.535513+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4297,"mds_1":4287,"mds_2":4263,"mds_3":4259,"mds_4":4257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4257":{"gid":4257,"name":"a","rank":4,"incarnation":18,"state":"up:active","state_seq":15,"addr":"172.21.15.72:6835/3946563056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":3946563056},{"type":"v1","addr":"172.21.15.72:6835","nonce":3946563056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4259":{"gid":4259,"name":"f","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.110:6838/840351907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":840351907},{"type":"v1","addr":"172.21.15.110:6838","nonce":840351907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4263":{"gid":4263,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.72:6837/1048256382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":1048256382},{"type":"v1","addr":"172.21.15.72:6837","nonce":1048256382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.110:6839/966325499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6837","nonce":966325499},{"type":"v1","addr":"172.21.15.110:6839","nonce":966325499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6836/4134424941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":4134424941},{"type":"v1","addr":"172.21.15.110:6836","nonce":4134424941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4257,4259,4263,4287,4297]},"id":1}]} 2024-05-09T05:55:10.321 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 19 2024-05-09T05:55:10.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.334+0000 7f68f1c46640 1 -- 172.21.15.72:0/3501594904 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f68d806f400 msgr2=0x7f68d8071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:10.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.334+0000 7f68f1c46640 1 --2- 172.21.15.72:0/3501594904 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f68d806f400 0x7f68d8071910 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f68dc000f70 tx=0x7f68dc007c10 comp rx=0 tx=0).stop 2024-05-09T05:55:10.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.334+0000 7f68f1c46640 1 -- 172.21.15.72:0/3501594904 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68ec15dea0 msgr2=0x7f68ec140fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:10.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.334+0000 7f68f1c46640 1 --2- 172.21.15.72:0/3501594904 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68ec15dea0 0x7f68ec140fb0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f68e4007e90 tx=0x7f68e400e4b0 comp rx=0 tx=0).stop 2024-05-09T05:55:10.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.334+0000 7f68f1c46640 1 -- 172.21.15.72:0/3501594904 shutdown_connections 2024-05-09T05:55:10.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.334+0000 7f68f1c46640 1 --2- 172.21.15.72:0/3501594904 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f68d806f400 0x7f68d8071910 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:10.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.334+0000 7f68f1c46640 1 --2- 172.21.15.72:0/3501594904 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68ec15dea0 0x7f68ec140fb0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:10.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.334+0000 7f68f1c46640 1 --2- 172.21.15.72:0/3501594904 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68ec15da90 0x7f68ec14b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:10.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.334+0000 7f68f1c46640 1 --2- 172.21.15.72:0/3501594904 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f68ec074af0 0x7f68ec15ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:10.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.334+0000 7f68f1c46640 1 -- 172.21.15.72:0/3501594904 >> 172.21.15.72:0/3501594904 conn(0x7f68ec0cde90 msgr2=0x7f68ec0c4d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:55:10.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.334+0000 7f68f1c46640 1 -- 172.21.15.72:0/3501594904 shutdown_connections 2024-05-09T05:55:10.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:10.334+0000 7f68f1c46640 1 -- 172.21.15.72:0/3501594904 wait complete. 2024-05-09T05:55:10.340 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-05-09T05:55:12.341 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:55:12.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.514+0000 7ff1142ca640 1 Processor -- start 2024-05-09T05:55:12.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.514+0000 7ff1142ca640 1 -- start start 2024-05-09T05:55:12.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.518+0000 7ff1142ca640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff10c0ca960 0x7ff10c0cad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:12.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.518+0000 7ff1142ca640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff10c0cc260 con 0x7ff10c06c7a0 2024-05-09T05:55:12.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.518+0000 7ff1142ca640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff10c15a5f0 con 0x7ff10c06d2e0 2024-05-09T05:55:12.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.518+0000 7ff1142ca640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7ff10c0c8660 con 0x7ff10c0ca960 2024-05-09T05:55:12.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.518+0000 7ff111865640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff10c0ca960 0x7ff10c0cad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:12.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.518+0000 7ff112867640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff10c06c7a0 0x7ff10c164f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41236/0 (socket says 172.21.15.72:41236) 2024-05-09T05:55:12.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.518+0000 7ff112867640 1 -- 172.21.15.72:0/166771997 learned_addr learned my addr 172.21.15.72:0/166771997 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:55:12.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.518+0000 7ff111865640 1 -- 172.21.15.72:0/166771997 >> v1:172.21.15.110:6789/0 conn(0x7ff10c06d2e0 legacy=0x7ff10c154700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:55:12.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.518+0000 7ff111865640 1 -- 172.21.15.72:0/166771997 >> v1:172.21.15.72:6789/0 conn(0x7ff10c06c7a0 legacy=0x7ff10c164f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:12.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.518+0000 7ff111865640 1 -- 172.21.15.72:0/166771997 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff10c06e9f0 con 0x7ff10c0ca960 2024-05-09T05:55:12.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.518+0000 7ff111064640 1 -- 172.21.15.72:0/166771997 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 291186733 0 0) 0x7ff1040014a0 con 0x7ff10c06c7a0 2024-05-09T05:55:12.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.522+0000 7ff111865640 1 --2- 172.21.15.72:0/166771997 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff10c0ca960 0x7ff10c0cad70 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc0097c0 tx=0x7ff0fc01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be06ed08f94eefb6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:55:12.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.522+0000 7ff111064640 1 -- 172.21.15.72:0/166771997 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0fc0b1070 con 0x7ff10c0ca960 2024-05-09T05:55:12.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.522+0000 7ff111064640 1 -- 172.21.15.72:0/166771997 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0fc0ac410 con 0x7ff10c0ca960 2024-05-09T05:55:12.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.522+0000 7ff111064640 1 -- 172.21.15.72:0/166771997 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0fc0ac7e0 con 0x7ff10c0ca960 2024-05-09T05:55:12.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.522+0000 7ff1142ca640 1 -- 172.21.15.72:0/166771997 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff10c0ca960 msgr2=0x7ff10c0cad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:12.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.522+0000 7ff1142ca640 1 --2- 172.21.15.72:0/166771997 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff10c0ca960 0x7ff10c0cad70 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc0097c0 tx=0x7ff0fc01c4a0 comp rx=0 tx=0).stop 2024-05-09T05:55:12.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.522+0000 7ff1142ca640 1 -- 172.21.15.72:0/166771997 shutdown_connections 2024-05-09T05:55:12.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.522+0000 7ff1142ca640 1 --2- 172.21.15.72:0/166771997 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff10c0ca960 0x7ff10c0cad70 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:12.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.522+0000 7ff1142ca640 1 -- 172.21.15.72:0/166771997 >> 172.21.15.72:0/166771997 conn(0x7ff10c0cb350 msgr2=0x7ff10c0cb760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:55:12.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.522+0000 7ff1142ca640 1 -- 172.21.15.72:0/166771997 shutdown_connections 2024-05-09T05:55:12.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.522+0000 7ff1142ca640 1 -- 172.21.15.72:0/166771997 wait complete. 2024-05-09T05:55:12.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.522+0000 7ff1142ca640 1 Processor -- start 2024-05-09T05:55:12.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.522+0000 7ff1142ca640 1 -- start start 2024-05-09T05:55:12.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.526+0000 7ff1142ca640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff10c06c7a0 0x7ff10c1452e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:12.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.526+0000 7ff1142ca640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff10c06d2e0 0x7ff10c1f66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:12.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.526+0000 7ff1142ca640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff10c0ca960 0x7ff10c0c1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:12.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.526+0000 7ff1142ca640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff10c0cbeb0 con 0x7ff10c0ca960 2024-05-09T05:55:12.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.526+0000 7ff1142ca640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ff10c0c2410 con 0x7ff10c06c7a0 2024-05-09T05:55:12.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.526+0000 7ff1142ca640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7ff10c147080 con 0x7ff10c06d2e0 2024-05-09T05:55:12.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.526+0000 7ff112867640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff10c0ca960 0x7ff10c0c1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:12.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.526+0000 7ff112867640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff10c0ca960 0x7ff10c0c1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33724/0 (socket says 172.21.15.72:33724) 2024-05-09T05:55:12.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.526+0000 7ff112867640 1 -- 172.21.15.72:0/2131725808 learned_addr learned my addr 172.21.15.72:0/2131725808 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:55:12.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.526+0000 7ff112066640 1 --2- 172.21.15.72:0/2131725808 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff10c06c7a0 0x7ff10c1452e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:12.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.526+0000 7ff111865640 1 --2- 172.21.15.72:0/2131725808 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff10c06d2e0 0x7ff10c1f66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:12.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.526+0000 7ff112867640 1 -- 172.21.15.72:0/2131725808 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff10c06d2e0 msgr2=0x7ff10c1f66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:12.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.526+0000 7ff112867640 1 --2- 172.21.15.72:0/2131725808 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff10c06d2e0 0x7ff10c1f66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:12.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.526+0000 7ff112867640 1 -- 172.21.15.72:0/2131725808 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff10c06c7a0 msgr2=0x7ff10c1452e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:12.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.526+0000 7ff112867640 1 --2- 172.21.15.72:0/2131725808 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff10c06c7a0 0x7ff10c1452e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:12.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.526+0000 7ff112867640 1 -- 172.21.15.72:0/2131725808 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff10c144b50 con 0x7ff10c0ca960 2024-05-09T05:55:12.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.526+0000 7ff112066640 1 --2- 172.21.15.72:0/2131725808 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff10c06c7a0 0x7ff10c1452e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:55:12.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.526+0000 7ff112867640 1 --2- 172.21.15.72:0/2131725808 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff10c0ca960 0x7ff10c0c1520 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff10400c6b0 tx=0x7ff10400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:55:12.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.526+0000 7ff102ffd640 1 -- 172.21.15.72:0/2131725808 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff104018070 con 0x7ff10c0ca960 2024-05-09T05:55:12.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.526+0000 7ff102ffd640 1 -- 172.21.15.72:0/2131725808 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff104004db0 con 0x7ff10c0ca960 2024-05-09T05:55:12.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.526+0000 7ff1142ca640 1 -- 172.21.15.72:0/2131725808 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff10c145820 con 0x7ff10c0ca960 2024-05-09T05:55:12.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.526+0000 7ff102ffd640 1 -- 172.21.15.72:0/2131725808 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff10400a880 con 0x7ff10c0ca960 2024-05-09T05:55:12.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.526+0000 7ff1142ca640 1 -- 172.21.15.72:0/2131725808 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff10c0735d0 con 0x7ff10c0ca960 2024-05-09T05:55:12.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.526+0000 7ff1142ca640 1 -- 172.21.15.72:0/2131725808 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff10c144970 con 0x7ff10c0ca960 2024-05-09T05:55:12.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.526+0000 7ff102ffd640 1 -- 172.21.15.72:0/2131725808 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff10401b070 con 0x7ff10c0ca960 2024-05-09T05:55:12.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.526+0000 7ff102ffd640 1 --2- 172.21.15.72:0/2131725808 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7ff0f006f430 0x7ff0f0071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:12.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.530+0000 7ff102ffd640 1 -- 172.21.15.72:0/2131725808 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7ff10408ed10 con 0x7ff10c0ca960 2024-05-09T05:55:12.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.530+0000 7ff112066640 1 --2- 172.21.15.72:0/2131725808 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7ff0f006f430 0x7ff0f0071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:12.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.530+0000 7ff112066640 1 --2- 172.21.15.72:0/2131725808 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7ff0f006f430 0x7ff0f0071940 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff108000f70 tx=0x7ff108009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:55:12.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.534+0000 7ff102ffd640 1 -- 172.21.15.72:0/2131725808 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7ff10c144970 con 0x7ff10c0ca960 2024-05-09T05:55:12.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.742+0000 7ff1142ca640 1 -- 172.21.15.72:0/2131725808 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff10c06a520 con 0x7ff10c0ca960 2024-05-09T05:55:12.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.746+0000 7ff102ffd640 1 -- 172.21.15.72:0/2131725808 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6915 (secure 0 0 0) 0x7ff10c0cc260 con 0x7ff10c0ca960 2024-05-09T05:55:12.732 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:55:12.732 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6834/1142956298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1142956298},{"type":"v1","addr":"172.21.15.72:6834","nonce":1142956298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:53:23.494975+0000","modified":"2024-05-09T05:54:11.535513+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4297,"mds_1":4287,"mds_2":4263,"mds_3":4259,"mds_4":4257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4257":{"gid":4257,"name":"a","rank":4,"incarnation":18,"state":"up:active","state_seq":15,"addr":"172.21.15.72:6835/3946563056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":3946563056},{"type":"v1","addr":"172.21.15.72:6835","nonce":3946563056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4259":{"gid":4259,"name":"f","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.110:6838/840351907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":840351907},{"type":"v1","addr":"172.21.15.110:6838","nonce":840351907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4263":{"gid":4263,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.72:6837/1048256382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":1048256382},{"type":"v1","addr":"172.21.15.72:6837","nonce":1048256382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.110:6839/966325499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6837","nonce":966325499},{"type":"v1","addr":"172.21.15.110:6839","nonce":966325499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6836/4134424941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":4134424941},{"type":"v1","addr":"172.21.15.110:6836","nonce":4134424941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4257,4259,4263,4287,4297]},"id":1}]} 2024-05-09T05:55:12.732 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 19 2024-05-09T05:55:12.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.746+0000 7ff1142ca640 1 -- 172.21.15.72:0/2131725808 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7ff0f006f430 msgr2=0x7ff0f0071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:12.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.746+0000 7ff1142ca640 1 --2- 172.21.15.72:0/2131725808 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7ff0f006f430 0x7ff0f0071940 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff108000f70 tx=0x7ff108009040 comp rx=0 tx=0).stop 2024-05-09T05:55:12.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.746+0000 7ff1142ca640 1 -- 172.21.15.72:0/2131725808 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff10c0ca960 msgr2=0x7ff10c0c1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:12.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.746+0000 7ff1142ca640 1 --2- 172.21.15.72:0/2131725808 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff10c0ca960 0x7ff10c0c1520 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff10400c6b0 tx=0x7ff10400cb70 comp rx=0 tx=0).stop 2024-05-09T05:55:12.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.746+0000 7ff1142ca640 1 -- 172.21.15.72:0/2131725808 shutdown_connections 2024-05-09T05:55:12.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.746+0000 7ff1142ca640 1 --2- 172.21.15.72:0/2131725808 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7ff0f006f430 0x7ff0f0071940 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:12.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.746+0000 7ff1142ca640 1 --2- 172.21.15.72:0/2131725808 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff10c0ca960 0x7ff10c0c1520 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:12.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.746+0000 7ff1142ca640 1 --2- 172.21.15.72:0/2131725808 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff10c06d2e0 0x7ff10c1f66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:12.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.746+0000 7ff1142ca640 1 --2- 172.21.15.72:0/2131725808 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff10c06c7a0 0x7ff10c1452e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:12.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.746+0000 7ff1142ca640 1 -- 172.21.15.72:0/2131725808 >> 172.21.15.72:0/2131725808 conn(0x7ff10c0cb350 msgr2=0x7ff10c076360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:55:12.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.746+0000 7ff1142ca640 1 -- 172.21.15.72:0/2131725808 shutdown_connections 2024-05-09T05:55:12.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:12.746+0000 7ff1142ca640 1 -- 172.21.15.72:0/2131725808 wait complete. 2024-05-09T05:55:12.754 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-05-09T05:55:14.755 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:55:14.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.934+0000 7fc45e851640 1 Processor -- start 2024-05-09T05:55:14.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.934+0000 7fc45e851640 1 -- start start 2024-05-09T05:55:14.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.938+0000 7fc45e851640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc45815afa0 0x7fc458165e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:14.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.938+0000 7fc45e851640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4580cad30 con 0x7fc45815ab90 2024-05-09T05:55:14.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.938+0000 7fc45e851640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4580cb990 con 0x7fc4580c4bf0 2024-05-09T05:55:14.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.938+0000 7fc45e851640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fc4580cc4d0 con 0x7fc45815afa0 2024-05-09T05:55:14.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.938+0000 7fc4577fe640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc45815ab90 0x7fc4580c5420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41244/0 (socket says 172.21.15.72:41244) 2024-05-09T05:55:14.927 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.938+0000 7fc4577fe640 1 -- 172.21.15.72:0/2005268994 learned_addr learned my addr 172.21.15.72:0/2005268994 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:55:14.927 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.938+0000 7fc45cdee640 1 --2- 172.21.15.72:0/2005268994 >> v2:172.21.15.110:3300/0 conn(0x7fc45815afa0 0x7fc458165e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:14.927 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.938+0000 7fc456ffd640 1 -- 172.21.15.72:0/2005268994 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2232365662 0 0) 0x7fc4580cad30 con 0x7fc45815ab90 2024-05-09T05:55:14.927 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.938+0000 7fc456ffd640 1 -- 172.21.15.72:0/2005268994 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc444003530 con 0x7fc45815ab90 2024-05-09T05:55:14.927 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.938+0000 7fc456ffd640 1 -- 172.21.15.72:0/2005268994 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1867663208 0 0) 0x7fc444003530 con 0x7fc45815ab90 2024-05-09T05:55:14.927 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.938+0000 7fc456ffd640 1 -- 172.21.15.72:0/2005268994 >> v2:172.21.15.110:3300/0 conn(0x7fc45815afa0 msgr2=0x7fc458165e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:55:14.927 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.938+0000 7fc456ffd640 1 --2- 172.21.15.72:0/2005268994 >> v2:172.21.15.110:3300/0 conn(0x7fc45815afa0 0x7fc458165e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:14.927 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.938+0000 7fc456ffd640 1 -- 172.21.15.72:0/2005268994 >> v1:172.21.15.110:6789/0 conn(0x7fc4580c4bf0 legacy=0x7fc4580ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:14.927 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.938+0000 7fc456ffd640 1 -- 172.21.15.72:0/2005268994 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4580cbc30 con 0x7fc45815ab90 2024-05-09T05:55:14.927 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.938+0000 7fc456ffd640 1 -- 172.21.15.72:0/2005268994 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2749052815 0 0) 0x7fc440001700 con 0x7fc45815ab90 2024-05-09T05:55:14.927 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.938+0000 7fc456ffd640 1 -- 172.21.15.72:0/2005268994 >> v1:172.21.15.72:6789/0 conn(0x7fc45815ab90 legacy=0x7fc4580c5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:14.927 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.938+0000 7fc456ffd640 1 --2- 172.21.15.72:0/2005268994 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc444003a60 0x7fc444003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:14.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.938+0000 7fc456ffd640 1 --2- 172.21.15.72:0/2005268994 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc444004810 0x7fc444004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:14.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.938+0000 7fc456ffd640 1 --2- 172.21.15.72:0/2005268994 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc444005280 0x7fc44400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:14.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.938+0000 7fc456ffd640 1 -- 172.21.15.72:0/2005268994 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fc4580cc4d0 con 0x7fc444003a60 2024-05-09T05:55:14.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.938+0000 7fc456ffd640 1 -- 172.21.15.72:0/2005268994 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fc44400c200 con 0x7fc444004810 2024-05-09T05:55:14.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.938+0000 7fc456ffd640 1 -- 172.21.15.72:0/2005268994 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fc44400c400 con 0x7fc444005280 2024-05-09T05:55:14.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.938+0000 7fc457fff640 1 --2- 172.21.15.72:0/2005268994 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc444003a60 0x7fc444003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:14.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.938+0000 7fc4577fe640 1 --2- 172.21.15.72:0/2005268994 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc444004810 0x7fc444004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:14.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.938+0000 7fc45cdee640 1 --2- 172.21.15.72:0/2005268994 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc444005280 0x7fc44400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:14.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.938+0000 7fc457fff640 1 -- 172.21.15.72:0/2005268994 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc444005280 msgr2=0x7fc44400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:55:14.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.938+0000 7fc457fff640 1 --2- 172.21.15.72:0/2005268994 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc444005280 0x7fc44400b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:14.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.938+0000 7fc457fff640 1 -- 172.21.15.72:0/2005268994 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc444004810 msgr2=0x7fc444004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:55:14.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.938+0000 7fc457fff640 1 --2- 172.21.15.72:0/2005268994 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc444004810 0x7fc444004c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:14.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.938+0000 7fc45cdee640 1 -- 172.21.15.72:0/2005268994 reap_dead start 2024-05-09T05:55:14.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.938+0000 7fc457fff640 1 -- 172.21.15.72:0/2005268994 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc444003530 con 0x7fc444003a60 2024-05-09T05:55:14.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.942+0000 7fc457fff640 1 --2- 172.21.15.72:0/2005268994 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc444003a60 0x7fc444003ef0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc448001e90 tx=0x7fc44801c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d18bccc29c341f27 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:55:14.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.942+0000 7fc456ffd640 1 -- 172.21.15.72:0/2005268994 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc448001ae0 con 0x7fc444003a60 2024-05-09T05:55:14.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.942+0000 7fc456ffd640 1 -- 172.21.15.72:0/2005268994 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc448003b80 con 0x7fc444003a60 2024-05-09T05:55:14.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.942+0000 7fc456ffd640 1 -- 172.21.15.72:0/2005268994 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc448005080 con 0x7fc444003a60 2024-05-09T05:55:14.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.942+0000 7fc45e851640 1 -- 172.21.15.72:0/2005268994 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc444003a60 msgr2=0x7fc444003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:14.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.942+0000 7fc45e851640 1 --2- 172.21.15.72:0/2005268994 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc444003a60 0x7fc444003ef0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc448001e90 tx=0x7fc44801c710 comp rx=0 tx=0).stop 2024-05-09T05:55:14.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.942+0000 7fc45e851640 1 -- 172.21.15.72:0/2005268994 shutdown_connections 2024-05-09T05:55:14.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.942+0000 7fc45e851640 1 --2- 172.21.15.72:0/2005268994 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc444003a60 0x7fc444003ef0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:14.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.942+0000 7fc45e851640 1 -- 172.21.15.72:0/2005268994 >> 172.21.15.72:0/2005268994 conn(0x7fc458072080 msgr2=0x7fc458072490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:55:14.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.942+0000 7fc45e851640 1 -- 172.21.15.72:0/2005268994 shutdown_connections 2024-05-09T05:55:14.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.942+0000 7fc45e851640 1 -- 172.21.15.72:0/2005268994 wait complete. 2024-05-09T05:55:14.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.942+0000 7fc45e851640 1 Processor -- start 2024-05-09T05:55:14.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.942+0000 7fc45e851640 1 -- start start 2024-05-09T05:55:14.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.946+0000 7fc45e851640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc444003a60 0x7fc4580c54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:14.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.946+0000 7fc45e851640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc458154dc0 0x7fc4580b2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:14.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.946+0000 7fc45e851640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc4580b3450 0x7fc4581507b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:14.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.946+0000 7fc45e851640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fc4580cc1f0 con 0x7fc444003a60 2024-05-09T05:55:14.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.946+0000 7fc45e851640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fc45815a700 con 0x7fc4580b3450 2024-05-09T05:55:14.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.946+0000 7fc45e851640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fc458154b50 con 0x7fc458154dc0 2024-05-09T05:55:14.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.946+0000 7fc457fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc444003a60 0x7fc4580c54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:14.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.946+0000 7fc457fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc444003a60 0x7fc4580c54f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33742/0 (socket says 172.21.15.72:33742) 2024-05-09T05:55:14.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.946+0000 7fc457fff640 1 -- 172.21.15.72:0/1643787545 learned_addr learned my addr 172.21.15.72:0/1643787545 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:55:14.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.946+0000 7fc4577fe640 1 --2- 172.21.15.72:0/1643787545 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc458154dc0 0x7fc4580b2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:14.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.946+0000 7fc457fff640 1 -- 172.21.15.72:0/1643787545 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc458154dc0 msgr2=0x7fc4580b2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:14.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.946+0000 7fc457fff640 1 --2- 172.21.15.72:0/1643787545 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc458154dc0 0x7fc4580b2f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:14.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.946+0000 7fc45cdee640 1 --2- 172.21.15.72:0/1643787545 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc4580b3450 0x7fc4581507b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:14.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.946+0000 7fc457fff640 1 -- 172.21.15.72:0/1643787545 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc4580b3450 msgr2=0x7fc4581507b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:14.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.946+0000 7fc457fff640 1 --2- 172.21.15.72:0/1643787545 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc4580b3450 0x7fc4581507b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:14.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.946+0000 7fc457fff640 1 -- 172.21.15.72:0/1643787545 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4581f3bd0 con 0x7fc444003a60 2024-05-09T05:55:14.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.946+0000 7fc457fff640 1 --2- 172.21.15.72:0/1643787545 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc444003a60 0x7fc4580c54f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc44801ae10 tx=0x7fc444005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:55:14.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.946+0000 7fc454ff9640 1 -- 172.21.15.72:0/1643787545 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4480b8070 con 0x7fc444003a60 2024-05-09T05:55:14.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.946+0000 7fc454ff9640 1 -- 172.21.15.72:0/1643787545 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc448001ac0 con 0x7fc444003a60 2024-05-09T05:55:14.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.946+0000 7fc45e851640 1 -- 172.21.15.72:0/1643787545 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc458157e10 con 0x7fc444003a60 2024-05-09T05:55:14.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.946+0000 7fc454ff9640 1 -- 172.21.15.72:0/1643787545 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc448006b60 con 0x7fc444003a60 2024-05-09T05:55:14.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.946+0000 7fc45e851640 1 -- 172.21.15.72:0/1643787545 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4581f30f0 con 0x7fc444003a60 2024-05-09T05:55:14.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.946+0000 7fc45e851640 1 -- 172.21.15.72:0/1643787545 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc45806a520 con 0x7fc444003a60 2024-05-09T05:55:14.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.946+0000 7fc454ff9640 1 -- 172.21.15.72:0/1643787545 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fc4480bb070 con 0x7fc444003a60 2024-05-09T05:55:14.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.950+0000 7fc454ff9640 1 --2- 172.21.15.72:0/1643787545 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fc43806f430 0x7fc438071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:14.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.950+0000 7fc454ff9640 1 -- 172.21.15.72:0/1643787545 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6676+0+0 (secure 0 0 0) 0x7fc4481288b0 con 0x7fc444003a60 2024-05-09T05:55:14.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.950+0000 7fc4577fe640 1 --2- 172.21.15.72:0/1643787545 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fc43806f430 0x7fc438071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:14.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.950+0000 7fc4577fe640 1 --2- 172.21.15.72:0/1643787545 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fc43806f430 0x7fc438071940 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc4581564b0 tx=0x7fc440001120 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:55:14.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:14.954+0000 7fc454ff9640 1 -- 172.21.15.72:0/1643787545 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fc4480ac020 con 0x7fc444003a60 2024-05-09T05:55:15.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.158+0000 7fc45e851640 1 -- 172.21.15.72:0/1643787545 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc4580cee00 con 0x7fc444003a60 2024-05-09T05:55:15.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.162+0000 7fc454ff9640 1 -- 172.21.15.72:0/1643787545 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+6087 (secure 0 0 0) 0x7fc448016470 con 0x7fc444003a60 2024-05-09T05:55:15.148 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:55:15.148 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:53:23.494975+0000","modified":"2024-05-09T05:55:14.345518+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4297,"mds_1":4287,"mds_2":4263,"mds_3":4259,"mds_4":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"e","rank":4,"incarnation":20,"state":"up:replay","state_seq":1,"addr":"172.21.15.72:6834/1142956298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1142956298},{"type":"v1","addr":"172.21.15.72:6834","nonce":1142956298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4259":{"gid":4259,"name":"f","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.110:6838/840351907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":840351907},{"type":"v1","addr":"172.21.15.110:6838","nonce":840351907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4263":{"gid":4263,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.72:6837/1048256382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":1048256382},{"type":"v1","addr":"172.21.15.72:6837","nonce":1048256382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.110:6839/966325499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6837","nonce":966325499},{"type":"v1","addr":"172.21.15.110:6839","nonce":966325499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6836/4134424941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":4134424941},{"type":"v1","addr":"172.21.15.110:6836","nonce":4134424941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4259,4263,4287,4297]},"id":1}]} 2024-05-09T05:55:15.148 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 20 2024-05-09T05:55:15.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.162+0000 7fc45e851640 1 -- 172.21.15.72:0/1643787545 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fc43806f430 msgr2=0x7fc438071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:15.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.162+0000 7fc45e851640 1 --2- 172.21.15.72:0/1643787545 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fc43806f430 0x7fc438071940 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc4581564b0 tx=0x7fc440001120 comp rx=0 tx=0).stop 2024-05-09T05:55:15.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.162+0000 7fc45e851640 1 -- 172.21.15.72:0/1643787545 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc444003a60 msgr2=0x7fc4580c54f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:15.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.162+0000 7fc45e851640 1 --2- 172.21.15.72:0/1643787545 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc444003a60 0x7fc4580c54f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc44801ae10 tx=0x7fc444005840 comp rx=0 tx=0).stop 2024-05-09T05:55:15.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.162+0000 7fc45e851640 1 -- 172.21.15.72:0/1643787545 shutdown_connections 2024-05-09T05:55:15.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.162+0000 7fc45e851640 1 --2- 172.21.15.72:0/1643787545 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fc43806f430 0x7fc438071940 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:15.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.162+0000 7fc45e851640 1 --2- 172.21.15.72:0/1643787545 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc4580b3450 0x7fc4581507b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:15.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.162+0000 7fc45e851640 1 --2- 172.21.15.72:0/1643787545 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc458154dc0 0x7fc4580b2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:15.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.162+0000 7fc45e851640 1 --2- 172.21.15.72:0/1643787545 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc444003a60 0x7fc4580c54f0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:15.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.162+0000 7fc45e851640 1 -- 172.21.15.72:0/1643787545 >> 172.21.15.72:0/1643787545 conn(0x7fc458072080 msgr2=0x7fc458074e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:55:15.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.162+0000 7fc45e851640 1 -- 172.21.15.72:0/1643787545 shutdown_connections 2024-05-09T05:55:15.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.162+0000 7fc45e851640 1 -- 172.21.15.72:0/1643787545 wait complete. 2024-05-09T05:55:15.168 INFO:tasks.mds_thrash.fs.[cephfs]:mds.a down, removed from mdsmap 2024-05-09T05:55:15.168 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for mds cluster to stabilize... 2024-05-09T05:55:15.168 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:55:15.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.322+0000 7f69aab4f640 1 Processor -- start 2024-05-09T05:55:15.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.322+0000 7f69aab4f640 1 -- start start 2024-05-09T05:55:15.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.322+0000 7f69aab4f640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f69a40c4bf0 0x7f69a40ca620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:15.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.322+0000 7f69aab4f640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f69a415afa0 0x7f69a4164e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:15.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.322+0000 7f69aab4f640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69a40cb990 con 0x7f69a415ab90 2024-05-09T05:55:15.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.322+0000 7f69aab4f640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f69a40cc4d0 con 0x7f69a415afa0 2024-05-09T05:55:15.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.322+0000 7f69aab4f640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f69a415a700 con 0x7f69a40c4bf0 2024-05-09T05:55:15.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.322+0000 7f69a90ec640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f69a415afa0 0x7f69a4164e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:15.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.322+0000 7f69a90ec640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f69a415afa0 0x7f69a4164e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33752/0 (socket says 172.21.15.72:33752) 2024-05-09T05:55:15.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.322+0000 7f69a90ec640 1 -- 172.21.15.72:0/3190474140 learned_addr learned my addr 172.21.15.72:0/3190474140 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:55:15.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.322+0000 7f69a90ec640 1 -- 172.21.15.72:0/3190474140 >> v2:172.21.15.110:3300/0 conn(0x7f69a40c4bf0 msgr2=0x7f69a40ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:55:15.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.322+0000 7f69a90ec640 1 --2- 172.21.15.72:0/3190474140 >> v2:172.21.15.110:3300/0 conn(0x7f69a40c4bf0 0x7f69a40ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:15.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.322+0000 7f69a90ec640 1 -- 172.21.15.72:0/3190474140 >> v1:172.21.15.110:6789/0 conn(0x7f69a415ab90 legacy=0x7f69a40c5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:55:15.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.322+0000 7f69a90ec640 1 -- 172.21.15.72:0/3190474140 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69a40cbc30 con 0x7f69a415afa0 2024-05-09T05:55:15.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.326+0000 7f69a90ec640 1 --2- 172.21.15.72:0/3190474140 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69a415afa0 0x7f69a4164e50 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f69a40cc680 tx=0x7f699c01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8527acadcb0de79 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:55:15.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.326+0000 7f69a37fe640 1 -- 172.21.15.72:0/3190474140 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f699c0b5070 con 0x7f69a415afa0 2024-05-09T05:55:15.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.326+0000 7f69a37fe640 1 -- 172.21.15.72:0/3190474140 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f699c0a89d0 con 0x7f69a415afa0 2024-05-09T05:55:15.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.326+0000 7f69a37fe640 1 -- 172.21.15.72:0/3190474140 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f699c0a8da0 con 0x7f69a415afa0 2024-05-09T05:55:15.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.326+0000 7f69aab4f640 1 -- 172.21.15.72:0/3190474140 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69a415afa0 msgr2=0x7f69a4164e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:15.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.326+0000 7f69aab4f640 1 --2- 172.21.15.72:0/3190474140 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69a415afa0 0x7f69a4164e50 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f69a40cc680 tx=0x7f699c01ed10 comp rx=0 tx=0).stop 2024-05-09T05:55:15.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.326+0000 7f69aab4f640 1 -- 172.21.15.72:0/3190474140 shutdown_connections 2024-05-09T05:55:15.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.326+0000 7f69aab4f640 1 --2- 172.21.15.72:0/3190474140 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69a415afa0 0x7f69a4164e50 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:15.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.326+0000 7f69aab4f640 1 --2- 172.21.15.72:0/3190474140 >> v2:172.21.15.110:3300/0 conn(0x7f69a40c4bf0 0x7f69a40ca620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:15.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.326+0000 7f69aab4f640 1 -- 172.21.15.72:0/3190474140 >> 172.21.15.72:0/3190474140 conn(0x7f69a4072080 msgr2=0x7f69a4072490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:55:15.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.326+0000 7f69aab4f640 1 -- 172.21.15.72:0/3190474140 shutdown_connections 2024-05-09T05:55:15.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.326+0000 7f69aab4f640 1 -- 172.21.15.72:0/3190474140 wait complete. 2024-05-09T05:55:15.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.326+0000 7f69aab4f640 1 Processor -- start 2024-05-09T05:55:15.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.326+0000 7f69aab4f640 1 -- start start 2024-05-09T05:55:15.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.330+0000 7f69aab4f640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69a40c4bf0 0x7f69a406e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:15.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.330+0000 7f69aab4f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f69a415ab90 0x7f69a41e0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:15.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.330+0000 7f69aab4f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f69a415afa0 0x7f69a41e1160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:15.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.330+0000 7f69aab4f640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f69a4154b50 con 0x7f69a40c4bf0 2024-05-09T05:55:15.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.330+0000 7f69aab4f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f69a40cc1f0 con 0x7f69a415afa0 2024-05-09T05:55:15.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.330+0000 7f69aab4f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f69a415b3b0 con 0x7f69a415ab90 2024-05-09T05:55:15.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.330+0000 7f69a88eb640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69a40c4bf0 0x7f69a406e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:15.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.330+0000 7f69a88eb640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69a40c4bf0 0x7f69a406e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33754/0 (socket says 172.21.15.72:33754) 2024-05-09T05:55:15.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.330+0000 7f69a88eb640 1 -- 172.21.15.72:0/3741618339 learned_addr learned my addr 172.21.15.72:0/3741618339 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:55:15.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.330+0000 7f69a90ec640 1 --2- 172.21.15.72:0/3741618339 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f69a415afa0 0x7f69a41e1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:15.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.330+0000 7f69a3fff640 1 --2- 172.21.15.72:0/3741618339 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f69a415ab90 0x7f69a41e0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:15.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.330+0000 7f69a88eb640 1 -- 172.21.15.72:0/3741618339 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f69a415ab90 msgr2=0x7f69a41e0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:15.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.330+0000 7f69a88eb640 1 --2- 172.21.15.72:0/3741618339 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f69a415ab90 0x7f69a41e0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:15.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.330+0000 7f69a88eb640 1 -- 172.21.15.72:0/3741618339 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f69a415afa0 msgr2=0x7f69a41e1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:15.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.330+0000 7f69a88eb640 1 --2- 172.21.15.72:0/3741618339 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f69a415afa0 0x7f69a41e1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:15.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.330+0000 7f69a88eb640 1 -- 172.21.15.72:0/3741618339 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69a406ee50 con 0x7f69a40c4bf0 2024-05-09T05:55:15.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.330+0000 7f69a88eb640 1 --2- 172.21.15.72:0/3741618339 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69a40c4bf0 0x7f69a406e910 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f699400ba80 tx=0x7f699400bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:55:15.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.330+0000 7f69a17fa640 1 -- 172.21.15.72:0/3741618339 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6994019070 con 0x7f69a40c4bf0 2024-05-09T05:55:15.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.330+0000 7f69a17fa640 1 -- 172.21.15.72:0/3741618339 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f699400cc20 con 0x7f69a40c4bf0 2024-05-09T05:55:15.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.330+0000 7f69aab4f640 1 -- 172.21.15.72:0/3741618339 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69a40c97e0 con 0x7f69a40c4bf0 2024-05-09T05:55:15.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.330+0000 7f69a17fa640 1 -- 172.21.15.72:0/3741618339 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6994014440 con 0x7f69a40c4bf0 2024-05-09T05:55:15.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.330+0000 7f69aab4f640 1 -- 172.21.15.72:0/3741618339 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69a41e30f0 con 0x7f69a40c4bf0 2024-05-09T05:55:15.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.330+0000 7f69aab4f640 1 -- 172.21.15.72:0/3741618339 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69a406a520 con 0x7f69a40c4bf0 2024-05-09T05:55:15.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.330+0000 7f69a17fa640 1 -- 172.21.15.72:0/3741618339 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f699401c070 con 0x7f69a40c4bf0 2024-05-09T05:55:15.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.334+0000 7f69a17fa640 1 --2- 172.21.15.72:0/3741618339 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f698406f400 0x7f6984071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:15.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.334+0000 7f69a17fa640 1 -- 172.21.15.72:0/3741618339 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6676+0+0 (secure 0 0 0) 0x7f699408f1d0 con 0x7f69a40c4bf0 2024-05-09T05:55:15.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.334+0000 7f69a3fff640 1 --2- 172.21.15.72:0/3741618339 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f698406f400 0x7f6984071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:15.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.334+0000 7f69a3fff640 1 --2- 172.21.15.72:0/3741618339 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f698406f400 0x7f6984071910 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f69a40c9d90 tx=0x7f698c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:55:15.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.338+0000 7f69a17fa640 1 -- 172.21.15.72:0/3741618339 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f699405b7c0 con 0x7f69a40c4bf0 2024-05-09T05:55:15.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.542+0000 7f69aab4f640 1 -- 172.21.15.72:0/3741618339 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f69a4072b30 con 0x7f69a40c4bf0 2024-05-09T05:55:15.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.542+0000 7f69a17fa640 1 -- 172.21.15.72:0/3741618339 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+6087 (secure 0 0 0) 0x7f699405fac0 con 0x7f69a40c4bf0 2024-05-09T05:55:15.528 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:55:15.528 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:53:23.494975+0000","modified":"2024-05-09T05:55:14.345518+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4297,"mds_1":4287,"mds_2":4263,"mds_3":4259,"mds_4":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"e","rank":4,"incarnation":20,"state":"up:replay","state_seq":1,"addr":"172.21.15.72:6834/1142956298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1142956298},{"type":"v1","addr":"172.21.15.72:6834","nonce":1142956298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4259":{"gid":4259,"name":"f","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.110:6838/840351907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":840351907},{"type":"v1","addr":"172.21.15.110:6838","nonce":840351907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4263":{"gid":4263,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.72:6837/1048256382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":1048256382},{"type":"v1","addr":"172.21.15.72:6837","nonce":1048256382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.110:6839/966325499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6837","nonce":966325499},{"type":"v1","addr":"172.21.15.110:6839","nonce":966325499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6836/4134424941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":4134424941},{"type":"v1","addr":"172.21.15.110:6836","nonce":4134424941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4259,4263,4287,4297]},"id":1}]} 2024-05-09T05:55:15.529 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 20 2024-05-09T05:55:15.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.542+0000 7f69aab4f640 1 -- 172.21.15.72:0/3741618339 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f698406f400 msgr2=0x7f6984071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:15.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.542+0000 7f69aab4f640 1 --2- 172.21.15.72:0/3741618339 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f698406f400 0x7f6984071910 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f69a40c9d90 tx=0x7f698c008040 comp rx=0 tx=0).stop 2024-05-09T05:55:15.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.542+0000 7f69aab4f640 1 -- 172.21.15.72:0/3741618339 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69a40c4bf0 msgr2=0x7f69a406e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:15.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.542+0000 7f69aab4f640 1 --2- 172.21.15.72:0/3741618339 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69a40c4bf0 0x7f69a406e910 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f699400ba80 tx=0x7f699400bf40 comp rx=0 tx=0).stop 2024-05-09T05:55:15.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.542+0000 7f69aab4f640 1 -- 172.21.15.72:0/3741618339 shutdown_connections 2024-05-09T05:55:15.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.542+0000 7f69aab4f640 1 --2- 172.21.15.72:0/3741618339 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f698406f400 0x7f6984071910 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:15.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.542+0000 7f69aab4f640 1 --2- 172.21.15.72:0/3741618339 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f69a415afa0 0x7f69a41e1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:15.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.542+0000 7f69aab4f640 1 --2- 172.21.15.72:0/3741618339 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f69a415ab90 0x7f69a41e0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:15.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.542+0000 7f69aab4f640 1 --2- 172.21.15.72:0/3741618339 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69a40c4bf0 0x7f69a406e910 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:15.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.542+0000 7f69aab4f640 1 -- 172.21.15.72:0/3741618339 >> 172.21.15.72:0/3741618339 conn(0x7f69a4072080 msgr2=0x7f69a4158b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:55:15.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.542+0000 7f69aab4f640 1 -- 172.21.15.72:0/3741618339 shutdown_connections 2024-05-09T05:55:15.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:15.542+0000 7f69aab4f640 1 -- 172.21.15.72:0/3741618339 wait complete. 2024-05-09T05:55:15.549 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 20, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-05-09T05:53:23.494975+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 20, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0, 1, 2, 3, 4 ], "info": { "gid_4254": { "addr": "172.21.15.72:6834/1142956298", "addrs": { "addrvec": [ { "addr": "172.21.15.72:6832", "nonce": 1142956298, "type": "v2" }, { "addr": "172.21.15.72:6834", "nonce": 1142956298, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4254, "incarnation": 20, "join_fscid": -1, "name": "e", "rank": 4, "state": "up:replay", "state_seq": 1 }, "gid_4259": { "addr": "172.21.15.110:6838/840351907", "addrs": { "addrvec": [ { "addr": "172.21.15.110:6835", "nonce": 840351907, "type": "v2" }, { "addr": "172.21.15.110:6838", "nonce": 840351907, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4259, "incarnation": 16, "join_fscid": -1, "name": "f", "rank": 3, "state": "up:active", "state_seq": 13 }, "gid_4263": { "addr": "172.21.15.72:6837/1048256382", "addrs": { "addrvec": [ { "addr": "172.21.15.72:6836", "nonce": 1048256382, "type": "v2" }, { "addr": "172.21.15.72:6837", "nonce": 1048256382, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4263, "incarnation": 14, "join_fscid": -1, "name": "c", "rank": 2, "state": "up:active", "state_seq": 12 }, "gid_4287": { "addr": "172.21.15.110:6839/966325499", "addrs": { "addrvec": [ { "addr": "172.21.15.110:6837", "nonce": 966325499, "type": "v2" }, { "addr": "172.21.15.110:6839", "nonce": 966325499, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4287, "incarnation": 10, "join_fscid": -1, "name": "d", "rank": 1, "state": "up:active", "state_seq": 10 }, "gid_4297": { "addr": "172.21.15.110:6836/4134424941", "addrs": { "addrvec": [ { "addr": "172.21.15.110:6834", "nonce": 4134424941, "type": "v2" }, { "addr": "172.21.15.110:6836", "nonce": 4134424941, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4297, "incarnation": 4, "join_fscid": -1, "name": "b", "rank": 0, "state": "up:active", "state_seq": 4 } }, "last_failure": 0, "last_failure_osd_epoch": 28, "max_file_size": 1099511627776, "max_mds": 5, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-05-09T05:55:14.345518+0000", "qdb_cluster": [ 4259, 4263, 4287, 4297 ], "qdb_leader": 4297, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4297, "mds_1": 4287, "mds_2": 4263, "mds_3": 4259, "mds_4": 4254 } } } ], "standbys": [] } 2024-05-09T05:55:17.550 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:55:17.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.738+0000 7fbf9d001640 1 Processor -- start 2024-05-09T05:55:17.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.738+0000 7fbf9d001640 1 -- start start 2024-05-09T05:55:17.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.738+0000 7fbf9d001640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbf98156b50 0x7fbf98073ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:17.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.738+0000 7fbf9d001640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf9815f480 0x7fbf9815f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:17.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.738+0000 7fbf9d001640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf980cda30 con 0x7fbf98074410 2024-05-09T05:55:17.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.738+0000 7fbf9d001640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fbf980cc020 con 0x7fbf98156b50 2024-05-09T05:55:17.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.738+0000 7fbf9d001640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fbf9815dfe0 con 0x7fbf9815f480 2024-05-09T05:55:17.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.738+0000 7fbf96d9d640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbf98156b50 0x7fbf98073ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:17.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.738+0000 7fbf96d9d640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbf98156b50 0x7fbf98073ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33762/0 (socket says 172.21.15.72:33762) 2024-05-09T05:55:17.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.738+0000 7fbf96d9d640 1 -- 172.21.15.72:0/978081718 learned_addr learned my addr 172.21.15.72:0/978081718 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:55:17.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.738+0000 7fbf9759e640 1 --2- 172.21.15.72:0/978081718 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf9815f480 0x7fbf9815f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:17.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.738+0000 7fbf96d9d640 1 -- 172.21.15.72:0/978081718 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf9815f480 msgr2=0x7fbf9815f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:55:17.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.738+0000 7fbf96d9d640 1 --2- 172.21.15.72:0/978081718 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf9815f480 0x7fbf9815f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:17.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.738+0000 7fbf96d9d640 1 -- 172.21.15.72:0/978081718 >> v1:172.21.15.110:6789/0 conn(0x7fbf98074410 legacy=0x7fbf980cc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:55:17.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.738+0000 7fbf96d9d640 1 -- 172.21.15.72:0/978081718 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf9815cdd0 con 0x7fbf98156b50 2024-05-09T05:55:17.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.738+0000 7fbf9759e640 1 --2- 172.21.15.72:0/978081718 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf9815f480 0x7fbf9815f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:55:17.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.742+0000 7fbf96d9d640 1 --2- 172.21.15.72:0/978081718 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf98156b50 0x7fbf98073ed0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fbf88009870 tx=0x7fbf8801c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ef855f807c86b59 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:55:17.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.742+0000 7fbf9659c640 1 -- 172.21.15.72:0/978081718 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf880b0070 con 0x7fbf98156b50 2024-05-09T05:55:17.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.742+0000 7fbf9659c640 1 -- 172.21.15.72:0/978081718 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf880ab600 con 0x7fbf98156b50 2024-05-09T05:55:17.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.742+0000 7fbf9659c640 1 -- 172.21.15.72:0/978081718 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf880ab9d0 con 0x7fbf98156b50 2024-05-09T05:55:17.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.742+0000 7fbf9d001640 1 -- 172.21.15.72:0/978081718 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf98156b50 msgr2=0x7fbf98073ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:17.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.742+0000 7fbf9d001640 1 --2- 172.21.15.72:0/978081718 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf98156b50 0x7fbf98073ed0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fbf88009870 tx=0x7fbf8801c380 comp rx=0 tx=0).stop 2024-05-09T05:55:17.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.742+0000 7fbf9d001640 1 -- 172.21.15.72:0/978081718 shutdown_connections 2024-05-09T05:55:17.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.742+0000 7fbf9d001640 1 --2- 172.21.15.72:0/978081718 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf9815f480 0x7fbf9815f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:17.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.742+0000 7fbf9d001640 1 --2- 172.21.15.72:0/978081718 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf98156b50 0x7fbf98073ed0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:17.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.742+0000 7fbf9d001640 1 -- 172.21.15.72:0/978081718 >> 172.21.15.72:0/978081718 conn(0x7fbf980d1b70 msgr2=0x7fbf980d1f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:55:17.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.742+0000 7fbf9d001640 1 -- 172.21.15.72:0/978081718 shutdown_connections 2024-05-09T05:55:17.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.742+0000 7fbf9d001640 1 -- 172.21.15.72:0/978081718 wait complete. 2024-05-09T05:55:17.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.742+0000 7fbf9d001640 1 Processor -- start 2024-05-09T05:55:17.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.742+0000 7fbf9d001640 1 -- start start 2024-05-09T05:55:17.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.746+0000 7fbf9d001640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf98074410 0x7fbf98159a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:17.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.746+0000 7fbf9d001640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf98156b50 0x7fbf98155d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:17.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.746+0000 7fbf9d001640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf9815f480 0x7fbf981618d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:17.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.746+0000 7fbf9d001640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fbf98074cf0 con 0x7fbf98156b50 2024-05-09T05:55:17.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.746+0000 7fbf9d001640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fbf9815d950 con 0x7fbf98074410 2024-05-09T05:55:17.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.746+0000 7fbf9d001640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fbf9815c9b0 con 0x7fbf9815f480 2024-05-09T05:55:17.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.746+0000 7fbf8e59c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf98156b50 0x7fbf98155d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:17.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.746+0000 7fbf8e59c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf98156b50 0x7fbf98155d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33776/0 (socket says 172.21.15.72:33776) 2024-05-09T05:55:17.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.746+0000 7fbf8e59c640 1 -- 172.21.15.72:0/4094942745 learned_addr learned my addr 172.21.15.72:0/4094942745 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:55:17.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.746+0000 7fbf96d9d640 1 --2- 172.21.15.72:0/4094942745 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf98074410 0x7fbf98159a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:17.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.746+0000 7fbf9759e640 1 --2- 172.21.15.72:0/4094942745 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf9815f480 0x7fbf981618d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:17.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.746+0000 7fbf8e59c640 1 -- 172.21.15.72:0/4094942745 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf9815f480 msgr2=0x7fbf981618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:17.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.746+0000 7fbf8e59c640 1 --2- 172.21.15.72:0/4094942745 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf9815f480 0x7fbf981618d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:17.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.746+0000 7fbf8e59c640 1 -- 172.21.15.72:0/4094942745 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf98074410 msgr2=0x7fbf98159a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:17.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.746+0000 7fbf8e59c640 1 --2- 172.21.15.72:0/4094942745 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf98074410 0x7fbf98159a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:17.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.746+0000 7fbf8e59c640 1 -- 172.21.15.72:0/4094942745 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf98159f50 con 0x7fbf98156b50 2024-05-09T05:55:17.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.746+0000 7fbf8e59c640 1 --2- 172.21.15.72:0/4094942745 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf98156b50 0x7fbf98155d90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fbf8000b410 tx=0x7fbf8000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:55:17.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.746+0000 7fbf8ffff640 1 -- 172.21.15.72:0/4094942745 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf80015020 con 0x7fbf98156b50 2024-05-09T05:55:17.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.746+0000 7fbf8ffff640 1 -- 172.21.15.72:0/4094942745 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf80011830 con 0x7fbf98156b50 2024-05-09T05:55:17.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.746+0000 7fbf9d001640 1 -- 172.21.15.72:0/4094942745 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf980ce360 con 0x7fbf98156b50 2024-05-09T05:55:17.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.746+0000 7fbf8ffff640 1 -- 172.21.15.72:0/4094942745 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf80011c60 con 0x7fbf98156b50 2024-05-09T05:55:17.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.746+0000 7fbf9d001640 1 -- 172.21.15.72:0/4094942745 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf981f5b10 con 0x7fbf98156b50 2024-05-09T05:55:17.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.746+0000 7fbf9d001640 1 -- 172.21.15.72:0/4094942745 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf9806a520 con 0x7fbf98156b50 2024-05-09T05:55:17.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.746+0000 7fbf8ffff640 1 -- 172.21.15.72:0/4094942745 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fbf80018020 con 0x7fbf98156b50 2024-05-09T05:55:17.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.750+0000 7fbf8ffff640 1 --2- 172.21.15.72:0/4094942745 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fbf7806f400 0x7fbf78071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:17.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.750+0000 7fbf8ffff640 1 -- 172.21.15.72:0/4094942745 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6676+0+0 (secure 0 0 0) 0x7fbf8008f1f0 con 0x7fbf98156b50 2024-05-09T05:55:17.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.750+0000 7fbf96d9d640 1 --2- 172.21.15.72:0/4094942745 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fbf7806f400 0x7fbf78071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:17.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.750+0000 7fbf96d9d640 1 --2- 172.21.15.72:0/4094942745 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fbf7806f400 0x7fbf78071910 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbf880ad000 tx=0x7fbf880a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:55:17.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.754+0000 7fbf8ffff640 1 -- 172.21.15.72:0/4094942745 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fbf8001f030 con 0x7fbf98156b50 2024-05-09T05:55:17.982 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.994+0000 7fbf9d001640 1 -- 172.21.15.72:0/4094942745 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbf981f55b0 con 0x7fbf98156b50 2024-05-09T05:55:17.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.994+0000 7fbf8ffff640 1 -- 172.21.15.72:0/4094942745 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+6087 (secure 0 0 0) 0x7fbf981f55b0 con 0x7fbf98156b50 2024-05-09T05:55:17.983 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:55:17.983 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:53:23.494975+0000","modified":"2024-05-09T05:55:14.345518+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4297,"mds_1":4287,"mds_2":4263,"mds_3":4259,"mds_4":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"e","rank":4,"incarnation":20,"state":"up:replay","state_seq":1,"addr":"172.21.15.72:6834/1142956298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1142956298},{"type":"v1","addr":"172.21.15.72:6834","nonce":1142956298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4259":{"gid":4259,"name":"f","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.110:6838/840351907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":840351907},{"type":"v1","addr":"172.21.15.110:6838","nonce":840351907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4263":{"gid":4263,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.72:6837/1048256382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":1048256382},{"type":"v1","addr":"172.21.15.72:6837","nonce":1048256382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.110:6839/966325499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6837","nonce":966325499},{"type":"v1","addr":"172.21.15.110:6839","nonce":966325499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6836/4134424941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":4134424941},{"type":"v1","addr":"172.21.15.110:6836","nonce":4134424941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4259,4263,4287,4297]},"id":1}]} 2024-05-09T05:55:17.983 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 20 2024-05-09T05:55:17.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.998+0000 7fbf9d001640 1 -- 172.21.15.72:0/4094942745 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fbf7806f400 msgr2=0x7fbf78071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:17.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.998+0000 7fbf9d001640 1 --2- 172.21.15.72:0/4094942745 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fbf7806f400 0x7fbf78071910 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbf880ad000 tx=0x7fbf880a6000 comp rx=0 tx=0).stop 2024-05-09T05:55:17.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.998+0000 7fbf9d001640 1 -- 172.21.15.72:0/4094942745 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf98156b50 msgr2=0x7fbf98155d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:17.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.998+0000 7fbf9d001640 1 --2- 172.21.15.72:0/4094942745 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf98156b50 0x7fbf98155d90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fbf8000b410 tx=0x7fbf8000b8d0 comp rx=0 tx=0).stop 2024-05-09T05:55:17.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.998+0000 7fbf9d001640 1 -- 172.21.15.72:0/4094942745 shutdown_connections 2024-05-09T05:55:17.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.998+0000 7fbf9d001640 1 --2- 172.21.15.72:0/4094942745 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fbf7806f400 0x7fbf78071910 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:17.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.998+0000 7fbf9d001640 1 --2- 172.21.15.72:0/4094942745 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf9815f480 0x7fbf981618d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:17.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.998+0000 7fbf9d001640 1 --2- 172.21.15.72:0/4094942745 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf98156b50 0x7fbf98155d90 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:17.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.998+0000 7fbf9d001640 1 --2- 172.21.15.72:0/4094942745 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf98074410 0x7fbf98159a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:17.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.998+0000 7fbf9d001640 1 -- 172.21.15.72:0/4094942745 >> 172.21.15.72:0/4094942745 conn(0x7fbf980d1b70 msgr2=0x7fbf9815c240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:55:17.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.998+0000 7fbf9d001640 1 -- 172.21.15.72:0/4094942745 shutdown_connections 2024-05-09T05:55:17.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:17.998+0000 7fbf9d001640 1 -- 172.21.15.72:0/4094942745 wait complete. 2024-05-09T05:55:18.005 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-05-09T05:55:20.006 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:55:20.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.170+0000 7faf68618640 1 Processor -- start 2024-05-09T05:55:20.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.170+0000 7faf68618640 1 -- start start 2024-05-09T05:55:20.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.170+0000 7faf68618640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7faf60156b50 0x7faf60073ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:20.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.174+0000 7faf68618640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf60074410 0x7faf600cc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:20.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.174+0000 7faf68618640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf600cda30 con 0x7faf600cca30 2024-05-09T05:55:20.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.174+0000 7faf68618640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7faf600cc020 con 0x7faf60156b50 2024-05-09T05:55:20.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.174+0000 7faf68618640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7faf6015dfe0 con 0x7faf60074410 2024-05-09T05:55:20.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.174+0000 7faf65bb3640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf60074410 0x7faf600cc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:20.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.174+0000 7faf663b4640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7faf60156b50 0x7faf60073ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:20.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.174+0000 7faf66bb5640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7faf600cca30 0x7faf600cce40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.72:41408/0 (socket says 172.21.15.72:41408) 2024-05-09T05:55:20.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.174+0000 7faf65bb3640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf60074410 0x7faf600cc4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.72:54800/0 (socket says 172.21.15.72:54800) 2024-05-09T05:55:20.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.174+0000 7faf66bb5640 1 -- 172.21.15.72:0/2821113443 learned_addr learned my addr 172.21.15.72:0/2821113443 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:55:20.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.174+0000 7faf65bb3640 1 -- 172.21.15.72:0/2821113443 >> v2:172.21.15.110:3300/0 conn(0x7faf60156b50 msgr2=0x7faf60073ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:55:20.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.174+0000 7faf65bb3640 1 --2- 172.21.15.72:0/2821113443 >> v2:172.21.15.110:3300/0 conn(0x7faf60156b50 0x7faf60073ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:20.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.174+0000 7faf65bb3640 1 -- 172.21.15.72:0/2821113443 >> v1:172.21.15.110:6789/0 conn(0x7faf600cca30 legacy=0x7faf600cce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:20.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.174+0000 7faf65bb3640 1 -- 172.21.15.72:0/2821113443 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf6015cdd0 con 0x7faf60074410 2024-05-09T05:55:20.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.178+0000 7faf65bb3640 1 --2- 172.21.15.72:0/2821113443 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf60074410 0x7faf600cc4f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7faf540097c0 tx=0x7faf5401c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59e9935e83ef57a4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:55:20.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.178+0000 7faf653b2640 1 -- 172.21.15.72:0/2821113443 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf540b0070 con 0x7faf60074410 2024-05-09T05:55:20.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.178+0000 7faf653b2640 1 -- 172.21.15.72:0/2821113443 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf540ab600 con 0x7faf60074410 2024-05-09T05:55:20.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.178+0000 7faf653b2640 1 -- 172.21.15.72:0/2821113443 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf540ab9d0 con 0x7faf60074410 2024-05-09T05:55:20.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.178+0000 7faf68618640 1 -- 172.21.15.72:0/2821113443 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf60074410 msgr2=0x7faf600cc4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:20.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.178+0000 7faf68618640 1 --2- 172.21.15.72:0/2821113443 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf60074410 0x7faf600cc4f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7faf540097c0 tx=0x7faf5401c4a0 comp rx=0 tx=0).stop 2024-05-09T05:55:20.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.178+0000 7faf68618640 1 -- 172.21.15.72:0/2821113443 shutdown_connections 2024-05-09T05:55:20.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.178+0000 7faf68618640 1 --2- 172.21.15.72:0/2821113443 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf60074410 0x7faf600cc4f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:20.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.178+0000 7faf68618640 1 --2- 172.21.15.72:0/2821113443 >> v2:172.21.15.110:3300/0 conn(0x7faf60156b50 0x7faf60073ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:20.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.178+0000 7faf68618640 1 -- 172.21.15.72:0/2821113443 >> 172.21.15.72:0/2821113443 conn(0x7faf600d1b70 msgr2=0x7faf600d1f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:55:20.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.178+0000 7faf68618640 1 -- 172.21.15.72:0/2821113443 shutdown_connections 2024-05-09T05:55:20.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.178+0000 7faf68618640 1 -- 172.21.15.72:0/2821113443 wait complete. 2024-05-09T05:55:20.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.178+0000 7faf68618640 1 Processor -- start 2024-05-09T05:55:20.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.178+0000 7faf68618640 1 -- start start 2024-05-09T05:55:20.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.182+0000 7faf68618640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf60074410 0x7faf601f6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:20.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.182+0000 7faf68618640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf600cca30 0x7faf6015b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:20.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.182+0000 7faf68618640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf60156b50 0x7faf6014ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:20.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.182+0000 7faf68618640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7faf60074cf0 con 0x7faf60074410 2024-05-09T05:55:20.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.182+0000 7faf68618640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7faf6015d950 con 0x7faf60156b50 2024-05-09T05:55:20.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.182+0000 7faf68618640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7faf600cd550 con 0x7faf600cca30 2024-05-09T05:55:20.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.182+0000 7faf663b4640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf60074410 0x7faf601f6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:20.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.182+0000 7faf663b4640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf60074410 0x7faf601f6390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33780/0 (socket says 172.21.15.72:33780) 2024-05-09T05:55:20.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.182+0000 7faf663b4640 1 -- 172.21.15.72:0/3153107293 learned_addr learned my addr 172.21.15.72:0/3153107293 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:55:20.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.182+0000 7faf65bb3640 1 --2- 172.21.15.72:0/3153107293 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf600cca30 0x7faf6015b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:20.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.182+0000 7faf66bb5640 1 --2- 172.21.15.72:0/3153107293 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf60156b50 0x7faf6014ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:20.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.182+0000 7faf663b4640 1 -- 172.21.15.72:0/3153107293 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf600cca30 msgr2=0x7faf6015b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:20.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.182+0000 7faf663b4640 1 --2- 172.21.15.72:0/3153107293 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf600cca30 0x7faf6015b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:20.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.182+0000 7faf663b4640 1 -- 172.21.15.72:0/3153107293 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf60156b50 msgr2=0x7faf6014ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:20.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.182+0000 7faf663b4640 1 --2- 172.21.15.72:0/3153107293 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf60156b50 0x7faf6014ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:20.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.182+0000 7faf663b4640 1 -- 172.21.15.72:0/3153107293 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf60157ea0 con 0x7faf60074410 2024-05-09T05:55:20.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.182+0000 7faf65bb3640 1 --2- 172.21.15.72:0/3153107293 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf600cca30 0x7faf6015b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:55:20.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.182+0000 7faf66bb5640 1 --2- 172.21.15.72:0/3153107293 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf60156b50 0x7faf6014ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:55:20.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.182+0000 7faf663b4640 1 --2- 172.21.15.72:0/3153107293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf60074410 0x7faf601f6390 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7faf50009d10 tx=0x7faf5000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:55:20.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.182+0000 7faf5effd640 1 -- 172.21.15.72:0/3153107293 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf50018020 con 0x7faf60074410 2024-05-09T05:55:20.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.182+0000 7faf5effd640 1 -- 172.21.15.72:0/3153107293 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf50014480 con 0x7faf60074410 2024-05-09T05:55:20.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.182+0000 7faf5effd640 1 -- 172.21.15.72:0/3153107293 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf50014830 con 0x7faf60074410 2024-05-09T05:55:20.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.182+0000 7faf68618640 1 -- 172.21.15.72:0/3153107293 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf601ef020 con 0x7faf60074410 2024-05-09T05:55:20.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.182+0000 7faf68618640 1 -- 172.21.15.72:0/3153107293 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf601ef5e0 con 0x7faf60074410 2024-05-09T05:55:20.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.186+0000 7faf68618640 1 -- 172.21.15.72:0/3153107293 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf6006a520 con 0x7faf60074410 2024-05-09T05:55:20.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.186+0000 7faf5effd640 1 -- 172.21.15.72:0/3153107293 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7faf5001b020 con 0x7faf60074410 2024-05-09T05:55:20.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.186+0000 7faf5effd640 1 --2- 172.21.15.72:0/3153107293 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7faf4c06f430 0x7faf4c071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:20.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.186+0000 7faf5effd640 1 -- 172.21.15.72:0/3153107293 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6676+0+0 (secure 0 0 0) 0x7faf50090450 con 0x7faf60074410 2024-05-09T05:55:20.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.186+0000 7faf65bb3640 1 --2- 172.21.15.72:0/3153107293 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7faf4c06f430 0x7faf4c071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:20.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.186+0000 7faf65bb3640 1 --2- 172.21.15.72:0/3153107293 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7faf4c06f430 0x7faf4c071940 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7faf540ad000 tx=0x7faf54008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:55:20.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.190+0000 7faf5effd640 1 -- 172.21.15.72:0/3153107293 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7faf50022030 con 0x7faf60074410 2024-05-09T05:55:20.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.402+0000 7faf68618640 1 -- 172.21.15.72:0/3153107293 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faf600cdcb0 con 0x7faf60074410 2024-05-09T05:55:20.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.406+0000 7faf5effd640 1 -- 172.21.15.72:0/3153107293 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+6089 (secure 0 0 0) 0x7faf50010040 con 0x7faf60074410 2024-05-09T05:55:20.392 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:55:20.392 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:53:23.494975+0000","modified":"2024-05-09T05:55:19.359843+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4297,"mds_1":4287,"mds_2":4263,"mds_3":4259,"mds_4":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"e","rank":4,"incarnation":20,"state":"up:resolve","state_seq":32,"addr":"172.21.15.72:6834/1142956298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1142956298},{"type":"v1","addr":"172.21.15.72:6834","nonce":1142956298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4259":{"gid":4259,"name":"f","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.110:6838/840351907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":840351907},{"type":"v1","addr":"172.21.15.110:6838","nonce":840351907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4263":{"gid":4263,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.72:6837/1048256382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":1048256382},{"type":"v1","addr":"172.21.15.72:6837","nonce":1048256382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.110:6839/966325499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6837","nonce":966325499},{"type":"v1","addr":"172.21.15.110:6839","nonce":966325499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6836/4134424941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":4134424941},{"type":"v1","addr":"172.21.15.110:6836","nonce":4134424941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4297,4287,4263,4259]},"id":1}]} 2024-05-09T05:55:20.393 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 21 2024-05-09T05:55:20.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.406+0000 7faf68618640 1 -- 172.21.15.72:0/3153107293 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7faf4c06f430 msgr2=0x7faf4c071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:20.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.406+0000 7faf68618640 1 --2- 172.21.15.72:0/3153107293 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7faf4c06f430 0x7faf4c071940 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7faf540ad000 tx=0x7faf54008040 comp rx=0 tx=0).stop 2024-05-09T05:55:20.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.406+0000 7faf68618640 1 -- 172.21.15.72:0/3153107293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf60074410 msgr2=0x7faf601f6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:20.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.406+0000 7faf68618640 1 --2- 172.21.15.72:0/3153107293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf60074410 0x7faf601f6390 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7faf50009d10 tx=0x7faf5000c490 comp rx=0 tx=0).stop 2024-05-09T05:55:20.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.406+0000 7faf68618640 1 -- 172.21.15.72:0/3153107293 shutdown_connections 2024-05-09T05:55:20.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.406+0000 7faf68618640 1 --2- 172.21.15.72:0/3153107293 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7faf4c06f430 0x7faf4c071940 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:20.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.406+0000 7faf68618640 1 --2- 172.21.15.72:0/3153107293 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf60156b50 0x7faf6014ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:20.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.406+0000 7faf68618640 1 --2- 172.21.15.72:0/3153107293 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf600cca30 0x7faf6015b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:20.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.406+0000 7faf68618640 1 --2- 172.21.15.72:0/3153107293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf60074410 0x7faf601f6390 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:20.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.406+0000 7faf68618640 1 -- 172.21.15.72:0/3153107293 >> 172.21.15.72:0/3153107293 conn(0x7faf600d1b70 msgr2=0x7faf600cce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:55:20.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.406+0000 7faf68618640 1 -- 172.21.15.72:0/3153107293 shutdown_connections 2024-05-09T05:55:20.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:20.406+0000 7faf68618640 1 -- 172.21.15.72:0/3153107293 wait complete. 2024-05-09T05:55:20.414 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-05-09T05:55:22.415 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:55:22.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.570+0000 7f58900fb640 1 Processor -- start 2024-05-09T05:55:22.557 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.570+0000 7f58900fb640 1 -- start start 2024-05-09T05:55:22.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.570+0000 7f58900fb640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58880b3b70 0x7f5888073c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:22.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.570+0000 7f58900fb640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f588815d6f0 0x7f5888163f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:22.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.570+0000 7f58900fb640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5888068dc0 con 0x7f588815cbd0 2024-05-09T05:55:22.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.570+0000 7f58900fb640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f588806efb0 con 0x7f588815d6f0 2024-05-09T05:55:22.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.570+0000 7f58900fb640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f5888068820 con 0x7f58880b3b70 2024-05-09T05:55:22.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.574+0000 7f588e698640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f588815d6f0 0x7f5888163f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:22.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.574+0000 7f588e698640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f588815d6f0 0x7f5888163f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37198/0 (socket says 172.21.15.72:37198) 2024-05-09T05:55:22.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.574+0000 7f588e698640 1 -- 172.21.15.72:0/1369566741 learned_addr learned my addr 172.21.15.72:0/1369566741 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:55:22.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.574+0000 7f588d696640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f588815cbd0 0x7f588815cfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:43836/0 (socket says 172.21.15.72:43836) 2024-05-09T05:55:22.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.574+0000 7f588de97640 1 --2- 172.21.15.72:0/1369566741 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58880b3b70 0x7f5888073c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:22.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.574+0000 7f588e698640 1 -- 172.21.15.72:0/1369566741 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58880b3b70 msgr2=0x7f5888073c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:55:22.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.574+0000 7f588e698640 1 --2- 172.21.15.72:0/1369566741 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58880b3b70 0x7f5888073c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:22.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.574+0000 7f588e698640 1 -- 172.21.15.72:0/1369566741 >> v1:172.21.15.72:6789/0 conn(0x7f588815cbd0 legacy=0x7f588815cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:22.560 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.574+0000 7f588e698640 1 -- 172.21.15.72:0/1369566741 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5888068ae0 con 0x7f588815d6f0 2024-05-09T05:55:22.561 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.574+0000 7f588de97640 1 --2- 172.21.15.72:0/1369566741 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58880b3b70 0x7f5888073c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:55:22.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.574+0000 7f588e698640 1 --2- 172.21.15.72:0/1369566741 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f588815d6f0 0x7f5888163f60 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f5880009e50 tx=0x7f588001f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc7e201586e31540 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:55:22.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.574+0000 7f588ce95640 1 -- 172.21.15.72:0/1369566741 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58800b4070 con 0x7f588815d6f0 2024-05-09T05:55:22.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.574+0000 7f588ce95640 1 -- 172.21.15.72:0/1369566741 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58800af400 con 0x7f588815d6f0 2024-05-09T05:55:22.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.574+0000 7f588ce95640 1 -- 172.21.15.72:0/1369566741 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58800af7d0 con 0x7f588815d6f0 2024-05-09T05:55:22.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.574+0000 7f58900fb640 1 -- 172.21.15.72:0/1369566741 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f588815d6f0 msgr2=0x7f5888163f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:22.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.574+0000 7f58900fb640 1 --2- 172.21.15.72:0/1369566741 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f588815d6f0 0x7f5888163f60 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f5880009e50 tx=0x7f588001f210 comp rx=0 tx=0).stop 2024-05-09T05:55:22.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.574+0000 7f58900fb640 1 -- 172.21.15.72:0/1369566741 shutdown_connections 2024-05-09T05:55:22.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.574+0000 7f58900fb640 1 --2- 172.21.15.72:0/1369566741 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f588815d6f0 0x7f5888163f60 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:22.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.574+0000 7f58900fb640 1 --2- 172.21.15.72:0/1369566741 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58880b3b70 0x7f5888073c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:22.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.574+0000 7f58900fb640 1 -- 172.21.15.72:0/1369566741 >> 172.21.15.72:0/1369566741 conn(0x7f58880cbe10 msgr2=0x7f58880cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:55:22.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.574+0000 7f58900fb640 1 -- 172.21.15.72:0/1369566741 shutdown_connections 2024-05-09T05:55:22.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.574+0000 7f58900fb640 1 -- 172.21.15.72:0/1369566741 wait complete. 2024-05-09T05:55:22.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.578+0000 7f58900fb640 1 Processor -- start 2024-05-09T05:55:22.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.578+0000 7f58900fb640 1 -- start start 2024-05-09T05:55:22.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.578+0000 7f58900fb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58880b3b70 0x7f5888156690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:22.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.578+0000 7f58900fb640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f588815cbd0 0x7f58881f11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:22.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.578+0000 7f58900fb640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f588815d6f0 0x7f58881e5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:22.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.578+0000 7f58900fb640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f588806db80 con 0x7f588815cbd0 2024-05-09T05:55:22.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.578+0000 7f58900fb640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f588806cb90 con 0x7f58880b3b70 2024-05-09T05:55:22.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.578+0000 7f58900fb640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f58880b3f80 con 0x7f588815d6f0 2024-05-09T05:55:22.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.578+0000 7f588d696640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f588815cbd0 0x7f58881f11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:22.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.578+0000 7f588d696640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f588815cbd0 0x7f58881f11e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37200/0 (socket says 172.21.15.72:37200) 2024-05-09T05:55:22.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.578+0000 7f588d696640 1 -- 172.21.15.72:0/978943652 learned_addr learned my addr 172.21.15.72:0/978943652 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:55:22.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.582+0000 7f588de97640 1 --2- 172.21.15.72:0/978943652 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58880b3b70 0x7f5888156690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:22.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.582+0000 7f588e698640 1 --2- 172.21.15.72:0/978943652 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f588815d6f0 0x7f58881e5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:22.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.582+0000 7f588d696640 1 -- 172.21.15.72:0/978943652 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f588815d6f0 msgr2=0x7f58881e5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:22.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.582+0000 7f588d696640 1 --2- 172.21.15.72:0/978943652 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f588815d6f0 0x7f58881e5e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:22.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.582+0000 7f588d696640 1 -- 172.21.15.72:0/978943652 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58880b3b70 msgr2=0x7f5888156690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:22.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.582+0000 7f588d696640 1 --2- 172.21.15.72:0/978943652 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58880b3b70 0x7f5888156690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:22.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.582+0000 7f588d696640 1 -- 172.21.15.72:0/978943652 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f588815d110 con 0x7f588815cbd0 2024-05-09T05:55:22.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.582+0000 7f588d696640 1 --2- 172.21.15.72:0/978943652 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f588815cbd0 0x7f58881f11e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f587800c460 tx=0x7f587800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:55:22.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.582+0000 7f587e7fc640 1 -- 172.21.15.72:0/978943652 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5878018070 con 0x7f588815cbd0 2024-05-09T05:55:22.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.582+0000 7f587e7fc640 1 -- 172.21.15.72:0/978943652 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5878007480 con 0x7f588815cbd0 2024-05-09T05:55:22.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.582+0000 7f587e7fc640 1 -- 172.21.15.72:0/978943652 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58780047f0 con 0x7f588815cbd0 2024-05-09T05:55:22.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.582+0000 7f58900fb640 1 -- 172.21.15.72:0/978943652 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f588815a090 con 0x7f588815cbd0 2024-05-09T05:55:22.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.582+0000 7f58900fb640 1 -- 172.21.15.72:0/978943652 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58881f09e0 con 0x7f588815cbd0 2024-05-09T05:55:22.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.582+0000 7f58900fb640 1 -- 172.21.15.72:0/978943652 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f588806a520 con 0x7f588815cbd0 2024-05-09T05:55:22.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.582+0000 7f587e7fc640 1 -- 172.21.15.72:0/978943652 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f587801b070 con 0x7f588815cbd0 2024-05-09T05:55:22.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.582+0000 7f587e7fc640 1 --2- 172.21.15.72:0/978943652 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f586c06f430 0x7f586c071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:22.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.582+0000 7f587e7fc640 1 -- 172.21.15.72:0/978943652 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6676+0+0 (secure 0 0 0) 0x7f587808e900 con 0x7f588815cbd0 2024-05-09T05:55:22.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.582+0000 7f588de97640 1 --2- 172.21.15.72:0/978943652 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f586c06f430 0x7f586c071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:22.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.586+0000 7f588de97640 1 --2- 172.21.15.72:0/978943652 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f586c06f430 0x7f586c071940 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5884006fd0 tx=0x7f5884008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:55:22.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.586+0000 7f587e7fc640 1 -- 172.21.15.72:0/978943652 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f587805b420 con 0x7f588815cbd0 2024-05-09T05:55:22.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.802+0000 7f58900fb640 1 -- 172.21.15.72:0/978943652 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f58880cdaa0 con 0x7f588815cbd0 2024-05-09T05:55:22.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.802+0000 7f587e7fc640 1 -- 172.21.15.72:0/978943652 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+6089 (secure 0 0 0) 0x7f587805ad20 con 0x7f588815cbd0 2024-05-09T05:55:22.791 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:55:22.791 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:53:23.494975+0000","modified":"2024-05-09T05:55:19.359843+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4297,"mds_1":4287,"mds_2":4263,"mds_3":4259,"mds_4":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"e","rank":4,"incarnation":20,"state":"up:resolve","state_seq":32,"addr":"172.21.15.72:6834/1142956298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1142956298},{"type":"v1","addr":"172.21.15.72:6834","nonce":1142956298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4259":{"gid":4259,"name":"f","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.110:6838/840351907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":840351907},{"type":"v1","addr":"172.21.15.110:6838","nonce":840351907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4263":{"gid":4263,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.72:6837/1048256382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":1048256382},{"type":"v1","addr":"172.21.15.72:6837","nonce":1048256382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.110:6839/966325499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6837","nonce":966325499},{"type":"v1","addr":"172.21.15.110:6839","nonce":966325499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6836/4134424941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":4134424941},{"type":"v1","addr":"172.21.15.110:6836","nonce":4134424941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4297,4287,4263,4259]},"id":1}]} 2024-05-09T05:55:22.792 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 21 2024-05-09T05:55:22.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.806+0000 7f58900fb640 1 -- 172.21.15.72:0/978943652 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f586c06f430 msgr2=0x7f586c071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:22.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.806+0000 7f58900fb640 1 --2- 172.21.15.72:0/978943652 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f586c06f430 0x7f586c071940 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5884006fd0 tx=0x7f5884008040 comp rx=0 tx=0).stop 2024-05-09T05:55:22.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.806+0000 7f58900fb640 1 -- 172.21.15.72:0/978943652 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f588815cbd0 msgr2=0x7f58881f11e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:22.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.806+0000 7f58900fb640 1 --2- 172.21.15.72:0/978943652 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f588815cbd0 0x7f58881f11e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f587800c460 tx=0x7f587800c920 comp rx=0 tx=0).stop 2024-05-09T05:55:22.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.806+0000 7f58900fb640 1 -- 172.21.15.72:0/978943652 shutdown_connections 2024-05-09T05:55:22.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.806+0000 7f58900fb640 1 --2- 172.21.15.72:0/978943652 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f586c06f430 0x7f586c071940 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:22.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.806+0000 7f58900fb640 1 --2- 172.21.15.72:0/978943652 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f588815d6f0 0x7f58881e5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:22.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.806+0000 7f58900fb640 1 --2- 172.21.15.72:0/978943652 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f588815cbd0 0x7f58881f11e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:22.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.806+0000 7f58900fb640 1 --2- 172.21.15.72:0/978943652 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58880b3b70 0x7f5888156690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:22.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.806+0000 7f58900fb640 1 -- 172.21.15.72:0/978943652 >> 172.21.15.72:0/978943652 conn(0x7f58880cbe10 msgr2=0x7f58880c9ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:55:22.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.806+0000 7f58900fb640 1 -- 172.21.15.72:0/978943652 shutdown_connections 2024-05-09T05:55:22.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:22.806+0000 7f58900fb640 1 -- 172.21.15.72:0/978943652 wait complete. 2024-05-09T05:55:22.812 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-05-09T05:55:24.813 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:55:24.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.006+0000 7fbf35581640 1 Processor -- start 2024-05-09T05:55:24.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.006+0000 7fbf35581640 1 -- start start 2024-05-09T05:55:24.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.010+0000 7fbf35581640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbf30156b50 0x7fbf30073ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:24.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.010+0000 7fbf35581640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf30074410 0x7fbf300cc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:24.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.010+0000 7fbf35581640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf300cda30 con 0x7fbf300cca30 2024-05-09T05:55:24.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.010+0000 7fbf35581640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fbf300cc020 con 0x7fbf30156b50 2024-05-09T05:55:24.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.010+0000 7fbf35581640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fbf3015dfe0 con 0x7fbf30074410 2024-05-09T05:55:24.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.010+0000 7fbf2effd640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbf30156b50 0x7fbf30073ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:24.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.010+0000 7fbf2f7fe640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fbf300cca30 0x7fbf300cce40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:43838/0 (socket says 172.21.15.72:43838) 2024-05-09T05:55:24.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.010+0000 7fbf2f7fe640 1 -- 172.21.15.72:0/2003708560 learned_addr learned my addr 172.21.15.72:0/2003708560 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:55:24.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.010+0000 7fbf2e7fc640 1 --2- 172.21.15.72:0/2003708560 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf30074410 0x7fbf300cc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:24.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.010+0000 7fbf2effd640 1 -- 172.21.15.72:0/2003708560 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf30074410 msgr2=0x7fbf300cc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:55:24.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.010+0000 7fbf2dffb640 1 -- 172.21.15.72:0/2003708560 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 171771734 0 0) 0x7fbf280014a0 con 0x7fbf300cca30 2024-05-09T05:55:24.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.010+0000 7fbf2effd640 1 --2- 172.21.15.72:0/2003708560 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf30074410 0x7fbf300cc4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:24.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.010+0000 7fbf2effd640 1 -- 172.21.15.72:0/2003708560 >> v1:172.21.15.72:6789/0 conn(0x7fbf300cca30 legacy=0x7fbf300cce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:24.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.010+0000 7fbf2effd640 1 -- 172.21.15.72:0/2003708560 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf3015cdd0 con 0x7fbf30156b50 2024-05-09T05:55:24.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.014+0000 7fbf2effd640 1 --2- 172.21.15.72:0/2003708560 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf30156b50 0x7fbf30073ed0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fbf200097c0 tx=0x7fbf2001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d93358708f1c914d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:55:25.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.014+0000 7fbf2dffb640 1 -- 172.21.15.72:0/2003708560 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf200b0070 con 0x7fbf30156b50 2024-05-09T05:55:25.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.014+0000 7fbf2dffb640 1 -- 172.21.15.72:0/2003708560 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf200ab600 con 0x7fbf30156b50 2024-05-09T05:55:25.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.014+0000 7fbf2dffb640 1 -- 172.21.15.72:0/2003708560 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf200ab9d0 con 0x7fbf30156b50 2024-05-09T05:55:25.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.014+0000 7fbf35581640 1 -- 172.21.15.72:0/2003708560 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf30156b50 msgr2=0x7fbf30073ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:25.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.014+0000 7fbf35581640 1 --2- 172.21.15.72:0/2003708560 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf30156b50 0x7fbf30073ed0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fbf200097c0 tx=0x7fbf2001c4a0 comp rx=0 tx=0).stop 2024-05-09T05:55:25.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.014+0000 7fbf35581640 1 -- 172.21.15.72:0/2003708560 shutdown_connections 2024-05-09T05:55:25.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.014+0000 7fbf35581640 1 --2- 172.21.15.72:0/2003708560 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf30074410 0x7fbf300cc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:25.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.014+0000 7fbf35581640 1 --2- 172.21.15.72:0/2003708560 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf30156b50 0x7fbf30073ed0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:25.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.014+0000 7fbf35581640 1 -- 172.21.15.72:0/2003708560 >> 172.21.15.72:0/2003708560 conn(0x7fbf300d1b70 msgr2=0x7fbf300d1f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:55:25.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.014+0000 7fbf35581640 1 -- 172.21.15.72:0/2003708560 shutdown_connections 2024-05-09T05:55:25.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.014+0000 7fbf35581640 1 -- 172.21.15.72:0/2003708560 wait complete. 2024-05-09T05:55:25.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.018+0000 7fbf35581640 1 Processor -- start 2024-05-09T05:55:25.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.018+0000 7fbf35581640 1 -- start start 2024-05-09T05:55:25.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.018+0000 7fbf35581640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf30074410 0x7fbf301f9970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:25.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.018+0000 7fbf35581640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf300cca30 0x7fbf3014fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:25.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.018+0000 7fbf35581640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf30156b50 0x7fbf3014a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:25.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.018+0000 7fbf35581640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fbf30074cf0 con 0x7fbf30074410 2024-05-09T05:55:25.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.018+0000 7fbf35581640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fbf3015d950 con 0x7fbf30156b50 2024-05-09T05:55:25.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.018+0000 7fbf35581640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fbf300cd550 con 0x7fbf300cca30 2024-05-09T05:55:25.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.018+0000 7fbf2effd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf30074410 0x7fbf301f9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:25.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.018+0000 7fbf2effd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf30074410 0x7fbf301f9970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37210/0 (socket says 172.21.15.72:37210) 2024-05-09T05:55:25.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.018+0000 7fbf2effd640 1 -- 172.21.15.72:0/3714429955 learned_addr learned my addr 172.21.15.72:0/3714429955 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:55:25.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.018+0000 7fbf2e7fc640 1 --2- 172.21.15.72:0/3714429955 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf300cca30 0x7fbf3014fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:25.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.018+0000 7fbf2f7fe640 1 --2- 172.21.15.72:0/3714429955 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf30156b50 0x7fbf3014a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:25.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.018+0000 7fbf2effd640 1 -- 172.21.15.72:0/3714429955 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf300cca30 msgr2=0x7fbf3014fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:25.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.018+0000 7fbf2effd640 1 --2- 172.21.15.72:0/3714429955 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf300cca30 0x7fbf3014fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:25.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.018+0000 7fbf2effd640 1 -- 172.21.15.72:0/3714429955 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf30156b50 msgr2=0x7fbf3014a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:25.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.018+0000 7fbf2effd640 1 --2- 172.21.15.72:0/3714429955 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf30156b50 0x7fbf3014a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:25.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.018+0000 7fbf2effd640 1 -- 172.21.15.72:0/3714429955 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf3014ceb0 con 0x7fbf30074410 2024-05-09T05:55:25.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.018+0000 7fbf2effd640 1 --2- 172.21.15.72:0/3714429955 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf30074410 0x7fbf301f9970 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fbf200097c0 tx=0x7fbf2001ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:55:25.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.018+0000 7fbf177fe640 1 -- 172.21.15.72:0/3714429955 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf200bd070 con 0x7fbf30074410 2024-05-09T05:55:25.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.018+0000 7fbf177fe640 1 -- 172.21.15.72:0/3714429955 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf20004030 con 0x7fbf30074410 2024-05-09T05:55:25.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.018+0000 7fbf35581640 1 -- 172.21.15.72:0/3714429955 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf301f9eb0 con 0x7fbf30074410 2024-05-09T05:55:25.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.018+0000 7fbf177fe640 1 -- 172.21.15.72:0/3714429955 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf200b0040 con 0x7fbf30074410 2024-05-09T05:55:25.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.018+0000 7fbf35581640 1 -- 172.21.15.72:0/3714429955 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf3014d400 con 0x7fbf30074410 2024-05-09T05:55:25.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.022+0000 7fbf35581640 1 -- 172.21.15.72:0/3714429955 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf3006a520 con 0x7fbf30074410 2024-05-09T05:55:25.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.022+0000 7fbf177fe640 1 -- 172.21.15.72:0/3714429955 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fbf200c0070 con 0x7fbf30074410 2024-05-09T05:55:25.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.022+0000 7fbf177fe640 1 --2- 172.21.15.72:0/3714429955 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fbf1c06f400 0x7fbf1c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:25.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.022+0000 7fbf177fe640 1 -- 172.21.15.72:0/3714429955 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6676+0+0 (secure 0 0 0) 0x7fbf201290d0 con 0x7fbf30074410 2024-05-09T05:55:25.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.022+0000 7fbf2e7fc640 1 --2- 172.21.15.72:0/3714429955 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fbf1c06f400 0x7fbf1c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:25.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.022+0000 7fbf2e7fc640 1 --2- 172.21.15.72:0/3714429955 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fbf1c06f400 0x7fbf1c071910 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbf3015a650 tx=0x7fbf24008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:55:25.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.026+0000 7fbf177fe640 1 -- 172.21.15.72:0/3714429955 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fbf20016090 con 0x7fbf30074410 2024-05-09T05:55:25.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.246+0000 7fbf35581640 1 -- 172.21.15.72:0/3714429955 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbf300cdcb0 con 0x7fbf30074410 2024-05-09T05:55:25.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.246+0000 7fbf177fe640 1 -- 172.21.15.72:0/3714429955 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+6091 (secure 0 0 0) 0x7fbf200f5bf0 con 0x7fbf30074410 2024-05-09T05:55:25.234 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:55:25.234 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:53:23.494975+0000","modified":"2024-05-09T05:55:24.636960+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4297,"mds_1":4287,"mds_2":4263,"mds_3":4259,"mds_4":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"e","rank":4,"incarnation":20,"state":"up:reconnect","state_seq":34,"addr":"172.21.15.72:6834/1142956298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1142956298},{"type":"v1","addr":"172.21.15.72:6834","nonce":1142956298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4259":{"gid":4259,"name":"f","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.110:6838/840351907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":840351907},{"type":"v1","addr":"172.21.15.110:6838","nonce":840351907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4263":{"gid":4263,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.72:6837/1048256382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":1048256382},{"type":"v1","addr":"172.21.15.72:6837","nonce":1048256382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.110:6839/966325499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6837","nonce":966325499},{"type":"v1","addr":"172.21.15.110:6839","nonce":966325499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6836/4134424941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":4134424941},{"type":"v1","addr":"172.21.15.110:6836","nonce":4134424941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4259,4263,4287,4297]},"id":1}]} 2024-05-09T05:55:25.234 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 22 2024-05-09T05:55:25.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.250+0000 7fbf35581640 1 -- 172.21.15.72:0/3714429955 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fbf1c06f400 msgr2=0x7fbf1c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:25.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.250+0000 7fbf35581640 1 --2- 172.21.15.72:0/3714429955 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fbf1c06f400 0x7fbf1c071910 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbf3015a650 tx=0x7fbf24008040 comp rx=0 tx=0).stop 2024-05-09T05:55:25.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.250+0000 7fbf35581640 1 -- 172.21.15.72:0/3714429955 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf30074410 msgr2=0x7fbf301f9970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:25.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.250+0000 7fbf35581640 1 --2- 172.21.15.72:0/3714429955 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf30074410 0x7fbf301f9970 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fbf200097c0 tx=0x7fbf2001ace0 comp rx=0 tx=0).stop 2024-05-09T05:55:25.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.250+0000 7fbf35581640 1 -- 172.21.15.72:0/3714429955 shutdown_connections 2024-05-09T05:55:25.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.250+0000 7fbf35581640 1 --2- 172.21.15.72:0/3714429955 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fbf1c06f400 0x7fbf1c071910 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:25.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.250+0000 7fbf35581640 1 --2- 172.21.15.72:0/3714429955 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf30156b50 0x7fbf3014a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:25.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.250+0000 7fbf35581640 1 --2- 172.21.15.72:0/3714429955 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf300cca30 0x7fbf3014fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:25.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.250+0000 7fbf35581640 1 --2- 172.21.15.72:0/3714429955 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf30074410 0x7fbf301f9970 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:25.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.250+0000 7fbf35581640 1 -- 172.21.15.72:0/3714429955 >> 172.21.15.72:0/3714429955 conn(0x7fbf300d1b70 msgr2=0x7fbf30153c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:55:25.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.250+0000 7fbf35581640 1 -- 172.21.15.72:0/3714429955 shutdown_connections 2024-05-09T05:55:25.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:25.250+0000 7fbf35581640 1 -- 172.21.15.72:0/3714429955 wait complete. 2024-05-09T05:55:25.259 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-05-09T05:55:25.308 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T05:55:25.310 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T05:55:27.260 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:55:27.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.410+0000 7fde0027d640 1 Processor -- start 2024-05-09T05:55:27.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.410+0000 7fde0027d640 1 -- start start 2024-05-09T05:55:27.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.410+0000 7fde0027d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fddf806c7a0 0x7fddf8074040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:27.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.410+0000 7fde0027d640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fddf8074ce0 0x7fddf80c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:27.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.410+0000 7fde0027d640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddf806e920 con 0x7fddf80750f0 2024-05-09T05:55:27.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.410+0000 7fde0027d640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fddf8073b70 con 0x7fddf8074ce0 2024-05-09T05:55:27.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.410+0000 7fde0027d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fddf8073890 con 0x7fddf806c7a0 2024-05-09T05:55:27.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.410+0000 7fddfd818640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fddf8074ce0 0x7fddf80c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:27.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.410+0000 7fddfd818640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fddf8074ce0 0x7fddf80c7fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37220/0 (socket says 172.21.15.72:37220) 2024-05-09T05:55:27.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.410+0000 7fddfd818640 1 -- 172.21.15.72:0/96650944 learned_addr learned my addr 172.21.15.72:0/96650944 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:55:27.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.410+0000 7fddfe019640 1 --2- 172.21.15.72:0/96650944 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fddf806c7a0 0x7fddf8074040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:27.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.414+0000 7fddfd818640 1 -- 172.21.15.72:0/96650944 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fddf806c7a0 msgr2=0x7fddf8074040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:55:27.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.414+0000 7fddfd818640 1 --2- 172.21.15.72:0/96650944 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fddf806c7a0 0x7fddf8074040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:27.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.414+0000 7fddfd818640 1 -- 172.21.15.72:0/96650944 >> v1:172.21.15.110:6789/0 conn(0x7fddf80750f0 legacy=0x7fddf815da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:27.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.414+0000 7fddfd818640 1 -- 172.21.15.72:0/96650944 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddf806e360 con 0x7fddf8074ce0 2024-05-09T05:55:27.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.414+0000 7fddfe019640 1 --2- 172.21.15.72:0/96650944 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fddf806c7a0 0x7fddf8074040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:55:27.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.414+0000 7fddfd818640 1 --2- 172.21.15.72:0/96650944 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fddf8074ce0 0x7fddf80c7fd0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fdde8009870 tx=0x7fdde801ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45f8e14615393e9b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:55:27.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.414+0000 7fddfd017640 1 -- 172.21.15.72:0/96650944 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdde80b5070 con 0x7fddf8074ce0 2024-05-09T05:55:27.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.414+0000 7fddfd017640 1 -- 172.21.15.72:0/96650944 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdde80a8a50 con 0x7fddf8074ce0 2024-05-09T05:55:27.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.414+0000 7fddfd017640 1 -- 172.21.15.72:0/96650944 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdde80a8e20 con 0x7fddf8074ce0 2024-05-09T05:55:27.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.414+0000 7fde0027d640 1 -- 172.21.15.72:0/96650944 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fddf8074ce0 msgr2=0x7fddf80c7fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:27.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.414+0000 7fde0027d640 1 --2- 172.21.15.72:0/96650944 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fddf8074ce0 0x7fddf80c7fd0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fdde8009870 tx=0x7fdde801ed50 comp rx=0 tx=0).stop 2024-05-09T05:55:27.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.418+0000 7fde0027d640 1 -- 172.21.15.72:0/96650944 shutdown_connections 2024-05-09T05:55:27.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.418+0000 7fde0027d640 1 --2- 172.21.15.72:0/96650944 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fddf8074ce0 0x7fddf80c7fd0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:27.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.418+0000 7fde0027d640 1 --2- 172.21.15.72:0/96650944 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fddf806c7a0 0x7fddf8074040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:27.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.418+0000 7fde0027d640 1 -- 172.21.15.72:0/96650944 >> 172.21.15.72:0/96650944 conn(0x7fddf80cb3c0 msgr2=0x7fddf80cb7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:55:27.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.418+0000 7fde0027d640 1 -- 172.21.15.72:0/96650944 shutdown_connections 2024-05-09T05:55:27.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.418+0000 7fde0027d640 1 -- 172.21.15.72:0/96650944 wait complete. 2024-05-09T05:55:27.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.418+0000 7fde0027d640 1 Processor -- start 2024-05-09T05:55:27.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.418+0000 7fde0027d640 1 -- start start 2024-05-09T05:55:27.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.422+0000 7fde0027d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fddf806c7a0 0x7fddf80c5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:27.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.422+0000 7fde0027d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fddf8074ce0 0x7fddf80c9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:27.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.422+0000 7fde0027d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fddf80750f0 0x7fddf80ca2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:27.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.422+0000 7fde0027d640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fddf815a450 con 0x7fddf8074ce0 2024-05-09T05:55:27.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.422+0000 7fde0027d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fddf80747c0 con 0x7fddf806c7a0 2024-05-09T05:55:27.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.422+0000 7fde0027d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fddf815a5d0 con 0x7fddf80750f0 2024-05-09T05:55:27.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.422+0000 7fddfd818640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fddf8074ce0 0x7fddf80c9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:27.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.422+0000 7fddfd818640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fddf8074ce0 0x7fddf80c9db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37232/0 (socket says 172.21.15.72:37232) 2024-05-09T05:55:27.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.422+0000 7fddfd818640 1 -- 172.21.15.72:0/4087837145 learned_addr learned my addr 172.21.15.72:0/4087837145 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:55:27.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.422+0000 7fddfe019640 1 --2- 172.21.15.72:0/4087837145 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fddf806c7a0 0x7fddf80c5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:27.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.422+0000 7fddfe81a640 1 --2- 172.21.15.72:0/4087837145 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fddf80750f0 0x7fddf80ca2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:27.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.422+0000 7fddfd818640 1 -- 172.21.15.72:0/4087837145 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fddf80750f0 msgr2=0x7fddf80ca2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:27.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.422+0000 7fddfd818640 1 --2- 172.21.15.72:0/4087837145 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fddf80750f0 0x7fddf80ca2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:27.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.422+0000 7fddfd818640 1 -- 172.21.15.72:0/4087837145 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fddf806c7a0 msgr2=0x7fddf80c5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:27.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.422+0000 7fddfd818640 1 --2- 172.21.15.72:0/4087837145 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fddf806c7a0 0x7fddf80c5dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:27.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.422+0000 7fddfd818640 1 -- 172.21.15.72:0/4087837145 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddf8153850 con 0x7fddf8074ce0 2024-05-09T05:55:27.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.422+0000 7fddfd818640 1 --2- 172.21.15.72:0/4087837145 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fddf8074ce0 0x7fddf80c9db0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fdde801c980 tx=0x7fdde801baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:55:27.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.422+0000 7fddeeffd640 1 -- 172.21.15.72:0/4087837145 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdde80b5040 con 0x7fddf8074ce0 2024-05-09T05:55:27.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.422+0000 7fddeeffd640 1 -- 172.21.15.72:0/4087837145 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdde80be070 con 0x7fddf8074ce0 2024-05-09T05:55:27.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.422+0000 7fddeeffd640 1 -- 172.21.15.72:0/4087837145 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdde80b9440 con 0x7fddf8074ce0 2024-05-09T05:55:27.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.422+0000 7fde0027d640 1 -- 172.21.15.72:0/4087837145 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddf80c79c0 con 0x7fddf8074ce0 2024-05-09T05:55:27.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.422+0000 7fde0027d640 1 -- 172.21.15.72:0/4087837145 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddf81e6190 con 0x7fddf8074ce0 2024-05-09T05:55:27.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.426+0000 7fde0027d640 1 -- 172.21.15.72:0/4087837145 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddf81e63d0 con 0x7fddf8074ce0 2024-05-09T05:55:27.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.426+0000 7fddeeffd640 1 -- 172.21.15.72:0/4087837145 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fdde80a8910 con 0x7fddf8074ce0 2024-05-09T05:55:27.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.426+0000 7fddeeffd640 1 --2- 172.21.15.72:0/4087837145 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fdddc06f430 0x7fdddc071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:27.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.426+0000 7fddeeffd640 1 -- 172.21.15.72:0/4087837145 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6676+0+0 (secure 0 0 0) 0x7fdde812cde0 con 0x7fddf8074ce0 2024-05-09T05:55:27.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.426+0000 7fddfe019640 1 --2- 172.21.15.72:0/4087837145 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fdddc06f430 0x7fdddc071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:27.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.426+0000 7fddfe019640 1 --2- 172.21.15.72:0/4087837145 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fdddc06f430 0x7fdddc071940 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fddf4006fd0 tx=0x7fddf4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:55:27.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.434+0000 7fddeeffd640 1 -- 172.21.15.72:0/4087837145 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fddf81e63d0 con 0x7fddf8074ce0 2024-05-09T05:55:27.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.638+0000 7fde0027d640 1 -- 172.21.15.72:0/4087837145 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fddf806a520 con 0x7fddf8074ce0 2024-05-09T05:55:27.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.638+0000 7fddeeffd640 1 -- 172.21.15.72:0/4087837145 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+6091 (secure 0 0 0) 0x7fdde80188b0 con 0x7fddf8074ce0 2024-05-09T05:55:27.626 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:55:27.626 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:53:23.494975+0000","modified":"2024-05-09T05:55:24.636960+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4297,"mds_1":4287,"mds_2":4263,"mds_3":4259,"mds_4":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"e","rank":4,"incarnation":20,"state":"up:reconnect","state_seq":34,"addr":"172.21.15.72:6834/1142956298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1142956298},{"type":"v1","addr":"172.21.15.72:6834","nonce":1142956298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4259":{"gid":4259,"name":"f","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.110:6838/840351907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":840351907},{"type":"v1","addr":"172.21.15.110:6838","nonce":840351907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4263":{"gid":4263,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.72:6837/1048256382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":1048256382},{"type":"v1","addr":"172.21.15.72:6837","nonce":1048256382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.110:6839/966325499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6837","nonce":966325499},{"type":"v1","addr":"172.21.15.110:6839","nonce":966325499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6836/4134424941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":4134424941},{"type":"v1","addr":"172.21.15.110:6836","nonce":4134424941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4259,4263,4287,4297]},"id":1}]} 2024-05-09T05:55:27.626 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 22 2024-05-09T05:55:27.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.642+0000 7fde0027d640 1 -- 172.21.15.72:0/4087837145 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fdddc06f430 msgr2=0x7fdddc071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:27.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.642+0000 7fde0027d640 1 --2- 172.21.15.72:0/4087837145 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fdddc06f430 0x7fdddc071940 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fddf4006fd0 tx=0x7fddf4008040 comp rx=0 tx=0).stop 2024-05-09T05:55:27.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.642+0000 7fde0027d640 1 -- 172.21.15.72:0/4087837145 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fddf8074ce0 msgr2=0x7fddf80c9db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:27.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.642+0000 7fde0027d640 1 --2- 172.21.15.72:0/4087837145 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fddf8074ce0 0x7fddf80c9db0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fdde801c980 tx=0x7fdde801baf0 comp rx=0 tx=0).stop 2024-05-09T05:55:27.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.642+0000 7fde0027d640 1 -- 172.21.15.72:0/4087837145 shutdown_connections 2024-05-09T05:55:27.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.642+0000 7fde0027d640 1 --2- 172.21.15.72:0/4087837145 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fdddc06f430 0x7fdddc071940 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:27.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.642+0000 7fde0027d640 1 --2- 172.21.15.72:0/4087837145 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fddf80750f0 0x7fddf80ca2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:27.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.642+0000 7fde0027d640 1 --2- 172.21.15.72:0/4087837145 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fddf8074ce0 0x7fddf80c9db0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:27.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.642+0000 7fde0027d640 1 --2- 172.21.15.72:0/4087837145 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fddf806c7a0 0x7fddf80c5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:27.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.642+0000 7fde0027d640 1 -- 172.21.15.72:0/4087837145 >> 172.21.15.72:0/4087837145 conn(0x7fddf80cb3c0 msgr2=0x7fddf81586d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:55:27.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.642+0000 7fde0027d640 1 -- 172.21.15.72:0/4087837145 shutdown_connections 2024-05-09T05:55:27.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:27.642+0000 7fde0027d640 1 -- 172.21.15.72:0/4087837145 wait complete. 2024-05-09T05:55:27.646 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 22, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-05-09T05:53:23.494975+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 22, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0, 1, 2, 3, 4 ], "info": { "gid_4254": { "addr": "172.21.15.72:6834/1142956298", "addrs": { "addrvec": [ { "addr": "172.21.15.72:6832", "nonce": 1142956298, "type": "v2" }, { "addr": "172.21.15.72:6834", "nonce": 1142956298, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4254, "incarnation": 20, "join_fscid": -1, "name": "e", "rank": 4, "state": "up:reconnect", "state_seq": 34 }, "gid_4259": { "addr": "172.21.15.110:6838/840351907", "addrs": { "addrvec": [ { "addr": "172.21.15.110:6835", "nonce": 840351907, "type": "v2" }, { "addr": "172.21.15.110:6838", "nonce": 840351907, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4259, "incarnation": 16, "join_fscid": -1, "name": "f", "rank": 3, "state": "up:active", "state_seq": 13 }, "gid_4263": { "addr": "172.21.15.72:6837/1048256382", "addrs": { "addrvec": [ { "addr": "172.21.15.72:6836", "nonce": 1048256382, "type": "v2" }, { "addr": "172.21.15.72:6837", "nonce": 1048256382, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4263, "incarnation": 14, "join_fscid": -1, "name": "c", "rank": 2, "state": "up:active", "state_seq": 12 }, "gid_4287": { "addr": "172.21.15.110:6839/966325499", "addrs": { "addrvec": [ { "addr": "172.21.15.110:6837", "nonce": 966325499, "type": "v2" }, { "addr": "172.21.15.110:6839", "nonce": 966325499, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4287, "incarnation": 10, "join_fscid": -1, "name": "d", "rank": 1, "state": "up:active", "state_seq": 10 }, "gid_4297": { "addr": "172.21.15.110:6836/4134424941", "addrs": { "addrvec": [ { "addr": "172.21.15.110:6834", "nonce": 4134424941, "type": "v2" }, { "addr": "172.21.15.110:6836", "nonce": 4134424941, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4297, "incarnation": 4, "join_fscid": -1, "name": "b", "rank": 0, "state": "up:active", "state_seq": 4 } }, "last_failure": 0, "last_failure_osd_epoch": 28, "max_file_size": 1099511627776, "max_mds": 5, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-05-09T05:55:24.636960+0000", "qdb_cluster": [ 4259, 4263, 4287, 4297 ], "qdb_leader": 4297, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4297, "mds_1": 4287, "mds_2": 4263, "mds_3": 4259, "mds_4": 4254 } } } ], "standbys": [] } 2024-05-09T05:55:29.648 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:55:29.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.814+0000 7f6fd9e32640 1 Processor -- start 2024-05-09T05:55:29.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.814+0000 7f6fd9e32640 1 -- start start 2024-05-09T05:55:29.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.818+0000 7f6fd9e32640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6fd40723b0 0x7f6fd41542e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:29.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.818+0000 7f6fd9e32640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fd40743e0 con 0x7f6fd4071fa0 2024-05-09T05:55:29.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.818+0000 7f6fd9e32640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fd4074680 con 0x7f6fd4154820 2024-05-09T05:55:29.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.818+0000 7f6fd9e32640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f6fd40cc0f0 con 0x7f6fd40723b0 2024-05-09T05:55:29.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.818+0000 7f6fd37fe640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f6fd4071fa0 0x7f6fd40c9460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:43846/0 (socket says 172.21.15.72:43846) 2024-05-09T05:55:29.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.818+0000 7f6fd37fe640 1 -- 172.21.15.72:0/2502346078 learned_addr learned my addr 172.21.15.72:0/2502346078 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:55:29.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.818+0000 7f6fd27fc640 1 -- 172.21.15.72:0/2502346078 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2571468050 0 0) 0x7f6fd40743e0 con 0x7f6fd4071fa0 2024-05-09T05:55:29.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.818+0000 7f6fd27fc640 1 -- 172.21.15.72:0/2502346078 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6fbc003530 con 0x7f6fd4071fa0 2024-05-09T05:55:29.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.818+0000 7f6fd2ffd640 1 --2- 172.21.15.72:0/2502346078 >> v2:172.21.15.110:3300/0 conn(0x7f6fd40723b0 0x7f6fd41542e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:29.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.818+0000 7f6fd27fc640 1 -- 172.21.15.72:0/2502346078 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3067126757 0 0) 0x7f6fbc003530 con 0x7f6fd4071fa0 2024-05-09T05:55:29.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.818+0000 7f6fd27fc640 1 -- 172.21.15.72:0/2502346078 >> v2:172.21.15.110:3300/0 conn(0x7f6fd40723b0 msgr2=0x7f6fd41542e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:55:29.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.818+0000 7f6fd27fc640 1 --2- 172.21.15.72:0/2502346078 >> v2:172.21.15.110:3300/0 conn(0x7f6fd40723b0 0x7f6fd41542e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:29.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.818+0000 7f6fd27fc640 1 -- 172.21.15.72:0/2502346078 >> v1:172.21.15.110:6789/0 conn(0x7f6fd4154820 legacy=0x7f6fd415a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:29.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.818+0000 7f6fd27fc640 1 -- 172.21.15.72:0/2502346078 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fd4074960 con 0x7f6fd4071fa0 2024-05-09T05:55:29.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.818+0000 7f6fd27fc640 1 -- 172.21.15.72:0/2502346078 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2749052815 0 0) 0x7f6fc4001720 con 0x7f6fd4071fa0 2024-05-09T05:55:29.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.818+0000 7f6fd27fc640 1 -- 172.21.15.72:0/2502346078 >> v1:172.21.15.72:6789/0 conn(0x7f6fd4071fa0 legacy=0x7f6fd40c9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:29.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.818+0000 7f6fd27fc640 1 --2- 172.21.15.72:0/2502346078 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fbc003a60 0x7f6fbc003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:29.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.818+0000 7f6fd27fc640 1 --2- 172.21.15.72:0/2502346078 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6fbc004810 0x7f6fbc004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:29.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.818+0000 7f6fd27fc640 1 --2- 172.21.15.72:0/2502346078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fbc005360 0x7f6fbc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:29.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.818+0000 7f6fd27fc640 1 -- 172.21.15.72:0/2502346078 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f6fd40cc0f0 con 0x7f6fbc003a60 2024-05-09T05:55:29.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.818+0000 7f6fd27fc640 1 -- 172.21.15.72:0/2502346078 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f6fbc00c260 con 0x7f6fbc005360 2024-05-09T05:55:29.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.818+0000 7f6fd27fc640 1 -- 172.21.15.72:0/2502346078 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f6fbc00c460 con 0x7f6fbc004810 2024-05-09T05:55:29.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.818+0000 7f6fd37fe640 1 --2- 172.21.15.72:0/2502346078 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fbc003a60 0x7f6fbc003ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:29.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.818+0000 7f6fd3fff640 1 --2- 172.21.15.72:0/2502346078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fbc005360 0x7f6fbc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:29.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.818+0000 7f6fd2ffd640 1 --2- 172.21.15.72:0/2502346078 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6fbc004810 0x7f6fbc004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:29.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.818+0000 7f6fd37fe640 1 -- 172.21.15.72:0/2502346078 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6fbc004810 msgr2=0x7f6fbc004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:55:29.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.818+0000 7f6fd37fe640 1 --2- 172.21.15.72:0/2502346078 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6fbc004810 0x7f6fbc004c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:29.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.818+0000 7f6fd37fe640 1 -- 172.21.15.72:0/2502346078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fbc005360 msgr2=0x7f6fbc00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:55:29.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.818+0000 7f6fd37fe640 1 --2- 172.21.15.72:0/2502346078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fbc005360 0x7f6fbc00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:29.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.818+0000 7f6fd37fe640 1 -- 172.21.15.72:0/2502346078 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fd4074960 con 0x7f6fbc003a60 2024-05-09T05:55:29.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.818+0000 7f6fd3fff640 1 -- 172.21.15.72:0/2502346078 reap_dead start 2024-05-09T05:55:29.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.822+0000 7f6fd37fe640 1 --2- 172.21.15.72:0/2502346078 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fbc003a60 0x7f6fbc003ed0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6fd40745b0 tx=0x7f6fc401cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a065bfa06ead3a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:55:29.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.822+0000 7f6fd27fc640 1 -- 172.21.15.72:0/2502346078 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fc4007dc0 con 0x7f6fbc003a60 2024-05-09T05:55:29.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.822+0000 7f6fd27fc640 1 -- 172.21.15.72:0/2502346078 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fc40a9020 con 0x7f6fbc003a60 2024-05-09T05:55:29.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.822+0000 7f6fd27fc640 1 -- 172.21.15.72:0/2502346078 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fc40058e0 con 0x7f6fbc003a60 2024-05-09T05:55:29.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.822+0000 7f6fd9e32640 1 -- 172.21.15.72:0/2502346078 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fbc003a60 msgr2=0x7f6fbc003ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:29.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.822+0000 7f6fd9e32640 1 --2- 172.21.15.72:0/2502346078 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fbc003a60 0x7f6fbc003ed0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6fd40745b0 tx=0x7f6fc401cc50 comp rx=0 tx=0).stop 2024-05-09T05:55:29.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.822+0000 7f6fd9e32640 1 -- 172.21.15.72:0/2502346078 shutdown_connections 2024-05-09T05:55:29.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.822+0000 7f6fd9e32640 1 --2- 172.21.15.72:0/2502346078 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fbc003a60 0x7f6fbc003ed0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:29.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.822+0000 7f6fd9e32640 1 -- 172.21.15.72:0/2502346078 >> 172.21.15.72:0/2502346078 conn(0x7f6fd40cf860 msgr2=0x7f6fd40cfc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:55:29.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.822+0000 7f6fd9e32640 1 -- 172.21.15.72:0/2502346078 shutdown_connections 2024-05-09T05:55:29.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.822+0000 7f6fd9e32640 1 -- 172.21.15.72:0/2502346078 wait complete. 2024-05-09T05:55:29.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.826+0000 7f6fd9e32640 1 Processor -- start 2024-05-09T05:55:29.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.826+0000 7f6fd9e32640 1 -- start start 2024-05-09T05:55:29.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.830+0000 7f6fd9e32640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fbc003a60 0x7f6fd41f3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:29.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.830+0000 7f6fd9e32640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fd40cf330 0x7f6fd4156d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:29.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.830+0000 7f6fd9e32640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6fd4157960 0x7f6fd4142100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:29.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.830+0000 7f6fd9e32640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f6fd415a7c0 con 0x7f6fd40cf330 2024-05-09T05:55:29.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.830+0000 7f6fd9e32640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f6fd4154c30 con 0x7f6fbc003a60 2024-05-09T05:55:29.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.830+0000 7f6fd9e32640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f6fd415a940 con 0x7f6fd4157960 2024-05-09T05:55:29.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.830+0000 7f6fd2ffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fd40cf330 0x7f6fd4156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:29.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.830+0000 7f6fd2ffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fd40cf330 0x7f6fd4156d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37250/0 (socket says 172.21.15.72:37250) 2024-05-09T05:55:29.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.830+0000 7f6fd2ffd640 1 -- 172.21.15.72:0/2526703312 learned_addr learned my addr 172.21.15.72:0/2526703312 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:55:29.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.830+0000 7f6fd37fe640 1 --2- 172.21.15.72:0/2526703312 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fbc003a60 0x7f6fd41f3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:29.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.830+0000 7f6fd2ffd640 1 -- 172.21.15.72:0/2526703312 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6fd4157960 msgr2=0x7f6fd4142100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:29.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.830+0000 7f6fd3fff640 1 --2- 172.21.15.72:0/2526703312 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6fd4157960 0x7f6fd4142100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:29.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.830+0000 7f6fd2ffd640 1 --2- 172.21.15.72:0/2526703312 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6fd4157960 0x7f6fd4142100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:29.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.830+0000 7f6fd2ffd640 1 -- 172.21.15.72:0/2526703312 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fbc003a60 msgr2=0x7f6fd41f3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:29.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.830+0000 7f6fd2ffd640 1 --2- 172.21.15.72:0/2526703312 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fbc003a60 0x7f6fd41f3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:29.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.830+0000 7f6fd2ffd640 1 -- 172.21.15.72:0/2526703312 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fd41f4020 con 0x7f6fd40cf330 2024-05-09T05:55:29.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.830+0000 7f6fd2ffd640 1 --2- 172.21.15.72:0/2526703312 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fd40cf330 0x7f6fd4156d80 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6fc800e870 tx=0x7f6fc800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:55:29.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.830+0000 7f6fbbfff640 1 -- 172.21.15.72:0/2526703312 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fc8017070 con 0x7f6fd40cf330 2024-05-09T05:55:29.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.830+0000 7f6fbbfff640 1 -- 172.21.15.72:0/2526703312 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fc800c870 con 0x7f6fd40cf330 2024-05-09T05:55:29.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.830+0000 7f6fd9e32640 1 -- 172.21.15.72:0/2526703312 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fd40cefb0 con 0x7f6fd40cf330 2024-05-09T05:55:29.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.830+0000 7f6fd9e32640 1 -- 172.21.15.72:0/2526703312 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fd415a1f0 con 0x7f6fd40cf330 2024-05-09T05:55:29.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.830+0000 7f6fbbfff640 1 -- 172.21.15.72:0/2526703312 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fc800f040 con 0x7f6fd40cf330 2024-05-09T05:55:29.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.830+0000 7f6fd9e32640 1 -- 172.21.15.72:0/2526703312 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fb40052a0 con 0x7f6fd40cf330 2024-05-09T05:55:29.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.830+0000 7f6fbbfff640 1 -- 172.21.15.72:0/2526703312 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f6fc801a070 con 0x7f6fd40cf330 2024-05-09T05:55:29.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.830+0000 7f6fbbfff640 1 --2- 172.21.15.72:0/2526703312 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f6fc006f430 0x7f6fc0071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:29.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.834+0000 7f6fbbfff640 1 -- 172.21.15.72:0/2526703312 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6676+0+0 (secure 0 0 0) 0x7f6fc808f030 con 0x7f6fd40cf330 2024-05-09T05:55:29.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.834+0000 7f6fd37fe640 1 --2- 172.21.15.72:0/2526703312 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f6fc006f430 0x7f6fc0071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:29.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.834+0000 7f6fd37fe640 1 --2- 172.21.15.72:0/2526703312 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f6fc006f430 0x7f6fc0071940 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6fd40d08d0 tx=0x7f6fc4001a20 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:55:29.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:29.838+0000 7f6fbbfff640 1 -- 172.21.15.72:0/2526703312 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f6fc805bc70 con 0x7f6fd40cf330 2024-05-09T05:55:30.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:30.034+0000 7f6fd9e32640 1 -- 172.21.15.72:0/2526703312 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6fb4005860 con 0x7f6fd40cf330 2024-05-09T05:55:30.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:30.034+0000 7f6fbbfff640 1 -- 172.21.15.72:0/2526703312 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+6088 (secure 0 0 0) 0x7f6fc805b570 con 0x7f6fd40cf330 2024-05-09T05:55:30.021 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:55:30.022 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:53:23.494975+0000","modified":"2024-05-09T05:55:29.668677+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4297,"mds_1":4287,"mds_2":4263,"mds_3":4259,"mds_4":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"e","rank":4,"incarnation":20,"state":"up:rejoin","state_seq":36,"addr":"172.21.15.72:6834/1142956298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1142956298},{"type":"v1","addr":"172.21.15.72:6834","nonce":1142956298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4259":{"gid":4259,"name":"f","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.110:6838/840351907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":840351907},{"type":"v1","addr":"172.21.15.110:6838","nonce":840351907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4263":{"gid":4263,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.72:6837/1048256382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":1048256382},{"type":"v1","addr":"172.21.15.72:6837","nonce":1048256382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.110:6839/966325499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6837","nonce":966325499},{"type":"v1","addr":"172.21.15.110:6839","nonce":966325499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6836/4134424941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":4134424941},{"type":"v1","addr":"172.21.15.110:6836","nonce":4134424941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4297,4287,4263,4259]},"id":1}]} 2024-05-09T05:55:30.022 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 23 2024-05-09T05:55:30.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:30.038+0000 7f6fd9e32640 1 -- 172.21.15.72:0/2526703312 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f6fc006f430 msgr2=0x7f6fc0071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:30.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:30.038+0000 7f6fd9e32640 1 --2- 172.21.15.72:0/2526703312 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f6fc006f430 0x7f6fc0071940 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6fd40d08d0 tx=0x7f6fc4001a20 comp rx=0 tx=0).stop 2024-05-09T05:55:30.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:30.038+0000 7f6fd9e32640 1 -- 172.21.15.72:0/2526703312 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fd40cf330 msgr2=0x7f6fd4156d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:30.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:30.038+0000 7f6fd9e32640 1 --2- 172.21.15.72:0/2526703312 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fd40cf330 0x7f6fd4156d80 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6fc800e870 tx=0x7f6fc800ed30 comp rx=0 tx=0).stop 2024-05-09T05:55:30.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:30.038+0000 7f6fd9e32640 1 -- 172.21.15.72:0/2526703312 shutdown_connections 2024-05-09T05:55:30.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:30.038+0000 7f6fd9e32640 1 --2- 172.21.15.72:0/2526703312 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f6fc006f430 0x7f6fc0071940 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:30.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:30.038+0000 7f6fd9e32640 1 --2- 172.21.15.72:0/2526703312 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6fd4157960 0x7f6fd4142100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:30.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:30.038+0000 7f6fd9e32640 1 --2- 172.21.15.72:0/2526703312 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fd40cf330 0x7f6fd4156d80 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:30.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:30.038+0000 7f6fd9e32640 1 --2- 172.21.15.72:0/2526703312 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fbc003a60 0x7f6fd41f3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:30.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:30.038+0000 7f6fd9e32640 1 -- 172.21.15.72:0/2526703312 >> 172.21.15.72:0/2526703312 conn(0x7f6fd40cf860 msgr2=0x7f6fd41521f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:55:30.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:30.038+0000 7f6fd9e32640 1 -- 172.21.15.72:0/2526703312 shutdown_connections 2024-05-09T05:55:30.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:30.038+0000 7f6fd9e32640 1 -- 172.21.15.72:0/2526703312 wait complete. 2024-05-09T05:55:30.041 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-05-09T05:55:32.042 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:55:32.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.250+0000 7f7437c0d640 1 Processor -- start 2024-05-09T05:55:32.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.250+0000 7f7437c0d640 1 -- start start 2024-05-09T05:55:32.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.250+0000 7f7437c0d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7430075020 0x7f7430074090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:32.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.250+0000 7f7437c0d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7430161f80 0x7f74301643a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:32.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.250+0000 7f7437c0d640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f743006e960 con 0x7f74300745d0 2024-05-09T05:55:32.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.250+0000 7f7437c0d640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f7430072b20 con 0x7f7430161f80 2024-05-09T05:55:32.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.250+0000 7f7437c0d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f7430072840 con 0x7f7430075020 2024-05-09T05:55:32.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.254+0000 7f74359a9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7430075020 0x7f7430074090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:32.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.254+0000 7f74359a9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7430075020 0x7f7430074090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.72:34360/0 (socket says 172.21.15.72:34360) 2024-05-09T05:55:32.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.254+0000 7f74359a9640 1 -- 172.21.15.72:0/3758234221 learned_addr learned my addr 172.21.15.72:0/3758234221 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:55:32.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.254+0000 7f74361aa640 1 --2- 172.21.15.72:0/3758234221 >> v2:172.21.15.110:3300/0 conn(0x7f7430161f80 0x7f74301643a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:32.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.254+0000 7f74359a9640 1 -- 172.21.15.72:0/3758234221 >> v2:172.21.15.110:3300/0 conn(0x7f7430161f80 msgr2=0x7f74301643a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:55:32.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.254+0000 7f74359a9640 1 --2- 172.21.15.72:0/3758234221 >> v2:172.21.15.110:3300/0 conn(0x7f7430161f80 0x7f74301643a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:32.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.254+0000 7f74359a9640 1 -- 172.21.15.72:0/3758234221 >> v1:172.21.15.110:6789/0 conn(0x7f74300745d0 legacy=0x7f74300c7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:32.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.254+0000 7f74359a9640 1 -- 172.21.15.72:0/3758234221 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f743006ec20 con 0x7f7430075020 2024-05-09T05:55:32.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.258+0000 7f74359a9640 1 --2- 172.21.15.72:0/3758234221 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7430075020 0x7f7430074090 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f742c009870 tx=0x7f742c01ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd9005a07e859187 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:55:32.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.258+0000 7f74349a7640 1 -- 172.21.15.72:0/3758234221 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f742c0b5070 con 0x7f7430075020 2024-05-09T05:55:32.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.258+0000 7f74349a7640 1 -- 172.21.15.72:0/3758234221 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f742c0a8a50 con 0x7f7430075020 2024-05-09T05:55:32.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.258+0000 7f74349a7640 1 -- 172.21.15.72:0/3758234221 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f742c0a8e20 con 0x7f7430075020 2024-05-09T05:55:32.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.258+0000 7f7437c0d640 1 -- 172.21.15.72:0/3758234221 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7430075020 msgr2=0x7f7430074090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:32.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.258+0000 7f7437c0d640 1 --2- 172.21.15.72:0/3758234221 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7430075020 0x7f7430074090 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f742c009870 tx=0x7f742c01ed50 comp rx=0 tx=0).stop 2024-05-09T05:55:32.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.258+0000 7f7437c0d640 1 -- 172.21.15.72:0/3758234221 shutdown_connections 2024-05-09T05:55:32.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.258+0000 7f7437c0d640 1 --2- 172.21.15.72:0/3758234221 >> v2:172.21.15.110:3300/0 conn(0x7f7430161f80 0x7f74301643a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:32.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.258+0000 7f7437c0d640 1 --2- 172.21.15.72:0/3758234221 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7430075020 0x7f7430074090 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:32.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.258+0000 7f7437c0d640 1 -- 172.21.15.72:0/3758234221 >> 172.21.15.72:0/3758234221 conn(0x7f74300cb350 msgr2=0x7f74300cb760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:55:32.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.258+0000 7f7437c0d640 1 -- 172.21.15.72:0/3758234221 shutdown_connections 2024-05-09T05:55:32.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.258+0000 7f7437c0d640 1 -- 172.21.15.72:0/3758234221 wait complete. 2024-05-09T05:55:32.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.262+0000 7f7437c0d640 1 Processor -- start 2024-05-09T05:55:32.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.262+0000 7f7437c0d640 1 -- start start 2024-05-09T05:55:32.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.262+0000 7f7437c0d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74300745d0 0x7f74301568a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:32.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.262+0000 7f7437c0d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7430075020 0x7f743014e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:32.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.262+0000 7f7437c0d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7430161f80 0x7f7430154060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:32.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.262+0000 7f7437c0d640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7430159dc0 con 0x7f7430075020 2024-05-09T05:55:32.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.262+0000 7f7437c0d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f7430159ae0 con 0x7f74300745d0 2024-05-09T05:55:32.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.262+0000 7f7437c0d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f743015a0a0 con 0x7f7430161f80 2024-05-09T05:55:32.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.262+0000 7f74351a8640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7430075020 0x7f743014e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:32.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.262+0000 7f74351a8640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7430075020 0x7f743014e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49166/0 (socket says 172.21.15.72:49166) 2024-05-09T05:55:32.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.262+0000 7f74351a8640 1 -- 172.21.15.72:0/3050894419 learned_addr learned my addr 172.21.15.72:0/3050894419 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:55:32.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.262+0000 7f74359a9640 1 --2- 172.21.15.72:0/3050894419 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74300745d0 0x7f74301568a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:32.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.262+0000 7f74361aa640 1 --2- 172.21.15.72:0/3050894419 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7430161f80 0x7f7430154060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:32.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.262+0000 7f74351a8640 1 -- 172.21.15.72:0/3050894419 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7430161f80 msgr2=0x7f7430154060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:32.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.262+0000 7f74351a8640 1 --2- 172.21.15.72:0/3050894419 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7430161f80 0x7f7430154060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:32.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.262+0000 7f74351a8640 1 -- 172.21.15.72:0/3050894419 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74300745d0 msgr2=0x7f74301568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:32.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.262+0000 7f74351a8640 1 --2- 172.21.15.72:0/3050894419 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74300745d0 0x7f74301568a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:32.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.262+0000 7f74351a8640 1 -- 172.21.15.72:0/3050894419 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7430156de0 con 0x7f7430075020 2024-05-09T05:55:32.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.262+0000 7f74351a8640 1 --2- 172.21.15.72:0/3050894419 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7430075020 0x7f743014e350 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f742000c3f0 tx=0x7f742000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:55:32.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.262+0000 7f74267fc640 1 -- 172.21.15.72:0/3050894419 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7420017070 con 0x7f7430075020 2024-05-09T05:55:32.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.262+0000 7f74267fc640 1 -- 172.21.15.72:0/3050894419 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74200052d0 con 0x7f7430075020 2024-05-09T05:55:32.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.262+0000 7f74267fc640 1 -- 172.21.15.72:0/3050894419 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7420003820 con 0x7f7430075020 2024-05-09T05:55:32.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.266+0000 7f7437c0d640 1 -- 172.21.15.72:0/3050894419 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74300733c0 con 0x7f7430075020 2024-05-09T05:55:32.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.266+0000 7f7437c0d640 1 -- 172.21.15.72:0/3050894419 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7430155dc0 con 0x7f7430075020 2024-05-09T05:55:32.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.266+0000 7f7437c0d640 1 -- 172.21.15.72:0/3050894419 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f743006a520 con 0x7f7430075020 2024-05-09T05:55:32.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.266+0000 7f74267fc640 1 -- 172.21.15.72:0/3050894419 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f742001a070 con 0x7f7430075020 2024-05-09T05:55:32.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.266+0000 7f74267fc640 1 --2- 172.21.15.72:0/3050894419 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f7414073840 0x7f7414075d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:32.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.266+0000 7f74267fc640 1 -- 172.21.15.72:0/3050894419 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6676+0+0 (secure 0 0 0) 0x7f742008e7d0 con 0x7f7430075020 2024-05-09T05:55:32.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.270+0000 7f74359a9640 1 --2- 172.21.15.72:0/3050894419 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f7414073840 0x7f7414075d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:32.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.270+0000 7f74359a9640 1 --2- 172.21.15.72:0/3050894419 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f7414073840 0x7f7414075d50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f742c0b2000 tx=0x7f742c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:55:32.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.278+0000 7f74267fc640 1 -- 172.21.15.72:0/3050894419 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f7420005480 con 0x7f7430075020 2024-05-09T05:55:32.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.658+0000 7f7437c0d640 1 -- 172.21.15.72:0/3050894419 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7430153470 con 0x7f7430075020 2024-05-09T05:55:32.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.658+0000 7f74267fc640 1 -- 172.21.15.72:0/3050894419 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+6088 (secure 0 0 0) 0x7f7420063370 con 0x7f7430075020 2024-05-09T05:55:32.644 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:55:32.645 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:53:23.494975+0000","modified":"2024-05-09T05:55:29.668677+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4297,"mds_1":4287,"mds_2":4263,"mds_3":4259,"mds_4":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"e","rank":4,"incarnation":20,"state":"up:rejoin","state_seq":36,"addr":"172.21.15.72:6834/1142956298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1142956298},{"type":"v1","addr":"172.21.15.72:6834","nonce":1142956298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4259":{"gid":4259,"name":"f","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.110:6838/840351907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":840351907},{"type":"v1","addr":"172.21.15.110:6838","nonce":840351907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4263":{"gid":4263,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.72:6837/1048256382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":1048256382},{"type":"v1","addr":"172.21.15.72:6837","nonce":1048256382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.110:6839/966325499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6837","nonce":966325499},{"type":"v1","addr":"172.21.15.110:6839","nonce":966325499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6836/4134424941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":4134424941},{"type":"v1","addr":"172.21.15.110:6836","nonce":4134424941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4297,4287,4263,4259]},"id":1}]} 2024-05-09T05:55:32.645 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 23 2024-05-09T05:55:32.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.662+0000 7f7437c0d640 1 -- 172.21.15.72:0/3050894419 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f7414073840 msgr2=0x7f7414075d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:32.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.662+0000 7f7437c0d640 1 --2- 172.21.15.72:0/3050894419 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f7414073840 0x7f7414075d50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f742c0b2000 tx=0x7f742c009040 comp rx=0 tx=0).stop 2024-05-09T05:55:32.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.662+0000 7f7437c0d640 1 -- 172.21.15.72:0/3050894419 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7430075020 msgr2=0x7f743014e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:32.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.662+0000 7f7437c0d640 1 --2- 172.21.15.72:0/3050894419 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7430075020 0x7f743014e350 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f742000c3f0 tx=0x7f742000c8b0 comp rx=0 tx=0).stop 2024-05-09T05:55:32.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.662+0000 7f7437c0d640 1 -- 172.21.15.72:0/3050894419 shutdown_connections 2024-05-09T05:55:32.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.662+0000 7f7437c0d640 1 --2- 172.21.15.72:0/3050894419 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f7414073840 0x7f7414075d50 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:32.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.662+0000 7f7437c0d640 1 --2- 172.21.15.72:0/3050894419 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7430161f80 0x7f7430154060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:32.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.662+0000 7f7437c0d640 1 --2- 172.21.15.72:0/3050894419 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7430075020 0x7f743014e350 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:32.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.662+0000 7f7437c0d640 1 --2- 172.21.15.72:0/3050894419 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74300745d0 0x7f74301568a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:32.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.662+0000 7f7437c0d640 1 -- 172.21.15.72:0/3050894419 >> 172.21.15.72:0/3050894419 conn(0x7f74300cb350 msgr2=0x7f74300c8140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:55:32.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.662+0000 7f7437c0d640 1 -- 172.21.15.72:0/3050894419 shutdown_connections 2024-05-09T05:55:32.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:32.662+0000 7f7437c0d640 1 -- 172.21.15.72:0/3050894419 wait complete. 2024-05-09T05:55:32.671 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-05-09T05:55:34.671 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:55:34.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:34.878+0000 7f3245d0c640 1 Processor -- start 2024-05-09T05:55:34.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:34.878+0000 7f3245d0c640 1 -- start start 2024-05-09T05:55:34.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:34.882+0000 7f3245d0c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f324015ab90 0x7f324015afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:34.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:34.882+0000 7f3245d0c640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32400cad30 con 0x7f32400c5420 2024-05-09T05:55:34.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:34.882+0000 7f3245d0c640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32400cb990 con 0x7f32400c4bf0 2024-05-09T05:55:34.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:34.882+0000 7f323ffff640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f32400c5420 0x7f3240164e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39626/0 (socket says 172.21.15.72:39626) 2024-05-09T05:55:34.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:34.882+0000 7f323ffff640 1 -- 172.21.15.72:0/2099141039 learned_addr learned my addr 172.21.15.72:0/2099141039 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:55:34.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:34.882+0000 7f3245d0c640 1 -- 172.21.15.72:0/2099141039 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f324015b4e0 con 0x7f324015ab90 2024-05-09T05:55:34.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:34.882+0000 7f3237fff640 1 --2- 172.21.15.72:0/2099141039 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f324015ab90 0x7f324015afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:34.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:34.882+0000 7f323effd640 1 -- 172.21.15.72:0/2099141039 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3768329690 0 0) 0x7f32400cad30 con 0x7f32400c5420 2024-05-09T05:55:34.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:34.882+0000 7f323effd640 1 -- 172.21.15.72:0/2099141039 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f322c003530 con 0x7f32400c5420 2024-05-09T05:55:34.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:34.882+0000 7f323effd640 1 -- 172.21.15.72:0/2099141039 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2675156378 0 0) 0x7f32400cb990 con 0x7f32400c4bf0 2024-05-09T05:55:34.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:34.882+0000 7f323effd640 1 -- 172.21.15.72:0/2099141039 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32400cad30 con 0x7f32400c4bf0 2024-05-09T05:55:34.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:34.882+0000 7f323effd640 1 -- 172.21.15.72:0/2099141039 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1288341790 0 0) 0x7f322c003530 con 0x7f32400c5420 2024-05-09T05:55:34.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:34.882+0000 7f3237fff640 1 -- 172.21.15.72:0/2099141039 >> v1:172.21.15.110:6789/0 conn(0x7f32400c4bf0 legacy=0x7f32400ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:34.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:34.882+0000 7f3237fff640 1 -- 172.21.15.72:0/2099141039 >> v1:172.21.15.72:6789/0 conn(0x7f32400c5420 legacy=0x7f3240164e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:34.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:34.882+0000 7f3237fff640 1 -- 172.21.15.72:0/2099141039 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32400cbc30 con 0x7f324015ab90 2024-05-09T05:55:34.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:34.886+0000 7f3237fff640 1 --2- 172.21.15.72:0/2099141039 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f324015ab90 0x7f324015afa0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f32280097f0 tx=0x7f322801ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1c7f25214cfbb6f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:55:34.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:34.886+0000 7f323effd640 1 -- 172.21.15.72:0/2099141039 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32280b5070 con 0x7f324015ab90 2024-05-09T05:55:34.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:34.886+0000 7f323effd640 1 -- 172.21.15.72:0/2099141039 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32280a8690 con 0x7f324015ab90 2024-05-09T05:55:34.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:34.886+0000 7f323effd640 1 -- 172.21.15.72:0/2099141039 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3238001a80 con 0x7f324015ab90 2024-05-09T05:55:34.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:34.886+0000 7f3245d0c640 1 -- 172.21.15.72:0/2099141039 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f324015ab90 msgr2=0x7f324015afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:34.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:34.886+0000 7f3245d0c640 1 --2- 172.21.15.72:0/2099141039 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f324015ab90 0x7f324015afa0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f32280097f0 tx=0x7f322801ec10 comp rx=0 tx=0).stop 2024-05-09T05:55:34.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:34.886+0000 7f3245d0c640 1 -- 172.21.15.72:0/2099141039 shutdown_connections 2024-05-09T05:55:34.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:34.886+0000 7f3245d0c640 1 --2- 172.21.15.72:0/2099141039 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f324015ab90 0x7f324015afa0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:34.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:34.886+0000 7f3245d0c640 1 -- 172.21.15.72:0/2099141039 >> 172.21.15.72:0/2099141039 conn(0x7f3240072080 msgr2=0x7f3240072490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:55:34.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:34.886+0000 7f3245d0c640 1 -- 172.21.15.72:0/2099141039 shutdown_connections 2024-05-09T05:55:34.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:34.886+0000 7f3245d0c640 1 -- 172.21.15.72:0/2099141039 wait complete. 2024-05-09T05:55:34.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:34.890+0000 7f3245d0c640 1 Processor -- start 2024-05-09T05:55:34.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:34.890+0000 7f3245d0c640 1 -- start start 2024-05-09T05:55:34.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:34.894+0000 7f3245d0c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32400c4bf0 0x7f3240159690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:34.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:34.894+0000 7f3245d0c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32400c5420 0x7f32401436c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:34.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:34.894+0000 7f3245d0c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f324015ab90 0x7f3240143c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:34.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:34.894+0000 7f3245d0c640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f324015a700 con 0x7f32400c5420 2024-05-09T05:55:34.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:34.894+0000 7f3237fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32400c5420 0x7f32401436c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:34.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:34.894+0000 7f3245d0c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f32400cc4d0 con 0x7f32400c4bf0 2024-05-09T05:55:34.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:34.894+0000 7f3245d0c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f32400cc1f0 con 0x7f324015ab90 2024-05-09T05:55:34.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:34.894+0000 7f3237fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32400c5420 0x7f32401436c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49174/0 (socket says 172.21.15.72:49174) 2024-05-09T05:55:34.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:34.894+0000 7f3237fff640 1 -- 172.21.15.72:0/1803018343 learned_addr learned my addr 172.21.15.72:0/1803018343 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:55:34.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:34.894+0000 7f323f7fe640 1 --2- 172.21.15.72:0/1803018343 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32400c4bf0 0x7f3240159690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:34.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:34.894+0000 7f323ffff640 1 --2- 172.21.15.72:0/1803018343 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f324015ab90 0x7f3240143c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:34.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:34.894+0000 7f3237fff640 1 -- 172.21.15.72:0/1803018343 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f324015ab90 msgr2=0x7f3240143c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:34.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:34.894+0000 7f3237fff640 1 --2- 172.21.15.72:0/1803018343 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f324015ab90 0x7f3240143c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:34.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:34.894+0000 7f3237fff640 1 -- 172.21.15.72:0/1803018343 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32400c4bf0 msgr2=0x7f3240159690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:34.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:34.894+0000 7f3237fff640 1 --2- 172.21.15.72:0/1803018343 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32400c4bf0 0x7f3240159690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:34.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:34.894+0000 7f3237fff640 1 -- 172.21.15.72:0/1803018343 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32400c76d0 con 0x7f32400c5420 2024-05-09T05:55:34.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:34.894+0000 7f323f7fe640 1 --2- 172.21.15.72:0/1803018343 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32400c4bf0 0x7f3240159690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:55:34.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:34.894+0000 7f323ffff640 1 --2- 172.21.15.72:0/1803018343 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f324015ab90 0x7f3240143c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:55:34.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:34.894+0000 7f3237fff640 1 --2- 172.21.15.72:0/1803018343 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32400c5420 0x7f32401436c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f32280097f0 tx=0x7f322801b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:55:34.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:34.894+0000 7f323cff9640 1 -- 172.21.15.72:0/1803018343 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32280b5040 con 0x7f32400c5420 2024-05-09T05:55:34.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:34.894+0000 7f323cff9640 1 -- 172.21.15.72:0/1803018343 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32280bd070 con 0x7f32400c5420 2024-05-09T05:55:34.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:34.894+0000 7f323cff9640 1 -- 172.21.15.72:0/1803018343 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3228003620 con 0x7f32400c5420 2024-05-09T05:55:34.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:34.894+0000 7f3245d0c640 1 -- 172.21.15.72:0/1803018343 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32401556b0 con 0x7f32400c5420 2024-05-09T05:55:34.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:34.894+0000 7f3245d0c640 1 -- 172.21.15.72:0/1803018343 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32401565a0 con 0x7f32400c5420 2024-05-09T05:55:34.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:34.898+0000 7f323cff9640 1 -- 172.21.15.72:0/1803018343 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f32280037c0 con 0x7f32400c5420 2024-05-09T05:55:34.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:34.898+0000 7f3235ffb640 1 -- 172.21.15.72:0/1803018343 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32180052a0 con 0x7f32400c5420 2024-05-09T05:55:34.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:34.898+0000 7f323cff9640 1 --2- 172.21.15.72:0/1803018343 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f322006f400 0x7f3220071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:34.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:34.898+0000 7f323cff9640 1 -- 172.21.15.72:0/1803018343 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6676+0+0 (secure 0 0 0) 0x7f32281307d0 con 0x7f32400c5420 2024-05-09T05:55:34.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:34.898+0000 7f323f7fe640 1 --2- 172.21.15.72:0/1803018343 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f322006f400 0x7f3220071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:34.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:34.898+0000 7f323f7fe640 1 --2- 172.21.15.72:0/1803018343 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f322006f400 0x7f3220071910 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3230001130 tx=0x7f3230009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:55:34.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:34.906+0000 7f323cff9640 1 -- 172.21.15.72:0/1803018343 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f3228018770 con 0x7f32400c5420 2024-05-09T05:55:35.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:35.290+0000 7f3235ffb640 1 -- 172.21.15.72:0/1803018343 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3218005860 con 0x7f32400c5420 2024-05-09T05:55:35.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:35.290+0000 7f323cff9640 1 -- 172.21.15.72:0/1803018343 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+6088 (secure 0 0 0) 0x7f3228101030 con 0x7f32400c5420 2024-05-09T05:55:35.277 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:55:35.277 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:53:23.494975+0000","modified":"2024-05-09T05:55:29.668677+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4297,"mds_1":4287,"mds_2":4263,"mds_3":4259,"mds_4":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"e","rank":4,"incarnation":20,"state":"up:rejoin","state_seq":36,"addr":"172.21.15.72:6834/1142956298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1142956298},{"type":"v1","addr":"172.21.15.72:6834","nonce":1142956298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4259":{"gid":4259,"name":"f","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.110:6838/840351907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":840351907},{"type":"v1","addr":"172.21.15.110:6838","nonce":840351907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4263":{"gid":4263,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.72:6837/1048256382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":1048256382},{"type":"v1","addr":"172.21.15.72:6837","nonce":1048256382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.110:6839/966325499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6837","nonce":966325499},{"type":"v1","addr":"172.21.15.110:6839","nonce":966325499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6836/4134424941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":4134424941},{"type":"v1","addr":"172.21.15.110:6836","nonce":4134424941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4297,4287,4263,4259]},"id":1}]} 2024-05-09T05:55:35.277 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 23 2024-05-09T05:55:35.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:35.294+0000 7f3235ffb640 1 -- 172.21.15.72:0/1803018343 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f322006f400 msgr2=0x7f3220071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:35.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:35.294+0000 7f3235ffb640 1 --2- 172.21.15.72:0/1803018343 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f322006f400 0x7f3220071910 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3230001130 tx=0x7f3230009040 comp rx=0 tx=0).stop 2024-05-09T05:55:35.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:35.294+0000 7f3235ffb640 1 -- 172.21.15.72:0/1803018343 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32400c5420 msgr2=0x7f32401436c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:35.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:35.294+0000 7f3235ffb640 1 --2- 172.21.15.72:0/1803018343 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32400c5420 0x7f32401436c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f32280097f0 tx=0x7f322801b9b0 comp rx=0 tx=0).stop 2024-05-09T05:55:35.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:35.294+0000 7f3235ffb640 1 -- 172.21.15.72:0/1803018343 shutdown_connections 2024-05-09T05:55:35.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:35.294+0000 7f3235ffb640 1 --2- 172.21.15.72:0/1803018343 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f322006f400 0x7f3220071910 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:35.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:35.294+0000 7f3235ffb640 1 --2- 172.21.15.72:0/1803018343 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f324015ab90 0x7f3240143c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:35.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:35.294+0000 7f3235ffb640 1 --2- 172.21.15.72:0/1803018343 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32400c5420 0x7f32401436c0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:35.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:35.294+0000 7f3235ffb640 1 --2- 172.21.15.72:0/1803018343 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32400c4bf0 0x7f3240159690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:35.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:35.294+0000 7f3235ffb640 1 -- 172.21.15.72:0/1803018343 >> 172.21.15.72:0/1803018343 conn(0x7f3240072080 msgr2=0x7f32400c9050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:55:35.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:35.294+0000 7f3235ffb640 1 -- 172.21.15.72:0/1803018343 shutdown_connections 2024-05-09T05:55:35.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:35.294+0000 7f3235ffb640 1 -- 172.21.15.72:0/1803018343 wait complete. 2024-05-09T05:55:35.303 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-05-09T05:55:37.304 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:55:37.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.510+0000 7f0c1a9e0640 1 Processor -- start 2024-05-09T05:55:37.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.510+0000 7f0c1a9e0640 1 -- start start 2024-05-09T05:55:37.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.514+0000 7f0c1a9e0640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0c1406e9a0 0x7f0c1415ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:37.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.514+0000 7f0c1a9e0640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c140cc190 con 0x7f0c1415b140 2024-05-09T05:55:37.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.514+0000 7f0c1a9e0640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c14164ff0 con 0x7f0c140ca830 2024-05-09T05:55:37.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.514+0000 7f0c1a9e0640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f0c1415b550 con 0x7f0c1406e9a0 2024-05-09T05:55:37.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.514+0000 7f0c18f7d640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f0c1415b140 0x7f0c140c96d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39642/0 (socket says 172.21.15.72:39642) 2024-05-09T05:55:37.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.514+0000 7f0c18f7d640 1 -- 172.21.15.72:0/353686719 learned_addr learned my addr 172.21.15.72:0/353686719 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:55:37.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.514+0000 7f0c137fe640 1 --2- 172.21.15.72:0/353686719 >> v2:172.21.15.110:3300/0 conn(0x7f0c1406e9a0 0x7f0c1415ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:37.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.514+0000 7f0c12ffd640 1 -- 172.21.15.72:0/353686719 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4198998746 0 0) 0x7f0c140cc190 con 0x7f0c1415b140 2024-05-09T05:55:37.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.514+0000 7f0c12ffd640 1 -- 172.21.15.72:0/353686719 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0bfc003530 con 0x7f0c1415b140 2024-05-09T05:55:37.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.514+0000 7f0c137fe640 1 -- 172.21.15.72:0/353686719 >> v1:172.21.15.110:6789/0 conn(0x7f0c140ca830 legacy=0x7f0c141644e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:37.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.514+0000 7f0c137fe640 1 -- 172.21.15.72:0/353686719 >> v1:172.21.15.72:6789/0 conn(0x7f0c1415b140 legacy=0x7f0c140c96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:37.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.514+0000 7f0c137fe640 1 -- 172.21.15.72:0/353686719 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c1406d350 con 0x7f0c1406e9a0 2024-05-09T05:55:37.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.518+0000 7f0c137fe640 1 --2- 172.21.15.72:0/353686719 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c1406e9a0 0x7f0c1415ac00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0c040097c0 tx=0x7f0c0401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb37c13926021af2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:55:37.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.518+0000 7f0c12ffd640 1 -- 172.21.15.72:0/353686719 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c040b0070 con 0x7f0c1406e9a0 2024-05-09T05:55:37.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.518+0000 7f0c12ffd640 1 -- 172.21.15.72:0/353686719 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c040ab600 con 0x7f0c1406e9a0 2024-05-09T05:55:37.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.518+0000 7f0c12ffd640 1 -- 172.21.15.72:0/353686719 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c040ab9b0 con 0x7f0c1406e9a0 2024-05-09T05:55:37.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.518+0000 7f0c1a9e0640 1 -- 172.21.15.72:0/353686719 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c1406e9a0 msgr2=0x7f0c1415ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:37.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.518+0000 7f0c1a9e0640 1 --2- 172.21.15.72:0/353686719 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c1406e9a0 0x7f0c1415ac00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0c040097c0 tx=0x7f0c0401c4a0 comp rx=0 tx=0).stop 2024-05-09T05:55:37.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.518+0000 7f0c1a9e0640 1 -- 172.21.15.72:0/353686719 shutdown_connections 2024-05-09T05:55:37.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.518+0000 7f0c1a9e0640 1 --2- 172.21.15.72:0/353686719 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c1406e9a0 0x7f0c1415ac00 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:37.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.518+0000 7f0c1a9e0640 1 -- 172.21.15.72:0/353686719 >> 172.21.15.72:0/353686719 conn(0x7f0c140cb350 msgr2=0x7f0c140cb760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:55:37.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.518+0000 7f0c1a9e0640 1 -- 172.21.15.72:0/353686719 shutdown_connections 2024-05-09T05:55:37.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.518+0000 7f0c1a9e0640 1 -- 172.21.15.72:0/353686719 wait complete. 2024-05-09T05:55:37.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.522+0000 7f0c1a9e0640 1 Processor -- start 2024-05-09T05:55:37.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.522+0000 7f0c1a9e0640 1 -- start start 2024-05-09T05:55:37.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.522+0000 7f0c1a9e0640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c1406e9a0 0x7f0c1414b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:37.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.526+0000 7f0c1a9e0640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c140ca830 0x7f0c140cd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:37.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.526+0000 7f0c13fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c1406e9a0 0x7f0c1414b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:37.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.526+0000 7f0c13fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c1406e9a0 0x7f0c1414b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49180/0 (socket says 172.21.15.72:49180) 2024-05-09T05:55:37.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.526+0000 7f0c13fff640 1 -- 172.21.15.72:0/3189162773 learned_addr learned my addr 172.21.15.72:0/3189162773 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:55:37.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.526+0000 7f0c1a9e0640 1 --2- 172.21.15.72:0/3189162773 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c1415b140 0x7f0c140cdee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:37.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.526+0000 7f0c1a9e0640 1 -- 172.21.15.72:0/3189162773 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f0c1416f200 con 0x7f0c1406e9a0 2024-05-09T05:55:37.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.526+0000 7f0c1a9e0640 1 -- 172.21.15.72:0/3189162773 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f0c1416f080 con 0x7f0c140ca830 2024-05-09T05:55:37.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.526+0000 7f0c1a9e0640 1 -- 172.21.15.72:0/3189162773 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f0c1416f380 con 0x7f0c1415b140 2024-05-09T05:55:37.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.526+0000 7f0c137fe640 1 --2- 172.21.15.72:0/3189162773 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c140ca830 0x7f0c140cd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:37.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.526+0000 7f0c13fff640 1 -- 172.21.15.72:0/3189162773 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c1415b140 msgr2=0x7f0c140cdee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:37.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.526+0000 7f0c13fff640 1 --2- 172.21.15.72:0/3189162773 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c1415b140 0x7f0c140cdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:37.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.526+0000 7f0c13fff640 1 -- 172.21.15.72:0/3189162773 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c140ca830 msgr2=0x7f0c140cd9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:37.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.526+0000 7f0c13fff640 1 --2- 172.21.15.72:0/3189162773 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c140ca830 0x7f0c140cd9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:37.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.526+0000 7f0c13fff640 1 -- 172.21.15.72:0/3189162773 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c1414be10 con 0x7f0c1406e9a0 2024-05-09T05:55:37.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.526+0000 7f0c13fff640 1 --2- 172.21.15.72:0/3189162773 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c1406e9a0 0x7f0c1414b8d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0c0800c450 tx=0x7f0c0800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:55:37.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.526+0000 7f0c10ff9640 1 -- 172.21.15.72:0/3189162773 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c080052d0 con 0x7f0c1406e9a0 2024-05-09T05:55:37.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.526+0000 7f0c10ff9640 1 -- 172.21.15.72:0/3189162773 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c08005470 con 0x7f0c1406e9a0 2024-05-09T05:55:37.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.526+0000 7f0c10ff9640 1 -- 172.21.15.72:0/3189162773 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c08012850 con 0x7f0c1406e9a0 2024-05-09T05:55:37.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.526+0000 7f0c1a9e0640 1 -- 172.21.15.72:0/3189162773 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c14151570 con 0x7f0c1406e9a0 2024-05-09T05:55:37.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.526+0000 7f0c1a9e0640 1 -- 172.21.15.72:0/3189162773 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c14150fb0 con 0x7f0c1406e9a0 2024-05-09T05:55:37.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.526+0000 7f0bfa7fc640 1 -- 172.21.15.72:0/3189162773 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bec0052a0 con 0x7f0c1406e9a0 2024-05-09T05:55:37.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.530+0000 7f0c10ff9640 1 -- 172.21.15.72:0/3189162773 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f0c080129f0 con 0x7f0c1406e9a0 2024-05-09T05:55:37.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.530+0000 7f0c10ff9640 1 --2- 172.21.15.72:0/3189162773 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f0c0006f430 0x7f0c00071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:37.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.530+0000 7f0c10ff9640 1 -- 172.21.15.72:0/3189162773 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6676+0+0 (secure 0 0 0) 0x7f0c0808f250 con 0x7f0c1406e9a0 2024-05-09T05:55:37.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.530+0000 7f0c137fe640 1 --2- 172.21.15.72:0/3189162773 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f0c0006f430 0x7f0c00071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:37.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.530+0000 7f0c137fe640 1 --2- 172.21.15.72:0/3189162773 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f0c0006f430 0x7f0c00071940 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0c040ad000 tx=0x7f0c040a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:55:37.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.538+0000 7f0c10ff9640 1 -- 172.21.15.72:0/3189162773 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f0c0805bd60 con 0x7f0c1406e9a0 2024-05-09T05:55:37.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.922+0000 7f0bfa7fc640 1 -- 172.21.15.72:0/3189162773 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0bec005590 con 0x7f0c1406e9a0 2024-05-09T05:55:37.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.922+0000 7f0c10ff9640 1 -- 172.21.15.72:0/3189162773 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+6093 (secure 0 0 0) 0x7f0c0805b660 con 0x7f0c1406e9a0 2024-05-09T05:55:37.908 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:55:37.909 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:53:23.494975+0000","modified":"2024-05-09T05:55:35.580442+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4297,"mds_1":4287,"mds_2":4263,"mds_3":4259,"mds_4":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"e","rank":4,"incarnation":20,"state":"up:active","state_seq":38,"addr":"172.21.15.72:6834/1142956298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1142956298},{"type":"v1","addr":"172.21.15.72:6834","nonce":1142956298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4259":{"gid":4259,"name":"f","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.110:6838/840351907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":840351907},{"type":"v1","addr":"172.21.15.110:6838","nonce":840351907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4263":{"gid":4263,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.72:6837/1048256382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":1048256382},{"type":"v1","addr":"172.21.15.72:6837","nonce":1048256382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.110:6839/966325499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6837","nonce":966325499},{"type":"v1","addr":"172.21.15.110:6839","nonce":966325499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6836/4134424941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":4134424941},{"type":"v1","addr":"172.21.15.110:6836","nonce":4134424941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4254,4259,4263,4287,4297]},"id":1}]} 2024-05-09T05:55:37.909 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 24 2024-05-09T05:55:37.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.926+0000 7f0bfa7fc640 1 -- 172.21.15.72:0/3189162773 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f0c0006f430 msgr2=0x7f0c00071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:37.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.926+0000 7f0bfa7fc640 1 --2- 172.21.15.72:0/3189162773 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f0c0006f430 0x7f0c00071940 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0c040ad000 tx=0x7f0c040a6000 comp rx=0 tx=0).stop 2024-05-09T05:55:37.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.926+0000 7f0bfa7fc640 1 -- 172.21.15.72:0/3189162773 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c1406e9a0 msgr2=0x7f0c1414b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:37.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.926+0000 7f0bfa7fc640 1 --2- 172.21.15.72:0/3189162773 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c1406e9a0 0x7f0c1414b8d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0c0800c450 tx=0x7f0c0800c910 comp rx=0 tx=0).stop 2024-05-09T05:55:37.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.926+0000 7f0bfa7fc640 1 -- 172.21.15.72:0/3189162773 shutdown_connections 2024-05-09T05:55:37.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.926+0000 7f0bfa7fc640 1 --2- 172.21.15.72:0/3189162773 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f0c0006f430 0x7f0c00071940 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:37.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.926+0000 7f0bfa7fc640 1 --2- 172.21.15.72:0/3189162773 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c1415b140 0x7f0c140cdee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:37.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.926+0000 7f0bfa7fc640 1 --2- 172.21.15.72:0/3189162773 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c140ca830 0x7f0c140cd9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:37.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.926+0000 7f0bfa7fc640 1 --2- 172.21.15.72:0/3189162773 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c1406e9a0 0x7f0c1414b8d0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:37.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.926+0000 7f0bfa7fc640 1 -- 172.21.15.72:0/3189162773 >> 172.21.15.72:0/3189162773 conn(0x7f0c140cb350 msgr2=0x7f0c1414fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:55:37.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.926+0000 7f0bfa7fc640 1 -- 172.21.15.72:0/3189162773 shutdown_connections 2024-05-09T05:55:37.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:37.926+0000 7f0bfa7fc640 1 -- 172.21.15.72:0/3189162773 wait complete. 2024-05-09T05:55:37.936 INFO:tasks.mds_thrash.fs.[cephfs]:mds.e has gained rank=4, replacing gid=4257 2024-05-09T05:55:37.936 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 2 secs before reviving mds.a 2024-05-09T05:55:39.063 INFO:tasks.ceph.mds.b.smithi110.stderr:2024-05-09T05:55:39.071+0000 7f6833aba640 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-05-09T05:55:39.937 INFO:tasks.mds_thrash.fs.[cephfs]:reviving mds.a 2024-05-09T05:55:39.937 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-09T05:55:39.937 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-09T05:55:39.939 INFO:tasks.ceph.mds.a:Started 2024-05-09T05:55:39.940 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:55:40.059 INFO:tasks.ceph.mds.a.smithi072.stdout:starting mds.a at 2024-05-09T05:55:40.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.150+0000 7f73536ea640 1 Processor -- start 2024-05-09T05:55:40.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.150+0000 7f73536ea640 1 -- start start 2024-05-09T05:55:40.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.150+0000 7f73536ea640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f734c0cc680 0x7f734c1569e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:40.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.150+0000 7f73536ea640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f734c0741f0 0x7f734c074600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:40.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.150+0000 7f73536ea640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f734c06c7a0 con 0x7f734c0cde80 2024-05-09T05:55:40.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.150+0000 7f73536ea640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f734c15fbe0 con 0x7f734c0cc680 2024-05-09T05:55:40.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.150+0000 7f73536ea640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f734c15cb90 con 0x7f734c0741f0 2024-05-09T05:55:40.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.150+0000 7f7351486640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f734c0cc680 0x7f734c1569e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:40.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.150+0000 7f7351486640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f734c0cc680 0x7f734c1569e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49200/0 (socket says 172.21.15.72:49200) 2024-05-09T05:55:40.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.150+0000 7f7351486640 1 -- 172.21.15.72:0/4099258402 learned_addr learned my addr 172.21.15.72:0/4099258402 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:55:40.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.154+0000 7f7351c87640 1 --2- 172.21.15.72:0/4099258402 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f734c0741f0 0x7f734c074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:40.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.154+0000 7f7351486640 1 -- 172.21.15.72:0/4099258402 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f734c0741f0 msgr2=0x7f734c074600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:55:40.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.154+0000 7f7351486640 1 --2- 172.21.15.72:0/4099258402 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f734c0741f0 0x7f734c074600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:40.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.154+0000 7f7343fff640 1 -- 172.21.15.72:0/4099258402 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3669653976 0 0) 0x7f734c06c7a0 con 0x7f734c0cde80 2024-05-09T05:55:40.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.154+0000 7f7351486640 1 -- 172.21.15.72:0/4099258402 >> v1:172.21.15.110:6789/0 conn(0x7f734c0cde80 legacy=0x7f734c160350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:40.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.154+0000 7f7351486640 1 -- 172.21.15.72:0/4099258402 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f734c15ce70 con 0x7f734c0cc680 2024-05-09T05:55:40.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.154+0000 7f7351c87640 1 --2- 172.21.15.72:0/4099258402 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f734c0741f0 0x7f734c074600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T05:55:40.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.154+0000 7f7351486640 1 --2- 172.21.15.72:0/4099258402 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f734c0cc680 0x7f734c1569e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7348009870 tx=0x7f734801ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e96acc6e9f7f6501 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:55:40.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.154+0000 7f7343fff640 1 -- 172.21.15.72:0/4099258402 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73480b5070 con 0x7f734c0cc680 2024-05-09T05:55:40.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.154+0000 7f7343fff640 1 -- 172.21.15.72:0/4099258402 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73480a8a50 con 0x7f734c0cc680 2024-05-09T05:55:40.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.154+0000 7f7343fff640 1 -- 172.21.15.72:0/4099258402 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73480a8e20 con 0x7f734c0cc680 2024-05-09T05:55:40.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.158+0000 7f73536ea640 1 -- 172.21.15.72:0/4099258402 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f734c0cc680 msgr2=0x7f734c1569e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:40.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.158+0000 7f73536ea640 1 --2- 172.21.15.72:0/4099258402 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f734c0cc680 0x7f734c1569e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7348009870 tx=0x7f734801ed50 comp rx=0 tx=0).stop 2024-05-09T05:55:40.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.158+0000 7f73536ea640 1 -- 172.21.15.72:0/4099258402 shutdown_connections 2024-05-09T05:55:40.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.158+0000 7f73536ea640 1 --2- 172.21.15.72:0/4099258402 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f734c0741f0 0x7f734c074600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:40.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.158+0000 7f73536ea640 1 --2- 172.21.15.72:0/4099258402 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f734c0cc680 0x7f734c1569e0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:40.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.158+0000 7f73536ea640 1 -- 172.21.15.72:0/4099258402 >> 172.21.15.72:0/4099258402 conn(0x7f734c0d1f00 msgr2=0x7f734c0d2310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:55:40.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.158+0000 7f73536ea640 1 -- 172.21.15.72:0/4099258402 shutdown_connections 2024-05-09T05:55:40.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.158+0000 7f73536ea640 1 -- 172.21.15.72:0/4099258402 wait complete. 2024-05-09T05:55:40.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.162+0000 7f73536ea640 1 Processor -- start 2024-05-09T05:55:40.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.162+0000 7f73536ea640 1 -- start start 2024-05-09T05:55:40.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.162+0000 7f73536ea640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f734c0741f0 0x7f734c151c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:40.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.162+0000 7f73536ea640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f734c0cc680 0x7f734c0b56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:40.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.162+0000 7f73536ea640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f734c0cde80 0x7f734c14f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:40.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.162+0000 7f73536ea640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f734c15fe30 con 0x7f734c0cc680 2024-05-09T05:55:40.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.162+0000 7f7350c85640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f734c0cc680 0x7f734c0b56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:40.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.162+0000 7f7350c85640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f734c0cc680 0x7f734c0b56c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49204/0 (socket says 172.21.15.72:49204) 2024-05-09T05:55:40.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.162+0000 7f7350c85640 1 -- 172.21.15.72:0/884170137 learned_addr learned my addr 172.21.15.72:0/884170137 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:55:40.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.162+0000 7f7351486640 1 --2- 172.21.15.72:0/884170137 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f734c0741f0 0x7f734c151c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:40.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.162+0000 7f7351c87640 1 --2- 172.21.15.72:0/884170137 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f734c0cde80 0x7f734c14f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:40.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.162+0000 7f73536ea640 1 -- 172.21.15.72:0/884170137 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f734c15d430 con 0x7f734c0741f0 2024-05-09T05:55:40.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.162+0000 7f73536ea640 1 -- 172.21.15.72:0/884170137 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f734c160a60 con 0x7f734c0cde80 2024-05-09T05:55:40.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.162+0000 7f7350c85640 1 -- 172.21.15.72:0/884170137 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f734c0cde80 msgr2=0x7f734c14f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:40.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.162+0000 7f7350c85640 1 --2- 172.21.15.72:0/884170137 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f734c0cde80 0x7f734c14f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:40.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.162+0000 7f7350c85640 1 -- 172.21.15.72:0/884170137 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f734c0741f0 msgr2=0x7f734c151c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:40.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.162+0000 7f7350c85640 1 --2- 172.21.15.72:0/884170137 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f734c0741f0 0x7f734c151c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:40.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.162+0000 7f7350c85640 1 -- 172.21.15.72:0/884170137 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f734c1e7f00 con 0x7f734c0cc680 2024-05-09T05:55:40.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.162+0000 7f7350c85640 1 --2- 172.21.15.72:0/884170137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f734c0cc680 0x7f734c0b56c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f733c001ec0 tx=0x7f733c00c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:55:40.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.166+0000 7f7341ffb640 1 -- 172.21.15.72:0/884170137 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f733c017070 con 0x7f734c0cc680 2024-05-09T05:55:40.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.166+0000 7f7341ffb640 1 -- 172.21.15.72:0/884170137 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f733c003600 con 0x7f734c0cc680 2024-05-09T05:55:40.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.166+0000 7f7341ffb640 1 -- 172.21.15.72:0/884170137 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f733c0039f0 con 0x7f734c0cc680 2024-05-09T05:55:40.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.166+0000 7f73536ea640 1 -- 172.21.15.72:0/884170137 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f734c1e84a0 con 0x7f734c0cc680 2024-05-09T05:55:40.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.166+0000 7f73536ea640 1 -- 172.21.15.72:0/884170137 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f734c150fc0 con 0x7f734c0cc680 2024-05-09T05:55:40.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.166+0000 7f73536ea640 1 -- 172.21.15.72:0/884170137 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f734c06a520 con 0x7f734c0cc680 2024-05-09T05:55:40.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.170+0000 7f7341ffb640 1 -- 172.21.15.72:0/884170137 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f733c01a070 con 0x7f734c0cc680 2024-05-09T05:55:40.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.170+0000 7f7341ffb640 1 --2- 172.21.15.72:0/884170137 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f733006f480 0x7f7330071990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:40.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.170+0000 7f7341ffb640 1 -- 172.21.15.72:0/884170137 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6676+0+0 (secure 0 0 0) 0x7f733c057470 con 0x7f734c0cc680 2024-05-09T05:55:40.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.170+0000 7f7351486640 1 --2- 172.21.15.72:0/884170137 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f733006f480 0x7f7330071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:40.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.170+0000 7f7351486640 1 --2- 172.21.15.72:0/884170137 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f733006f480 0x7f7330071990 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f73480b2000 tx=0x7f7348009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:55:40.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.178+0000 7f7341ffb640 1 -- 172.21.15.72:0/884170137 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f733c021020 con 0x7f734c0cc680 2024-05-09T05:55:40.542 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.554+0000 7f73536ea640 1 -- 172.21.15.72:0/884170137 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f734c1e81f0 con 0x7f734c0cc680 2024-05-09T05:55:40.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.558+0000 7f7341ffb640 1 -- 172.21.15.72:0/884170137 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+6093 (secure 0 0 0) 0x7f733c05b1e0 con 0x7f734c0cc680 2024-05-09T05:55:40.544 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:55:40.544 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:53:23.494975+0000","modified":"2024-05-09T05:55:35.580442+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4297,"mds_1":4287,"mds_2":4263,"mds_3":4259,"mds_4":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"e","rank":4,"incarnation":20,"state":"up:active","state_seq":38,"addr":"172.21.15.72:6834/1142956298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1142956298},{"type":"v1","addr":"172.21.15.72:6834","nonce":1142956298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4259":{"gid":4259,"name":"f","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.110:6838/840351907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":840351907},{"type":"v1","addr":"172.21.15.110:6838","nonce":840351907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4263":{"gid":4263,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.72:6837/1048256382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":1048256382},{"type":"v1","addr":"172.21.15.72:6837","nonce":1048256382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.110:6839/966325499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6837","nonce":966325499},{"type":"v1","addr":"172.21.15.110:6839","nonce":966325499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6836/4134424941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":4134424941},{"type":"v1","addr":"172.21.15.110:6836","nonce":4134424941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4254,4259,4263,4287,4297]},"id":1}]} 2024-05-09T05:55:40.544 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 24 2024-05-09T05:55:40.546 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.558+0000 7f73536ea640 1 -- 172.21.15.72:0/884170137 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f733006f480 msgr2=0x7f7330071990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:40.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.558+0000 7f73536ea640 1 --2- 172.21.15.72:0/884170137 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f733006f480 0x7f7330071990 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f73480b2000 tx=0x7f7348009040 comp rx=0 tx=0).stop 2024-05-09T05:55:40.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.558+0000 7f73536ea640 1 -- 172.21.15.72:0/884170137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f734c0cc680 msgr2=0x7f734c0b56c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:40.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.558+0000 7f73536ea640 1 --2- 172.21.15.72:0/884170137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f734c0cc680 0x7f734c0b56c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f733c001ec0 tx=0x7f733c00c7d0 comp rx=0 tx=0).stop 2024-05-09T05:55:40.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.558+0000 7f73536ea640 1 -- 172.21.15.72:0/884170137 shutdown_connections 2024-05-09T05:55:40.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.558+0000 7f73536ea640 1 --2- 172.21.15.72:0/884170137 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f733006f480 0x7f7330071990 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:40.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.558+0000 7f73536ea640 1 --2- 172.21.15.72:0/884170137 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f734c0cde80 0x7f734c14f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:40.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.558+0000 7f73536ea640 1 --2- 172.21.15.72:0/884170137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f734c0cc680 0x7f734c0b56c0 secure :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f733c001ec0 tx=0x7f733c00c7d0 comp rx=0 tx=0).stop 2024-05-09T05:55:40.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.558+0000 7f73536ea640 1 --2- 172.21.15.72:0/884170137 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f734c0741f0 0x7f734c151c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:40.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.558+0000 7f73536ea640 1 -- 172.21.15.72:0/884170137 >> 172.21.15.72:0/884170137 conn(0x7f734c0d1f00 msgr2=0x7f734c0d2310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:55:40.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.558+0000 7f73536ea640 1 -- 172.21.15.72:0/884170137 shutdown_connections 2024-05-09T05:55:40.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:40.558+0000 7f73536ea640 1 -- 172.21.15.72:0/884170137 wait complete. 2024-05-09T05:55:40.570 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.a is in active, standby or standby-replay 2024-05-09T05:55:42.571 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:55:42.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:42.778+0000 7fa8e67ad640 1 Processor -- start 2024-05-09T05:55:42.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:42.778+0000 7fa8e67ad640 1 -- start start 2024-05-09T05:55:42.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:42.782+0000 7fa8e67ad640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8e0159640 0x7fa8e0159a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:42.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:42.782+0000 7fa8e67ad640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa8e0159f90 0x7fa8e0163f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:42.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:42.782+0000 7fa8e67ad640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8e0068dc0 con 0x7fa8e00b3b70 2024-05-09T05:55:42.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:42.782+0000 7fa8e67ad640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fa8e0074360 con 0x7fa8e0159f90 2024-05-09T05:55:42.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:42.782+0000 7fa8e67ad640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fa8e006efb0 con 0x7fa8e0159640 2024-05-09T05:55:42.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:42.782+0000 7fa8e4d4a640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa8e0159f90 0x7fa8e0163f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:42.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:42.782+0000 7fa8d7fff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8e0159640 0x7fa8e0159a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:42.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:42.782+0000 7fa8dffff640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fa8e00b3b70 0x7fa8e0073c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.72:39554/0 (socket says 172.21.15.72:39554) 2024-05-09T05:55:42.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:42.782+0000 7fa8dffff640 1 -- 172.21.15.72:0/3324518803 learned_addr learned my addr 172.21.15.72:0/3324518803 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:55:42.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:42.782+0000 7fa8d7fff640 1 -- 172.21.15.72:0/3324518803 >> v2:172.21.15.110:3300/0 conn(0x7fa8e0159f90 msgr2=0x7fa8e0163f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:55:42.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:42.782+0000 7fa8d7fff640 1 --2- 172.21.15.72:0/3324518803 >> v2:172.21.15.110:3300/0 conn(0x7fa8e0159f90 0x7fa8e0163f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:42.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:42.782+0000 7fa8d7fff640 1 -- 172.21.15.72:0/3324518803 >> v1:172.21.15.110:6789/0 conn(0x7fa8e00b3b70 legacy=0x7fa8e0073c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:42.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:42.782+0000 7fa8d7fff640 1 -- 172.21.15.72:0/3324518803 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8e0068820 con 0x7fa8e0159640 2024-05-09T05:55:42.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:42.782+0000 7fa8e4d4a640 1 --2- 172.21.15.72:0/3324518803 >> v2:172.21.15.110:3300/0 conn(0x7fa8e0159f90 0x7fa8e0163f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T05:55:42.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:42.786+0000 7fa8d7fff640 1 --2- 172.21.15.72:0/3324518803 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8e0159640 0x7fa8e0159a50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa8c80097c0 tx=0x7fa8c801ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55ecc328fe52542 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:55:42.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:42.786+0000 7fa8df7fe640 1 -- 172.21.15.72:0/3324518803 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c80b5070 con 0x7fa8e0159640 2024-05-09T05:55:42.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:42.786+0000 7fa8df7fe640 1 -- 172.21.15.72:0/3324518803 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8c80a8990 con 0x7fa8e0159640 2024-05-09T05:55:42.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:42.786+0000 7fa8df7fe640 1 -- 172.21.15.72:0/3324518803 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c80a8d60 con 0x7fa8e0159640 2024-05-09T05:55:42.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:42.786+0000 7fa8e67ad640 1 -- 172.21.15.72:0/3324518803 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8e0159640 msgr2=0x7fa8e0159a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:42.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:42.786+0000 7fa8e67ad640 1 --2- 172.21.15.72:0/3324518803 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8e0159640 0x7fa8e0159a50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa8c80097c0 tx=0x7fa8c801ec90 comp rx=0 tx=0).stop 2024-05-09T05:55:42.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:42.786+0000 7fa8e67ad640 1 -- 172.21.15.72:0/3324518803 shutdown_connections 2024-05-09T05:55:42.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:42.786+0000 7fa8e67ad640 1 --2- 172.21.15.72:0/3324518803 >> v2:172.21.15.110:3300/0 conn(0x7fa8e0159f90 0x7fa8e0163f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:42.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:42.786+0000 7fa8e67ad640 1 --2- 172.21.15.72:0/3324518803 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8e0159640 0x7fa8e0159a50 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:42.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:42.786+0000 7fa8e67ad640 1 -- 172.21.15.72:0/3324518803 >> 172.21.15.72:0/3324518803 conn(0x7fa8e00cbe10 msgr2=0x7fa8e00cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:55:42.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:42.786+0000 7fa8e67ad640 1 -- 172.21.15.72:0/3324518803 shutdown_connections 2024-05-09T05:55:42.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:42.786+0000 7fa8e67ad640 1 -- 172.21.15.72:0/3324518803 wait complete. 2024-05-09T05:55:42.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:42.790+0000 7fa8e67ad640 1 Processor -- start 2024-05-09T05:55:42.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:42.790+0000 7fa8e67ad640 1 -- start start 2024-05-09T05:55:42.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:42.794+0000 7fa8e67ad640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8e00b3b70 0x7fa8e0153790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:42.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:42.794+0000 7fa8e67ad640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8e0159640 0x7fa8e00c38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:42.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:42.794+0000 7fa8e67ad640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8e0159f90 0x7fa8e00bf7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:42.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:42.794+0000 7fa8e67ad640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fa8e006cb90 con 0x7fa8e0159f90 2024-05-09T05:55:42.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:42.794+0000 7fa8e4d4a640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8e0159f90 0x7fa8e00bf7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:42.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:42.794+0000 7fa8e4d4a640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8e0159f90 0x7fa8e00bf7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49366/0 (socket says 172.21.15.72:49366) 2024-05-09T05:55:42.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:42.794+0000 7fa8e4d4a640 1 -- 172.21.15.72:0/2565332526 learned_addr learned my addr 172.21.15.72:0/2565332526 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:55:42.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:42.794+0000 7fa8e67ad640 1 -- 172.21.15.72:0/2565332526 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fa8e006c8b0 con 0x7fa8e0159640 2024-05-09T05:55:42.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:42.794+0000 7fa8e67ad640 1 -- 172.21.15.72:0/2565332526 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fa8e006db80 con 0x7fa8e00b3b70 2024-05-09T05:55:42.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:42.794+0000 7fa8d7fff640 1 --2- 172.21.15.72:0/2565332526 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8e0159640 0x7fa8e00c38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:42.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:42.794+0000 7fa8dffff640 1 --2- 172.21.15.72:0/2565332526 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8e00b3b70 0x7fa8e0153790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:42.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:42.794+0000 7fa8e4d4a640 1 -- 172.21.15.72:0/2565332526 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8e00b3b70 msgr2=0x7fa8e0153790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:42.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:42.794+0000 7fa8e4d4a640 1 --2- 172.21.15.72:0/2565332526 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8e00b3b70 0x7fa8e0153790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:42.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:42.794+0000 7fa8e4d4a640 1 -- 172.21.15.72:0/2565332526 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8e0159640 msgr2=0x7fa8e00c38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:42.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:42.794+0000 7fa8e4d4a640 1 --2- 172.21.15.72:0/2565332526 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8e0159640 0x7fa8e00c38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:42.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:42.794+0000 7fa8e4d4a640 1 -- 172.21.15.72:0/2565332526 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8e00bfd20 con 0x7fa8e0159f90 2024-05-09T05:55:42.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:42.794+0000 7fa8e4d4a640 1 --2- 172.21.15.72:0/2565332526 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8e0159f90 0x7fa8e00bf7e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa8d800efc0 tx=0x7fa8d800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:55:42.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:42.794+0000 7fa8dd7fa640 1 -- 172.21.15.72:0/2565332526 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d8020070 con 0x7fa8e0159f90 2024-05-09T05:55:42.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:42.794+0000 7fa8dd7fa640 1 -- 172.21.15.72:0/2565332526 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8d80135c0 con 0x7fa8e0159f90 2024-05-09T05:55:42.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:42.794+0000 7fa8e67ad640 1 -- 172.21.15.72:0/2565332526 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8e00c1480 con 0x7fa8e0159f90 2024-05-09T05:55:42.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:42.794+0000 7fa8dd7fa640 1 -- 172.21.15.72:0/2565332526 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d80139b0 con 0x7fa8e0159f90 2024-05-09T05:55:42.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:42.794+0000 7fa8e67ad640 1 -- 172.21.15.72:0/2565332526 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8e00c4540 con 0x7fa8e0159f90 2024-05-09T05:55:42.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:42.798+0000 7fa8e67ad640 1 -- 172.21.15.72:0/2565332526 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8e006a520 con 0x7fa8e0159f90 2024-05-09T05:55:42.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:42.798+0000 7fa8dd7fa640 1 -- 172.21.15.72:0/2565332526 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fa8d8023070 con 0x7fa8e0159f90 2024-05-09T05:55:42.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:42.798+0000 7fa8dd7fa640 1 --2- 172.21.15.72:0/2565332526 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fa8c006f400 0x7fa8c0071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:55:42.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:42.798+0000 7fa8dd7fa640 1 -- 172.21.15.72:0/2565332526 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6676+0+0 (secure 0 0 0) 0x7fa8d8093a90 con 0x7fa8e0159f90 2024-05-09T05:55:42.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:42.802+0000 7fa8dffff640 1 --2- 172.21.15.72:0/2565332526 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fa8c006f400 0x7fa8c0071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:55:42.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:42.802+0000 7fa8dffff640 1 --2- 172.21.15.72:0/2565332526 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fa8c006f400 0x7fa8c0071910 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa8d0000f70 tx=0x7fa8d0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:55:42.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:42.806+0000 7fa8dd7fa640 1 -- 172.21.15.72:0/2565332526 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fa8d805ffe0 con 0x7fa8e0159f90 2024-05-09T05:55:43.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:43.186+0000 7fa8e67ad640 1 -- 172.21.15.72:0/2565332526 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa8e0159a50 con 0x7fa8e0159f90 2024-05-09T05:55:43.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:43.190+0000 7fa8dd7fa640 1 -- 172.21.15.72:0/2565332526 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+6917 (secure 0 0 0) 0x7fa8d80642e0 con 0x7fa8e0159f90 2024-05-09T05:55:43.175 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:55:43.175 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5007,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/1972750715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":1972750715},{"type":"v1","addr":"172.21.15.72:6835","nonce":1972750715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:53:23.494975+0000","modified":"2024-05-09T05:55:35.580442+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4297,"mds_1":4287,"mds_2":4263,"mds_3":4259,"mds_4":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"e","rank":4,"incarnation":20,"state":"up:active","state_seq":38,"addr":"172.21.15.72:6834/1142956298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1142956298},{"type":"v1","addr":"172.21.15.72:6834","nonce":1142956298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4259":{"gid":4259,"name":"f","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.110:6838/840351907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":840351907},{"type":"v1","addr":"172.21.15.110:6838","nonce":840351907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4263":{"gid":4263,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.72:6837/1048256382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":1048256382},{"type":"v1","addr":"172.21.15.72:6837","nonce":1048256382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.110:6839/966325499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6837","nonce":966325499},{"type":"v1","addr":"172.21.15.110:6839","nonce":966325499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6836/4134424941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":4134424941},{"type":"v1","addr":"172.21.15.110:6836","nonce":4134424941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4297,4287,4263,4259,4254]},"id":1}]} 2024-05-09T05:55:43.176 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 25 2024-05-09T05:55:43.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:43.190+0000 7fa8e67ad640 1 -- 172.21.15.72:0/2565332526 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fa8c006f400 msgr2=0x7fa8c0071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:43.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:43.190+0000 7fa8e67ad640 1 --2- 172.21.15.72:0/2565332526 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fa8c006f400 0x7fa8c0071910 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa8d0000f70 tx=0x7fa8d0009040 comp rx=0 tx=0).stop 2024-05-09T05:55:43.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:43.190+0000 7fa8e67ad640 1 -- 172.21.15.72:0/2565332526 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8e0159f90 msgr2=0x7fa8e00bf7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:55:43.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:43.190+0000 7fa8e67ad640 1 --2- 172.21.15.72:0/2565332526 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8e0159f90 0x7fa8e00bf7e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa8d800efc0 tx=0x7fa8d800c490 comp rx=0 tx=0).stop 2024-05-09T05:55:43.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:43.190+0000 7fa8e67ad640 1 -- 172.21.15.72:0/2565332526 shutdown_connections 2024-05-09T05:55:43.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:43.190+0000 7fa8e67ad640 1 --2- 172.21.15.72:0/2565332526 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fa8c006f400 0x7fa8c0071910 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:43.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:43.190+0000 7fa8e67ad640 1 --2- 172.21.15.72:0/2565332526 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8e0159f90 0x7fa8e00bf7e0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:43.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:43.190+0000 7fa8e67ad640 1 --2- 172.21.15.72:0/2565332526 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8e0159640 0x7fa8e00c38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:43.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:43.190+0000 7fa8e67ad640 1 --2- 172.21.15.72:0/2565332526 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8e00b3b70 0x7fa8e0153790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:55:43.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:43.190+0000 7fa8e67ad640 1 -- 172.21.15.72:0/2565332526 >> 172.21.15.72:0/2565332526 conn(0x7fa8e00cbe10 msgr2=0x7fa8e01df6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:55:43.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:43.190+0000 7fa8e67ad640 1 -- 172.21.15.72:0/2565332526 shutdown_connections 2024-05-09T05:55:43.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:55:43.190+0000 7fa8e67ad640 1 -- 172.21.15.72:0/2565332526 wait complete. 2024-05-09T05:55:43.204 INFO:tasks.mds_thrash.fs.[cephfs]:mds.a reported in up:standby state 2024-05-09T05:55:43.204 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 44 secs before thrashing 2024-05-09T05:55:53.876 INFO:tasks.workunit.client.0.smithi072.stderr:Note: switching to 'c9da4049f638c0f84bdd9b4e33c42e86046ac554'. 2024-05-09T05:55:53.876 INFO:tasks.workunit.client.0.smithi072.stderr: 2024-05-09T05:55:53.876 INFO:tasks.workunit.client.0.smithi072.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-05-09T05:55:53.876 INFO:tasks.workunit.client.0.smithi072.stderr:changes and commit them, and you can discard any commits you make in this 2024-05-09T05:55:53.877 INFO:tasks.workunit.client.0.smithi072.stderr:state without impacting any branches by switching back to a branch. 2024-05-09T05:55:53.877 INFO:tasks.workunit.client.0.smithi072.stderr: 2024-05-09T05:55:53.877 INFO:tasks.workunit.client.0.smithi072.stderr:If you want to create a new branch to retain commits you create, you may 2024-05-09T05:55:53.877 INFO:tasks.workunit.client.0.smithi072.stderr:do so (now or later) by using -c with the switch command. Example: 2024-05-09T05:55:53.877 INFO:tasks.workunit.client.0.smithi072.stderr: 2024-05-09T05:55:53.877 INFO:tasks.workunit.client.0.smithi072.stderr: git switch -c 2024-05-09T05:55:53.877 INFO:tasks.workunit.client.0.smithi072.stderr: 2024-05-09T05:55:53.877 INFO:tasks.workunit.client.0.smithi072.stderr:Or undo this operation with: 2024-05-09T05:55:53.877 INFO:tasks.workunit.client.0.smithi072.stderr: 2024-05-09T05:55:53.877 INFO:tasks.workunit.client.0.smithi072.stderr: git switch - 2024-05-09T05:55:53.877 INFO:tasks.workunit.client.0.smithi072.stderr: 2024-05-09T05:55:53.877 INFO:tasks.workunit.client.0.smithi072.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-05-09T05:55:53.877 INFO:tasks.workunit.client.0.smithi072.stderr: 2024-05-09T05:55:53.877 INFO:tasks.workunit.client.0.smithi072.stderr:HEAD is now at c9da4049f63 Merge PR #57081 into wip-pdonnell-testing-20240508.183908-debug 2024-05-09T05:55:53.883 DEBUG:teuthology.orchestra.run.smithi072:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-05-09T05:55:53.890 INFO:tasks.workunit.client.0.smithi072.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-05-09T05:55:53.894 INFO:tasks.workunit.client.0.smithi072.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-09T05:55:53.894 INFO:tasks.workunit.client.0.smithi072.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-05-09T05:55:54.939 INFO:tasks.workunit.client.0.smithi072.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-05-09T05:55:55.061 INFO:tasks.workunit.client.0.smithi072.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-05-09T05:55:55.122 INFO:tasks.workunit.client.0.smithi072.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-09T05:55:55.123 INFO:tasks.workunit.client.0.smithi072.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-09T05:55:55.123 INFO:tasks.workunit.client.0.smithi072.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-05-09T05:55:55.171 INFO:tasks.workunit.client.0.smithi072.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-09T05:55:55.174 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-09T05:55:55.174 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-05-09T05:55:55.223 INFO:tasks.workunit:Running workunits matching suites/iozone.sh on client.0... 2024-05-09T05:55:55.225 INFO:tasks.workunit:Running workunit suites/iozone.sh... 2024-05-09T05:55:55.225 DEBUG:teuthology.orchestra.run.smithi072:workunit test suites/iozone.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c9da4049f638c0f84bdd9b4e33c42e86046ac554 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/iozone.sh 2024-05-09T05:55:55.288 INFO:tasks.workunit.client.0.smithi072.stderr:+ iozone -c -e -s 1024M -r 16K -t 1 -F f1 -i 0 -i 1 2024-05-09T05:55:55.401 INFO:tasks.workunit.client.0.smithi072.stdout: Iozone: Performance Test of File I/O 2024-05-09T05:55:55.401 INFO:tasks.workunit.client.0.smithi072.stdout: Version $Revision: 3.489 $ 2024-05-09T05:55:55.401 INFO:tasks.workunit.client.0.smithi072.stdout: Compiled for 64 bit mode. 2024-05-09T05:55:55.401 INFO:tasks.workunit.client.0.smithi072.stdout: Build: linux-AMD64 2024-05-09T05:55:55.401 INFO:tasks.workunit.client.0.smithi072.stdout: 2024-05-09T05:55:55.401 INFO:tasks.workunit.client.0.smithi072.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-05-09T05:55:55.401 INFO:tasks.workunit.client.0.smithi072.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-05-09T05:55:55.401 INFO:tasks.workunit.client.0.smithi072.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-05-09T05:55:55.402 INFO:tasks.workunit.client.0.smithi072.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-05-09T05:55:55.402 INFO:tasks.workunit.client.0.smithi072.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-05-09T05:55:55.402 INFO:tasks.workunit.client.0.smithi072.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-05-09T05:55:55.402 INFO:tasks.workunit.client.0.smithi072.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-05-09T05:55:55.402 INFO:tasks.workunit.client.0.smithi072.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-05-09T05:55:55.402 INFO:tasks.workunit.client.0.smithi072.stdout: Alexey Skidanov, Sudhir Kumar. 2024-05-09T05:55:55.402 INFO:tasks.workunit.client.0.smithi072.stdout: 2024-05-09T05:55:55.402 INFO:tasks.workunit.client.0.smithi072.stdout: Run began: Thu May 9 05:55:55 2024 2024-05-09T05:55:55.402 INFO:tasks.workunit.client.0.smithi072.stdout: 2024-05-09T05:55:55.402 INFO:tasks.workunit.client.0.smithi072.stdout: Include close in write timing 2024-05-09T05:55:55.402 INFO:tasks.workunit.client.0.smithi072.stdout: Include fsync in write timing 2024-05-09T05:55:55.402 INFO:tasks.workunit.client.0.smithi072.stdout: File size set to 1048576 kB 2024-05-09T05:55:55.402 INFO:tasks.workunit.client.0.smithi072.stdout: Record Size 16 kB 2024-05-09T05:55:55.403 INFO:tasks.workunit.client.0.smithi072.stdout: Command line used: iozone -c -e -s 1024M -r 16K -t 1 -F f1 -i 0 -i 1 2024-05-09T05:55:55.403 INFO:tasks.workunit.client.0.smithi072.stdout: Output is in kBytes/sec 2024-05-09T05:55:55.403 INFO:tasks.workunit.client.0.smithi072.stdout: Time Resolution = 0.000001 seconds. 2024-05-09T05:55:55.403 INFO:tasks.workunit.client.0.smithi072.stdout: Processor cache size set to 1024 kBytes. 2024-05-09T05:55:55.403 INFO:tasks.workunit.client.0.smithi072.stdout: Processor cache line size set to 32 bytes. 2024-05-09T05:55:55.403 INFO:tasks.workunit.client.0.smithi072.stdout: File stride size set to 17 * record size. 2024-05-09T05:55:55.403 INFO:tasks.workunit.client.0.smithi072.stdout: Throughput test with 1 process 2024-05-09T05:55:55.403 INFO:tasks.workunit.client.0.smithi072.stdout: Each process writes a 1048576 kByte file in 16 kByte records 2024-05-09T05:55:55.430 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T05:55:55.434 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T05:56:07.687 INFO:tasks.workunit.client.0.smithi072.stdout: 2024-05-09T05:56:07.687 INFO:tasks.workunit.client.0.smithi072.stdout: Children see throughput for 1 initial writers = 85389.63 kB/sec 2024-05-09T05:56:07.687 INFO:tasks.workunit.client.0.smithi072.stdout: Parent sees throughput for 1 initial writers = 85386.01 kB/sec 2024-05-09T05:56:07.687 INFO:tasks.workunit.client.0.smithi072.stdout: Min throughput per process = 85389.63 kB/sec 2024-05-09T05:56:07.688 INFO:tasks.workunit.client.0.smithi072.stdout: Max throughput per process = 85389.63 kB/sec 2024-05-09T05:56:07.688 INFO:tasks.workunit.client.0.smithi072.stdout: Avg throughput per process = 85389.63 kB/sec 2024-05-09T05:56:07.688 INFO:tasks.workunit.client.0.smithi072.stdout: Min xfer = 1048576.00 kB 2024-05-09T05:56:25.632 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T05:56:25.637 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T05:56:27.205 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:56:27.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.373+0000 7f1dac3e9640 1 Processor -- start 2024-05-09T05:56:27.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.373+0000 7f1dac3e9640 1 -- start start 2024-05-09T05:56:27.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.373+0000 7f1dac3e9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1da40ca2b0 0x7f1da415c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:27.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.373+0000 7f1dac3e9640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1da406d7b0 0x7f1da406dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:27.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.373+0000 7f1dac3e9640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1da40c98e0 con 0x7f1da40c94d0 2024-05-09T05:56:27.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.373+0000 7f1dac3e9640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f1da415cf40 con 0x7f1da406d7b0 2024-05-09T05:56:27.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.373+0000 7f1dac3e9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f1da415d220 con 0x7f1da40ca2b0 2024-05-09T05:56:27.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.373+0000 7f1da9984640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1da40ca2b0 0x7f1da415c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:27.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.373+0000 7f1daa986640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1da406d7b0 0x7f1da406dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:27.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.373+0000 7f1da9984640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1da40ca2b0 0x7f1da415c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.72:34804/0 (socket says 172.21.15.72:34804) 2024-05-09T05:56:27.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.373+0000 7f1daa986640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1da406d7b0 0x7f1da406dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.72:48262/0 (socket says 172.21.15.72:48262) 2024-05-09T05:56:27.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.373+0000 7f1da9984640 1 -- 172.21.15.72:0/2106196986 learned_addr learned my addr 172.21.15.72:0/2106196986 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:56:27.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.373+0000 7f1da9984640 1 -- 172.21.15.72:0/2106196986 >> v2:172.21.15.110:3300/0 conn(0x7f1da406d7b0 msgr2=0x7f1da406dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:56:27.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.373+0000 7f1da9984640 1 --2- 172.21.15.72:0/2106196986 >> v2:172.21.15.110:3300/0 conn(0x7f1da406d7b0 0x7f1da406dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:27.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.373+0000 7f1da9984640 1 -- 172.21.15.72:0/2106196986 >> v1:172.21.15.110:6789/0 conn(0x7f1da40c94d0 legacy=0x7f1da4156630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:27.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.373+0000 7f1da9984640 1 -- 172.21.15.72:0/2106196986 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1da415d500 con 0x7f1da40ca2b0 2024-05-09T05:56:27.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.373+0000 7f1daa986640 1 --2- 172.21.15.72:0/2106196986 >> v2:172.21.15.110:3300/0 conn(0x7f1da406d7b0 0x7f1da406dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T05:56:27.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.377+0000 7f1da9984640 1 --2- 172.21.15.72:0/2106196986 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1da40ca2b0 0x7f1da415c690 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1d94009870 tx=0x7f1d9401ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52d92f1895e28229 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:56:27.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.377+0000 7f1da9183640 1 -- 172.21.15.72:0/2106196986 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d940b5070 con 0x7f1da40ca2b0 2024-05-09T05:56:27.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.377+0000 7f1da9183640 1 -- 172.21.15.72:0/2106196986 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d940a8a50 con 0x7f1da40ca2b0 2024-05-09T05:56:27.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.377+0000 7f1da9183640 1 -- 172.21.15.72:0/2106196986 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d940a8e20 con 0x7f1da40ca2b0 2024-05-09T05:56:27.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.377+0000 7f1dac3e9640 1 -- 172.21.15.72:0/2106196986 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1da40ca2b0 msgr2=0x7f1da415c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:27.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.377+0000 7f1dac3e9640 1 --2- 172.21.15.72:0/2106196986 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1da40ca2b0 0x7f1da415c690 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1d94009870 tx=0x7f1d9401ed50 comp rx=0 tx=0).stop 2024-05-09T05:56:27.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.377+0000 7f1dac3e9640 1 -- 172.21.15.72:0/2106196986 shutdown_connections 2024-05-09T05:56:27.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.377+0000 7f1dac3e9640 1 --2- 172.21.15.72:0/2106196986 >> v2:172.21.15.110:3300/0 conn(0x7f1da406d7b0 0x7f1da406dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:27.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.377+0000 7f1dac3e9640 1 --2- 172.21.15.72:0/2106196986 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1da40ca2b0 0x7f1da415c690 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:27.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.377+0000 7f1dac3e9640 1 -- 172.21.15.72:0/2106196986 >> 172.21.15.72:0/2106196986 conn(0x7f1da406e9b0 msgr2=0x7f1da406edc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:56:27.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.377+0000 7f1dac3e9640 1 -- 172.21.15.72:0/2106196986 shutdown_connections 2024-05-09T05:56:27.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.377+0000 7f1dac3e9640 1 -- 172.21.15.72:0/2106196986 wait complete. 2024-05-09T05:56:27.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.381+0000 7f1dac3e9640 1 Processor -- start 2024-05-09T05:56:27.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.381+0000 7f1dac3e9640 1 -- start start 2024-05-09T05:56:27.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.381+0000 7f1dac3e9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1da406d7b0 0x7f1da414eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:27.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.381+0000 7f1dac3e9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1da40c94d0 0x7f1da41e3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:27.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.381+0000 7f1dac3e9640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1da40ca2b0 0x7f1da41e3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:27.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.381+0000 7f1dac3e9640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f1da40c8fb0 con 0x7f1da40ca2b0 2024-05-09T05:56:27.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.381+0000 7f1dac3e9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f1da40c8cd0 con 0x7f1da40c94d0 2024-05-09T05:56:27.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.381+0000 7f1dac3e9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f1da415cbd0 con 0x7f1da406d7b0 2024-05-09T05:56:27.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.381+0000 7f1daa986640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1da40ca2b0 0x7f1da41e3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:27.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.381+0000 7f1daa986640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1da40ca2b0 0x7f1da41e3770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37804/0 (socket says 172.21.15.72:37804) 2024-05-09T05:56:27.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.381+0000 7f1daa986640 1 -- 172.21.15.72:0/3605852589 learned_addr learned my addr 172.21.15.72:0/3605852589 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:56:27.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.381+0000 7f1daa185640 1 --2- 172.21.15.72:0/3605852589 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1da406d7b0 0x7f1da414eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:27.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.381+0000 7f1da9984640 1 --2- 172.21.15.72:0/3605852589 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1da40c94d0 0x7f1da41e3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:27.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.385+0000 7f1daa986640 1 -- 172.21.15.72:0/3605852589 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1da406d7b0 msgr2=0x7f1da414eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:27.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.385+0000 7f1daa986640 1 --2- 172.21.15.72:0/3605852589 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1da406d7b0 0x7f1da414eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:27.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.385+0000 7f1daa986640 1 -- 172.21.15.72:0/3605852589 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1da40c94d0 msgr2=0x7f1da41e3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:27.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.385+0000 7f1daa986640 1 --2- 172.21.15.72:0/3605852589 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1da40c94d0 0x7f1da41e3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:27.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.385+0000 7f1daa986640 1 -- 172.21.15.72:0/3605852589 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1da41f3f20 con 0x7f1da40ca2b0 2024-05-09T05:56:27.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.385+0000 7f1daa986640 1 --2- 172.21.15.72:0/3605852589 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1da40ca2b0 0x7f1da41e3770 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c00e960 tx=0x7f1d9c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:56:27.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.385+0000 7f1d9affd640 1 -- 172.21.15.72:0/3605852589 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c017070 con 0x7f1da40ca2b0 2024-05-09T05:56:27.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.385+0000 7f1dac3e9640 1 -- 172.21.15.72:0/3605852589 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1da41f66a0 con 0x7f1da40ca2b0 2024-05-09T05:56:27.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.385+0000 7f1d9affd640 1 -- 172.21.15.72:0/3605852589 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d9c00ca00 con 0x7f1da40ca2b0 2024-05-09T05:56:27.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.385+0000 7f1d9affd640 1 -- 172.21.15.72:0/3605852589 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c00cdb0 con 0x7f1da40ca2b0 2024-05-09T05:56:27.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.385+0000 7f1dac3e9640 1 -- 172.21.15.72:0/3605852589 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1da41f6c60 con 0x7f1da40ca2b0 2024-05-09T05:56:27.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.385+0000 7f1dac3e9640 1 -- 172.21.15.72:0/3605852589 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1da406a520 con 0x7f1da40ca2b0 2024-05-09T05:56:27.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.385+0000 7f1d9affd640 1 -- 172.21.15.72:0/3605852589 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f1d9c01a070 con 0x7f1da40ca2b0 2024-05-09T05:56:27.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.385+0000 7f1d9affd640 1 --2- 172.21.15.72:0/3605852589 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f1d8806f400 0x7f1d88071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:27.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.385+0000 7f1d9affd640 1 -- 172.21.15.72:0/3605852589 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6676+0+0 (secure 0 0 0) 0x7f1d9c08f390 con 0x7f1da40ca2b0 2024-05-09T05:56:27.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.385+0000 7f1daa185640 1 --2- 172.21.15.72:0/3605852589 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f1d8806f400 0x7f1d88071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:27.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.389+0000 7f1daa185640 1 --2- 172.21.15.72:0/3605852589 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f1d8806f400 0x7f1d88071910 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1da0001e40 tx=0x7f1da0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:56:27.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.393+0000 7f1d9affd640 1 -- 172.21.15.72:0/3605852589 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f1d9c05b900 con 0x7f1da40ca2b0 2024-05-09T05:56:27.453 INFO:tasks.workunit.client.0.smithi072.stdout: 2024-05-09T05:56:27.453 INFO:tasks.workunit.client.0.smithi072.stdout: Children see throughput for 1 rewriters = 109507.72 kB/sec 2024-05-09T05:56:27.453 INFO:tasks.workunit.client.0.smithi072.stdout: Parent sees throughput for 1 rewriters = 109501.64 kB/sec 2024-05-09T05:56:27.454 INFO:tasks.workunit.client.0.smithi072.stdout: Min throughput per process = 109507.72 kB/sec 2024-05-09T05:56:27.454 INFO:tasks.workunit.client.0.smithi072.stdout: Max throughput per process = 109507.72 kB/sec 2024-05-09T05:56:27.454 INFO:tasks.workunit.client.0.smithi072.stdout: Avg throughput per process = 109507.72 kB/sec 2024-05-09T05:56:27.454 INFO:tasks.workunit.client.0.smithi072.stdout: Min xfer = 1048576.00 kB 2024-05-09T05:56:27.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.589+0000 7f1dac3e9640 1 -- 172.21.15.72:0/3605852589 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1da40c9e80 con 0x7f1da40ca2b0 2024-05-09T05:56:27.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.589+0000 7f1d9affd640 1 -- 172.21.15.72:0/3605852589 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+6917 (secure 0 0 0) 0x7f1d9c05fc00 con 0x7f1da40ca2b0 2024-05-09T05:56:27.578 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:56:27.578 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5007,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/1972750715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":1972750715},{"type":"v1","addr":"172.21.15.72:6835","nonce":1972750715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:53:23.494975+0000","modified":"2024-05-09T05:55:35.580442+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4297,"mds_1":4287,"mds_2":4263,"mds_3":4259,"mds_4":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"e","rank":4,"incarnation":20,"state":"up:active","state_seq":38,"addr":"172.21.15.72:6834/1142956298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1142956298},{"type":"v1","addr":"172.21.15.72:6834","nonce":1142956298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4259":{"gid":4259,"name":"f","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.110:6838/840351907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":840351907},{"type":"v1","addr":"172.21.15.110:6838","nonce":840351907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4263":{"gid":4263,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.72:6837/1048256382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":1048256382},{"type":"v1","addr":"172.21.15.72:6837","nonce":1048256382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.110:6839/966325499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6837","nonce":966325499},{"type":"v1","addr":"172.21.15.110:6839","nonce":966325499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6836/4134424941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":4134424941},{"type":"v1","addr":"172.21.15.110:6836","nonce":4134424941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4297,4287,4263,4259,4254]},"id":1}]} 2024-05-09T05:56:27.579 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 25 2024-05-09T05:56:27.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.593+0000 7f1dac3e9640 1 -- 172.21.15.72:0/3605852589 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f1d8806f400 msgr2=0x7f1d88071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:27.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.593+0000 7f1dac3e9640 1 --2- 172.21.15.72:0/3605852589 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f1d8806f400 0x7f1d88071910 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1da0001e40 tx=0x7f1da0009040 comp rx=0 tx=0).stop 2024-05-09T05:56:27.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.593+0000 7f1dac3e9640 1 -- 172.21.15.72:0/3605852589 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1da40ca2b0 msgr2=0x7f1da41e3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:27.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.593+0000 7f1dac3e9640 1 --2- 172.21.15.72:0/3605852589 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1da40ca2b0 0x7f1da41e3770 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c00e960 tx=0x7f1d9c00ee20 comp rx=0 tx=0).stop 2024-05-09T05:56:27.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.593+0000 7f1dac3e9640 1 -- 172.21.15.72:0/3605852589 shutdown_connections 2024-05-09T05:56:27.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.593+0000 7f1dac3e9640 1 --2- 172.21.15.72:0/3605852589 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f1d8806f400 0x7f1d88071910 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:27.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.593+0000 7f1dac3e9640 1 --2- 172.21.15.72:0/3605852589 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1da40ca2b0 0x7f1da41e3770 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:27.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.593+0000 7f1dac3e9640 1 --2- 172.21.15.72:0/3605852589 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1da40c94d0 0x7f1da41e3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:27.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.593+0000 7f1dac3e9640 1 --2- 172.21.15.72:0/3605852589 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1da406d7b0 0x7f1da414eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:27.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.593+0000 7f1dac3e9640 1 -- 172.21.15.72:0/3605852589 >> 172.21.15.72:0/3605852589 conn(0x7f1da406e9b0 msgr2=0x7f1da4076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:56:27.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.593+0000 7f1dac3e9640 1 -- 172.21.15.72:0/3605852589 shutdown_connections 2024-05-09T05:56:27.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.593+0000 7f1dac3e9640 1 -- 172.21.15.72:0/3605852589 wait complete. 2024-05-09T05:56:27.597 INFO:tasks.mds_thrash.fs.[cephfs]:kill mds.e (rank=4) 2024-05-09T05:56:27.597 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-05-09T05:56:27.598 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T05:56:27.614 INFO:tasks.ceph.mds.e:Stopped 2024-05-09T05:56:27.614 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:56:27.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.821+0000 7f1af1296640 1 Processor -- start 2024-05-09T05:56:27.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.821+0000 7f1af1296640 1 -- start start 2024-05-09T05:56:27.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.821+0000 7f1af1296640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1aec156b50 0x7f1aec073ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:27.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.821+0000 7f1af1296640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1aec074410 0x7f1aec0cc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:27.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.821+0000 7f1af1296640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1aec0cda30 con 0x7f1aec0cca30 2024-05-09T05:56:27.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.821+0000 7f1af1296640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f1aec0cc020 con 0x7f1aec156b50 2024-05-09T05:56:27.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.821+0000 7f1af1296640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f1aec15dfe0 con 0x7f1aec074410 2024-05-09T05:56:27.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.821+0000 7f1aeaffd640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1aec156b50 0x7f1aec073ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:27.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.821+0000 7f1aeaffd640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1aec156b50 0x7f1aec073ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37810/0 (socket says 172.21.15.72:37810) 2024-05-09T05:56:27.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.821+0000 7f1aeaffd640 1 -- 172.21.15.72:0/1065856282 learned_addr learned my addr 172.21.15.72:0/1065856282 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:56:27.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.821+0000 7f1aeb7fe640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f1aec0cca30 0x7f1aec0cce40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:56888/0 (socket says 172.21.15.72:56888) 2024-05-09T05:56:27.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.821+0000 7f1ae3fff640 1 --2- 172.21.15.72:0/1065856282 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1aec074410 0x7f1aec0cc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:27.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.821+0000 7f1aeaffd640 1 -- 172.21.15.72:0/1065856282 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1aec074410 msgr2=0x7f1aec0cc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:56:27.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.821+0000 7f1aeaffd640 1 --2- 172.21.15.72:0/1065856282 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1aec074410 0x7f1aec0cc4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:27.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.821+0000 7f1aeaffd640 1 -- 172.21.15.72:0/1065856282 >> v1:172.21.15.72:6789/0 conn(0x7f1aec0cca30 legacy=0x7f1aec0cce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:27.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.821+0000 7f1aeaffd640 1 -- 172.21.15.72:0/1065856282 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1aec15cdd0 con 0x7f1aec156b50 2024-05-09T05:56:27.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.825+0000 7f1aeaffd640 1 --2- 172.21.15.72:0/1065856282 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1aec156b50 0x7f1aec073ed0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f1adc009870 tx=0x7f1adc01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4315ae017c505c58 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:56:27.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.825+0000 7f1aea7fc640 1 -- 172.21.15.72:0/1065856282 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1adc0b0070 con 0x7f1aec156b50 2024-05-09T05:56:27.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.825+0000 7f1aea7fc640 1 -- 172.21.15.72:0/1065856282 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1adc004230 con 0x7f1aec156b50 2024-05-09T05:56:27.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.825+0000 7f1aea7fc640 1 -- 172.21.15.72:0/1065856282 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1adc003620 con 0x7f1aec156b50 2024-05-09T05:56:27.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.825+0000 7f1af1296640 1 -- 172.21.15.72:0/1065856282 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1aec156b50 msgr2=0x7f1aec073ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:27.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.825+0000 7f1af1296640 1 --2- 172.21.15.72:0/1065856282 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1aec156b50 0x7f1aec073ed0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f1adc009870 tx=0x7f1adc01c3f0 comp rx=0 tx=0).stop 2024-05-09T05:56:27.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.825+0000 7f1af1296640 1 -- 172.21.15.72:0/1065856282 shutdown_connections 2024-05-09T05:56:27.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.825+0000 7f1af1296640 1 --2- 172.21.15.72:0/1065856282 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1aec074410 0x7f1aec0cc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:27.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.825+0000 7f1af1296640 1 --2- 172.21.15.72:0/1065856282 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1aec156b50 0x7f1aec073ed0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:27.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.825+0000 7f1af1296640 1 -- 172.21.15.72:0/1065856282 >> 172.21.15.72:0/1065856282 conn(0x7f1aec0d1b70 msgr2=0x7f1aec0d1f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:56:27.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.825+0000 7f1af1296640 1 -- 172.21.15.72:0/1065856282 shutdown_connections 2024-05-09T05:56:27.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.825+0000 7f1af1296640 1 -- 172.21.15.72:0/1065856282 wait complete. 2024-05-09T05:56:27.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.829+0000 7f1af1296640 1 Processor -- start 2024-05-09T05:56:27.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.829+0000 7f1af1296640 1 -- start start 2024-05-09T05:56:27.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.829+0000 7f1af1296640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1aec074410 0x7f1aec0c5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:27.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.829+0000 7f1af1296640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1aec0cca30 0x7f1aec155d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:27.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.829+0000 7f1af1296640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1aec156b50 0x7f1aec156270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:27.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.829+0000 7f1af1296640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f1aec15d390 con 0x7f1aec0cca30 2024-05-09T05:56:27.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.829+0000 7f1af1296640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f1aec15d950 con 0x7f1aec156b50 2024-05-09T05:56:27.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.829+0000 7f1af1296640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f1aec15d670 con 0x7f1aec074410 2024-05-09T05:56:27.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.829+0000 7f1ae3fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1aec0cca30 0x7f1aec155d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:27.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.829+0000 7f1ae3fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1aec0cca30 0x7f1aec155d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37818/0 (socket says 172.21.15.72:37818) 2024-05-09T05:56:27.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.829+0000 7f1ae3fff640 1 -- 172.21.15.72:0/1805128084 learned_addr learned my addr 172.21.15.72:0/1805128084 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:56:27.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.829+0000 7f1aeaffd640 1 --2- 172.21.15.72:0/1805128084 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1aec074410 0x7f1aec0c5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:27.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.829+0000 7f1aeb7fe640 1 --2- 172.21.15.72:0/1805128084 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1aec156b50 0x7f1aec156270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:27.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.829+0000 7f1ae3fff640 1 -- 172.21.15.72:0/1805128084 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1aec074410 msgr2=0x7f1aec0c5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:27.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.829+0000 7f1ae3fff640 1 --2- 172.21.15.72:0/1805128084 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1aec074410 0x7f1aec0c5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:27.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.829+0000 7f1ae3fff640 1 -- 172.21.15.72:0/1805128084 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1aec156b50 msgr2=0x7f1aec156270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:27.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.829+0000 7f1ae3fff640 1 --2- 172.21.15.72:0/1805128084 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1aec156b50 0x7f1aec156270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:27.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.829+0000 7f1ae3fff640 1 -- 172.21.15.72:0/1805128084 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1aec1574e0 con 0x7f1aec0cca30 2024-05-09T05:56:27.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.829+0000 7f1aeb7fe640 1 --2- 172.21.15.72:0/1805128084 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1aec156b50 0x7f1aec156270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:56:27.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.829+0000 7f1ae3fff640 1 --2- 172.21.15.72:0/1805128084 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1aec0cca30 0x7f1aec155d30 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f1ad400d5f0 tx=0x7f1ad400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:56:27.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.829+0000 7f1ae37fe640 1 -- 172.21.15.72:0/1805128084 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad40125f0 con 0x7f1aec0cca30 2024-05-09T05:56:27.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.829+0000 7f1ae37fe640 1 -- 172.21.15.72:0/1805128084 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ad4019070 con 0x7f1aec0cca30 2024-05-09T05:56:27.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.829+0000 7f1af1296640 1 -- 172.21.15.72:0/1805128084 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1aec0c60a0 con 0x7f1aec0cca30 2024-05-09T05:56:27.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.829+0000 7f1ae37fe640 1 -- 172.21.15.72:0/1805128084 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad40129b0 con 0x7f1aec0cca30 2024-05-09T05:56:27.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.829+0000 7f1af1296640 1 -- 172.21.15.72:0/1805128084 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1aec0cb0c0 con 0x7f1aec0cca30 2024-05-09T05:56:27.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.833+0000 7f1af1296640 1 -- 172.21.15.72:0/1805128084 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1aec06a520 con 0x7f1aec0cca30 2024-05-09T05:56:27.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.833+0000 7f1ae37fe640 1 -- 172.21.15.72:0/1805128084 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f1ad4012b50 con 0x7f1aec0cca30 2024-05-09T05:56:27.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.833+0000 7f1ae37fe640 1 --2- 172.21.15.72:0/1805128084 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f1acc06f400 0x7f1acc071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:27.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.833+0000 7f1ae37fe640 1 -- 172.21.15.72:0/1805128084 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6676+0+0 (secure 0 0 0) 0x7f1ad4090440 con 0x7f1aec0cca30 2024-05-09T05:56:27.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.833+0000 7f1aeaffd640 1 --2- 172.21.15.72:0/1805128084 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f1acc06f400 0x7f1acc071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:27.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.833+0000 7f1aeaffd640 1 --2- 172.21.15.72:0/1805128084 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f1acc06f400 0x7f1acc071910 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1adc0ad000 tx=0x7f1adc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:56:27.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:27.837+0000 7f1ae37fe640 1 -- 172.21.15.72:0/1805128084 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f1ad405d160 con 0x7f1aec0cca30 2024-05-09T05:56:28.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:28.017+0000 7f1af1296640 1 -- 172.21.15.72:0/1805128084 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1aec0cdcb0 con 0x7f1aec0cca30 2024-05-09T05:56:28.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:28.017+0000 7f1ae37fe640 1 -- 172.21.15.72:0/1805128084 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+6917 (secure 0 0 0) 0x7f1ad405ca60 con 0x7f1aec0cca30 2024-05-09T05:56:28.004 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:56:28.005 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5007,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/1972750715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":1972750715},{"type":"v1","addr":"172.21.15.72:6835","nonce":1972750715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:53:23.494975+0000","modified":"2024-05-09T05:55:35.580442+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4297,"mds_1":4287,"mds_2":4263,"mds_3":4259,"mds_4":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"e","rank":4,"incarnation":20,"state":"up:active","state_seq":38,"addr":"172.21.15.72:6834/1142956298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1142956298},{"type":"v1","addr":"172.21.15.72:6834","nonce":1142956298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4259":{"gid":4259,"name":"f","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.110:6838/840351907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":840351907},{"type":"v1","addr":"172.21.15.110:6838","nonce":840351907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4263":{"gid":4263,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.72:6837/1048256382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":1048256382},{"type":"v1","addr":"172.21.15.72:6837","nonce":1048256382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.110:6839/966325499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6837","nonce":966325499},{"type":"v1","addr":"172.21.15.110:6839","nonce":966325499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6836/4134424941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":4134424941},{"type":"v1","addr":"172.21.15.110:6836","nonce":4134424941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4297,4287,4263,4259,4254]},"id":1}]} 2024-05-09T05:56:28.005 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 25 2024-05-09T05:56:28.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:28.017+0000 7f1af1296640 1 -- 172.21.15.72:0/1805128084 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f1acc06f400 msgr2=0x7f1acc071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:28.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:28.017+0000 7f1af1296640 1 --2- 172.21.15.72:0/1805128084 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f1acc06f400 0x7f1acc071910 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1adc0ad000 tx=0x7f1adc009040 comp rx=0 tx=0).stop 2024-05-09T05:56:28.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:28.017+0000 7f1af1296640 1 -- 172.21.15.72:0/1805128084 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1aec0cca30 msgr2=0x7f1aec155d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:28.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:28.017+0000 7f1af1296640 1 --2- 172.21.15.72:0/1805128084 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1aec0cca30 0x7f1aec155d30 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f1ad400d5f0 tx=0x7f1ad400dab0 comp rx=0 tx=0).stop 2024-05-09T05:56:28.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:28.021+0000 7f1af1296640 1 -- 172.21.15.72:0/1805128084 shutdown_connections 2024-05-09T05:56:28.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:28.021+0000 7f1af1296640 1 --2- 172.21.15.72:0/1805128084 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f1acc06f400 0x7f1acc071910 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:28.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:28.021+0000 7f1af1296640 1 --2- 172.21.15.72:0/1805128084 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1aec156b50 0x7f1aec156270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:28.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:28.021+0000 7f1af1296640 1 --2- 172.21.15.72:0/1805128084 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1aec0cca30 0x7f1aec155d30 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:28.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:28.021+0000 7f1af1296640 1 --2- 172.21.15.72:0/1805128084 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1aec074410 0x7f1aec0c5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:28.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:28.021+0000 7f1af1296640 1 -- 172.21.15.72:0/1805128084 >> 172.21.15.72:0/1805128084 conn(0x7f1aec0d1b70 msgr2=0x7f1aec15bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:56:28.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:28.021+0000 7f1af1296640 1 -- 172.21.15.72:0/1805128084 shutdown_connections 2024-05-09T05:56:28.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:28.021+0000 7f1af1296640 1 -- 172.21.15.72:0/1805128084 wait complete. 2024-05-09T05:56:28.024 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is laggy/crashed, in failed state, or mds.e is removed from mdsmap 2024-05-09T05:56:30.025 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:56:30.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.197+0000 7fa5301f9640 1 Processor -- start 2024-05-09T05:56:30.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.197+0000 7fa5301f9640 1 -- start start 2024-05-09T05:56:30.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.197+0000 7fa5301f9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa5280c7480 0x7fa5280c7890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:30.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.197+0000 7fa5301f9640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa528161f80 0x7fa5281643a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:30.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.197+0000 7fa5301f9640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa52806e960 con 0x7fa528075020 2024-05-09T05:56:30.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.197+0000 7fa5301f9640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fa528072b20 con 0x7fa528161f80 2024-05-09T05:56:30.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.197+0000 7fa5301f9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fa528072840 con 0x7fa5280c7480 2024-05-09T05:56:30.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.197+0000 7fa52e796640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa528161f80 0x7fa5281643a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:30.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.197+0000 7fa52e796640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa528161f80 0x7fa5281643a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37828/0 (socket says 172.21.15.72:37828) 2024-05-09T05:56:30.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.197+0000 7fa52e796640 1 -- 172.21.15.72:0/1326961184 learned_addr learned my addr 172.21.15.72:0/1326961184 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:56:30.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.197+0000 7fa52d794640 1 --2- 172.21.15.72:0/1326961184 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa5280c7480 0x7fa5280c7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:30.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.197+0000 7fa52e796640 1 -- 172.21.15.72:0/1326961184 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa5280c7480 msgr2=0x7fa5280c7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:56:30.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.197+0000 7fa52e796640 1 --2- 172.21.15.72:0/1326961184 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa5280c7480 0x7fa5280c7890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:30.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.197+0000 7fa52e796640 1 -- 172.21.15.72:0/1326961184 >> v1:172.21.15.110:6789/0 conn(0x7fa528075020 legacy=0x7fa528074090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:30.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.197+0000 7fa52e796640 1 -- 172.21.15.72:0/1326961184 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa52806ec20 con 0x7fa528161f80 2024-05-09T05:56:30.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.201+0000 7fa52e796640 1 --2- 172.21.15.72:0/1326961184 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa528161f80 0x7fa5281643a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa524009870 tx=0x7fa52401ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3404abfeed5ded5e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:56:30.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.201+0000 7fa52cf93640 1 -- 172.21.15.72:0/1326961184 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5240b5070 con 0x7fa528161f80 2024-05-09T05:56:30.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.201+0000 7fa52cf93640 1 -- 172.21.15.72:0/1326961184 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5240a8a50 con 0x7fa528161f80 2024-05-09T05:56:30.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.201+0000 7fa52cf93640 1 -- 172.21.15.72:0/1326961184 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5240a8e20 con 0x7fa528161f80 2024-05-09T05:56:30.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.201+0000 7fa5301f9640 1 -- 172.21.15.72:0/1326961184 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa528161f80 msgr2=0x7fa5281643a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:30.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.201+0000 7fa5301f9640 1 --2- 172.21.15.72:0/1326961184 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa528161f80 0x7fa5281643a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa524009870 tx=0x7fa52401ed50 comp rx=0 tx=0).stop 2024-05-09T05:56:30.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.201+0000 7fa5301f9640 1 -- 172.21.15.72:0/1326961184 shutdown_connections 2024-05-09T05:56:30.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.201+0000 7fa5301f9640 1 --2- 172.21.15.72:0/1326961184 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa528161f80 0x7fa5281643a0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:30.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.201+0000 7fa5301f9640 1 --2- 172.21.15.72:0/1326961184 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa5280c7480 0x7fa5280c7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:30.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.201+0000 7fa5301f9640 1 -- 172.21.15.72:0/1326961184 >> 172.21.15.72:0/1326961184 conn(0x7fa5280cb350 msgr2=0x7fa5280cb760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:56:30.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.201+0000 7fa5301f9640 1 -- 172.21.15.72:0/1326961184 shutdown_connections 2024-05-09T05:56:30.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.201+0000 7fa5301f9640 1 -- 172.21.15.72:0/1326961184 wait complete. 2024-05-09T05:56:30.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.205+0000 7fa5301f9640 1 Processor -- start 2024-05-09T05:56:30.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.205+0000 7fa5301f9640 1 -- start start 2024-05-09T05:56:30.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.205+0000 7fa5301f9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa528075020 0x7fa5281f0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:30.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.205+0000 7fa5301f9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa5280c7480 0x7fa5281519c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:30.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.205+0000 7fa5301f9640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa528161f80 0x7fa52814a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:30.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.205+0000 7fa5301f9640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fa528159dc0 con 0x7fa528161f80 2024-05-09T05:56:30.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.205+0000 7fa5301f9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fa528159ae0 con 0x7fa528075020 2024-05-09T05:56:30.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.205+0000 7fa5301f9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fa52815a0a0 con 0x7fa5280c7480 2024-05-09T05:56:30.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.205+0000 7fa52e796640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa528161f80 0x7fa52814a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:30.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.205+0000 7fa52e796640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa528161f80 0x7fa52814a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37830/0 (socket says 172.21.15.72:37830) 2024-05-09T05:56:30.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.205+0000 7fa52e796640 1 -- 172.21.15.72:0/3575483452 learned_addr learned my addr 172.21.15.72:0/3575483452 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:56:30.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.205+0000 7fa52df95640 1 --2- 172.21.15.72:0/3575483452 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa528075020 0x7fa5281f0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:30.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.205+0000 7fa52d794640 1 --2- 172.21.15.72:0/3575483452 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa5280c7480 0x7fa5281519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:30.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.205+0000 7fa52e796640 1 -- 172.21.15.72:0/3575483452 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa5280c7480 msgr2=0x7fa5281519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:30.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.205+0000 7fa52e796640 1 --2- 172.21.15.72:0/3575483452 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa5280c7480 0x7fa5281519c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:30.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.205+0000 7fa52e796640 1 -- 172.21.15.72:0/3575483452 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa528075020 msgr2=0x7fa5281f0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:30.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.205+0000 7fa52e796640 1 --2- 172.21.15.72:0/3575483452 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa528075020 0x7fa5281f0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:30.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.205+0000 7fa52e796640 1 -- 172.21.15.72:0/3575483452 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5281f4090 con 0x7fa528161f80 2024-05-09T05:56:30.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.205+0000 7fa52e796640 1 --2- 172.21.15.72:0/3575483452 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa528161f80 0x7fa52814a2e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa5240b3040 tx=0x7fa52401baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:56:30.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.205+0000 7fa51a7fc640 1 -- 172.21.15.72:0/3575483452 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5240c0070 con 0x7fa528161f80 2024-05-09T05:56:30.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.205+0000 7fa51a7fc640 1 -- 172.21.15.72:0/3575483452 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5240ae550 con 0x7fa528161f80 2024-05-09T05:56:30.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.205+0000 7fa5301f9640 1 -- 172.21.15.72:0/3575483452 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa52814c3e0 con 0x7fa528161f80 2024-05-09T05:56:30.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.205+0000 7fa51a7fc640 1 -- 172.21.15.72:0/3575483452 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5240b5070 con 0x7fa528161f80 2024-05-09T05:56:30.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.205+0000 7fa5301f9640 1 -- 172.21.15.72:0/3575483452 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5281f4610 con 0x7fa528161f80 2024-05-09T05:56:30.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.209+0000 7fa5301f9640 1 -- 172.21.15.72:0/3575483452 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa52806a520 con 0x7fa528161f80 2024-05-09T05:56:30.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.209+0000 7fa51a7fc640 1 -- 172.21.15.72:0/3575483452 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fa5240c3070 con 0x7fa528161f80 2024-05-09T05:56:30.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.209+0000 7fa51a7fc640 1 --2- 172.21.15.72:0/3575483452 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fa50c06f400 0x7fa50c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:30.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.209+0000 7fa51a7fc640 1 -- 172.21.15.72:0/3575483452 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6676+0+0 (secure 0 0 0) 0x7fa52412cf40 con 0x7fa528161f80 2024-05-09T05:56:30.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.209+0000 7fa52df95640 1 --2- 172.21.15.72:0/3575483452 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fa50c06f400 0x7fa50c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:30.197 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.209+0000 7fa52df95640 1 --2- 172.21.15.72:0/3575483452 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fa50c06f400 0x7fa50c071910 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa5200012f0 tx=0x7fa520009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:56:30.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.213+0000 7fa51a7fc640 1 -- 172.21.15.72:0/3575483452 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fa5240188b0 con 0x7fa528161f80 2024-05-09T05:56:30.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.409+0000 7fa5301f9640 1 -- 172.21.15.72:0/3575483452 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa5281f0ec0 con 0x7fa528161f80 2024-05-09T05:56:30.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.409+0000 7fa51a7fc640 1 -- 172.21.15.72:0/3575483452 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+6917 (secure 0 0 0) 0x7fa5240f9a60 con 0x7fa528161f80 2024-05-09T05:56:30.397 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:56:30.397 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5007,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/1972750715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":1972750715},{"type":"v1","addr":"172.21.15.72:6835","nonce":1972750715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:53:23.494975+0000","modified":"2024-05-09T05:55:35.580442+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4297,"mds_1":4287,"mds_2":4263,"mds_3":4259,"mds_4":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"e","rank":4,"incarnation":20,"state":"up:active","state_seq":38,"addr":"172.21.15.72:6834/1142956298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1142956298},{"type":"v1","addr":"172.21.15.72:6834","nonce":1142956298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4259":{"gid":4259,"name":"f","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.110:6838/840351907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":840351907},{"type":"v1","addr":"172.21.15.110:6838","nonce":840351907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4263":{"gid":4263,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.72:6837/1048256382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":1048256382},{"type":"v1","addr":"172.21.15.72:6837","nonce":1048256382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.110:6839/966325499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6837","nonce":966325499},{"type":"v1","addr":"172.21.15.110:6839","nonce":966325499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6836/4134424941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":4134424941},{"type":"v1","addr":"172.21.15.110:6836","nonce":4134424941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4297,4287,4263,4259,4254]},"id":1}]} 2024-05-09T05:56:30.397 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 25 2024-05-09T05:56:30.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.413+0000 7fa5301f9640 1 -- 172.21.15.72:0/3575483452 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fa50c06f400 msgr2=0x7fa50c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:30.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.413+0000 7fa5301f9640 1 --2- 172.21.15.72:0/3575483452 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fa50c06f400 0x7fa50c071910 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa5200012f0 tx=0x7fa520009040 comp rx=0 tx=0).stop 2024-05-09T05:56:30.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.413+0000 7fa5301f9640 1 -- 172.21.15.72:0/3575483452 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa528161f80 msgr2=0x7fa52814a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:30.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.413+0000 7fa5301f9640 1 --2- 172.21.15.72:0/3575483452 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa528161f80 0x7fa52814a2e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa5240b3040 tx=0x7fa52401baf0 comp rx=0 tx=0).stop 2024-05-09T05:56:30.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.413+0000 7fa5301f9640 1 -- 172.21.15.72:0/3575483452 shutdown_connections 2024-05-09T05:56:30.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.413+0000 7fa5301f9640 1 --2- 172.21.15.72:0/3575483452 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fa50c06f400 0x7fa50c071910 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:30.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.413+0000 7fa5301f9640 1 --2- 172.21.15.72:0/3575483452 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa528161f80 0x7fa52814a2e0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:30.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.413+0000 7fa5301f9640 1 --2- 172.21.15.72:0/3575483452 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa5280c7480 0x7fa5281519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:30.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.413+0000 7fa5301f9640 1 --2- 172.21.15.72:0/3575483452 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa528075020 0x7fa5281f0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:30.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.413+0000 7fa5301f9640 1 -- 172.21.15.72:0/3575483452 >> 172.21.15.72:0/3575483452 conn(0x7fa5280cb350 msgr2=0x7fa5280c9d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:56:30.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.413+0000 7fa5301f9640 1 -- 172.21.15.72:0/3575483452 shutdown_connections 2024-05-09T05:56:30.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:30.413+0000 7fa5301f9640 1 -- 172.21.15.72:0/3575483452 wait complete. 2024-05-09T05:56:30.417 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is laggy/crashed, in failed state, or mds.e is removed from mdsmap 2024-05-09T05:56:32.419 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:56:32.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:32.593+0000 7f4b1940a640 1 Processor -- start 2024-05-09T05:56:32.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:32.593+0000 7f4b1940a640 1 -- start start 2024-05-09T05:56:32.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:32.593+0000 7f4b1940a640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4b14068820 0x7f4b14168250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:32.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:32.593+0000 7f4b1940a640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b1406e200 con 0x7f4b14072b40 2024-05-09T05:56:32.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:32.593+0000 7f4b1940a640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b1406c8d0 con 0x7f4b140750e0 2024-05-09T05:56:32.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:32.593+0000 7f4b1940a640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f4b140754f0 con 0x7f4b14068820 2024-05-09T05:56:32.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:32.593+0000 7f4b137fe640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4b14068820 0x7f4b14168250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:32.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:32.593+0000 7f4b127fc640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f4b14072b40 0x7f4b1415cfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:56290/0 (socket says 172.21.15.72:56290) 2024-05-09T05:56:32.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:32.593+0000 7f4b127fc640 1 -- 172.21.15.72:0/2458667138 learned_addr learned my addr 172.21.15.72:0/2458667138 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:56:32.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:32.593+0000 7f4b137fe640 1 -- 172.21.15.72:0/2458667138 >> v1:172.21.15.110:6789/0 conn(0x7f4b140750e0 legacy=0x7f4b1415c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:32.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:32.593+0000 7f4b137fe640 1 -- 172.21.15.72:0/2458667138 >> v1:172.21.15.72:6789/0 conn(0x7f4b14072b40 legacy=0x7f4b1415cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:32.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:32.593+0000 7f4b137fe640 1 -- 172.21.15.72:0/2458667138 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b1406cbb0 con 0x7f4b14068820 2024-05-09T05:56:32.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:32.597+0000 7f4b137fe640 1 --2- 172.21.15.72:0/2458667138 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b14068820 0x7f4b14168250 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4b040097c0 tx=0x7f4b0401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df89e7a6af6ae10f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:56:32.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:32.597+0000 7f4b11ffb640 1 -- 172.21.15.72:0/2458667138 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b040b0070 con 0x7f4b14068820 2024-05-09T05:56:32.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:32.597+0000 7f4b11ffb640 1 -- 172.21.15.72:0/2458667138 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b040ab600 con 0x7f4b14068820 2024-05-09T05:56:32.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:32.597+0000 7f4b11ffb640 1 -- 172.21.15.72:0/2458667138 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b040ab9d0 con 0x7f4b14068820 2024-05-09T05:56:32.585 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:32.597+0000 7f4b1940a640 1 -- 172.21.15.72:0/2458667138 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b14068820 msgr2=0x7f4b14168250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:32.585 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:32.597+0000 7f4b1940a640 1 --2- 172.21.15.72:0/2458667138 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b14068820 0x7f4b14168250 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4b040097c0 tx=0x7f4b0401c4a0 comp rx=0 tx=0).stop 2024-05-09T05:56:32.585 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:32.597+0000 7f4b1940a640 1 -- 172.21.15.72:0/2458667138 shutdown_connections 2024-05-09T05:56:32.585 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:32.597+0000 7f4b1940a640 1 --2- 172.21.15.72:0/2458667138 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b14068820 0x7f4b14168250 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:32.585 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:32.597+0000 7f4b1940a640 1 -- 172.21.15.72:0/2458667138 >> 172.21.15.72:0/2458667138 conn(0x7f4b140cbe10 msgr2=0x7f4b140cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:56:32.585 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:32.597+0000 7f4b1940a640 1 -- 172.21.15.72:0/2458667138 shutdown_connections 2024-05-09T05:56:32.585 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:32.597+0000 7f4b1940a640 1 -- 172.21.15.72:0/2458667138 wait complete. 2024-05-09T05:56:32.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:32.601+0000 7f4b1940a640 1 Processor -- start 2024-05-09T05:56:32.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:32.601+0000 7f4b1940a640 1 -- start start 2024-05-09T05:56:32.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:32.601+0000 7f4b1940a640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b14068820 0x7f4b1414b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:32.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:32.601+0000 7f4b1940a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b14072b40 0x7f4b1415e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:32.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:32.601+0000 7f4b1940a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b140750e0 0x7f4b1415e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:32.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:32.601+0000 7f4b1940a640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f4b14068c30 con 0x7f4b14068820 2024-05-09T05:56:32.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:32.601+0000 7f4b1940a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f4b1406e4e0 con 0x7f4b14072b40 2024-05-09T05:56:32.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:32.601+0000 7f4b1940a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f4b1406d1c0 con 0x7f4b140750e0 2024-05-09T05:56:32.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:32.601+0000 7f4b12ffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b14068820 0x7f4b1414b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:32.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:32.601+0000 7f4b12ffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b14068820 0x7f4b1414b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32938/0 (socket says 172.21.15.72:32938) 2024-05-09T05:56:32.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:32.601+0000 7f4b12ffd640 1 -- 172.21.15.72:0/1004205398 learned_addr learned my addr 172.21.15.72:0/1004205398 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:56:32.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:32.601+0000 7f4b127fc640 1 --2- 172.21.15.72:0/1004205398 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b14072b40 0x7f4b1415e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:32.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:32.601+0000 7f4b12ffd640 1 -- 172.21.15.72:0/1004205398 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b140750e0 msgr2=0x7f4b1415e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:32.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:32.601+0000 7f4b137fe640 1 --2- 172.21.15.72:0/1004205398 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b140750e0 0x7f4b1415e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:32.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:32.601+0000 7f4b12ffd640 1 --2- 172.21.15.72:0/1004205398 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b140750e0 0x7f4b1415e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:32.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:32.601+0000 7f4b12ffd640 1 -- 172.21.15.72:0/1004205398 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b14072b40 msgr2=0x7f4b1415e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:32.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:32.601+0000 7f4b12ffd640 1 --2- 172.21.15.72:0/1004205398 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b14072b40 0x7f4b1415e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:32.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:32.601+0000 7f4b12ffd640 1 -- 172.21.15.72:0/1004205398 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b1415f490 con 0x7f4b14068820 2024-05-09T05:56:32.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:32.601+0000 7f4b12ffd640 1 --2- 172.21.15.72:0/1004205398 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b14068820 0x7f4b1414b4d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c00c3c0 tx=0x7f4b0c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:56:32.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:32.601+0000 7f4b0b7fe640 1 -- 172.21.15.72:0/1004205398 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c017070 con 0x7f4b14068820 2024-05-09T05:56:32.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:32.601+0000 7f4b0b7fe640 1 -- 172.21.15.72:0/1004205398 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b0c0052d0 con 0x7f4b14068820 2024-05-09T05:56:32.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:32.601+0000 7f4b1940a640 1 -- 172.21.15.72:0/1004205398 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b1415f1d0 con 0x7f4b14068820 2024-05-09T05:56:32.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:32.601+0000 7f4b0b7fe640 1 -- 172.21.15.72:0/1004205398 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c0054c0 con 0x7f4b14068820 2024-05-09T05:56:32.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:32.601+0000 7f4b1940a640 1 -- 172.21.15.72:0/1004205398 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b14151b90 con 0x7f4b14068820 2024-05-09T05:56:32.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:32.601+0000 7f4b1940a640 1 -- 172.21.15.72:0/1004205398 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b1406a520 con 0x7f4b14068820 2024-05-09T05:56:32.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:32.605+0000 7f4b0b7fe640 1 -- 172.21.15.72:0/1004205398 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f4b0c01a070 con 0x7f4b14068820 2024-05-09T05:56:32.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:32.605+0000 7f4b0b7fe640 1 --2- 172.21.15.72:0/1004205398 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f4af406f400 0x7f4af4071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:32.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:32.605+0000 7f4b0b7fe640 1 -- 172.21.15.72:0/1004205398 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6676+0+0 (secure 0 0 0) 0x7f4b0c08e930 con 0x7f4b14068820 2024-05-09T05:56:32.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:32.605+0000 7f4b127fc640 1 --2- 172.21.15.72:0/1004205398 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f4af406f400 0x7f4af4071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:32.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:32.605+0000 7f4b127fc640 1 --2- 172.21.15.72:0/1004205398 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f4af406f400 0x7f4af4071910 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4b1415a470 tx=0x7f4afc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:56:32.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:32.609+0000 7f4b0b7fe640 1 -- 172.21.15.72:0/1004205398 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f4b0c05b570 con 0x7f4b14068820 2024-05-09T05:56:32.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:32.801+0000 7f4b1940a640 1 -- 172.21.15.72:0/1004205398 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4b14074af0 con 0x7f4b14068820 2024-05-09T05:56:32.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:32.801+0000 7f4b0b7fe640 1 -- 172.21.15.72:0/1004205398 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+6917 (secure 0 0 0) 0x7f4b0c05ae70 con 0x7f4b14068820 2024-05-09T05:56:32.788 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:56:32.788 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5007,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/1972750715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":1972750715},{"type":"v1","addr":"172.21.15.72:6835","nonce":1972750715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:53:23.494975+0000","modified":"2024-05-09T05:55:35.580442+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4297,"mds_1":4287,"mds_2":4263,"mds_3":4259,"mds_4":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"e","rank":4,"incarnation":20,"state":"up:active","state_seq":38,"addr":"172.21.15.72:6834/1142956298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1142956298},{"type":"v1","addr":"172.21.15.72:6834","nonce":1142956298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4259":{"gid":4259,"name":"f","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.110:6838/840351907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":840351907},{"type":"v1","addr":"172.21.15.110:6838","nonce":840351907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4263":{"gid":4263,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.72:6837/1048256382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":1048256382},{"type":"v1","addr":"172.21.15.72:6837","nonce":1048256382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.110:6839/966325499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6837","nonce":966325499},{"type":"v1","addr":"172.21.15.110:6839","nonce":966325499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6836/4134424941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":4134424941},{"type":"v1","addr":"172.21.15.110:6836","nonce":4134424941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4297,4287,4263,4259,4254]},"id":1}]} 2024-05-09T05:56:32.788 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 25 2024-05-09T05:56:32.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:32.805+0000 7f4b1940a640 1 -- 172.21.15.72:0/1004205398 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f4af406f400 msgr2=0x7f4af4071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:32.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:32.805+0000 7f4b1940a640 1 --2- 172.21.15.72:0/1004205398 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f4af406f400 0x7f4af4071910 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4b1415a470 tx=0x7f4afc009040 comp rx=0 tx=0).stop 2024-05-09T05:56:32.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:32.805+0000 7f4b1940a640 1 -- 172.21.15.72:0/1004205398 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b14068820 msgr2=0x7f4b1414b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:32.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:32.805+0000 7f4b1940a640 1 --2- 172.21.15.72:0/1004205398 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b14068820 0x7f4b1414b4d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c00c3c0 tx=0x7f4b0c00c880 comp rx=0 tx=0).stop 2024-05-09T05:56:32.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:32.805+0000 7f4b1940a640 1 -- 172.21.15.72:0/1004205398 shutdown_connections 2024-05-09T05:56:32.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:32.805+0000 7f4b1940a640 1 --2- 172.21.15.72:0/1004205398 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f4af406f400 0x7f4af4071910 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:32.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:32.805+0000 7f4b1940a640 1 --2- 172.21.15.72:0/1004205398 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b140750e0 0x7f4b1415e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:32.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:32.805+0000 7f4b1940a640 1 --2- 172.21.15.72:0/1004205398 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b14072b40 0x7f4b1415e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:32.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:32.805+0000 7f4b1940a640 1 --2- 172.21.15.72:0/1004205398 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b14068820 0x7f4b1414b4d0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:32.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:32.805+0000 7f4b1940a640 1 -- 172.21.15.72:0/1004205398 >> 172.21.15.72:0/1004205398 conn(0x7f4b140cbe10 msgr2=0x7f4b1415a730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:56:32.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:32.805+0000 7f4b1940a640 1 -- 172.21.15.72:0/1004205398 shutdown_connections 2024-05-09T05:56:32.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:32.805+0000 7f4b1940a640 1 -- 172.21.15.72:0/1004205398 wait complete. 2024-05-09T05:56:32.809 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is laggy/crashed, in failed state, or mds.e is removed from mdsmap 2024-05-09T05:56:34.584 INFO:tasks.workunit.client.0.smithi072.stdout: 2024-05-09T05:56:34.584 INFO:tasks.workunit.client.0.smithi072.stdout: Children see throughput for 1 readers = 6257279.50 kB/sec 2024-05-09T05:56:34.584 INFO:tasks.workunit.client.0.smithi072.stdout: Parent sees throughput for 1 readers = 6237516.20 kB/sec 2024-05-09T05:56:34.585 INFO:tasks.workunit.client.0.smithi072.stdout: Min throughput per process = 6257279.50 kB/sec 2024-05-09T05:56:34.585 INFO:tasks.workunit.client.0.smithi072.stdout: Max throughput per process = 6257279.50 kB/sec 2024-05-09T05:56:34.585 INFO:tasks.workunit.client.0.smithi072.stdout: Avg throughput per process = 6257279.50 kB/sec 2024-05-09T05:56:34.585 INFO:tasks.workunit.client.0.smithi072.stdout: Min xfer = 1048576.00 kB 2024-05-09T05:56:34.810 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:56:34.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:34.977+0000 7f17b5271640 1 Processor -- start 2024-05-09T05:56:34.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:34.977+0000 7f17b5271640 1 -- start start 2024-05-09T05:56:34.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:34.977+0000 7f17b5271640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f17b015da90 0x7f17b00c7570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:34.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:34.977+0000 7f17b5271640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f17b015dea0 0x7f17b00745b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:34.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:34.977+0000 7f17b5271640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17b015a4f0 con 0x7f17b0074af0 2024-05-09T05:56:34.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:34.977+0000 7f17b5271640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f17b01513f0 con 0x7f17b015da90 2024-05-09T05:56:34.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:34.977+0000 7f17b5271640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f17b00c84f0 con 0x7f17b015dea0 2024-05-09T05:56:34.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:34.977+0000 7f17af7fe640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f17b0074af0 0x7f17b006fc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:56306/0 (socket says 172.21.15.72:56306) 2024-05-09T05:56:34.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:34.977+0000 7f17aeffd640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f17b015da90 0x7f17b00c7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:34.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:34.977+0000 7f17af7fe640 1 -- 172.21.15.72:0/2096800127 learned_addr learned my addr 172.21.15.72:0/2096800127 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:56:34.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:34.977+0000 7f17ae7fc640 1 --2- 172.21.15.72:0/2096800127 >> v2:172.21.15.110:3300/0 conn(0x7f17b015dea0 0x7f17b00745b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:34.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:34.977+0000 7f17aeffd640 1 -- 172.21.15.72:0/2096800127 >> v2:172.21.15.110:3300/0 conn(0x7f17b015dea0 msgr2=0x7f17b00745b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:56:34.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:34.977+0000 7f17aeffd640 1 --2- 172.21.15.72:0/2096800127 >> v2:172.21.15.110:3300/0 conn(0x7f17b015dea0 0x7f17b00745b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:34.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:34.977+0000 7f17aeffd640 1 -- 172.21.15.72:0/2096800127 >> v1:172.21.15.72:6789/0 conn(0x7f17b0074af0 legacy=0x7f17b006fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:34.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:34.977+0000 7f17aeffd640 1 -- 172.21.15.72:0/2096800127 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17b00c87d0 con 0x7f17b015da90 2024-05-09T05:56:34.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:34.977+0000 7f17adffb640 1 -- 172.21.15.72:0/2096800127 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2338325035 0 0) 0x7f17b015a4f0 con 0x7f17b0074af0 2024-05-09T05:56:34.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:34.981+0000 7f17aeffd640 1 --2- 172.21.15.72:0/2096800127 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17b015da90 0x7f17b00c7570 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f17b00715b0 tx=0x7f17a401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19d46273a5c62dae server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:56:34.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:34.981+0000 7f17adffb640 1 -- 172.21.15.72:0/2096800127 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a40b0070 con 0x7f17b015da90 2024-05-09T05:56:34.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:34.981+0000 7f17adffb640 1 -- 172.21.15.72:0/2096800127 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17a40ab600 con 0x7f17b015da90 2024-05-09T05:56:34.968 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:34.981+0000 7f17adffb640 1 -- 172.21.15.72:0/2096800127 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a40ab9d0 con 0x7f17b015da90 2024-05-09T05:56:34.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:34.981+0000 7f17b5271640 1 -- 172.21.15.72:0/2096800127 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17b015da90 msgr2=0x7f17b00c7570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:34.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:34.981+0000 7f17b5271640 1 --2- 172.21.15.72:0/2096800127 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17b015da90 0x7f17b00c7570 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f17b00715b0 tx=0x7f17a401c480 comp rx=0 tx=0).stop 2024-05-09T05:56:34.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:34.981+0000 7f17b5271640 1 -- 172.21.15.72:0/2096800127 shutdown_connections 2024-05-09T05:56:34.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:34.981+0000 7f17b5271640 1 --2- 172.21.15.72:0/2096800127 >> v2:172.21.15.110:3300/0 conn(0x7f17b015dea0 0x7f17b00745b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:34.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:34.981+0000 7f17b5271640 1 --2- 172.21.15.72:0/2096800127 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17b015da90 0x7f17b00c7570 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:34.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:34.981+0000 7f17b5271640 1 -- 172.21.15.72:0/2096800127 >> 172.21.15.72:0/2096800127 conn(0x7f17b00cde90 msgr2=0x7f17b00ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:56:34.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:34.981+0000 7f17b5271640 1 -- 172.21.15.72:0/2096800127 shutdown_connections 2024-05-09T05:56:34.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:34.981+0000 7f17b5271640 1 -- 172.21.15.72:0/2096800127 wait complete. 2024-05-09T05:56:34.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:34.985+0000 7f17b5271640 1 Processor -- start 2024-05-09T05:56:34.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:34.985+0000 7f17b5271640 1 -- start start 2024-05-09T05:56:34.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:34.985+0000 7f17b5271640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17b0074af0 0x7f17b00727e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:34.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:34.985+0000 7f17b5271640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17b015da90 0x7f17b014b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:34.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:34.985+0000 7f17b5271640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f17b015dea0 0x7f17b0142120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:34.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:34.985+0000 7f17b5271640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f17b00c81b0 con 0x7f17b015da90 2024-05-09T05:56:34.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:34.985+0000 7f17b5271640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f17b00c70e0 con 0x7f17b0074af0 2024-05-09T05:56:34.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:34.985+0000 7f17b5271640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f17b0154ab0 con 0x7f17b015dea0 2024-05-09T05:56:34.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:34.985+0000 7f17ae7fc640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17b015da90 0x7f17b014b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:34.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:34.985+0000 7f17ae7fc640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17b015da90 0x7f17b014b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32948/0 (socket says 172.21.15.72:32948) 2024-05-09T05:56:34.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:34.985+0000 7f17ae7fc640 1 -- 172.21.15.72:0/2590599206 learned_addr learned my addr 172.21.15.72:0/2590599206 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:56:34.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:34.985+0000 7f17aeffd640 1 --2- 172.21.15.72:0/2590599206 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17b0074af0 0x7f17b00727e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:34.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:34.985+0000 7f17af7fe640 1 --2- 172.21.15.72:0/2590599206 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f17b015dea0 0x7f17b0142120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:34.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:34.985+0000 7f17ae7fc640 1 -- 172.21.15.72:0/2590599206 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f17b015dea0 msgr2=0x7f17b0142120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:34.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:34.985+0000 7f17ae7fc640 1 --2- 172.21.15.72:0/2590599206 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f17b015dea0 0x7f17b0142120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:34.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:34.985+0000 7f17ae7fc640 1 -- 172.21.15.72:0/2590599206 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17b0074af0 msgr2=0x7f17b00727e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:34.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:34.985+0000 7f17ae7fc640 1 --2- 172.21.15.72:0/2590599206 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17b0074af0 0x7f17b00727e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:34.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:34.985+0000 7f17ae7fc640 1 -- 172.21.15.72:0/2590599206 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17b0074300 con 0x7f17b015da90 2024-05-09T05:56:34.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:34.985+0000 7f17ae7fc640 1 --2- 172.21.15.72:0/2590599206 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17b015da90 0x7f17b014b620 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f17a000d5d0 tx=0x7f17a000da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:56:34.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:34.985+0000 7f17977fe640 1 -- 172.21.15.72:0/2590599206 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a00125f0 con 0x7f17b015da90 2024-05-09T05:56:34.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:34.985+0000 7f17977fe640 1 -- 172.21.15.72:0/2590599206 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17a0019070 con 0x7f17b015da90 2024-05-09T05:56:34.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:34.985+0000 7f17b5271640 1 -- 172.21.15.72:0/2590599206 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17b0074020 con 0x7f17b015da90 2024-05-09T05:56:34.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:34.985+0000 7f17977fe640 1 -- 172.21.15.72:0/2590599206 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a00129b0 con 0x7f17b015da90 2024-05-09T05:56:34.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:34.985+0000 7f17b5271640 1 -- 172.21.15.72:0/2590599206 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17b0143750 con 0x7f17b015da90 2024-05-09T05:56:34.976 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:34.989+0000 7f17b5271640 1 -- 172.21.15.72:0/2590599206 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17b0142a10 con 0x7f17b015da90 2024-05-09T05:56:34.976 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:34.989+0000 7f17977fe640 1 -- 172.21.15.72:0/2590599206 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f17a0012b50 con 0x7f17b015da90 2024-05-09T05:56:34.976 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:34.989+0000 7f17977fe640 1 --2- 172.21.15.72:0/2590599206 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f179c06f400 0x7f179c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:34.976 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:34.989+0000 7f17977fe640 1 -- 172.21.15.72:0/2590599206 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6676+0+0 (secure 0 0 0) 0x7f17a008fab0 con 0x7f17b015da90 2024-05-09T05:56:34.976 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:34.989+0000 7f17aeffd640 1 --2- 172.21.15.72:0/2590599206 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f179c06f400 0x7f179c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:34.976 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:34.989+0000 7f17aeffd640 1 --2- 172.21.15.72:0/2590599206 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f179c06f400 0x7f179c071910 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f17a40ad000 tx=0x7f17a4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:56:34.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:34.993+0000 7f17977fe640 1 -- 172.21.15.72:0/2590599206 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f17a005c5d0 con 0x7f17b015da90 2024-05-09T05:56:35.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:35.177+0000 7f17b5271640 1 -- 172.21.15.72:0/2590599206 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f17b006a520 con 0x7f17b015da90 2024-05-09T05:56:35.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:35.177+0000 7f17977fe640 1 -- 172.21.15.72:0/2590599206 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+6917 (secure 0 0 0) 0x7f17a005bed0 con 0x7f17b015da90 2024-05-09T05:56:35.166 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:56:35.166 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5007,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/1972750715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":1972750715},{"type":"v1","addr":"172.21.15.72:6835","nonce":1972750715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:53:23.494975+0000","modified":"2024-05-09T05:55:35.580442+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4297,"mds_1":4287,"mds_2":4263,"mds_3":4259,"mds_4":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"e","rank":4,"incarnation":20,"state":"up:active","state_seq":38,"addr":"172.21.15.72:6834/1142956298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1142956298},{"type":"v1","addr":"172.21.15.72:6834","nonce":1142956298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4259":{"gid":4259,"name":"f","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.110:6838/840351907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":840351907},{"type":"v1","addr":"172.21.15.110:6838","nonce":840351907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4263":{"gid":4263,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.72:6837/1048256382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":1048256382},{"type":"v1","addr":"172.21.15.72:6837","nonce":1048256382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.110:6839/966325499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6837","nonce":966325499},{"type":"v1","addr":"172.21.15.110:6839","nonce":966325499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6836/4134424941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":4134424941},{"type":"v1","addr":"172.21.15.110:6836","nonce":4134424941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4297,4287,4263,4259,4254]},"id":1}]} 2024-05-09T05:56:35.166 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 25 2024-05-09T05:56:35.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:35.181+0000 7f17b5271640 1 -- 172.21.15.72:0/2590599206 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f179c06f400 msgr2=0x7f179c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:35.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:35.181+0000 7f17b5271640 1 --2- 172.21.15.72:0/2590599206 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f179c06f400 0x7f179c071910 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f17a40ad000 tx=0x7f17a4008040 comp rx=0 tx=0).stop 2024-05-09T05:56:35.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:35.181+0000 7f17b5271640 1 -- 172.21.15.72:0/2590599206 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17b015da90 msgr2=0x7f17b014b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:35.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:35.181+0000 7f17b5271640 1 --2- 172.21.15.72:0/2590599206 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17b015da90 0x7f17b014b620 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f17a000d5d0 tx=0x7f17a000da90 comp rx=0 tx=0).stop 2024-05-09T05:56:35.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:35.181+0000 7f17b5271640 1 -- 172.21.15.72:0/2590599206 shutdown_connections 2024-05-09T05:56:35.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:35.181+0000 7f17b5271640 1 --2- 172.21.15.72:0/2590599206 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f179c06f400 0x7f179c071910 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:35.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:35.181+0000 7f17b5271640 1 --2- 172.21.15.72:0/2590599206 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f17b015dea0 0x7f17b0142120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:35.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:35.181+0000 7f17b5271640 1 --2- 172.21.15.72:0/2590599206 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17b015da90 0x7f17b014b620 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:35.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:35.181+0000 7f17b5271640 1 --2- 172.21.15.72:0/2590599206 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17b0074af0 0x7f17b00727e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:35.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:35.181+0000 7f17b5271640 1 -- 172.21.15.72:0/2590599206 >> 172.21.15.72:0/2590599206 conn(0x7f17b00cde90 msgr2=0x7f17b006f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:56:35.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:35.181+0000 7f17b5271640 1 -- 172.21.15.72:0/2590599206 shutdown_connections 2024-05-09T05:56:35.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:35.181+0000 7f17b5271640 1 -- 172.21.15.72:0/2590599206 wait complete. 2024-05-09T05:56:35.186 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is laggy/crashed, in failed state, or mds.e is removed from mdsmap 2024-05-09T05:56:37.041 INFO:tasks.workunit.client.0.smithi072.stdout: 2024-05-09T05:56:37.041 INFO:tasks.workunit.client.0.smithi072.stdout: Children see throughput for 1 re-readers = 5274842.50 kB/sec 2024-05-09T05:56:37.041 INFO:tasks.workunit.client.0.smithi072.stdout: Parent sees throughput for 1 re-readers = 5259689.94 kB/sec 2024-05-09T05:56:37.041 INFO:tasks.workunit.client.0.smithi072.stdout: Min throughput per process = 5274842.50 kB/sec 2024-05-09T05:56:37.041 INFO:tasks.workunit.client.0.smithi072.stdout: Max throughput per process = 5274842.50 kB/sec 2024-05-09T05:56:37.041 INFO:tasks.workunit.client.0.smithi072.stdout: Avg throughput per process = 5274842.50 kB/sec 2024-05-09T05:56:37.041 INFO:tasks.workunit.client.0.smithi072.stdout: Min xfer = 1048576.00 kB 2024-05-09T05:56:37.187 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:56:37.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.357+0000 7fe8e91ef640 1 Processor -- start 2024-05-09T05:56:37.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.357+0000 7fe8e91ef640 1 -- start start 2024-05-09T05:56:37.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.357+0000 7fe8e91ef640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe8e40750e0 0x7fe8e4072b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:37.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.357+0000 7fe8e91ef640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe8e4068820 0x7fe8e415c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:37.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.357+0000 7fe8e91ef640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8e415ce00 0x7fe8e415d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:37.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.357+0000 7fe8e91ef640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fe8e40754f0 con 0x7fe8e4068820 2024-05-09T05:56:37.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.357+0000 7fe8e91ef640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fe8e406e4e0 con 0x7fe8e40750e0 2024-05-09T05:56:37.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.357+0000 7fe8e91ef640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fe8e415d750 con 0x7fe8e415ce00 2024-05-09T05:56:37.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.357+0000 7fe8e259c640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe8e4068820 0x7fe8e415c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:37.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.357+0000 7fe8e259c640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe8e4068820 0x7fe8e415c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32956/0 (socket says 172.21.15.72:32956) 2024-05-09T05:56:37.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.357+0000 7fe8e259c640 1 -- 172.21.15.72:0/616426521 learned_addr learned my addr 172.21.15.72:0/616426521 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:56:37.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.357+0000 7fe8e2d9d640 1 --2- 172.21.15.72:0/616426521 >> v2:172.21.15.110:3300/0 conn(0x7fe8e40750e0 0x7fe8e4072b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:37.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.357+0000 7fe8e359e640 1 --2- 172.21.15.72:0/616426521 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8e415ce00 0x7fe8e415d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:37.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.357+0000 7fe8e259c640 1 -- 172.21.15.72:0/616426521 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8e415ce00 msgr2=0x7fe8e415d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:56:37.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.357+0000 7fe8e259c640 1 --2- 172.21.15.72:0/616426521 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8e415ce00 0x7fe8e415d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:37.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.357+0000 7fe8e259c640 1 -- 172.21.15.72:0/616426521 >> v2:172.21.15.110:3300/0 conn(0x7fe8e40750e0 msgr2=0x7fe8e4072b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:56:37.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.357+0000 7fe8e259c640 1 --2- 172.21.15.72:0/616426521 >> v2:172.21.15.110:3300/0 conn(0x7fe8e40750e0 0x7fe8e4072b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:37.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.357+0000 7fe8e259c640 1 -- 172.21.15.72:0/616426521 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8e406e200 con 0x7fe8e4068820 2024-05-09T05:56:37.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.357+0000 7fe8e359e640 1 --2- 172.21.15.72:0/616426521 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8e415ce00 0x7fe8e415d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:56:37.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.361+0000 7fe8e259c640 1 --2- 172.21.15.72:0/616426521 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8e4068820 0x7fe8e415c8c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe8e40cda60 tx=0x7fe8d801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92b36ae33791b249 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:56:37.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.361+0000 7fe8e1d9b640 1 -- 172.21.15.72:0/616426521 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d80ab5f0 con 0x7fe8e4068820 2024-05-09T05:56:37.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.361+0000 7fe8e1d9b640 1 -- 172.21.15.72:0/616426521 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8d80b0070 con 0x7fe8e4068820 2024-05-09T05:56:37.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.361+0000 7fe8e1d9b640 1 -- 172.21.15.72:0/616426521 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d80ab9b0 con 0x7fe8e4068820 2024-05-09T05:56:37.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.361+0000 7fe8e91ef640 1 -- 172.21.15.72:0/616426521 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8e4068820 msgr2=0x7fe8e415c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:37.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.361+0000 7fe8e91ef640 1 --2- 172.21.15.72:0/616426521 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8e4068820 0x7fe8e415c8c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe8e40cda60 tx=0x7fe8d801c520 comp rx=0 tx=0).stop 2024-05-09T05:56:37.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.361+0000 7fe8e91ef640 1 -- 172.21.15.72:0/616426521 shutdown_connections 2024-05-09T05:56:37.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.361+0000 7fe8e91ef640 1 --2- 172.21.15.72:0/616426521 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8e415ce00 0x7fe8e415d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:37.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.361+0000 7fe8e91ef640 1 --2- 172.21.15.72:0/616426521 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8e4068820 0x7fe8e415c8c0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:37.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.361+0000 7fe8e91ef640 1 --2- 172.21.15.72:0/616426521 >> v2:172.21.15.110:3300/0 conn(0x7fe8e40750e0 0x7fe8e4072b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:37.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.361+0000 7fe8e91ef640 1 -- 172.21.15.72:0/616426521 >> 172.21.15.72:0/616426521 conn(0x7fe8e40cbe10 msgr2=0x7fe8e40cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:56:37.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.361+0000 7fe8e91ef640 1 -- 172.21.15.72:0/616426521 shutdown_connections 2024-05-09T05:56:37.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.361+0000 7fe8e91ef640 1 -- 172.21.15.72:0/616426521 wait complete. 2024-05-09T05:56:37.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.365+0000 7fe8e91ef640 1 Processor -- start 2024-05-09T05:56:37.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.365+0000 7fe8e91ef640 1 -- start start 2024-05-09T05:56:37.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.365+0000 7fe8e91ef640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8e4068820 0x7fe8e4161960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:37.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.365+0000 7fe8e91ef640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8e40750e0 0x7fe8e4158280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:37.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.365+0000 7fe8e91ef640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8e415ce00 0x7fe8e40c6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:37.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.365+0000 7fe8e91ef640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e406d1c0 con 0x7fe8e40750e0 2024-05-09T05:56:37.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.365+0000 7fe8e91ef640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e4068c30 con 0x7fe8e415ce00 2024-05-09T05:56:37.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.365+0000 7fe8e91ef640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fe8e41606c0 con 0x7fe8e4068820 2024-05-09T05:56:37.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.365+0000 7fe8e259c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8e40750e0 0x7fe8e4158280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:37.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.365+0000 7fe8e259c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8e40750e0 0x7fe8e4158280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32970/0 (socket says 172.21.15.72:32970) 2024-05-09T05:56:37.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.365+0000 7fe8e259c640 1 -- 172.21.15.72:0/3121829613 learned_addr learned my addr 172.21.15.72:0/3121829613 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:56:37.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.365+0000 7fe8e359e640 1 --2- 172.21.15.72:0/3121829613 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8e415ce00 0x7fe8e40c6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:37.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.365+0000 7fe8e2d9d640 1 --2- 172.21.15.72:0/3121829613 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8e4068820 0x7fe8e4161960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:37.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.365+0000 7fe8e259c640 1 -- 172.21.15.72:0/3121829613 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8e4068820 msgr2=0x7fe8e4161960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:37.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.365+0000 7fe8e259c640 1 --2- 172.21.15.72:0/3121829613 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8e4068820 0x7fe8e4161960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:37.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.365+0000 7fe8e259c640 1 -- 172.21.15.72:0/3121829613 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8e415ce00 msgr2=0x7fe8e40c6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:37.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.365+0000 7fe8e259c640 1 --2- 172.21.15.72:0/3121829613 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8e415ce00 0x7fe8e40c6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:37.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.365+0000 7fe8e259c640 1 -- 172.21.15.72:0/3121829613 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8e41587c0 con 0x7fe8e40750e0 2024-05-09T05:56:37.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.365+0000 7fe8e259c640 1 --2- 172.21.15.72:0/3121829613 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8e40750e0 0x7fe8e4158280 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe8d801abd0 tx=0x7fe8d801ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:56:37.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.365+0000 7fe8cb7fe640 1 -- 172.21.15.72:0/3121829613 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d80be5f0 con 0x7fe8e40750e0 2024-05-09T05:56:37.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.365+0000 7fe8cb7fe640 1 -- 172.21.15.72:0/3121829613 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8d80be790 con 0x7fe8e40750e0 2024-05-09T05:56:37.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.365+0000 7fe8e91ef640 1 -- 172.21.15.72:0/3121829613 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8e41f9f60 con 0x7fe8e40750e0 2024-05-09T05:56:37.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.365+0000 7fe8cb7fe640 1 -- 172.21.15.72:0/3121829613 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d80beb80 con 0x7fe8e40750e0 2024-05-09T05:56:37.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.365+0000 7fe8e91ef640 1 -- 172.21.15.72:0/3121829613 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8e41589d0 con 0x7fe8e40750e0 2024-05-09T05:56:37.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.369+0000 7fe8e91ef640 1 -- 172.21.15.72:0/3121829613 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8e4157440 con 0x7fe8e40750e0 2024-05-09T05:56:37.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.369+0000 7fe8cb7fe640 1 -- 172.21.15.72:0/3121829613 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe8d80b43f0 con 0x7fe8e40750e0 2024-05-09T05:56:37.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.369+0000 7fe8cb7fe640 1 --2- 172.21.15.72:0/3121829613 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fe8d006f400 0x7fe8d0071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:37.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.369+0000 7fe8cb7fe640 1 -- 172.21.15.72:0/3121829613 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6676+0+0 (secure 0 0 0) 0x7fe8d8129ed0 con 0x7fe8e40750e0 2024-05-09T05:56:37.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.369+0000 7fe8e2d9d640 1 --2- 172.21.15.72:0/3121829613 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fe8d006f400 0x7fe8d0071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:37.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.369+0000 7fe8e2d9d640 1 --2- 172.21.15.72:0/3121829613 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fe8d006f400 0x7fe8d0071910 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe8d40045f0 tx=0x7fe8d4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:56:37.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.373+0000 7fe8cb7fe640 1 -- 172.21.15.72:0/3121829613 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fe8d80c4060 con 0x7fe8e40750e0 2024-05-09T05:56:37.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.569+0000 7fe8e91ef640 1 -- 172.21.15.72:0/3121829613 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe8e406a520 con 0x7fe8e40750e0 2024-05-09T05:56:37.559 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.573+0000 7fe8cb7fe640 1 -- 172.21.15.72:0/3121829613 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+6917 (secure 0 0 0) 0x7fe8d8016110 con 0x7fe8e40750e0 2024-05-09T05:56:37.559 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:56:37.559 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5007,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/1972750715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":1972750715},{"type":"v1","addr":"172.21.15.72:6835","nonce":1972750715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:53:23.494975+0000","modified":"2024-05-09T05:55:35.580442+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4297,"mds_1":4287,"mds_2":4263,"mds_3":4259,"mds_4":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"e","rank":4,"incarnation":20,"state":"up:active","state_seq":38,"addr":"172.21.15.72:6834/1142956298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1142956298},{"type":"v1","addr":"172.21.15.72:6834","nonce":1142956298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4259":{"gid":4259,"name":"f","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.110:6838/840351907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":840351907},{"type":"v1","addr":"172.21.15.110:6838","nonce":840351907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4263":{"gid":4263,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.72:6837/1048256382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":1048256382},{"type":"v1","addr":"172.21.15.72:6837","nonce":1048256382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.110:6839/966325499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6837","nonce":966325499},{"type":"v1","addr":"172.21.15.110:6839","nonce":966325499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6836/4134424941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":4134424941},{"type":"v1","addr":"172.21.15.110:6836","nonce":4134424941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4297,4287,4263,4259,4254]},"id":1}]} 2024-05-09T05:56:37.560 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 25 2024-05-09T05:56:37.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.573+0000 7fe8e91ef640 1 -- 172.21.15.72:0/3121829613 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fe8d006f400 msgr2=0x7fe8d0071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:37.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.573+0000 7fe8e91ef640 1 --2- 172.21.15.72:0/3121829613 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fe8d006f400 0x7fe8d0071910 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe8d40045f0 tx=0x7fe8d4008040 comp rx=0 tx=0).stop 2024-05-09T05:56:37.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.573+0000 7fe8e91ef640 1 -- 172.21.15.72:0/3121829613 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8e40750e0 msgr2=0x7fe8e4158280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:37.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.573+0000 7fe8e91ef640 1 --2- 172.21.15.72:0/3121829613 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8e40750e0 0x7fe8e4158280 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe8d801abd0 tx=0x7fe8d801ad60 comp rx=0 tx=0).stop 2024-05-09T05:56:37.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.573+0000 7fe8e91ef640 1 -- 172.21.15.72:0/3121829613 shutdown_connections 2024-05-09T05:56:37.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.573+0000 7fe8e91ef640 1 --2- 172.21.15.72:0/3121829613 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fe8d006f400 0x7fe8d0071910 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:37.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.573+0000 7fe8e91ef640 1 --2- 172.21.15.72:0/3121829613 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8e415ce00 0x7fe8e40c6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:37.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.573+0000 7fe8e91ef640 1 --2- 172.21.15.72:0/3121829613 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8e40750e0 0x7fe8e4158280 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:37.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.573+0000 7fe8e91ef640 1 --2- 172.21.15.72:0/3121829613 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8e4068820 0x7fe8e4161960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:37.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.573+0000 7fe8e91ef640 1 -- 172.21.15.72:0/3121829613 >> 172.21.15.72:0/3121829613 conn(0x7fe8e40cbe10 msgr2=0x7fe8e41564b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:56:37.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.573+0000 7fe8e91ef640 1 -- 172.21.15.72:0/3121829613 shutdown_connections 2024-05-09T05:56:37.563 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:37.573+0000 7fe8e91ef640 1 -- 172.21.15.72:0/3121829613 wait complete. 2024-05-09T05:56:37.581 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is laggy/crashed, in failed state, or mds.e is removed from mdsmap 2024-05-09T05:56:39.582 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:56:39.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.753+0000 7f50c72e9640 1 Processor -- start 2024-05-09T05:56:39.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.753+0000 7f50c72e9640 1 -- start start 2024-05-09T05:56:39.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.753+0000 7f50c72e9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50c0156b50 0x7f50c0073ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:39.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.753+0000 7f50c72e9640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f50c0074410 0x7f50c00cc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:39.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.753+0000 7f50c72e9640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50c00cda30 con 0x7f50c00cca30 2024-05-09T05:56:39.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.753+0000 7f50c72e9640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f50c00cc020 con 0x7f50c0074410 2024-05-09T05:56:39.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.753+0000 7f50c72e9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f50c015dfe0 con 0x7f50c0156b50 2024-05-09T05:56:39.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.753+0000 7f50c5085640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50c0156b50 0x7f50c0073ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:39.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.753+0000 7f50c5886640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f50c00cca30 0x7f50c00cce40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.72:45428/0 (socket says 172.21.15.72:45428) 2024-05-09T05:56:39.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.753+0000 7f50c5886640 1 -- 172.21.15.72:0/1824001308 learned_addr learned my addr 172.21.15.72:0/1824001308 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:56:39.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.753+0000 7f50c4884640 1 --2- 172.21.15.72:0/1824001308 >> v2:172.21.15.110:3300/0 conn(0x7f50c0074410 0x7f50c00cc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:39.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.753+0000 7f50b7fff640 1 -- 172.21.15.72:0/1824001308 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2439352232 0 0) 0x7f50b80014a0 con 0x7f50c00cca30 2024-05-09T05:56:39.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.753+0000 7f50b7fff640 1 -- 172.21.15.72:0/1824001308 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50ac003530 con 0x7f50c00cca30 2024-05-09T05:56:39.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.753+0000 7f50c5085640 1 -- 172.21.15.72:0/1824001308 >> v2:172.21.15.110:3300/0 conn(0x7f50c0074410 msgr2=0x7f50c00cc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:56:39.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.753+0000 7f50c5085640 1 --2- 172.21.15.72:0/1824001308 >> v2:172.21.15.110:3300/0 conn(0x7f50c0074410 0x7f50c00cc4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:39.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.757+0000 7f50c5085640 1 -- 172.21.15.72:0/1824001308 >> v1:172.21.15.110:6789/0 conn(0x7f50c00cca30 legacy=0x7f50c00cce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:39.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.757+0000 7f50c5085640 1 -- 172.21.15.72:0/1824001308 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50c015cdd0 con 0x7f50c0156b50 2024-05-09T05:56:39.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.757+0000 7f50c5085640 1 --2- 172.21.15.72:0/1824001308 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50c0156b50 0x7f50c0073ed0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f50b00097c0 tx=0x7f50b001c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f2460591dd30e90 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:56:39.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.757+0000 7f50b7fff640 1 -- 172.21.15.72:0/1824001308 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b00b0070 con 0x7f50c0156b50 2024-05-09T05:56:39.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.757+0000 7f50b7fff640 1 -- 172.21.15.72:0/1824001308 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50b00ab600 con 0x7f50c0156b50 2024-05-09T05:56:39.746 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.757+0000 7f50b7fff640 1 -- 172.21.15.72:0/1824001308 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b00ab9b0 con 0x7f50c0156b50 2024-05-09T05:56:39.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.761+0000 7f50c72e9640 1 -- 172.21.15.72:0/1824001308 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50c0156b50 msgr2=0x7f50c0073ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:39.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.761+0000 7f50c72e9640 1 --2- 172.21.15.72:0/1824001308 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50c0156b50 0x7f50c0073ed0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f50b00097c0 tx=0x7f50b001c4a0 comp rx=0 tx=0).stop 2024-05-09T05:56:39.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.761+0000 7f50c72e9640 1 -- 172.21.15.72:0/1824001308 shutdown_connections 2024-05-09T05:56:39.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.761+0000 7f50c72e9640 1 --2- 172.21.15.72:0/1824001308 >> v2:172.21.15.110:3300/0 conn(0x7f50c0074410 0x7f50c00cc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:39.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.761+0000 7f50c72e9640 1 --2- 172.21.15.72:0/1824001308 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50c0156b50 0x7f50c0073ed0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:39.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.761+0000 7f50c72e9640 1 -- 172.21.15.72:0/1824001308 >> 172.21.15.72:0/1824001308 conn(0x7f50c00d1b70 msgr2=0x7f50c00d1f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:56:39.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.761+0000 7f50c72e9640 1 -- 172.21.15.72:0/1824001308 shutdown_connections 2024-05-09T05:56:39.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.761+0000 7f50c72e9640 1 -- 172.21.15.72:0/1824001308 wait complete. 2024-05-09T05:56:39.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.761+0000 7f50c72e9640 1 Processor -- start 2024-05-09T05:56:39.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.761+0000 7f50c72e9640 1 -- start start 2024-05-09T05:56:39.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.761+0000 7f50c72e9640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50c0074410 0x7f50c01f61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:39.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.765+0000 7f50c72e9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50c00cca30 0x7f50c00ca750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:39.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.765+0000 7f50c72e9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50c0156b50 0x7f50c00c6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:39.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.765+0000 7f50c72e9640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f50c0074cf0 con 0x7f50c0074410 2024-05-09T05:56:39.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.765+0000 7f50c72e9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f50c015d950 con 0x7f50c00cca30 2024-05-09T05:56:39.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.765+0000 7f50c72e9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f50c00cd550 con 0x7f50c0156b50 2024-05-09T05:56:39.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.765+0000 7f50c5085640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50c0074410 0x7f50c01f61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:39.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.765+0000 7f50c5085640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50c0074410 0x7f50c01f61b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32980/0 (socket says 172.21.15.72:32980) 2024-05-09T05:56:39.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.765+0000 7f50c5085640 1 -- 172.21.15.72:0/558123948 learned_addr learned my addr 172.21.15.72:0/558123948 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:56:39.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.765+0000 7f50c5886640 1 --2- 172.21.15.72:0/558123948 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50c0156b50 0x7f50c00c6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:39.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.765+0000 7f50c4884640 1 --2- 172.21.15.72:0/558123948 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50c00cca30 0x7f50c00ca750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:39.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.765+0000 7f50c5085640 1 -- 172.21.15.72:0/558123948 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50c0156b50 msgr2=0x7f50c00c6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:39.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.765+0000 7f50c5085640 1 --2- 172.21.15.72:0/558123948 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50c0156b50 0x7f50c00c6c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:39.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.765+0000 7f50c5085640 1 -- 172.21.15.72:0/558123948 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50c00cca30 msgr2=0x7f50c00ca750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:39.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.765+0000 7f50c5085640 1 --2- 172.21.15.72:0/558123948 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50c00cca30 0x7f50c00ca750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:39.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.765+0000 7f50c5085640 1 -- 172.21.15.72:0/558123948 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50c01f66f0 con 0x7f50c0074410 2024-05-09T05:56:39.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.765+0000 7f50c5085640 1 --2- 172.21.15.72:0/558123948 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50c0074410 0x7f50c01f61b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f50b00ae040 tx=0x7f50b001ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:56:39.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.765+0000 7f50b5ffb640 1 -- 172.21.15.72:0/558123948 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b00b0070 con 0x7f50c0074410 2024-05-09T05:56:39.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.765+0000 7f50b5ffb640 1 -- 172.21.15.72:0/558123948 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50b00ba070 con 0x7f50c0074410 2024-05-09T05:56:39.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.765+0000 7f50c72e9640 1 -- 172.21.15.72:0/558123948 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50c01f9750 con 0x7f50c0074410 2024-05-09T05:56:39.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.765+0000 7f50b5ffb640 1 -- 172.21.15.72:0/558123948 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b00abc00 con 0x7f50c0074410 2024-05-09T05:56:39.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.765+0000 7f50c72e9640 1 -- 172.21.15.72:0/558123948 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50c01f9d10 con 0x7f50c0074410 2024-05-09T05:56:39.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.765+0000 7f50c72e9640 1 -- 172.21.15.72:0/558123948 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50c006a520 con 0x7f50c0074410 2024-05-09T05:56:39.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.765+0000 7f50b5ffb640 1 -- 172.21.15.72:0/558123948 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f50b0003620 con 0x7f50c0074410 2024-05-09T05:56:39.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.765+0000 7f50b5ffb640 1 --2- 172.21.15.72:0/558123948 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f50a406f430 0x7f50a4071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:39.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.765+0000 7f50b5ffb640 1 -- 172.21.15.72:0/558123948 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6676+0+0 (secure 0 0 0) 0x7f50b0129440 con 0x7f50c0074410 2024-05-09T05:56:39.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.765+0000 7f50c4884640 1 --2- 172.21.15.72:0/558123948 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f50a406f430 0x7f50a4071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:39.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.769+0000 7f50c4884640 1 --2- 172.21.15.72:0/558123948 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f50a406f430 0x7f50a4071940 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f50c015a260 tx=0x7f50bc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:56:39.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.773+0000 7f50b5ffb640 1 -- 172.21.15.72:0/558123948 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f50b0016090 con 0x7f50c0074410 2024-05-09T05:56:39.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.961+0000 7f50c72e9640 1 -- 172.21.15.72:0/558123948 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f50c00c8a20 con 0x7f50c0074410 2024-05-09T05:56:39.950 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.965+0000 7f50b5ffb640 1 -- 172.21.15.72:0/558123948 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+6917 (secure 0 0 0) 0x7f50b00f5ff0 con 0x7f50c0074410 2024-05-09T05:56:39.950 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:56:39.951 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5007,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/1972750715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":1972750715},{"type":"v1","addr":"172.21.15.72:6835","nonce":1972750715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:53:23.494975+0000","modified":"2024-05-09T05:55:35.580442+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4297,"mds_1":4287,"mds_2":4263,"mds_3":4259,"mds_4":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"e","rank":4,"incarnation":20,"state":"up:active","state_seq":38,"addr":"172.21.15.72:6834/1142956298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1142956298},{"type":"v1","addr":"172.21.15.72:6834","nonce":1142956298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4259":{"gid":4259,"name":"f","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.110:6838/840351907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":840351907},{"type":"v1","addr":"172.21.15.110:6838","nonce":840351907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4263":{"gid":4263,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.72:6837/1048256382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":1048256382},{"type":"v1","addr":"172.21.15.72:6837","nonce":1048256382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.110:6839/966325499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6837","nonce":966325499},{"type":"v1","addr":"172.21.15.110:6839","nonce":966325499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6836/4134424941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":4134424941},{"type":"v1","addr":"172.21.15.110:6836","nonce":4134424941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4297,4287,4263,4259,4254]},"id":1}]} 2024-05-09T05:56:39.951 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 25 2024-05-09T05:56:39.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.965+0000 7f50c72e9640 1 -- 172.21.15.72:0/558123948 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f50a406f430 msgr2=0x7f50a4071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:39.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.965+0000 7f50c72e9640 1 --2- 172.21.15.72:0/558123948 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f50a406f430 0x7f50a4071940 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f50c015a260 tx=0x7f50bc008040 comp rx=0 tx=0).stop 2024-05-09T05:56:39.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.965+0000 7f50c72e9640 1 -- 172.21.15.72:0/558123948 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50c0074410 msgr2=0x7f50c01f61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:39.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.965+0000 7f50c72e9640 1 --2- 172.21.15.72:0/558123948 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50c0074410 0x7f50c01f61b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f50b00ae040 tx=0x7f50b001ace0 comp rx=0 tx=0).stop 2024-05-09T05:56:39.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.965+0000 7f50c72e9640 1 -- 172.21.15.72:0/558123948 shutdown_connections 2024-05-09T05:56:39.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.965+0000 7f50c72e9640 1 --2- 172.21.15.72:0/558123948 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f50a406f430 0x7f50a4071940 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:39.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.965+0000 7f50c72e9640 1 --2- 172.21.15.72:0/558123948 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50c0156b50 0x7f50c00c6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:39.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.965+0000 7f50c72e9640 1 --2- 172.21.15.72:0/558123948 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50c00cca30 0x7f50c00ca750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:39.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.965+0000 7f50c72e9640 1 --2- 172.21.15.72:0/558123948 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50c0074410 0x7f50c01f61b0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:39.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.965+0000 7f50c72e9640 1 -- 172.21.15.72:0/558123948 >> 172.21.15.72:0/558123948 conn(0x7f50c00d1b70 msgr2=0x7f50c00cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:56:39.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.965+0000 7f50c72e9640 1 -- 172.21.15.72:0/558123948 shutdown_connections 2024-05-09T05:56:39.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:39.965+0000 7f50c72e9640 1 -- 172.21.15.72:0/558123948 wait complete. 2024-05-09T05:56:39.971 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is laggy/crashed, in failed state, or mds.e is removed from mdsmap 2024-05-09T05:56:41.971 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:56:42.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.145+0000 7ffbe5d6a640 1 Processor -- start 2024-05-09T05:56:42.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.145+0000 7ffbe5d6a640 1 -- start start 2024-05-09T05:56:42.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.145+0000 7ffbe5d6a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffbe015e470 0x7ffbe015e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:42.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.145+0000 7ffbe5d6a640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbe00cda30 con 0x7ffbe015edc0 2024-05-09T05:56:42.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.145+0000 7ffbe5d6a640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbe015cdd0 con 0x7ffbe0156b50 2024-05-09T05:56:42.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.145+0000 7ffbe5d6a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7ffbe00cc020 con 0x7ffbe015e470 2024-05-09T05:56:42.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.145+0000 7ffbdffff640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ffbe015edc0 0x7ffbe015f1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:47868/0 (socket says 172.21.15.72:47868) 2024-05-09T05:56:42.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.145+0000 7ffbdffff640 1 -- 172.21.15.72:0/3281681990 learned_addr learned my addr 172.21.15.72:0/3281681990 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:56:42.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.145+0000 7ffbdeffd640 1 --2- 172.21.15.72:0/3281681990 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffbe015e470 0x7ffbe015e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:42.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.145+0000 7ffbde7fc640 1 -- 172.21.15.72:0/3281681990 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1572917439 0 0) 0x7ffbd0001120 con 0x7ffbe015edc0 2024-05-09T05:56:42.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.149+0000 7ffbde7fc640 1 -- 172.21.15.72:0/3281681990 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffbcc003530 con 0x7ffbe015edc0 2024-05-09T05:56:42.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.149+0000 7ffbde7fc640 1 -- 172.21.15.72:0/3281681990 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3707951660 0 0) 0x7ffbcc003530 con 0x7ffbe015edc0 2024-05-09T05:56:42.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.149+0000 7ffbde7fc640 1 -- 172.21.15.72:0/3281681990 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffbe015e470 msgr2=0x7ffbe015e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:56:42.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.149+0000 7ffbde7fc640 1 --2- 172.21.15.72:0/3281681990 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffbe015e470 0x7ffbe015e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:42.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.149+0000 7ffbde7fc640 1 -- 172.21.15.72:0/3281681990 >> v1:172.21.15.110:6789/0 conn(0x7ffbe0156b50 legacy=0x7ffbe0073ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:42.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.149+0000 7ffbde7fc640 1 -- 172.21.15.72:0/3281681990 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbe015d0b0 con 0x7ffbe015edc0 2024-05-09T05:56:42.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.149+0000 7ffbde7fc640 1 -- 172.21.15.72:0/3281681990 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2749052815 0 0) 0x7ffbd00018d0 con 0x7ffbe015edc0 2024-05-09T05:56:42.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.149+0000 7ffbde7fc640 1 -- 172.21.15.72:0/3281681990 >> v1:172.21.15.72:6789/0 conn(0x7ffbe015edc0 legacy=0x7ffbe015f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:42.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.149+0000 7ffbde7fc640 1 --2- 172.21.15.72:0/3281681990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffbcc003a40 0x7ffbcc003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:42.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.149+0000 7ffbde7fc640 1 --2- 172.21.15.72:0/3281681990 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffbcc004810 0x7ffbcc004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:42.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.149+0000 7ffbde7fc640 1 --2- 172.21.15.72:0/3281681990 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffbe015e470 0x7ffbcc0052e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:42.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.149+0000 7ffbde7fc640 1 -- 172.21.15.72:0/3281681990 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ffbe00cc020 con 0x7ffbcc003a40 2024-05-09T05:56:42.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.149+0000 7ffbde7fc640 1 -- 172.21.15.72:0/3281681990 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ffbcc00bb90 con 0x7ffbcc004810 2024-05-09T05:56:42.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.149+0000 7ffbde7fc640 1 -- 172.21.15.72:0/3281681990 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7ffbcc00bd90 con 0x7ffbe015e470 2024-05-09T05:56:42.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.149+0000 7ffbdf7fe640 1 --2- 172.21.15.72:0/3281681990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffbcc003a40 0x7ffbcc003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:42.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.149+0000 7ffbdeffd640 1 --2- 172.21.15.72:0/3281681990 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffbcc004810 0x7ffbcc004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:42.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.149+0000 7ffbdffff640 1 --2- 172.21.15.72:0/3281681990 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffbe015e470 0x7ffbcc0052e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:42.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.149+0000 7ffbdf7fe640 1 -- 172.21.15.72:0/3281681990 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffbe015e470 msgr2=0x7ffbcc0052e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:56:42.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.149+0000 7ffbdf7fe640 1 --2- 172.21.15.72:0/3281681990 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffbe015e470 0x7ffbcc0052e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:42.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.149+0000 7ffbdf7fe640 1 -- 172.21.15.72:0/3281681990 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffbcc004810 msgr2=0x7ffbcc004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:56:42.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.149+0000 7ffbdf7fe640 1 --2- 172.21.15.72:0/3281681990 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffbcc004810 0x7ffbcc004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:42.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.149+0000 7ffbdf7fe640 1 -- 172.21.15.72:0/3281681990 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbcc003530 con 0x7ffbcc003a40 2024-05-09T05:56:42.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.149+0000 7ffbdffff640 1 --2- 172.21.15.72:0/3281681990 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffbe015e470 0x7ffbcc0052e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:56:42.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.149+0000 7ffbdeffd640 1 --2- 172.21.15.72:0/3281681990 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffbcc004810 0x7ffbcc004c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:56:42.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.149+0000 7ffbdf7fe640 1 --2- 172.21.15.72:0/3281681990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffbcc003a40 0x7ffbcc003eb0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ffbd8001e90 tx=0x7ffbd801c770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c55faec18418e361 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:56:42.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.149+0000 7ffbde7fc640 1 -- 172.21.15.72:0/3281681990 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbd80af070 con 0x7ffbcc003a40 2024-05-09T05:56:42.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.149+0000 7ffbde7fc640 1 -- 172.21.15.72:0/3281681990 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbd80a6040 con 0x7ffbcc003a40 2024-05-09T05:56:42.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.149+0000 7ffbde7fc640 1 -- 172.21.15.72:0/3281681990 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbd8001ae0 con 0x7ffbcc003a40 2024-05-09T05:56:42.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.153+0000 7ffbe5d6a640 1 -- 172.21.15.72:0/3281681990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffbcc003a40 msgr2=0x7ffbcc003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:42.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.153+0000 7ffbe5d6a640 1 --2- 172.21.15.72:0/3281681990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffbcc003a40 0x7ffbcc003eb0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ffbd8001e90 tx=0x7ffbd801c770 comp rx=0 tx=0).stop 2024-05-09T05:56:42.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.153+0000 7ffbdffff640 1 -- 172.21.15.72:0/3281681990 reap_dead start 2024-05-09T05:56:42.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.153+0000 7ffbe5d6a640 1 -- 172.21.15.72:0/3281681990 shutdown_connections 2024-05-09T05:56:42.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.153+0000 7ffbe5d6a640 1 -- 172.21.15.72:0/3281681990 >> 172.21.15.72:0/3281681990 conn(0x7ffbe00d1b70 msgr2=0x7ffbe00d1f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:56:42.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.153+0000 7ffbe5d6a640 1 -- 172.21.15.72:0/3281681990 shutdown_connections 2024-05-09T05:56:42.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.153+0000 7ffbe5d6a640 1 -- 172.21.15.72:0/3281681990 wait complete. 2024-05-09T05:56:42.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.153+0000 7ffbe5d6a640 1 Processor -- start 2024-05-09T05:56:42.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.153+0000 7ffbe5d6a640 1 -- start start 2024-05-09T05:56:42.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.153+0000 7ffbe5d6a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffbcc003a40 0x7ffbe0155f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:42.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.153+0000 7ffbe5d6a640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffbe015afc0 0x7ffbe0153c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:42.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.153+0000 7ffbe5d6a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffbe0163c90 0x7ffbe0154150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:42.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.153+0000 7ffbe5d6a640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ffbe015d950 con 0x7ffbe015afc0 2024-05-09T05:56:42.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.153+0000 7ffbe5d6a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ffbe015dfe0 con 0x7ffbe0163c90 2024-05-09T05:56:42.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.153+0000 7ffbe5d6a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7ffbe015fcf0 con 0x7ffbcc003a40 2024-05-09T05:56:42.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.153+0000 7ffbdeffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffbe015afc0 0x7ffbe0153c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:42.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.153+0000 7ffbdeffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffbe015afc0 0x7ffbe0153c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35682/0 (socket says 172.21.15.72:35682) 2024-05-09T05:56:42.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.153+0000 7ffbdeffd640 1 -- 172.21.15.72:0/132087387 learned_addr learned my addr 172.21.15.72:0/132087387 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:56:42.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.153+0000 7ffbdffff640 1 --2- 172.21.15.72:0/132087387 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffbe0163c90 0x7ffbe0154150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:42.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.153+0000 7ffbdf7fe640 1 --2- 172.21.15.72:0/132087387 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffbcc003a40 0x7ffbe0155f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:42.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.153+0000 7ffbdeffd640 1 -- 172.21.15.72:0/132087387 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffbcc003a40 msgr2=0x7ffbe0155f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:42.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.153+0000 7ffbdeffd640 1 --2- 172.21.15.72:0/132087387 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffbcc003a40 0x7ffbe0155f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:42.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.153+0000 7ffbdeffd640 1 -- 172.21.15.72:0/132087387 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffbe0163c90 msgr2=0x7ffbe0154150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:42.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.153+0000 7ffbdeffd640 1 --2- 172.21.15.72:0/132087387 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffbe0163c90 0x7ffbe0154150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:42.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.153+0000 7ffbdeffd640 1 -- 172.21.15.72:0/132087387 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbe01f5e40 con 0x7ffbe015afc0 2024-05-09T05:56:42.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.153+0000 7ffbdffff640 1 --2- 172.21.15.72:0/132087387 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffbe0163c90 0x7ffbe0154150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:56:42.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.157+0000 7ffbdeffd640 1 --2- 172.21.15.72:0/132087387 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffbe015afc0 0x7ffbe0153c10 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ffbc80108d0 tx=0x7ffbc8010d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:56:42.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.157+0000 7ffbd7fff640 1 -- 172.21.15.72:0/132087387 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbc800f040 con 0x7ffbe015afc0 2024-05-09T05:56:42.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.157+0000 7ffbd7fff640 1 -- 172.21.15.72:0/132087387 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbc8004220 con 0x7ffbe015afc0 2024-05-09T05:56:42.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.157+0000 7ffbd7fff640 1 -- 172.21.15.72:0/132087387 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbc800e960 con 0x7ffbe015afc0 2024-05-09T05:56:42.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.157+0000 7ffbe5d6a640 1 -- 172.21.15.72:0/132087387 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbe00cd4e0 con 0x7ffbe015afc0 2024-05-09T05:56:42.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.157+0000 7ffbe5d6a640 1 -- 172.21.15.72:0/132087387 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbe01f63e0 con 0x7ffbe015afc0 2024-05-09T05:56:42.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.157+0000 7ffbe5d6a640 1 -- 172.21.15.72:0/132087387 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbe006a520 con 0x7ffbe015afc0 2024-05-09T05:56:42.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.157+0000 7ffbd7fff640 1 -- 172.21.15.72:0/132087387 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ffbc800eb00 con 0x7ffbe015afc0 2024-05-09T05:56:42.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.157+0000 7ffbd7fff640 1 --2- 172.21.15.72:0/132087387 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7ffbc006f400 0x7ffbc0071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:42.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.157+0000 7ffbd7fff640 1 -- 172.21.15.72:0/132087387 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6676+0+0 (secure 0 0 0) 0x7ffbc808fae0 con 0x7ffbe015afc0 2024-05-09T05:56:42.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.157+0000 7ffbdf7fe640 1 --2- 172.21.15.72:0/132087387 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7ffbc006f400 0x7ffbc0071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:42.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.157+0000 7ffbdf7fe640 1 --2- 172.21.15.72:0/132087387 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7ffbc006f400 0x7ffbc0071910 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ffbd80ac000 tx=0x7ffbd8001520 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:56:42.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.161+0000 7ffbd7fff640 1 -- 172.21.15.72:0/132087387 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7ffbc8018030 con 0x7ffbe015afc0 2024-05-09T05:56:42.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.357+0000 7ffbe5d6a640 1 -- 172.21.15.72:0/132087387 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffbe00cd270 con 0x7ffbe015afc0 2024-05-09T05:56:42.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.361+0000 7ffbd7fff640 1 -- 172.21.15.72:0/132087387 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+6917 (secure 0 0 0) 0x7ffbc805c6e0 con 0x7ffbe015afc0 2024-05-09T05:56:42.347 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:56:42.347 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5007,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/1972750715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":1972750715},{"type":"v1","addr":"172.21.15.72:6835","nonce":1972750715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:53:23.494975+0000","modified":"2024-05-09T05:55:35.580442+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4297,"mds_1":4287,"mds_2":4263,"mds_3":4259,"mds_4":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"e","rank":4,"incarnation":20,"state":"up:active","state_seq":38,"addr":"172.21.15.72:6834/1142956298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1142956298},{"type":"v1","addr":"172.21.15.72:6834","nonce":1142956298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4259":{"gid":4259,"name":"f","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.110:6838/840351907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":840351907},{"type":"v1","addr":"172.21.15.110:6838","nonce":840351907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4263":{"gid":4263,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.72:6837/1048256382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":1048256382},{"type":"v1","addr":"172.21.15.72:6837","nonce":1048256382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.110:6839/966325499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6837","nonce":966325499},{"type":"v1","addr":"172.21.15.110:6839","nonce":966325499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6836/4134424941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":4134424941},{"type":"v1","addr":"172.21.15.110:6836","nonce":4134424941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4297,4287,4263,4259,4254]},"id":1}]} 2024-05-09T05:56:42.347 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 25 2024-05-09T05:56:42.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.361+0000 7ffbe5d6a640 1 -- 172.21.15.72:0/132087387 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7ffbc006f400 msgr2=0x7ffbc0071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:42.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.361+0000 7ffbe5d6a640 1 --2- 172.21.15.72:0/132087387 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7ffbc006f400 0x7ffbc0071910 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ffbd80ac000 tx=0x7ffbd8001520 comp rx=0 tx=0).stop 2024-05-09T05:56:42.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.361+0000 7ffbe5d6a640 1 -- 172.21.15.72:0/132087387 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffbe015afc0 msgr2=0x7ffbe0153c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:42.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.361+0000 7ffbe5d6a640 1 --2- 172.21.15.72:0/132087387 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffbe015afc0 0x7ffbe0153c10 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ffbc80108d0 tx=0x7ffbc8010d90 comp rx=0 tx=0).stop 2024-05-09T05:56:42.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.361+0000 7ffbe5d6a640 1 -- 172.21.15.72:0/132087387 shutdown_connections 2024-05-09T05:56:42.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.361+0000 7ffbe5d6a640 1 --2- 172.21.15.72:0/132087387 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7ffbc006f400 0x7ffbc0071910 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:42.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.361+0000 7ffbe5d6a640 1 --2- 172.21.15.72:0/132087387 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffbe0163c90 0x7ffbe0154150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:42.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.361+0000 7ffbe5d6a640 1 --2- 172.21.15.72:0/132087387 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffbe015afc0 0x7ffbe0153c10 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:42.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.361+0000 7ffbe5d6a640 1 --2- 172.21.15.72:0/132087387 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffbcc003a40 0x7ffbe0155f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:42.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.361+0000 7ffbe5d6a640 1 -- 172.21.15.72:0/132087387 >> 172.21.15.72:0/132087387 conn(0x7ffbe00d1b70 msgr2=0x7ffbe00d0570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:56:42.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.361+0000 7ffbe5d6a640 1 -- 172.21.15.72:0/132087387 shutdown_connections 2024-05-09T05:56:42.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:42.361+0000 7ffbe5d6a640 1 -- 172.21.15.72:0/132087387 wait complete. 2024-05-09T05:56:42.370 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is laggy/crashed, in failed state, or mds.e is removed from mdsmap 2024-05-09T05:56:43.669 INFO:tasks.workunit.client.0.smithi072.stdout: 2024-05-09T05:56:43.669 INFO:tasks.workunit.client.0.smithi072.stdout: 2024-05-09T05:56:43.669 INFO:tasks.workunit.client.0.smithi072.stdout: 2024-05-09T05:56:43.669 INFO:tasks.workunit.client.0.smithi072.stdout:iozone test complete. 2024-05-09T05:56:43.671 INFO:tasks.workunit.client.0.smithi072.stderr:+ iozone -c -e -s 1024M -r 1M -t 1 -F f2 -i 0 -i 1 2024-05-09T05:56:43.748 INFO:tasks.workunit.client.0.smithi072.stdout: Iozone: Performance Test of File I/O 2024-05-09T05:56:43.749 INFO:tasks.workunit.client.0.smithi072.stdout: Version $Revision: 3.489 $ 2024-05-09T05:56:43.749 INFO:tasks.workunit.client.0.smithi072.stdout: Compiled for 64 bit mode. 2024-05-09T05:56:43.749 INFO:tasks.workunit.client.0.smithi072.stdout: Build: linux-AMD64 2024-05-09T05:56:43.749 INFO:tasks.workunit.client.0.smithi072.stdout: 2024-05-09T05:56:43.749 INFO:tasks.workunit.client.0.smithi072.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-05-09T05:56:43.749 INFO:tasks.workunit.client.0.smithi072.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-05-09T05:56:43.749 INFO:tasks.workunit.client.0.smithi072.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-05-09T05:56:43.749 INFO:tasks.workunit.client.0.smithi072.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-05-09T05:56:43.749 INFO:tasks.workunit.client.0.smithi072.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-05-09T05:56:43.749 INFO:tasks.workunit.client.0.smithi072.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-05-09T05:56:43.750 INFO:tasks.workunit.client.0.smithi072.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-05-09T05:56:43.750 INFO:tasks.workunit.client.0.smithi072.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-05-09T05:56:43.750 INFO:tasks.workunit.client.0.smithi072.stdout: Alexey Skidanov, Sudhir Kumar. 2024-05-09T05:56:43.750 INFO:tasks.workunit.client.0.smithi072.stdout: 2024-05-09T05:56:43.750 INFO:tasks.workunit.client.0.smithi072.stdout: Run began: Thu May 9 05:56:43 2024 2024-05-09T05:56:43.750 INFO:tasks.workunit.client.0.smithi072.stdout: 2024-05-09T05:56:43.750 INFO:tasks.workunit.client.0.smithi072.stdout: Include close in write timing 2024-05-09T05:56:43.750 INFO:tasks.workunit.client.0.smithi072.stdout: Include fsync in write timing 2024-05-09T05:56:43.750 INFO:tasks.workunit.client.0.smithi072.stdout: File size set to 1048576 kB 2024-05-09T05:56:43.750 INFO:tasks.workunit.client.0.smithi072.stdout: Record Size 1024 kB 2024-05-09T05:56:43.750 INFO:tasks.workunit.client.0.smithi072.stdout: Command line used: iozone -c -e -s 1024M -r 1M -t 1 -F f2 -i 0 -i 1 2024-05-09T05:56:43.751 INFO:tasks.workunit.client.0.smithi072.stdout: Output is in kBytes/sec 2024-05-09T05:56:43.751 INFO:tasks.workunit.client.0.smithi072.stdout: Time Resolution = 0.000001 seconds. 2024-05-09T05:56:43.751 INFO:tasks.workunit.client.0.smithi072.stdout: Processor cache size set to 1024 kBytes. 2024-05-09T05:56:43.751 INFO:tasks.workunit.client.0.smithi072.stdout: Processor cache line size set to 32 bytes. 2024-05-09T05:56:43.751 INFO:tasks.workunit.client.0.smithi072.stdout: File stride size set to 17 * record size. 2024-05-09T05:56:43.751 INFO:tasks.workunit.client.0.smithi072.stdout: Throughput test with 1 process 2024-05-09T05:56:43.751 INFO:tasks.workunit.client.0.smithi072.stdout: Each process writes a 1048576 kByte file in 1024 kByte records 2024-05-09T05:56:44.371 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:56:44.585 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:44.597+0000 7f3956845640 1 Processor -- start 2024-05-09T05:56:44.586 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:44.597+0000 7f3956845640 1 -- start start 2024-05-09T05:56:44.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:44.601+0000 7f3956845640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f395015b150 0x7f3950165e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:44.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:44.601+0000 7f3956845640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f395006f7b0 con 0x7f3950074260 2024-05-09T05:56:44.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:44.601+0000 7f3956845640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3950074670 con 0x7f39501549d0 2024-05-09T05:56:44.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:44.601+0000 7f3956845640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f395006f580 con 0x7f395015b150 2024-05-09T05:56:44.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:44.601+0000 7f3954de2640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f395015b150 0x7f3950165e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:44.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:44.601+0000 7f394f7fe640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f3950074260 0x7f395015aa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:47870/0 (socket says 172.21.15.72:47870) 2024-05-09T05:56:44.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:44.601+0000 7f394f7fe640 1 -- 172.21.15.72:0/1615485200 learned_addr learned my addr 172.21.15.72:0/1615485200 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:56:44.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:44.601+0000 7f3954de2640 1 -- 172.21.15.72:0/1615485200 >> v1:172.21.15.110:6789/0 conn(0x7f39501549d0 legacy=0x7f395006d7b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T05:56:44.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:44.601+0000 7f3954de2640 1 -- 172.21.15.72:0/1615485200 >> v1:172.21.15.72:6789/0 conn(0x7f3950074260 legacy=0x7f395015aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:44.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:44.601+0000 7f3954de2640 1 -- 172.21.15.72:0/1615485200 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f395006fa50 con 0x7f395015b150 2024-05-09T05:56:44.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:44.605+0000 7f3954de2640 1 --2- 172.21.15.72:0/1615485200 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f395015b150 0x7f3950165e60 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f3948009d90 tx=0x7f394801f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2ff18732743a538 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:56:44.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:44.605+0000 7f394effd640 1 -- 172.21.15.72:0/1615485200 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39480b4070 con 0x7f395015b150 2024-05-09T05:56:44.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:44.605+0000 7f394effd640 1 -- 172.21.15.72:0/1615485200 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39480af600 con 0x7f395015b150 2024-05-09T05:56:44.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:44.605+0000 7f394effd640 1 -- 172.21.15.72:0/1615485200 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39480af9d0 con 0x7f395015b150 2024-05-09T05:56:44.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:44.605+0000 7f3956845640 1 -- 172.21.15.72:0/1615485200 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f395015b150 msgr2=0x7f3950165e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:44.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:44.605+0000 7f3956845640 1 --2- 172.21.15.72:0/1615485200 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f395015b150 0x7f3950165e60 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f3948009d90 tx=0x7f394801f150 comp rx=0 tx=0).stop 2024-05-09T05:56:44.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:44.609+0000 7f3956845640 1 -- 172.21.15.72:0/1615485200 shutdown_connections 2024-05-09T05:56:44.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:44.609+0000 7f3956845640 1 --2- 172.21.15.72:0/1615485200 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f395015b150 0x7f3950165e60 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:44.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:44.609+0000 7f3956845640 1 -- 172.21.15.72:0/1615485200 >> 172.21.15.72:0/1615485200 conn(0x7f395006e9b0 msgr2=0x7f395006edc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:56:44.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:44.609+0000 7f3956845640 1 -- 172.21.15.72:0/1615485200 shutdown_connections 2024-05-09T05:56:44.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:44.609+0000 7f3956845640 1 -- 172.21.15.72:0/1615485200 wait complete. 2024-05-09T05:56:44.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:44.609+0000 7f3956845640 1 Processor -- start 2024-05-09T05:56:44.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:44.609+0000 7f3956845640 1 -- start start 2024-05-09T05:56:44.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:44.613+0000 7f3956845640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3950074260 0x7f39501551a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:44.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:44.613+0000 7f3956845640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f39501549d0 0x7f39501e3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:44.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:44.613+0000 7f3956845640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f395015b150 0x7f39501e4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:44.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:44.613+0000 7f3956845640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f39500ca2b0 con 0x7f395015b150 2024-05-09T05:56:44.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:44.613+0000 7f3956845640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f39500c9fd0 con 0x7f3950074260 2024-05-09T05:56:44.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:44.613+0000 7f3956845640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f395015a4d0 con 0x7f39501549d0 2024-05-09T05:56:44.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:44.613+0000 7f3954de2640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f395015b150 0x7f39501e4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:44.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:44.613+0000 7f3954de2640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f395015b150 0x7f39501e4c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35696/0 (socket says 172.21.15.72:35696) 2024-05-09T05:56:44.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:44.613+0000 7f3954de2640 1 -- 172.21.15.72:0/3775427525 learned_addr learned my addr 172.21.15.72:0/3775427525 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:56:44.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:44.613+0000 7f394ffff640 1 --2- 172.21.15.72:0/3775427525 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3950074260 0x7f39501551a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:44.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:44.613+0000 7f394f7fe640 1 --2- 172.21.15.72:0/3775427525 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f39501549d0 0x7f39501e3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:44.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:44.613+0000 7f3954de2640 1 -- 172.21.15.72:0/3775427525 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f39501549d0 msgr2=0x7f39501e3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:44.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:44.613+0000 7f3954de2640 1 --2- 172.21.15.72:0/3775427525 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f39501549d0 0x7f39501e3af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:44.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:44.613+0000 7f3954de2640 1 -- 172.21.15.72:0/3775427525 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3950074260 msgr2=0x7f39501551a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:44.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:44.613+0000 7f3954de2640 1 --2- 172.21.15.72:0/3775427525 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3950074260 0x7f39501551a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:44.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:44.613+0000 7f3954de2640 1 -- 172.21.15.72:0/3775427525 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39501556e0 con 0x7f395015b150 2024-05-09T05:56:44.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:44.613+0000 7f3954de2640 1 --2- 172.21.15.72:0/3775427525 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f395015b150 0x7f39501e4c90 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f39480b2040 tx=0x7f394801bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:56:44.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:44.613+0000 7f394cff9640 1 -- 172.21.15.72:0/3775427525 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39480b4040 con 0x7f395015b150 2024-05-09T05:56:44.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:44.613+0000 7f394cff9640 1 -- 172.21.15.72:0/3775427525 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39480c2070 con 0x7f395015b150 2024-05-09T05:56:44.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:44.613+0000 7f3956845640 1 -- 172.21.15.72:0/3775427525 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39501f1140 con 0x7f395015b150 2024-05-09T05:56:44.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:44.613+0000 7f394cff9640 1 -- 172.21.15.72:0/3775427525 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39480ba680 con 0x7f395015b150 2024-05-09T05:56:44.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:44.613+0000 7f3956845640 1 -- 172.21.15.72:0/3775427525 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39501f16e0 con 0x7f395015b150 2024-05-09T05:56:44.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:44.617+0000 7f394cff9640 1 -- 172.21.15.72:0/3775427525 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f39480ba820 con 0x7f395015b150 2024-05-09T05:56:44.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:44.617+0000 7f3956845640 1 -- 172.21.15.72:0/3775427525 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f395006a520 con 0x7f395015b150 2024-05-09T05:56:44.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:44.617+0000 7f394cff9640 1 --2- 172.21.15.72:0/3775427525 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f393c06f430 0x7f393c071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:44.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:44.617+0000 7f394cff9640 1 -- 172.21.15.72:0/3775427525 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6762+0+0 (secure 0 0 0) 0x7f394812d5c0 con 0x7f395015b150 2024-05-09T05:56:44.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:44.617+0000 7f394ffff640 1 --2- 172.21.15.72:0/3775427525 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f393c06f430 0x7f393c071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:44.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:44.617+0000 7f394ffff640 1 --2- 172.21.15.72:0/3775427525 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f393c06f430 0x7f393c071940 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3940006fd0 tx=0x7f3940009060 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:56:44.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:44.625+0000 7f394cff9640 1 -- 172.21.15.72:0/3775427525 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f39480cb020 con 0x7f395015b150 2024-05-09T05:56:44.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:44.957+0000 7f3956845640 1 -- 172.21.15.72:0/3775427525 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f39500c8240 con 0x7f395015b150 2024-05-09T05:56:44.946 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:44.957+0000 7f394cff9640 1 -- 172.21.15.72:0/3775427525 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+6087 (secure 0 0 0) 0x7f3948018cb0 con 0x7f395015b150 2024-05-09T05:56:44.946 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:56:44.947 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:53:23.494975+0000","modified":"2024-05-09T05:56:44.362020+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4297,"mds_1":4287,"mds_2":4263,"mds_3":4259,"mds_4":5007},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4259":{"gid":4259,"name":"f","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.110:6838/840351907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":840351907},{"type":"v1","addr":"172.21.15.110:6838","nonce":840351907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4263":{"gid":4263,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.72:6837/1048256382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":1048256382},{"type":"v1","addr":"172.21.15.72:6837","nonce":1048256382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.110:6839/966325499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6837","nonce":966325499},{"type":"v1","addr":"172.21.15.110:6839","nonce":966325499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6836/4134424941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":4134424941},{"type":"v1","addr":"172.21.15.110:6836","nonce":4134424941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5007":{"gid":5007,"name":"a","rank":4,"incarnation":26,"state":"up:replay","state_seq":1,"addr":"172.21.15.72:6835/1972750715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":1972750715},{"type":"v1","addr":"172.21.15.72:6835","nonce":1972750715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4259,4263,4287,4297]},"id":1}]} 2024-05-09T05:56:44.947 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 26 2024-05-09T05:56:44.950 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:44.961+0000 7f3956845640 1 -- 172.21.15.72:0/3775427525 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f393c06f430 msgr2=0x7f393c071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:44.950 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:44.961+0000 7f3956845640 1 --2- 172.21.15.72:0/3775427525 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f393c06f430 0x7f393c071940 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3940006fd0 tx=0x7f3940009060 comp rx=0 tx=0).stop 2024-05-09T05:56:44.950 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:44.961+0000 7f3956845640 1 -- 172.21.15.72:0/3775427525 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f395015b150 msgr2=0x7f39501e4c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:44.950 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:44.961+0000 7f3956845640 1 --2- 172.21.15.72:0/3775427525 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f395015b150 0x7f39501e4c90 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f39480b2040 tx=0x7f394801bef0 comp rx=0 tx=0).stop 2024-05-09T05:56:44.950 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:44.961+0000 7f3956845640 1 -- 172.21.15.72:0/3775427525 shutdown_connections 2024-05-09T05:56:44.950 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:44.961+0000 7f3956845640 1 --2- 172.21.15.72:0/3775427525 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f393c06f430 0x7f393c071940 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:44.950 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:44.961+0000 7f3956845640 1 --2- 172.21.15.72:0/3775427525 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f395015b150 0x7f39501e4c90 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:44.950 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:44.961+0000 7f3956845640 1 --2- 172.21.15.72:0/3775427525 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f39501549d0 0x7f39501e3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:44.950 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:44.961+0000 7f3956845640 1 --2- 172.21.15.72:0/3775427525 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3950074260 0x7f39501551a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:44.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:44.961+0000 7f3956845640 1 -- 172.21.15.72:0/3775427525 >> 172.21.15.72:0/3775427525 conn(0x7f395006e9b0 msgr2=0x7f39500cc970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:56:44.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:44.965+0000 7f3956845640 1 -- 172.21.15.72:0/3775427525 shutdown_connections 2024-05-09T05:56:44.951 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:44.965+0000 7f3956845640 1 -- 172.21.15.72:0/3775427525 wait complete. 2024-05-09T05:56:44.982 INFO:tasks.mds_thrash.fs.[cephfs]:mds.e down, removed from mdsmap 2024-05-09T05:56:44.982 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for mds cluster to stabilize... 2024-05-09T05:56:44.982 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:56:45.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.205+0000 7fdf14d8c640 1 Processor -- start 2024-05-09T05:56:45.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.205+0000 7fdf14d8c640 1 -- start start 2024-05-09T05:56:45.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.205+0000 7fdf14d8c640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdf10156910 0x7fdf1015d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:45.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.205+0000 7fdf14d8c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf100cf1f0 0x7fdf10167250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:45.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.205+0000 7fdf14d8c640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf1015d890 con 0x7fdf100cede0 2024-05-09T05:56:45.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.205+0000 7fdf14d8c640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fdf100ce0b0 con 0x7fdf10156910 2024-05-09T05:56:45.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.205+0000 7fdf14d8c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fdf100cd460 con 0x7fdf100cf1f0 2024-05-09T05:56:45.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.205+0000 7fdf0e59c640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdf10156910 0x7fdf1015d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:45.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.205+0000 7fdf0e59c640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdf10156910 0x7fdf1015d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35706/0 (socket says 172.21.15.72:35706) 2024-05-09T05:56:45.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.205+0000 7fdf0e59c640 1 -- 172.21.15.72:0/658390291 learned_addr learned my addr 172.21.15.72:0/658390291 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:56:45.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.205+0000 7fdf0dd9b640 1 --1- 172.21.15.72:0/658390291 >> v1:172.21.15.110:6789/0 conn(0x7fdf100cede0 0x7fdf100d1ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.72:57038/0 (socket says 172.21.15.72:57038) 2024-05-09T05:56:45.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.205+0000 7fdf0ed9d640 1 --2- 172.21.15.72:0/658390291 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf100cf1f0 0x7fdf10167250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:45.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.205+0000 7fdf0e59c640 1 -- 172.21.15.72:0/658390291 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf100cf1f0 msgr2=0x7fdf10167250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:56:45.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.205+0000 7fdf0e59c640 1 --2- 172.21.15.72:0/658390291 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf100cf1f0 0x7fdf10167250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:45.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.205+0000 7fdf0e59c640 1 -- 172.21.15.72:0/658390291 >> v1:172.21.15.110:6789/0 conn(0x7fdf100cede0 legacy=0x7fdf100d1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:45.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.205+0000 7fdf0e59c640 1 -- 172.21.15.72:0/658390291 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf100cd720 con 0x7fdf10156910 2024-05-09T05:56:45.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.213+0000 7fdf0e59c640 1 --2- 172.21.15.72:0/658390291 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf10156910 0x7fdf1015d350 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fdf04009870 tx=0x7fdf0401c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8135edbbf23ffac7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:56:45.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.213+0000 7fdf0d59a640 1 -- 172.21.15.72:0/658390291 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf040a95f0 con 0x7fdf10156910 2024-05-09T05:56:45.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.213+0000 7fdf0d59a640 1 -- 172.21.15.72:0/658390291 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf040a9790 con 0x7fdf10156910 2024-05-09T05:56:45.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.213+0000 7fdf0d59a640 1 -- 172.21.15.72:0/658390291 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf040a9b60 con 0x7fdf10156910 2024-05-09T05:56:45.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.213+0000 7fdf14d8c640 1 -- 172.21.15.72:0/658390291 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf10156910 msgr2=0x7fdf1015d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:45.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.213+0000 7fdf14d8c640 1 --2- 172.21.15.72:0/658390291 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf10156910 0x7fdf1015d350 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fdf04009870 tx=0x7fdf0401c530 comp rx=0 tx=0).stop 2024-05-09T05:56:45.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.213+0000 7fdf14d8c640 1 -- 172.21.15.72:0/658390291 shutdown_connections 2024-05-09T05:56:45.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.213+0000 7fdf14d8c640 1 --2- 172.21.15.72:0/658390291 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf100cf1f0 0x7fdf10167250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:45.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.213+0000 7fdf14d8c640 1 --2- 172.21.15.72:0/658390291 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf10156910 0x7fdf1015d350 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:45.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.213+0000 7fdf14d8c640 1 -- 172.21.15.72:0/658390291 >> 172.21.15.72:0/658390291 conn(0x7fdf100740a0 msgr2=0x7fdf100744e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:56:45.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.213+0000 7fdf14d8c640 1 -- 172.21.15.72:0/658390291 shutdown_connections 2024-05-09T05:56:45.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.213+0000 7fdf14d8c640 1 -- 172.21.15.72:0/658390291 wait complete. 2024-05-09T05:56:45.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.213+0000 7fdf14d8c640 1 Processor -- start 2024-05-09T05:56:45.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.213+0000 7fdf14d8c640 1 -- start start 2024-05-09T05:56:45.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.217+0000 7fdf14d8c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf100cede0 0x7fdf1015ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:45.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.217+0000 7fdf14d8c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdf100cf1f0 0x7fdf10152d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:45.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.217+0000 7fdf14d8c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf10156910 0x7fdf1015b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:45.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.217+0000 7fdf14d8c640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fdf100c7520 con 0x7fdf10156910 2024-05-09T05:56:45.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.217+0000 7fdf14d8c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fdf10156d20 con 0x7fdf100cf1f0 2024-05-09T05:56:45.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.217+0000 7fdf14d8c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fdf100c76a0 con 0x7fdf100cede0 2024-05-09T05:56:45.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.217+0000 7fdf0ed9d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf10156910 0x7fdf1015b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:45.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.217+0000 7fdf0ed9d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf10156910 0x7fdf1015b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35712/0 (socket says 172.21.15.72:35712) 2024-05-09T05:56:45.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.217+0000 7fdf0ed9d640 1 -- 172.21.15.72:0/3017393775 learned_addr learned my addr 172.21.15.72:0/3017393775 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:56:45.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.217+0000 7fdf0e59c640 1 --2- 172.21.15.72:0/3017393775 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf100cede0 0x7fdf1015ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:45.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.217+0000 7fdf0ed9d640 1 -- 172.21.15.72:0/3017393775 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf100cede0 msgr2=0x7fdf1015ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:45.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.217+0000 7fdf0ed9d640 1 --2- 172.21.15.72:0/3017393775 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf100cede0 0x7fdf1015ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:45.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.217+0000 7fdf0ed9d640 1 -- 172.21.15.72:0/3017393775 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdf100cf1f0 msgr2=0x7fdf10152d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:45.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.217+0000 7fdf0ed9d640 1 --2- 172.21.15.72:0/3017393775 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdf100cf1f0 0x7fdf10152d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:45.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.217+0000 7fdf0ed9d640 1 -- 172.21.15.72:0/3017393775 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf1015f140 con 0x7fdf10156910 2024-05-09T05:56:45.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.217+0000 7fdf0e59c640 1 --2- 172.21.15.72:0/3017393775 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf100cede0 0x7fdf1015ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:56:45.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.217+0000 7fdf0ed9d640 1 --2- 172.21.15.72:0/3017393775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf10156910 0x7fdf1015b870 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fdf0800ef90 tx=0x7fdf0800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:56:45.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.217+0000 7fdefeffd640 1 -- 172.21.15.72:0/3017393775 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf08018020 con 0x7fdf10156910 2024-05-09T05:56:45.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.221+0000 7fdefeffd640 1 -- 172.21.15.72:0/3017393775 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf08014480 con 0x7fdf10156910 2024-05-09T05:56:45.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.221+0000 7fdefeffd640 1 -- 172.21.15.72:0/3017393775 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf08009e60 con 0x7fdf10156910 2024-05-09T05:56:45.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.221+0000 7fdf14d8c640 1 -- 172.21.15.72:0/3017393775 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf1015aaf0 con 0x7fdf10156910 2024-05-09T05:56:45.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.221+0000 7fdf14d8c640 1 -- 172.21.15.72:0/3017393775 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf1015b070 con 0x7fdf10156910 2024-05-09T05:56:45.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.221+0000 7fdefcff9640 1 -- 172.21.15.72:0/3017393775 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf101f9bc0 con 0x7fdf10156910 2024-05-09T05:56:45.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.221+0000 7fdefeffd640 1 -- 172.21.15.72:0/3017393775 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fdf0801b020 con 0x7fdf10156910 2024-05-09T05:56:45.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.221+0000 7fdefeffd640 1 --2- 172.21.15.72:0/3017393775 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fdef006f400 0x7fdef0071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:45.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.221+0000 7fdefeffd640 1 -- 172.21.15.72:0/3017393775 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6762+0+0 (secure 0 0 0) 0x7fdf080903d0 con 0x7fdf10156910 2024-05-09T05:56:45.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.221+0000 7fdf0e59c640 1 --2- 172.21.15.72:0/3017393775 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fdef006f400 0x7fdef0071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:45.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.225+0000 7fdf0e59c640 1 --2- 172.21.15.72:0/3017393775 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fdef006f400 0x7fdef0071910 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fdf040ae000 tx=0x7fdf040a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:56:45.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.233+0000 7fdefeffd640 1 -- 172.21.15.72:0/3017393775 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fdf08022030 con 0x7fdf10156910 2024-05-09T05:56:45.593 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:56:45.593 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:53:23.494975+0000","modified":"2024-05-09T05:56:44.362020+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4297,"mds_1":4287,"mds_2":4263,"mds_3":4259,"mds_4":5007},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4259":{"gid":4259,"name":"f","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.110:6838/840351907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":840351907},{"type":"v1","addr":"172.21.15.110:6838","nonce":840351907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4263":{"gid":4263,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.72:6837/1048256382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":1048256382},{"type":"v1","addr":"172.21.15.72:6837","nonce":1048256382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.110:6839/966325499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6837","nonce":966325499},{"type":"v1","addr":"172.21.15.110:6839","nonce":966325499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6836/4134424941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":4134424941},{"type":"v1","addr":"172.21.15.110:6836","nonce":4134424941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5007":{"gid":5007,"name":"a","rank":4,"incarnation":26,"state":"up:replay","state_seq":1,"addr":"172.21.15.72:6835/1972750715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":1972750715},{"type":"v1","addr":"172.21.15.72:6835","nonce":1972750715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4259,4263,4287,4297]},"id":1}]} 2024-05-09T05:56:45.594 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 26 2024-05-09T05:56:45.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.605+0000 7fdefcff9640 1 -- 172.21.15.72:0/3017393775 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdf1006a520 con 0x7fdf10156910 2024-05-09T05:56:45.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.605+0000 7fdefeffd640 1 -- 172.21.15.72:0/3017393775 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+6087 (secure 0 0 0) 0x7fdf08010040 con 0x7fdf10156910 2024-05-09T05:56:45.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.609+0000 7fdefcff9640 1 -- 172.21.15.72:0/3017393775 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fdef006f400 msgr2=0x7fdef0071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:45.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.609+0000 7fdefcff9640 1 --2- 172.21.15.72:0/3017393775 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fdef006f400 0x7fdef0071910 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fdf040ae000 tx=0x7fdf040a7000 comp rx=0 tx=0).stop 2024-05-09T05:56:45.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.609+0000 7fdefcff9640 1 -- 172.21.15.72:0/3017393775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf10156910 msgr2=0x7fdf1015b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:45.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.609+0000 7fdefcff9640 1 --2- 172.21.15.72:0/3017393775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf10156910 0x7fdf1015b870 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fdf0800ef90 tx=0x7fdf0800c490 comp rx=0 tx=0).stop 2024-05-09T05:56:45.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.609+0000 7fdefcff9640 1 -- 172.21.15.72:0/3017393775 shutdown_connections 2024-05-09T05:56:45.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.609+0000 7fdefcff9640 1 --2- 172.21.15.72:0/3017393775 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fdef006f400 0x7fdef0071910 secure :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fdf040ae000 tx=0x7fdf040a7000 comp rx=0 tx=0).stop 2024-05-09T05:56:45.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.609+0000 7fdefcff9640 1 --2- 172.21.15.72:0/3017393775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf10156910 0x7fdf1015b870 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:45.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.609+0000 7fdefcff9640 1 --2- 172.21.15.72:0/3017393775 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdf100cf1f0 0x7fdf10152d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:45.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.609+0000 7fdefcff9640 1 --2- 172.21.15.72:0/3017393775 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf100cede0 0x7fdf1015ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:45.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.609+0000 7fdefcff9640 1 -- 172.21.15.72:0/3017393775 >> 172.21.15.72:0/3017393775 conn(0x7fdf100740a0 msgr2=0x7fdf10155ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:56:45.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.609+0000 7fdefcff9640 1 -- 172.21.15.72:0/3017393775 shutdown_connections 2024-05-09T05:56:45.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:45.609+0000 7fdefcff9640 1 -- 172.21.15.72:0/3017393775 wait complete. 2024-05-09T05:56:45.667 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 26, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-05-09T05:53:23.494975+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 26, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0, 1, 2, 3, 4 ], "info": { "gid_4259": { "addr": "172.21.15.110:6838/840351907", "addrs": { "addrvec": [ { "addr": "172.21.15.110:6835", "nonce": 840351907, "type": "v2" }, { "addr": "172.21.15.110:6838", "nonce": 840351907, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4259, "incarnation": 16, "join_fscid": -1, "name": "f", "rank": 3, "state": "up:active", "state_seq": 13 }, "gid_4263": { "addr": "172.21.15.72:6837/1048256382", "addrs": { "addrvec": [ { "addr": "172.21.15.72:6836", "nonce": 1048256382, "type": "v2" }, { "addr": "172.21.15.72:6837", "nonce": 1048256382, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4263, "incarnation": 14, "join_fscid": -1, "name": "c", "rank": 2, "state": "up:active", "state_seq": 12 }, "gid_4287": { "addr": "172.21.15.110:6839/966325499", "addrs": { "addrvec": [ { "addr": "172.21.15.110:6837", "nonce": 966325499, "type": "v2" }, { "addr": "172.21.15.110:6839", "nonce": 966325499, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4287, "incarnation": 10, "join_fscid": -1, "name": "d", "rank": 1, "state": "up:active", "state_seq": 10 }, "gid_4297": { "addr": "172.21.15.110:6836/4134424941", "addrs": { "addrvec": [ { "addr": "172.21.15.110:6834", "nonce": 4134424941, "type": "v2" }, { "addr": "172.21.15.110:6836", "nonce": 4134424941, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4297, "incarnation": 4, "join_fscid": -1, "name": "b", "rank": 0, "state": "up:active", "state_seq": 4 }, "gid_5007": { "addr": "172.21.15.72:6835/1972750715", "addrs": { "addrvec": [ { "addr": "172.21.15.72:6833", "nonce": 1972750715, "type": "v2" }, { "addr": "172.21.15.72:6835", "nonce": 1972750715, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5007, "incarnation": 26, "join_fscid": -1, "name": "a", "rank": 4, "state": "up:replay", "state_seq": 1 } }, "last_failure": 0, "last_failure_osd_epoch": 29, "max_file_size": 1099511627776, "max_mds": 5, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-05-09T05:56:44.362020+0000", "qdb_cluster": [ 4259, 4263, 4287, 4297 ], "qdb_leader": 4297, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4297, "mds_1": 4287, "mds_2": 4263, "mds_3": 4259, "mds_4": 5007 } } } ], "standbys": [] } 2024-05-09T05:56:46.063 INFO:tasks.workunit.client.0.smithi072.stdout: 2024-05-09T05:56:46.063 INFO:tasks.workunit.client.0.smithi072.stdout: Children see throughput for 1 initial writers = 461501.41 kB/sec 2024-05-09T05:56:46.063 INFO:tasks.workunit.client.0.smithi072.stdout: Parent sees throughput for 1 initial writers = 461365.18 kB/sec 2024-05-09T05:56:46.063 INFO:tasks.workunit.client.0.smithi072.stdout: Min throughput per process = 461501.41 kB/sec 2024-05-09T05:56:46.063 INFO:tasks.workunit.client.0.smithi072.stdout: Max throughput per process = 461501.41 kB/sec 2024-05-09T05:56:46.063 INFO:tasks.workunit.client.0.smithi072.stdout: Avg throughput per process = 461501.41 kB/sec 2024-05-09T05:56:46.063 INFO:tasks.workunit.client.0.smithi072.stdout: Min xfer = 1048576.00 kB 2024-05-09T05:56:47.668 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:56:47.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:47.837+0000 7f95a3810640 1 Processor -- start 2024-05-09T05:56:47.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:47.837+0000 7f95a3810640 1 -- start start 2024-05-09T05:56:47.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:47.841+0000 7f95a3810640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f959c15da90 0x7f959c0c7570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:47.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:47.841+0000 7f95a3810640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f959c162e60 0x7f959c165280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:47.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:47.841+0000 7f95a3810640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f959c15a4f0 con 0x7f959c15dea0 2024-05-09T05:56:47.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:47.841+0000 7f95a3810640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f959c1513f0 con 0x7f959c15da90 2024-05-09T05:56:47.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:47.841+0000 7f95a3810640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f959c0c84f0 con 0x7f959c162e60 2024-05-09T05:56:47.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:47.841+0000 7f95a15ac640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f959c15da90 0x7f959c0c7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:47.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:47.841+0000 7f95a15ac640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f959c15da90 0x7f959c0c7570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35724/0 (socket says 172.21.15.72:35724) 2024-05-09T05:56:47.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:47.841+0000 7f95a15ac640 1 -- 172.21.15.72:0/880074328 learned_addr learned my addr 172.21.15.72:0/880074328 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:56:47.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:47.841+0000 7f95a1dad640 1 --2- 172.21.15.72:0/880074328 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f959c162e60 0x7f959c165280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:47.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:47.841+0000 7f95a15ac640 1 -- 172.21.15.72:0/880074328 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f959c162e60 msgr2=0x7f959c165280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:56:47.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:47.841+0000 7f95a15ac640 1 --2- 172.21.15.72:0/880074328 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f959c162e60 0x7f959c165280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:47.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:47.841+0000 7f95a15ac640 1 -- 172.21.15.72:0/880074328 >> v1:172.21.15.110:6789/0 conn(0x7f959c15dea0 legacy=0x7f959c0745b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:47.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:47.841+0000 7f95a15ac640 1 -- 172.21.15.72:0/880074328 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f959c0c87d0 con 0x7f959c15da90 2024-05-09T05:56:47.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:47.845+0000 7f95a15ac640 1 --2- 172.21.15.72:0/880074328 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f959c15da90 0x7f959c0c7570 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f9598009870 tx=0x7f959801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66dad6ee373f9c8b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:56:47.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:47.845+0000 7f9593fff640 1 -- 172.21.15.72:0/880074328 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95980b2070 con 0x7f959c15da90 2024-05-09T05:56:47.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:47.845+0000 7f9593fff640 1 -- 172.21.15.72:0/880074328 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95980a9070 con 0x7f959c15da90 2024-05-09T05:56:47.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:47.845+0000 7f9593fff640 1 -- 172.21.15.72:0/880074328 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95980ad880 con 0x7f959c15da90 2024-05-09T05:56:47.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:47.845+0000 7f95a3810640 1 -- 172.21.15.72:0/880074328 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f959c15da90 msgr2=0x7f959c0c7570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:47.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:47.845+0000 7f95a3810640 1 --2- 172.21.15.72:0/880074328 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f959c15da90 0x7f959c0c7570 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f9598009870 tx=0x7f959801c560 comp rx=0 tx=0).stop 2024-05-09T05:56:47.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:47.845+0000 7f95a3810640 1 -- 172.21.15.72:0/880074328 shutdown_connections 2024-05-09T05:56:47.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:47.845+0000 7f95a3810640 1 --2- 172.21.15.72:0/880074328 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f959c162e60 0x7f959c165280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:47.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:47.845+0000 7f95a3810640 1 --2- 172.21.15.72:0/880074328 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f959c15da90 0x7f959c0c7570 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:47.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:47.845+0000 7f95a3810640 1 -- 172.21.15.72:0/880074328 >> 172.21.15.72:0/880074328 conn(0x7f959c0cde90 msgr2=0x7f959c0ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:56:47.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:47.845+0000 7f95a3810640 1 -- 172.21.15.72:0/880074328 shutdown_connections 2024-05-09T05:56:47.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:47.845+0000 7f95a3810640 1 -- 172.21.15.72:0/880074328 wait complete. 2024-05-09T05:56:47.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:47.845+0000 7f95a3810640 1 Processor -- start 2024-05-09T05:56:47.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:47.845+0000 7f95a3810640 1 -- start start 2024-05-09T05:56:47.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:47.849+0000 7f95a3810640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f959c15da90 0x7f959c15ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:47.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:47.849+0000 7f95a3810640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f959c15dea0 0x7f959c149690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:47.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:47.849+0000 7f95a3810640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f959c162e60 0x7f959c1f7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:47.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:47.849+0000 7f95a3810640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f959c0c81b0 con 0x7f959c15da90 2024-05-09T05:56:47.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:47.849+0000 7f95a3810640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f959c0c70e0 con 0x7f959c15dea0 2024-05-09T05:56:47.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:47.849+0000 7f95a3810640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f959c154ab0 con 0x7f959c162e60 2024-05-09T05:56:47.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:47.849+0000 7f95a15ac640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f959c15da90 0x7f959c15ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:47.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:47.849+0000 7f95a15ac640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f959c15da90 0x7f959c15ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35740/0 (socket says 172.21.15.72:35740) 2024-05-09T05:56:47.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:47.849+0000 7f95a15ac640 1 -- 172.21.15.72:0/1782277254 learned_addr learned my addr 172.21.15.72:0/1782277254 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:56:47.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:47.849+0000 7f95a1dad640 1 --2- 172.21.15.72:0/1782277254 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f959c162e60 0x7f959c1f7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:47.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:47.849+0000 7f95a0dab640 1 --2- 172.21.15.72:0/1782277254 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f959c15dea0 0x7f959c149690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:47.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:47.849+0000 7f95a15ac640 1 -- 172.21.15.72:0/1782277254 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f959c162e60 msgr2=0x7f959c1f7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:47.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:47.849+0000 7f95a15ac640 1 --2- 172.21.15.72:0/1782277254 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f959c162e60 0x7f959c1f7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:47.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:47.849+0000 7f95a15ac640 1 -- 172.21.15.72:0/1782277254 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f959c15dea0 msgr2=0x7f959c149690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:47.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:47.849+0000 7f95a15ac640 1 --2- 172.21.15.72:0/1782277254 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f959c15dea0 0x7f959c149690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:47.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:47.849+0000 7f95a15ac640 1 -- 172.21.15.72:0/1782277254 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f959c15bfd0 con 0x7f959c15da90 2024-05-09T05:56:47.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:47.849+0000 7f95a15ac640 1 --2- 172.21.15.72:0/1782277254 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f959c15da90 0x7f959c15ba90 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f959801a190 tx=0x7f959801ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:56:47.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:47.849+0000 7f9591ffb640 1 -- 172.21.15.72:0/1782277254 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95980b2040 con 0x7f959c15da90 2024-05-09T05:56:47.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:47.849+0000 7f9591ffb640 1 -- 172.21.15.72:0/1782277254 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95980be070 con 0x7f959c15da90 2024-05-09T05:56:47.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:47.849+0000 7f9591ffb640 1 -- 172.21.15.72:0/1782277254 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95980b8640 con 0x7f959c15da90 2024-05-09T05:56:47.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:47.849+0000 7f95a3810640 1 -- 172.21.15.72:0/1782277254 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f959c0cc3d0 con 0x7f959c15da90 2024-05-09T05:56:47.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:47.849+0000 7f95a3810640 1 -- 172.21.15.72:0/1782277254 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f959c0cc990 con 0x7f959c15da90 2024-05-09T05:56:47.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:47.849+0000 7f95a3810640 1 -- 172.21.15.72:0/1782277254 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f959c06a520 con 0x7f959c15da90 2024-05-09T05:56:47.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:47.849+0000 7f9591ffb640 1 -- 172.21.15.72:0/1782277254 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f95980ab070 con 0x7f959c15da90 2024-05-09T05:56:47.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:47.849+0000 7f9591ffb640 1 --2- 172.21.15.72:0/1782277254 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f958006f430 0x7f9580071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:47.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:47.853+0000 7f9591ffb640 1 -- 172.21.15.72:0/1782277254 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6762+0+0 (secure 0 0 0) 0x7f959812a190 con 0x7f959c15da90 2024-05-09T05:56:47.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:47.853+0000 7f95a0dab640 1 --2- 172.21.15.72:0/1782277254 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f958006f430 0x7f9580071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:47.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:47.853+0000 7f95a0dab640 1 --2- 172.21.15.72:0/1782277254 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f958006f430 0x7f9580071940 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f959c158050 tx=0x7f958c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:56:47.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:47.857+0000 7f9591ffb640 1 -- 172.21.15.72:0/1782277254 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f9598016150 con 0x7f959c15da90 2024-05-09T05:56:48.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:48.033+0000 7f95a3810640 1 -- 172.21.15.72:0/1782277254 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f959c076780 con 0x7f959c15da90 2024-05-09T05:56:48.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:48.037+0000 7f9591ffb640 1 -- 172.21.15.72:0/1782277254 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+6087 (secure 0 0 0) 0x7f95980f6d40 con 0x7f959c15da90 2024-05-09T05:56:48.023 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:56:48.023 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:53:23.494975+0000","modified":"2024-05-09T05:56:44.362020+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4297,"mds_1":4287,"mds_2":4263,"mds_3":4259,"mds_4":5007},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4259":{"gid":4259,"name":"f","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.110:6838/840351907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":840351907},{"type":"v1","addr":"172.21.15.110:6838","nonce":840351907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4263":{"gid":4263,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.72:6837/1048256382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":1048256382},{"type":"v1","addr":"172.21.15.72:6837","nonce":1048256382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.110:6839/966325499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6837","nonce":966325499},{"type":"v1","addr":"172.21.15.110:6839","nonce":966325499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6836/4134424941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":4134424941},{"type":"v1","addr":"172.21.15.110:6836","nonce":4134424941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5007":{"gid":5007,"name":"a","rank":4,"incarnation":26,"state":"up:replay","state_seq":1,"addr":"172.21.15.72:6835/1972750715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":1972750715},{"type":"v1","addr":"172.21.15.72:6835","nonce":1972750715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4259,4263,4287,4297]},"id":1}]} 2024-05-09T05:56:48.023 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 26 2024-05-09T05:56:48.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:48.037+0000 7f95a3810640 1 -- 172.21.15.72:0/1782277254 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f958006f430 msgr2=0x7f9580071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:48.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:48.037+0000 7f95a3810640 1 --2- 172.21.15.72:0/1782277254 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f958006f430 0x7f9580071940 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f959c158050 tx=0x7f958c009040 comp rx=0 tx=0).stop 2024-05-09T05:56:48.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:48.037+0000 7f95a3810640 1 -- 172.21.15.72:0/1782277254 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f959c15da90 msgr2=0x7f959c15ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:48.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:48.037+0000 7f95a3810640 1 --2- 172.21.15.72:0/1782277254 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f959c15da90 0x7f959c15ba90 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f959801a190 tx=0x7f959801ada0 comp rx=0 tx=0).stop 2024-05-09T05:56:48.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:48.037+0000 7f95a3810640 1 -- 172.21.15.72:0/1782277254 shutdown_connections 2024-05-09T05:56:48.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:48.037+0000 7f95a3810640 1 --2- 172.21.15.72:0/1782277254 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f958006f430 0x7f9580071940 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:48.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:48.037+0000 7f95a3810640 1 --2- 172.21.15.72:0/1782277254 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f959c162e60 0x7f959c1f7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:48.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:48.037+0000 7f95a3810640 1 --2- 172.21.15.72:0/1782277254 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f959c15dea0 0x7f959c149690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:48.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:48.037+0000 7f95a3810640 1 --2- 172.21.15.72:0/1782277254 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f959c15da90 0x7f959c15ba90 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:48.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:48.037+0000 7f95a3810640 1 -- 172.21.15.72:0/1782277254 >> 172.21.15.72:0/1782277254 conn(0x7f959c0cde90 msgr2=0x7f959c159660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:56:48.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:48.037+0000 7f95a3810640 1 -- 172.21.15.72:0/1782277254 shutdown_connections 2024-05-09T05:56:48.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:48.037+0000 7f95a3810640 1 -- 172.21.15.72:0/1782277254 wait complete. 2024-05-09T05:56:48.043 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-05-09T05:56:50.044 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:56:50.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.305+0000 7ff5d21f5640 1 Processor -- start 2024-05-09T05:56:50.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.305+0000 7ff5d21f5640 1 -- start start 2024-05-09T05:56:50.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.309+0000 7ff5d21f5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5cc0c7500 0x7ff5cc0c81b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:50.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.309+0000 7ff5d21f5640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff5cc0c5630 0x7ff5cc0c5a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:50.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.309+0000 7ff5d21f5640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff5cc15da90 0x7ff5cc15dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:50.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.309+0000 7ff5d21f5640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7ff5cc0c7c80 con 0x7ff5cc15da90 2024-05-09T05:56:50.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.309+0000 7ff5d21f5640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7ff5cc15a5b0 con 0x7ff5cc0c5630 2024-05-09T05:56:50.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.309+0000 7ff5d21f5640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7ff5cc15a890 con 0x7ff5cc0c7500 2024-05-09T05:56:50.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.309+0000 7ff5cbfff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff5cc15da90 0x7ff5cc15dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:50.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.309+0000 7ff5cbfff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff5cc15da90 0x7ff5cc15dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35744/0 (socket says 172.21.15.72:35744) 2024-05-09T05:56:50.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.309+0000 7ff5cbfff640 1 -- 172.21.15.72:0/1171370497 learned_addr learned my addr 172.21.15.72:0/1171370497 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:56:50.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.309+0000 7ff5caffd640 1 --2- 172.21.15.72:0/1171370497 >> v2:172.21.15.110:3300/0 conn(0x7ff5cc0c5630 0x7ff5cc0c5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:50.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.309+0000 7ff5cb7fe640 1 --2- 172.21.15.72:0/1171370497 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5cc0c7500 0x7ff5cc0c81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:50.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.309+0000 7ff5caffd640 1 -- 172.21.15.72:0/1171370497 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5cc0c7500 msgr2=0x7ff5cc0c81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:56:50.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.309+0000 7ff5caffd640 1 --2- 172.21.15.72:0/1171370497 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5cc0c7500 0x7ff5cc0c81b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:50.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.309+0000 7ff5caffd640 1 -- 172.21.15.72:0/1171370497 >> v2:172.21.15.72:3300/0 conn(0x7ff5cc15da90 msgr2=0x7ff5cc15dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:56:50.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.309+0000 7ff5caffd640 1 --2- 172.21.15.72:0/1171370497 >> v2:172.21.15.72:3300/0 conn(0x7ff5cc15da90 0x7ff5cc15dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:50.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.309+0000 7ff5caffd640 1 -- 172.21.15.72:0/1171370497 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5cc15ab70 con 0x7ff5cc0c5630 2024-05-09T05:56:50.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.313+0000 7ff5caffd640 1 --2- 172.21.15.72:0/1171370497 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5cc0c5630 0x7ff5cc0c5a40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc070d20 tx=0x7ff5bc01c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d01a627ca8099370 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:56:50.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.317+0000 7ff5ca7fc640 1 -- 172.21.15.72:0/1171370497 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc0b0070 con 0x7ff5cc0c5630 2024-05-09T05:56:50.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.317+0000 7ff5ca7fc640 1 -- 172.21.15.72:0/1171370497 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5bc0ab600 con 0x7ff5cc0c5630 2024-05-09T05:56:50.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.317+0000 7ff5ca7fc640 1 -- 172.21.15.72:0/1171370497 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc0ab9d0 con 0x7ff5cc0c5630 2024-05-09T05:56:50.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.317+0000 7ff5d21f5640 1 -- 172.21.15.72:0/1171370497 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5cc0c5630 msgr2=0x7ff5cc0c5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:50.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.317+0000 7ff5d21f5640 1 --2- 172.21.15.72:0/1171370497 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5cc0c5630 0x7ff5cc0c5a40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc070d20 tx=0x7ff5bc01c410 comp rx=0 tx=0).stop 2024-05-09T05:56:50.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.321+0000 7ff5d21f5640 1 -- 172.21.15.72:0/1171370497 shutdown_connections 2024-05-09T05:56:50.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.321+0000 7ff5d21f5640 1 --2- 172.21.15.72:0/1171370497 >> v2:172.21.15.72:3300/0 conn(0x7ff5cc15da90 0x7ff5cc15dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:50.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.321+0000 7ff5d21f5640 1 --2- 172.21.15.72:0/1171370497 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5cc0c5630 0x7ff5cc0c5a40 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:50.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.321+0000 7ff5d21f5640 1 --2- 172.21.15.72:0/1171370497 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5cc0c7500 0x7ff5cc0c81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:50.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.321+0000 7ff5d21f5640 1 -- 172.21.15.72:0/1171370497 >> 172.21.15.72:0/1171370497 conn(0x7ff5cc0cde90 msgr2=0x7ff5cc0ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:56:50.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.321+0000 7ff5d21f5640 1 -- 172.21.15.72:0/1171370497 shutdown_connections 2024-05-09T05:56:50.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.321+0000 7ff5d21f5640 1 -- 172.21.15.72:0/1171370497 wait complete. 2024-05-09T05:56:50.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.325+0000 7ff5d21f5640 1 Processor -- start 2024-05-09T05:56:50.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.325+0000 7ff5d21f5640 1 -- start start 2024-05-09T05:56:50.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.325+0000 7ff5d21f5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5cc0c5630 0x7ff5cc13fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:50.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.325+0000 7ff5d21f5640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5cc0c7500 0x7ff5cc15c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:50.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.325+0000 7ff5d21f5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5cc15da90 0x7ff5cc142fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:50.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.325+0000 7ff5d21f5640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff5cc0c8870 con 0x7ff5cc0c7500 2024-05-09T05:56:50.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.325+0000 7ff5d21f5640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ff5cc0c86f0 con 0x7ff5cc15da90 2024-05-09T05:56:50.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.325+0000 7ff5d21f5640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7ff5cc070410 con 0x7ff5cc0c5630 2024-05-09T05:56:50.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.325+0000 7ff5cb7fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5cc0c5630 0x7ff5cc13fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:50.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.325+0000 7ff5caffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5cc0c7500 0x7ff5cc15c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:50.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.325+0000 7ff5cb7fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5cc0c5630 0x7ff5cc13fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.72:43418/0 (socket says 172.21.15.72:43418) 2024-05-09T05:56:50.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.325+0000 7ff5cb7fe640 1 -- 172.21.15.72:0/3186399001 learned_addr learned my addr 172.21.15.72:0/3186399001 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:56:50.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.325+0000 7ff5caffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5cc0c7500 0x7ff5cc15c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35750/0 (socket says 172.21.15.72:35750) 2024-05-09T05:56:50.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.325+0000 7ff5cbfff640 1 --2- 172.21.15.72:0/3186399001 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5cc15da90 0x7ff5cc142fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:50.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.325+0000 7ff5cbfff640 1 -- 172.21.15.72:0/3186399001 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5cc0c5630 msgr2=0x7ff5cc13fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:50.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.325+0000 7ff5cbfff640 1 --2- 172.21.15.72:0/3186399001 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5cc0c5630 0x7ff5cc13fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:50.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.325+0000 7ff5cbfff640 1 -- 172.21.15.72:0/3186399001 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5cc0c7500 msgr2=0x7ff5cc15c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:50.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.325+0000 7ff5cbfff640 1 --2- 172.21.15.72:0/3186399001 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5cc0c7500 0x7ff5cc15c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:50.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.325+0000 7ff5cbfff640 1 -- 172.21.15.72:0/3186399001 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5cc1401d0 con 0x7ff5cc15da90 2024-05-09T05:56:50.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.325+0000 7ff5cb7fe640 1 --2- 172.21.15.72:0/3186399001 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5cc0c5630 0x7ff5cc13fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T05:56:50.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.329+0000 7ff5cbfff640 1 --2- 172.21.15.72:0/3186399001 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5cc15da90 0x7ff5cc142fc0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff5c4007ac0 tx=0x7ff5c4007ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:56:50.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.329+0000 7ff5b3fff640 1 -- 172.21.15.72:0/3186399001 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c401a070 con 0x7ff5cc15da90 2024-05-09T05:56:50.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.329+0000 7ff5d21f5640 1 -- 172.21.15.72:0/3186399001 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5cc15d180 con 0x7ff5cc15da90 2024-05-09T05:56:50.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.329+0000 7ff5d21f5640 1 -- 172.21.15.72:0/3186399001 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5cc13f930 con 0x7ff5cc15da90 2024-05-09T05:56:50.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.329+0000 7ff5b3fff640 1 -- 172.21.15.72:0/3186399001 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5c400dbe0 con 0x7ff5cc15da90 2024-05-09T05:56:50.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.329+0000 7ff5b3fff640 1 -- 172.21.15.72:0/3186399001 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c4015400 con 0x7ff5cc15da90 2024-05-09T05:56:50.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.329+0000 7ff5b3fff640 1 -- 172.21.15.72:0/3186399001 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff5c401d070 con 0x7ff5cc15da90 2024-05-09T05:56:50.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.333+0000 7ff5b3fff640 1 --2- 172.21.15.72:0/3186399001 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7ff5b806f450 0x7ff5b8071960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:50.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.333+0000 7ff5b3fff640 1 -- 172.21.15.72:0/3186399001 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6762+0+0 (secure 0 0 0) 0x7ff5c408f3d0 con 0x7ff5cc15da90 2024-05-09T05:56:50.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.333+0000 7ff5cb7fe640 1 --2- 172.21.15.72:0/3186399001 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7ff5b806f450 0x7ff5b8071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:50.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.341+0000 7ff5d21f5640 1 -- 172.21.15.72:0/3186399001 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5ac0052a0 con 0x7ff5cc15da90 2024-05-09T05:56:50.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.341+0000 7ff5cb7fe640 1 --2- 172.21.15.72:0/3186399001 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7ff5b806f450 0x7ff5b8071960 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff5c0009ef0 tx=0x7ff5c0009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:56:50.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.353+0000 7ff5b3fff640 1 -- 172.21.15.72:0/3186399001 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7ff5c4010070 con 0x7ff5cc15da90 2024-05-09T05:56:50.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.693+0000 7ff5d21f5640 1 -- 172.21.15.72:0/3186399001 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff5ac005860 con 0x7ff5cc15da90 2024-05-09T05:56:50.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.697+0000 7ff5b3fff640 1 -- 172.21.15.72:0/3186399001 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+6089 (secure 0 0 0) 0x7ff5c405b9c0 con 0x7ff5cc15da90 2024-05-09T05:56:50.683 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:56:50.683 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:53:23.494975+0000","modified":"2024-05-09T05:56:49.473793+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4297,"mds_1":4287,"mds_2":4263,"mds_3":4259,"mds_4":5007},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4259":{"gid":4259,"name":"f","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.110:6838/840351907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":840351907},{"type":"v1","addr":"172.21.15.110:6838","nonce":840351907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4263":{"gid":4263,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.72:6837/1048256382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":1048256382},{"type":"v1","addr":"172.21.15.72:6837","nonce":1048256382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.110:6839/966325499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6837","nonce":966325499},{"type":"v1","addr":"172.21.15.110:6839","nonce":966325499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6836/4134424941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":4134424941},{"type":"v1","addr":"172.21.15.110:6836","nonce":4134424941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5007":{"gid":5007,"name":"a","rank":4,"incarnation":26,"state":"up:resolve","state_seq":19,"addr":"172.21.15.72:6835/1972750715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":1972750715},{"type":"v1","addr":"172.21.15.72:6835","nonce":1972750715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4297,4287,4263,4259]},"id":1}]} 2024-05-09T05:56:50.684 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 27 2024-05-09T05:56:50.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.701+0000 7ff5d21f5640 1 -- 172.21.15.72:0/3186399001 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7ff5b806f450 msgr2=0x7ff5b8071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:50.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.701+0000 7ff5d21f5640 1 --2- 172.21.15.72:0/3186399001 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7ff5b806f450 0x7ff5b8071960 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff5c0009ef0 tx=0x7ff5c0009190 comp rx=0 tx=0).stop 2024-05-09T05:56:50.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.701+0000 7ff5d21f5640 1 -- 172.21.15.72:0/3186399001 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5cc15da90 msgr2=0x7ff5cc142fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:50.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.701+0000 7ff5d21f5640 1 --2- 172.21.15.72:0/3186399001 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5cc15da90 0x7ff5cc142fc0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff5c4007ac0 tx=0x7ff5c4007ec0 comp rx=0 tx=0).stop 2024-05-09T05:56:50.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.701+0000 7ff5d21f5640 1 -- 172.21.15.72:0/3186399001 shutdown_connections 2024-05-09T05:56:50.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.701+0000 7ff5d21f5640 1 --2- 172.21.15.72:0/3186399001 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7ff5b806f450 0x7ff5b8071960 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:50.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.701+0000 7ff5d21f5640 1 --2- 172.21.15.72:0/3186399001 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5cc15da90 0x7ff5cc142fc0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:50.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.701+0000 7ff5d21f5640 1 --2- 172.21.15.72:0/3186399001 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5cc0c7500 0x7ff5cc15c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:50.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.701+0000 7ff5d21f5640 1 --2- 172.21.15.72:0/3186399001 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5cc0c5630 0x7ff5cc13fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:50.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.701+0000 7ff5d21f5640 1 -- 172.21.15.72:0/3186399001 >> 172.21.15.72:0/3186399001 conn(0x7ff5cc0cde90 msgr2=0x7ff5cc0c7e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:56:50.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.701+0000 7ff5d21f5640 1 -- 172.21.15.72:0/3186399001 shutdown_connections 2024-05-09T05:56:50.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:50.701+0000 7ff5d21f5640 1 -- 172.21.15.72:0/3186399001 wait complete. 2024-05-09T05:56:50.722 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-05-09T05:56:52.118 INFO:tasks.workunit.client.0.smithi072.stdout: 2024-05-09T05:56:52.118 INFO:tasks.workunit.client.0.smithi072.stdout: Children see throughput for 1 rewriters = 486781.00 kB/sec 2024-05-09T05:56:52.118 INFO:tasks.workunit.client.0.smithi072.stdout: Parent sees throughput for 1 rewriters = 486598.29 kB/sec 2024-05-09T05:56:52.118 INFO:tasks.workunit.client.0.smithi072.stdout: Min throughput per process = 486781.00 kB/sec 2024-05-09T05:56:52.118 INFO:tasks.workunit.client.0.smithi072.stdout: Max throughput per process = 486781.00 kB/sec 2024-05-09T05:56:52.118 INFO:tasks.workunit.client.0.smithi072.stdout: Avg throughput per process = 486781.00 kB/sec 2024-05-09T05:56:52.119 INFO:tasks.workunit.client.0.smithi072.stdout: Min xfer = 1048576.00 kB 2024-05-09T05:56:52.723 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:56:52.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:52.893+0000 7fed43c53640 1 Processor -- start 2024-05-09T05:56:52.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:52.893+0000 7fed43c53640 1 -- start start 2024-05-09T05:56:52.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:52.893+0000 7fed43c53640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fed3c15e4a0 0x7fed3c0ca620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:52.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:52.893+0000 7fed43c53640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fed3c0cc6b0 0x7fed3c0ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:52.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:52.893+0000 7fed43c53640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed3c0c9a30 con 0x7fed3c074620 2024-05-09T05:56:52.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:52.893+0000 7fed43c53640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fed3c0cc200 con 0x7fed3c15e4a0 2024-05-09T05:56:52.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:52.893+0000 7fed43c53640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fed3c0c9d10 con 0x7fed3c0cc6b0 2024-05-09T05:56:52.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:52.893+0000 7fed419ef640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fed3c15e4a0 0x7fed3c0ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:52.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:52.893+0000 7fed421f0640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fed3c074620 0x7fed3c074a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52218/0 (socket says 172.21.15.72:52218) 2024-05-09T05:56:52.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:52.893+0000 7fed421f0640 1 -- 172.21.15.72:0/304310225 learned_addr learned my addr 172.21.15.72:0/304310225 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:56:52.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:52.893+0000 7fed411ee640 1 --2- 172.21.15.72:0/304310225 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fed3c0cc6b0 0x7fed3c0ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:52.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:52.893+0000 7fed419ef640 1 -- 172.21.15.72:0/304310225 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fed3c0cc6b0 msgr2=0x7fed3c0ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:56:52.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:52.893+0000 7fed419ef640 1 --2- 172.21.15.72:0/304310225 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fed3c0cc6b0 0x7fed3c0ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:52.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:52.893+0000 7fed419ef640 1 -- 172.21.15.72:0/304310225 >> v1:172.21.15.72:6789/0 conn(0x7fed3c074620 legacy=0x7fed3c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:52.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:52.893+0000 7fed419ef640 1 -- 172.21.15.72:0/304310225 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed3c0c9ff0 con 0x7fed3c15e4a0 2024-05-09T05:56:52.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:52.893+0000 7fed409ed640 1 -- 172.21.15.72:0/304310225 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1972848600 0 0) 0x7fed3c0c9a30 con 0x7fed3c074620 2024-05-09T05:56:52.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:52.897+0000 7fed419ef640 1 --2- 172.21.15.72:0/304310225 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fed3c15e4a0 0x7fed3c0ca620 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fed34009d90 tx=0x7fed3401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=844a4ef743e58ba3 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:56:52.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:52.897+0000 7fed409ed640 1 -- 172.21.15.72:0/304310225 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed340b2070 con 0x7fed3c15e4a0 2024-05-09T05:56:52.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:52.897+0000 7fed409ed640 1 -- 172.21.15.72:0/304310225 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed340a57a0 con 0x7fed3c15e4a0 2024-05-09T05:56:52.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:52.897+0000 7fed409ed640 1 -- 172.21.15.72:0/304310225 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed340a5b70 con 0x7fed3c15e4a0 2024-05-09T05:56:52.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:52.897+0000 7fed43c53640 1 -- 172.21.15.72:0/304310225 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fed3c15e4a0 msgr2=0x7fed3c0ca620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:52.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:52.897+0000 7fed43c53640 1 --2- 172.21.15.72:0/304310225 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fed3c15e4a0 0x7fed3c0ca620 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fed34009d90 tx=0x7fed3401c8e0 comp rx=0 tx=0).stop 2024-05-09T05:56:52.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:52.897+0000 7fed43c53640 1 -- 172.21.15.72:0/304310225 shutdown_connections 2024-05-09T05:56:52.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:52.897+0000 7fed43c53640 1 --2- 172.21.15.72:0/304310225 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fed3c0cc6b0 0x7fed3c0ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:52.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:52.897+0000 7fed43c53640 1 --2- 172.21.15.72:0/304310225 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fed3c15e4a0 0x7fed3c0ca620 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:52.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:52.897+0000 7fed43c53640 1 -- 172.21.15.72:0/304310225 >> 172.21.15.72:0/304310225 conn(0x7fed3c0cfc20 msgr2=0x7fed3c0d0030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:56:52.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:52.897+0000 7fed43c53640 1 -- 172.21.15.72:0/304310225 shutdown_connections 2024-05-09T05:56:52.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:52.897+0000 7fed43c53640 1 -- 172.21.15.72:0/304310225 wait complete. 2024-05-09T05:56:52.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:52.901+0000 7fed43c53640 1 Processor -- start 2024-05-09T05:56:52.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:52.901+0000 7fed43c53640 1 -- start start 2024-05-09T05:56:52.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:52.901+0000 7fed43c53640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fed3c074620 0x7fed3c143790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:52.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:52.901+0000 7fed43c53640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fed3c0cc6b0 0x7fed3c153940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:52.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:52.901+0000 7fed43c53640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fed3c15e4a0 0x7fed3c153e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:52.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:52.901+0000 7fed43c53640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fed3c167640 con 0x7fed3c074620 2024-05-09T05:56:52.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:52.901+0000 7fed43c53640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fed3c0cad70 con 0x7fed3c0cc6b0 2024-05-09T05:56:52.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:52.901+0000 7fed43c53640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fed3c1677c0 con 0x7fed3c15e4a0 2024-05-09T05:56:52.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:52.901+0000 7fed419ef640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fed3c074620 0x7fed3c143790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:52.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:52.901+0000 7fed419ef640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fed3c074620 0x7fed3c143790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56202/0 (socket says 172.21.15.72:56202) 2024-05-09T05:56:52.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:52.901+0000 7fed419ef640 1 -- 172.21.15.72:0/3834329629 learned_addr learned my addr 172.21.15.72:0/3834329629 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:56:52.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:52.901+0000 7fed411ee640 1 --2- 172.21.15.72:0/3834329629 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fed3c0cc6b0 0x7fed3c153940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:52.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:52.901+0000 7fed421f0640 1 --2- 172.21.15.72:0/3834329629 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fed3c15e4a0 0x7fed3c153e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:52.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:52.901+0000 7fed419ef640 1 -- 172.21.15.72:0/3834329629 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fed3c15e4a0 msgr2=0x7fed3c153e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:52.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:52.901+0000 7fed419ef640 1 --2- 172.21.15.72:0/3834329629 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fed3c15e4a0 0x7fed3c153e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:52.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:52.901+0000 7fed419ef640 1 -- 172.21.15.72:0/3834329629 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fed3c0cc6b0 msgr2=0x7fed3c153940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:52.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:52.901+0000 7fed419ef640 1 --2- 172.21.15.72:0/3834329629 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fed3c0cc6b0 0x7fed3c153940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:52.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:52.901+0000 7fed419ef640 1 -- 172.21.15.72:0/3834329629 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed3c1f8fd0 con 0x7fed3c074620 2024-05-09T05:56:52.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:52.901+0000 7fed419ef640 1 --2- 172.21.15.72:0/3834329629 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fed3c074620 0x7fed3c143790 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fed340b0040 tx=0x7fed34019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:56:52.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:52.901+0000 7fed2e7fc640 1 -- 172.21.15.72:0/3834329629 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed340b2050 con 0x7fed3c074620 2024-05-09T05:56:52.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:52.901+0000 7fed2e7fc640 1 -- 172.21.15.72:0/3834329629 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed340be070 con 0x7fed3c074620 2024-05-09T05:56:52.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:52.901+0000 7fed43c53640 1 -- 172.21.15.72:0/3834329629 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed3c06f1c0 con 0x7fed3c074620 2024-05-09T05:56:52.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:52.901+0000 7fed2e7fc640 1 -- 172.21.15.72:0/3834329629 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed340ad850 con 0x7fed3c074620 2024-05-09T05:56:52.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:52.901+0000 7fed43c53640 1 -- 172.21.15.72:0/3834329629 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed3c06f780 con 0x7fed3c074620 2024-05-09T05:56:52.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:52.901+0000 7fed43c53640 1 -- 172.21.15.72:0/3834329629 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed3c06a520 con 0x7fed3c074620 2024-05-09T05:56:52.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:52.905+0000 7fed2e7fc640 1 -- 172.21.15.72:0/3834329629 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fed340ad9f0 con 0x7fed3c074620 2024-05-09T05:56:52.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:52.905+0000 7fed2e7fc640 1 --2- 172.21.15.72:0/3834329629 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fed2006f400 0x7fed20071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:52.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:52.905+0000 7fed2e7fc640 1 -- 172.21.15.72:0/3834329629 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6762+0+0 (secure 0 0 0) 0x7fed3412a840 con 0x7fed3c074620 2024-05-09T05:56:52.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:52.905+0000 7fed411ee640 1 --2- 172.21.15.72:0/3834329629 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fed2006f400 0x7fed20071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:52.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:52.905+0000 7fed411ee640 1 --2- 172.21.15.72:0/3834329629 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fed2006f400 0x7fed20071910 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fed3c0ca810 tx=0x7fed38008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:56:52.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:52.909+0000 7fed2e7fc640 1 -- 172.21.15.72:0/3834329629 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fed34016560 con 0x7fed3c074620 2024-05-09T05:56:53.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:53.093+0000 7fed43c53640 1 -- 172.21.15.72:0/3834329629 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fed3c0cb720 con 0x7fed3c074620 2024-05-09T05:56:53.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:53.093+0000 7fed2e7fc640 1 -- 172.21.15.72:0/3834329629 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+6089 (secure 0 0 0) 0x7fed340f7310 con 0x7fed3c074620 2024-05-09T05:56:53.080 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:56:53.080 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:53:23.494975+0000","modified":"2024-05-09T05:56:49.473793+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4297,"mds_1":4287,"mds_2":4263,"mds_3":4259,"mds_4":5007},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4259":{"gid":4259,"name":"f","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.110:6838/840351907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":840351907},{"type":"v1","addr":"172.21.15.110:6838","nonce":840351907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4263":{"gid":4263,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.72:6837/1048256382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":1048256382},{"type":"v1","addr":"172.21.15.72:6837","nonce":1048256382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.110:6839/966325499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6837","nonce":966325499},{"type":"v1","addr":"172.21.15.110:6839","nonce":966325499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6836/4134424941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":4134424941},{"type":"v1","addr":"172.21.15.110:6836","nonce":4134424941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5007":{"gid":5007,"name":"a","rank":4,"incarnation":26,"state":"up:resolve","state_seq":19,"addr":"172.21.15.72:6835/1972750715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":1972750715},{"type":"v1","addr":"172.21.15.72:6835","nonce":1972750715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4297,4287,4263,4259]},"id":1}]} 2024-05-09T05:56:53.081 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 27 2024-05-09T05:56:53.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:53.097+0000 7fed43c53640 1 -- 172.21.15.72:0/3834329629 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fed2006f400 msgr2=0x7fed20071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:53.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:53.097+0000 7fed43c53640 1 --2- 172.21.15.72:0/3834329629 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fed2006f400 0x7fed20071910 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fed3c0ca810 tx=0x7fed38008040 comp rx=0 tx=0).stop 2024-05-09T05:56:53.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:53.097+0000 7fed43c53640 1 -- 172.21.15.72:0/3834329629 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fed3c074620 msgr2=0x7fed3c143790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:53.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:53.097+0000 7fed43c53640 1 --2- 172.21.15.72:0/3834329629 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fed3c074620 0x7fed3c143790 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fed340b0040 tx=0x7fed34019680 comp rx=0 tx=0).stop 2024-05-09T05:56:53.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:53.097+0000 7fed43c53640 1 -- 172.21.15.72:0/3834329629 shutdown_connections 2024-05-09T05:56:53.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:53.097+0000 7fed43c53640 1 --2- 172.21.15.72:0/3834329629 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fed2006f400 0x7fed20071910 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:53.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:53.097+0000 7fed43c53640 1 --2- 172.21.15.72:0/3834329629 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fed3c15e4a0 0x7fed3c153e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:53.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:53.097+0000 7fed43c53640 1 --2- 172.21.15.72:0/3834329629 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fed3c0cc6b0 0x7fed3c153940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:53.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:53.097+0000 7fed43c53640 1 --2- 172.21.15.72:0/3834329629 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fed3c074620 0x7fed3c143790 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:53.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:53.097+0000 7fed43c53640 1 -- 172.21.15.72:0/3834329629 >> 172.21.15.72:0/3834329629 conn(0x7fed3c0cfc20 msgr2=0x7fed3c074a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:56:53.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:53.097+0000 7fed43c53640 1 -- 172.21.15.72:0/3834329629 shutdown_connections 2024-05-09T05:56:53.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:53.097+0000 7fed43c53640 1 -- 172.21.15.72:0/3834329629 wait complete. 2024-05-09T05:56:53.100 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-05-09T05:56:55.101 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:56:55.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.277+0000 7f8d80eb3640 1 Processor -- start 2024-05-09T05:56:55.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.277+0000 7f8d80eb3640 1 -- start start 2024-05-09T05:56:55.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.277+0000 7f8d80eb3640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8d7c15dea0 0x7f8d7c0745b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:55.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.277+0000 7f8d80eb3640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8d7c074af0 0x7f8d7c164e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:55.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.277+0000 7f8d80eb3640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d7c0c7c80 con 0x7f8d7c15da90 2024-05-09T05:56:55.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.277+0000 7f8d80eb3640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f8d7c1513f0 con 0x7f8d7c074af0 2024-05-09T05:56:55.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.277+0000 7f8d80eb3640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f8d7c15a4f0 con 0x7f8d7c15dea0 2024-05-09T05:56:55.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.277+0000 7f8d79d9b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8d7c15dea0 0x7f8d7c0745b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:55.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.277+0000 7f8d7ad9d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8d7c074af0 0x7f8d7c164e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:55.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.277+0000 7f8d79d9b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8d7c15dea0 0x7f8d7c0745b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.72:54882/0 (socket says 172.21.15.72:54882) 2024-05-09T05:56:55.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.277+0000 7f8d79d9b640 1 -- 172.21.15.72:0/3939097572 learned_addr learned my addr 172.21.15.72:0/3939097572 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:56:55.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.277+0000 7f8d7ad9d640 1 -- 172.21.15.72:0/3939097572 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8d7c15dea0 msgr2=0x7f8d7c0745b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:56:55.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.277+0000 7f8d7ad9d640 1 --2- 172.21.15.72:0/3939097572 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8d7c15dea0 0x7f8d7c0745b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:55.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.277+0000 7f8d7ad9d640 1 -- 172.21.15.72:0/3939097572 >> v1:172.21.15.110:6789/0 conn(0x7f8d7c15da90 legacy=0x7f8d7c0c7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:55.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.277+0000 7f8d7ad9d640 1 -- 172.21.15.72:0/3939097572 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d7c0c84f0 con 0x7f8d7c074af0 2024-05-09T05:56:55.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.281+0000 7f8d7ad9d640 1 --2- 172.21.15.72:0/3939097572 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d7c074af0 0x7f8d7c164e70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8d740097c0 tx=0x7f8d7401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86811f10f43b036d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:56:55.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.281+0000 7f8d7959a640 1 -- 172.21.15.72:0/3939097572 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d740b0070 con 0x7f8d7c074af0 2024-05-09T05:56:55.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.281+0000 7f8d7959a640 1 -- 172.21.15.72:0/3939097572 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d740ab600 con 0x7f8d7c074af0 2024-05-09T05:56:55.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.281+0000 7f8d7959a640 1 -- 172.21.15.72:0/3939097572 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d740ab9d0 con 0x7f8d7c074af0 2024-05-09T05:56:55.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.281+0000 7f8d80eb3640 1 -- 172.21.15.72:0/3939097572 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d7c074af0 msgr2=0x7f8d7c164e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:55.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.281+0000 7f8d80eb3640 1 --2- 172.21.15.72:0/3939097572 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d7c074af0 0x7f8d7c164e70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8d740097c0 tx=0x7f8d7401c4a0 comp rx=0 tx=0).stop 2024-05-09T05:56:55.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.281+0000 7f8d80eb3640 1 -- 172.21.15.72:0/3939097572 shutdown_connections 2024-05-09T05:56:55.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.281+0000 7f8d80eb3640 1 --2- 172.21.15.72:0/3939097572 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d7c074af0 0x7f8d7c164e70 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:55.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.281+0000 7f8d80eb3640 1 --2- 172.21.15.72:0/3939097572 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8d7c15dea0 0x7f8d7c0745b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:55.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.281+0000 7f8d80eb3640 1 -- 172.21.15.72:0/3939097572 >> 172.21.15.72:0/3939097572 conn(0x7f8d7c0cde90 msgr2=0x7f8d7c0ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:56:55.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.281+0000 7f8d80eb3640 1 -- 172.21.15.72:0/3939097572 shutdown_connections 2024-05-09T05:56:55.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.281+0000 7f8d80eb3640 1 -- 172.21.15.72:0/3939097572 wait complete. 2024-05-09T05:56:55.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.285+0000 7f8d80eb3640 1 Processor -- start 2024-05-09T05:56:55.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.285+0000 7f8d80eb3640 1 -- start start 2024-05-09T05:56:55.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.285+0000 7f8d80eb3640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d7c074af0 0x7f8d7c1f5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:55.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.285+0000 7f8d80eb3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d7c15da90 0x7f8d7c1437c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:55.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.285+0000 7f8d80eb3640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8d7c15dea0 0x7f8d7c14ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:55.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.285+0000 7f8d80eb3640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f8d7c0c70e0 con 0x7f8d7c074af0 2024-05-09T05:56:55.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.285+0000 7f8d80eb3640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f8d7c15ad70 con 0x7f8d7c15da90 2024-05-09T05:56:55.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.285+0000 7f8d80eb3640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f8d7c0c81b0 con 0x7f8d7c15dea0 2024-05-09T05:56:55.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.285+0000 7f8d7a59c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d7c074af0 0x7f8d7c1f5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:55.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.285+0000 7f8d7a59c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d7c074af0 0x7f8d7c1f5d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56212/0 (socket says 172.21.15.72:56212) 2024-05-09T05:56:55.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.285+0000 7f8d7a59c640 1 -- 172.21.15.72:0/4207023424 learned_addr learned my addr 172.21.15.72:0/4207023424 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:56:55.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.285+0000 7f8d79d9b640 1 --2- 172.21.15.72:0/4207023424 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d7c15da90 0x7f8d7c1437c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:55.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.285+0000 7f8d7ad9d640 1 --2- 172.21.15.72:0/4207023424 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8d7c15dea0 0x7f8d7c14ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:55.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.285+0000 7f8d7a59c640 1 -- 172.21.15.72:0/4207023424 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8d7c15dea0 msgr2=0x7f8d7c14ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:55.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.285+0000 7f8d7a59c640 1 --2- 172.21.15.72:0/4207023424 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8d7c15dea0 0x7f8d7c14ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:55.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.285+0000 7f8d7a59c640 1 -- 172.21.15.72:0/4207023424 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d7c15da90 msgr2=0x7f8d7c1437c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:55.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.285+0000 7f8d7a59c640 1 --2- 172.21.15.72:0/4207023424 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d7c15da90 0x7f8d7c1437c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:55.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.285+0000 7f8d7a59c640 1 -- 172.21.15.72:0/4207023424 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d7c0ca5c0 con 0x7f8d7c074af0 2024-05-09T05:56:55.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.285+0000 7f8d7ad9d640 1 --2- 172.21.15.72:0/4207023424 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8d7c15dea0 0x7f8d7c14ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:56:55.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.285+0000 7f8d7a59c640 1 --2- 172.21.15.72:0/4207023424 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d7c074af0 0x7f8d7c1f5d50 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c00c7d0 tx=0x7f8d6c00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:56:55.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.289+0000 7f8d6affd640 1 -- 172.21.15.72:0/4207023424 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c003b80 con 0x7f8d7c074af0 2024-05-09T05:56:55.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.289+0000 7f8d6affd640 1 -- 172.21.15.72:0/4207023424 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d6c003d20 con 0x7f8d7c074af0 2024-05-09T05:56:55.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.289+0000 7f8d80eb3640 1 -- 172.21.15.72:0/4207023424 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d7c1f9990 con 0x7f8d7c074af0 2024-05-09T05:56:55.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.289+0000 7f8d6affd640 1 -- 172.21.15.72:0/4207023424 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c00aa70 con 0x7f8d7c074af0 2024-05-09T05:56:55.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.289+0000 7f8d80eb3640 1 -- 172.21.15.72:0/4207023424 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d7c0ca270 con 0x7f8d7c074af0 2024-05-09T05:56:55.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.289+0000 7f8d80eb3640 1 -- 172.21.15.72:0/4207023424 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d7c06a520 con 0x7f8d7c074af0 2024-05-09T05:56:55.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.289+0000 7f8d6affd640 1 -- 172.21.15.72:0/4207023424 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f8d6c00ac10 con 0x7f8d7c074af0 2024-05-09T05:56:55.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.289+0000 7f8d6affd640 1 --2- 172.21.15.72:0/4207023424 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f8d5c06f400 0x7f8d5c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:55.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.289+0000 7f8d6affd640 1 -- 172.21.15.72:0/4207023424 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6762+0+0 (secure 0 0 0) 0x7f8d6c08f5e0 con 0x7f8d7c074af0 2024-05-09T05:56:55.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.289+0000 7f8d79d9b640 1 --2- 172.21.15.72:0/4207023424 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f8d5c06f400 0x7f8d5c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:55.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.289+0000 7f8d79d9b640 1 --2- 172.21.15.72:0/4207023424 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f8d5c06f400 0x7f8d5c071910 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c14afb0 tx=0x7f8d70008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:56:55.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.293+0000 7f8d6affd640 1 -- 172.21.15.72:0/4207023424 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f8d7c1f9990 con 0x7f8d7c074af0 2024-05-09T05:56:55.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.477+0000 7f8d80eb3640 1 -- 172.21.15.72:0/4207023424 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8d7c0c8b30 con 0x7f8d7c074af0 2024-05-09T05:56:55.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.481+0000 7f8d6affd640 1 -- 172.21.15.72:0/4207023424 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+6089 (secure 0 0 0) 0x7f8d6c05c140 con 0x7f8d7c074af0 2024-05-09T05:56:55.467 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:56:55.468 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:53:23.494975+0000","modified":"2024-05-09T05:56:49.473793+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4297,"mds_1":4287,"mds_2":4263,"mds_3":4259,"mds_4":5007},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4259":{"gid":4259,"name":"f","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.110:6838/840351907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":840351907},{"type":"v1","addr":"172.21.15.110:6838","nonce":840351907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4263":{"gid":4263,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.72:6837/1048256382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":1048256382},{"type":"v1","addr":"172.21.15.72:6837","nonce":1048256382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.110:6839/966325499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6837","nonce":966325499},{"type":"v1","addr":"172.21.15.110:6839","nonce":966325499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6836/4134424941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":4134424941},{"type":"v1","addr":"172.21.15.110:6836","nonce":4134424941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5007":{"gid":5007,"name":"a","rank":4,"incarnation":26,"state":"up:resolve","state_seq":19,"addr":"172.21.15.72:6835/1972750715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":1972750715},{"type":"v1","addr":"172.21.15.72:6835","nonce":1972750715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4297,4287,4263,4259]},"id":1}]} 2024-05-09T05:56:55.468 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 27 2024-05-09T05:56:55.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.481+0000 7f8d80eb3640 1 -- 172.21.15.72:0/4207023424 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f8d5c06f400 msgr2=0x7f8d5c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:55.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.481+0000 7f8d80eb3640 1 --2- 172.21.15.72:0/4207023424 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f8d5c06f400 0x7f8d5c071910 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c14afb0 tx=0x7f8d70008040 comp rx=0 tx=0).stop 2024-05-09T05:56:55.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.481+0000 7f8d80eb3640 1 -- 172.21.15.72:0/4207023424 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d7c074af0 msgr2=0x7f8d7c1f5d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:55.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.481+0000 7f8d80eb3640 1 --2- 172.21.15.72:0/4207023424 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d7c074af0 0x7f8d7c1f5d50 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c00c7d0 tx=0x7f8d6c00cc90 comp rx=0 tx=0).stop 2024-05-09T05:56:55.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.481+0000 7f8d80eb3640 1 -- 172.21.15.72:0/4207023424 shutdown_connections 2024-05-09T05:56:55.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.481+0000 7f8d80eb3640 1 --2- 172.21.15.72:0/4207023424 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f8d5c06f400 0x7f8d5c071910 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:55.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.481+0000 7f8d80eb3640 1 --2- 172.21.15.72:0/4207023424 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8d7c15dea0 0x7f8d7c14ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:55.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.481+0000 7f8d80eb3640 1 --2- 172.21.15.72:0/4207023424 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d7c15da90 0x7f8d7c1437c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:55.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.481+0000 7f8d80eb3640 1 --2- 172.21.15.72:0/4207023424 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d7c074af0 0x7f8d7c1f5d50 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:55.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.481+0000 7f8d80eb3640 1 -- 172.21.15.72:0/4207023424 >> 172.21.15.72:0/4207023424 conn(0x7f8d7c0cde90 msgr2=0x7f8d7c070580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:56:55.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.481+0000 7f8d80eb3640 1 -- 172.21.15.72:0/4207023424 shutdown_connections 2024-05-09T05:56:55.471 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:55.481+0000 7f8d80eb3640 1 -- 172.21.15.72:0/4207023424 wait complete. 2024-05-09T05:56:55.487 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-05-09T05:56:55.693 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T05:56:55.696 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T05:56:56.944 INFO:tasks.workunit.client.0.smithi072.stdout: 2024-05-09T05:56:56.944 INFO:tasks.workunit.client.0.smithi072.stdout: Children see throughput for 1 readers = 6507634.00 kB/sec 2024-05-09T05:56:56.944 INFO:tasks.workunit.client.0.smithi072.stdout: Parent sees throughput for 1 readers = 6480411.29 kB/sec 2024-05-09T05:56:56.944 INFO:tasks.workunit.client.0.smithi072.stdout: Min throughput per process = 6507634.00 kB/sec 2024-05-09T05:56:56.944 INFO:tasks.workunit.client.0.smithi072.stdout: Max throughput per process = 6507634.00 kB/sec 2024-05-09T05:56:56.945 INFO:tasks.workunit.client.0.smithi072.stdout: Avg throughput per process = 6507634.00 kB/sec 2024-05-09T05:56:56.945 INFO:tasks.workunit.client.0.smithi072.stdout: Min xfer = 1048576.00 kB 2024-05-09T05:56:57.488 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:56:57.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.661+0000 7f0858f19640 1 Processor -- start 2024-05-09T05:56:57.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.661+0000 7f0858f19640 1 -- start start 2024-05-09T05:56:57.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.665+0000 7f0858f19640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0854156bc0 0x7f08540c92c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:57.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.665+0000 7f0858f19640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f085415fd90 0x7f08541601a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:57.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.665+0000 7f0858f19640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08541606e0 con 0x7f085406d1b0 2024-05-09T05:56:57.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.665+0000 7f0858f19640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f085415d480 con 0x7f085415fd90 2024-05-09T05:56:57.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.665+0000 7f0858f19640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f0854156fd0 con 0x7f0854156bc0 2024-05-09T05:56:57.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.665+0000 7f0852d9d640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f085415fd90 0x7f08541601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:57.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.665+0000 7f0852d9d640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f085415fd90 0x7f08541601a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56224/0 (socket says 172.21.15.72:56224) 2024-05-09T05:56:57.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.665+0000 7f0852d9d640 1 -- 172.21.15.72:0/3771245188 learned_addr learned my addr 172.21.15.72:0/3771245188 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:56:57.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.665+0000 7f085259c640 1 --1- 172.21.15.72:0/3771245188 >> v1:172.21.15.72:6789/0 conn(0x7f085406d1b0 0x7f0854073ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52226/0 (socket says 172.21.15.72:52226) 2024-05-09T05:56:57.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.665+0000 7f0851d9b640 1 --2- 172.21.15.72:0/3771245188 >> v2:172.21.15.110:3300/0 conn(0x7f0854156bc0 0x7f08540c92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:57.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.665+0000 7f0852d9d640 1 -- 172.21.15.72:0/3771245188 >> v2:172.21.15.110:3300/0 conn(0x7f0854156bc0 msgr2=0x7f08540c92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:56:57.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.665+0000 7f0852d9d640 1 --2- 172.21.15.72:0/3771245188 >> v2:172.21.15.110:3300/0 conn(0x7f0854156bc0 0x7f08540c92c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:57.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.665+0000 7f0852d9d640 1 -- 172.21.15.72:0/3771245188 >> v1:172.21.15.72:6789/0 conn(0x7f085406d1b0 legacy=0x7f0854073ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:57.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.665+0000 7f085159a640 1 -- 172.21.15.72:0/3771245188 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2981576063 0 0) 0x7f0844001120 con 0x7f085406d1b0 2024-05-09T05:56:57.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.665+0000 7f0852d9d640 1 -- 172.21.15.72:0/3771245188 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08540c99b0 con 0x7f085415fd90 2024-05-09T05:56:57.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.669+0000 7f0852d9d640 1 --2- 172.21.15.72:0/3771245188 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f085415fd90 0x7f08541601a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f085415a450 tx=0x7f084c01f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0f27abcbae8b2ae server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:56:57.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.669+0000 7f085159a640 1 -- 172.21.15.72:0/3771245188 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f084c0b4070 con 0x7f085415fd90 2024-05-09T05:56:57.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.669+0000 7f085159a640 1 -- 172.21.15.72:0/3771245188 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f084c0af400 con 0x7f085415fd90 2024-05-09T05:56:57.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.669+0000 7f085159a640 1 -- 172.21.15.72:0/3771245188 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f084c0af7d0 con 0x7f085415fd90 2024-05-09T05:56:57.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.669+0000 7f0858f19640 1 -- 172.21.15.72:0/3771245188 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f085415fd90 msgr2=0x7f08541601a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:57.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.669+0000 7f0858f19640 1 --2- 172.21.15.72:0/3771245188 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f085415fd90 0x7f08541601a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f085415a450 tx=0x7f084c01f1e0 comp rx=0 tx=0).stop 2024-05-09T05:56:57.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.669+0000 7f0858f19640 1 -- 172.21.15.72:0/3771245188 shutdown_connections 2024-05-09T05:56:57.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.669+0000 7f0858f19640 1 --2- 172.21.15.72:0/3771245188 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f085415fd90 0x7f08541601a0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:57.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.669+0000 7f0858f19640 1 --2- 172.21.15.72:0/3771245188 >> v2:172.21.15.110:3300/0 conn(0x7f0854156bc0 0x7f08540c92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:57.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.669+0000 7f0858f19640 1 -- 172.21.15.72:0/3771245188 >> 172.21.15.72:0/3771245188 conn(0x7f08540ce8c0 msgr2=0x7f08540cecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:56:57.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.669+0000 7f0858f19640 1 -- 172.21.15.72:0/3771245188 shutdown_connections 2024-05-09T05:56:57.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.669+0000 7f0858f19640 1 -- 172.21.15.72:0/3771245188 wait complete. 2024-05-09T05:56:57.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.669+0000 7f0858f19640 1 Processor -- start 2024-05-09T05:56:57.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.669+0000 7f0858f19640 1 -- start start 2024-05-09T05:56:57.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.673+0000 7f0858f19640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f085406d1b0 0x7f08540cbba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:57.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.673+0000 7f0858f19640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0854156bc0 0x7f08541f6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:57.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.673+0000 7f0858f19640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f085415fd90 0x7f08541e5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:57.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.673+0000 7f0858f19640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f085415d110 con 0x7f0854156bc0 2024-05-09T05:56:57.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.673+0000 7f0858f19640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f085415ce30 con 0x7f085415fd90 2024-05-09T05:56:57.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.673+0000 7f0858f19640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f085415c820 con 0x7f085406d1b0 2024-05-09T05:56:57.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.673+0000 7f0851d9b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0854156bc0 0x7f08541f6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:57.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.673+0000 7f0851d9b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0854156bc0 0x7f08541f6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56238/0 (socket says 172.21.15.72:56238) 2024-05-09T05:56:57.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.673+0000 7f0851d9b640 1 -- 172.21.15.72:0/1812471942 learned_addr learned my addr 172.21.15.72:0/1812471942 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:56:57.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.673+0000 7f085259c640 1 --2- 172.21.15.72:0/1812471942 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f085406d1b0 0x7f08540cbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:57.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.673+0000 7f0852d9d640 1 --2- 172.21.15.72:0/1812471942 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f085415fd90 0x7f08541e5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:57.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.673+0000 7f0851d9b640 1 -- 172.21.15.72:0/1812471942 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f085406d1b0 msgr2=0x7f08540cbba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:57.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.673+0000 7f0851d9b640 1 --2- 172.21.15.72:0/1812471942 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f085406d1b0 0x7f08540cbba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:57.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.673+0000 7f0851d9b640 1 -- 172.21.15.72:0/1812471942 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f085415fd90 msgr2=0x7f08541e5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:57.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.673+0000 7f0851d9b640 1 --2- 172.21.15.72:0/1812471942 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f085415fd90 0x7f08541e5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:57.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.673+0000 7f0851d9b640 1 -- 172.21.15.72:0/1812471942 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f085415f6d0 con 0x7f0854156bc0 2024-05-09T05:56:57.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.673+0000 7f0851d9b640 1 --2- 172.21.15.72:0/1812471942 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0854156bc0 0x7f08541f6b90 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f084800d620 tx=0x7f084800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:56:57.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.673+0000 7f0842ffd640 1 -- 172.21.15.72:0/1812471942 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f084800b620 con 0x7f0854156bc0 2024-05-09T05:56:57.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.673+0000 7f0842ffd640 1 -- 172.21.15.72:0/1812471942 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0848019070 con 0x7f0854156bc0 2024-05-09T05:56:57.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.673+0000 7f0858f19640 1 -- 172.21.15.72:0/1812471942 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08541f70d0 con 0x7f0854156bc0 2024-05-09T05:56:57.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.673+0000 7f0842ffd640 1 -- 172.21.15.72:0/1812471942 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f084800ba20 con 0x7f0854156bc0 2024-05-09T05:56:57.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.673+0000 7f0858f19640 1 -- 172.21.15.72:0/1812471942 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f085415f110 con 0x7f0854156bc0 2024-05-09T05:56:57.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.673+0000 7f0858f19640 1 -- 172.21.15.72:0/1812471942 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f085406a520 con 0x7f0854156bc0 2024-05-09T05:56:57.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.673+0000 7f0842ffd640 1 -- 172.21.15.72:0/1812471942 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f084800bbc0 con 0x7f0854156bc0 2024-05-09T05:56:57.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.673+0000 7f0842ffd640 1 --2- 172.21.15.72:0/1812471942 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f083406f400 0x7f0834071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:56:57.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.673+0000 7f0842ffd640 1 -- 172.21.15.72:0/1812471942 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6762+0+0 (secure 0 0 0) 0x7f084808fb90 con 0x7f0854156bc0 2024-05-09T05:56:57.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.677+0000 7f085259c640 1 --2- 172.21.15.72:0/1812471942 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f083406f400 0x7f0834071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:56:57.664 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.677+0000 7f085259c640 1 --2- 172.21.15.72:0/1812471942 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f083406f400 0x7f0834071910 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0844000f70 tx=0x7f0844007c10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:56:57.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.681+0000 7f0842ffd640 1 -- 172.21.15.72:0/1812471942 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f084805c660 con 0x7f0854156bc0 2024-05-09T05:56:57.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.877+0000 7f0858f19640 1 -- 172.21.15.72:0/1812471942 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f085415ee60 con 0x7f0854156bc0 2024-05-09T05:56:57.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.881+0000 7f0842ffd640 1 -- 172.21.15.72:0/1812471942 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+6091 (secure 0 0 0) 0x7f084805bf60 con 0x7f0854156bc0 2024-05-09T05:56:57.867 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:56:57.867 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:53:23.494975+0000","modified":"2024-05-09T05:56:55.122323+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4297,"mds_1":4287,"mds_2":4263,"mds_3":4259,"mds_4":5007},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4259":{"gid":4259,"name":"f","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.110:6838/840351907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":840351907},{"type":"v1","addr":"172.21.15.110:6838","nonce":840351907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4263":{"gid":4263,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.72:6837/1048256382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":1048256382},{"type":"v1","addr":"172.21.15.72:6837","nonce":1048256382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.110:6839/966325499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6837","nonce":966325499},{"type":"v1","addr":"172.21.15.110:6839","nonce":966325499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6836/4134424941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":4134424941},{"type":"v1","addr":"172.21.15.110:6836","nonce":4134424941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5007":{"gid":5007,"name":"a","rank":4,"incarnation":26,"state":"up:reconnect","state_seq":21,"addr":"172.21.15.72:6835/1972750715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":1972750715},{"type":"v1","addr":"172.21.15.72:6835","nonce":1972750715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4259,4263,4287,4297]},"id":1}]} 2024-05-09T05:56:57.867 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 28 2024-05-09T05:56:57.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.881+0000 7f0858f19640 1 -- 172.21.15.72:0/1812471942 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f083406f400 msgr2=0x7f0834071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:57.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.881+0000 7f0858f19640 1 --2- 172.21.15.72:0/1812471942 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f083406f400 0x7f0834071910 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0844000f70 tx=0x7f0844007c10 comp rx=0 tx=0).stop 2024-05-09T05:56:57.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.881+0000 7f0858f19640 1 -- 172.21.15.72:0/1812471942 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0854156bc0 msgr2=0x7f08541f6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:56:57.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.881+0000 7f0858f19640 1 --2- 172.21.15.72:0/1812471942 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0854156bc0 0x7f08541f6b90 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f084800d620 tx=0x7f084800dae0 comp rx=0 tx=0).stop 2024-05-09T05:56:57.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.881+0000 7f0858f19640 1 -- 172.21.15.72:0/1812471942 shutdown_connections 2024-05-09T05:56:57.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.881+0000 7f0858f19640 1 --2- 172.21.15.72:0/1812471942 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f083406f400 0x7f0834071910 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:57.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.881+0000 7f0858f19640 1 --2- 172.21.15.72:0/1812471942 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f085415fd90 0x7f08541e5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:57.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.881+0000 7f0858f19640 1 --2- 172.21.15.72:0/1812471942 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0854156bc0 0x7f08541f6b90 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:57.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.881+0000 7f0858f19640 1 --2- 172.21.15.72:0/1812471942 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f085406d1b0 0x7f08540cbba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:56:57.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.881+0000 7f0858f19640 1 -- 172.21.15.72:0/1812471942 >> 172.21.15.72:0/1812471942 conn(0x7f08540ce8c0 msgr2=0x7f085406c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:56:57.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.881+0000 7f0858f19640 1 -- 172.21.15.72:0/1812471942 shutdown_connections 2024-05-09T05:56:57.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:56:57.881+0000 7f0858f19640 1 -- 172.21.15.72:0/1812471942 wait complete. 2024-05-09T05:56:57.889 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 28, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-05-09T05:53:23.494975+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 28, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0, 1, 2, 3, 4 ], "info": { "gid_4259": { "addr": "172.21.15.110:6838/840351907", "addrs": { "addrvec": [ { "addr": "172.21.15.110:6835", "nonce": 840351907, "type": "v2" }, { "addr": "172.21.15.110:6838", "nonce": 840351907, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4259, "incarnation": 16, "join_fscid": -1, "name": "f", "rank": 3, "state": "up:active", "state_seq": 13 }, "gid_4263": { "addr": "172.21.15.72:6837/1048256382", "addrs": { "addrvec": [ { "addr": "172.21.15.72:6836", "nonce": 1048256382, "type": "v2" }, { "addr": "172.21.15.72:6837", "nonce": 1048256382, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4263, "incarnation": 14, "join_fscid": -1, "name": "c", "rank": 2, "state": "up:active", "state_seq": 12 }, "gid_4287": { "addr": "172.21.15.110:6839/966325499", "addrs": { "addrvec": [ { "addr": "172.21.15.110:6837", "nonce": 966325499, "type": "v2" }, { "addr": "172.21.15.110:6839", "nonce": 966325499, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4287, "incarnation": 10, "join_fscid": -1, "name": "d", "rank": 1, "state": "up:active", "state_seq": 10 }, "gid_4297": { "addr": "172.21.15.110:6836/4134424941", "addrs": { "addrvec": [ { "addr": "172.21.15.110:6834", "nonce": 4134424941, "type": "v2" }, { "addr": "172.21.15.110:6836", "nonce": 4134424941, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4297, "incarnation": 4, "join_fscid": -1, "name": "b", "rank": 0, "state": "up:active", "state_seq": 4 }, "gid_5007": { "addr": "172.21.15.72:6835/1972750715", "addrs": { "addrvec": [ { "addr": "172.21.15.72:6833", "nonce": 1972750715, "type": "v2" }, { "addr": "172.21.15.72:6835", "nonce": 1972750715, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5007, "incarnation": 26, "join_fscid": -1, "name": "a", "rank": 4, "state": "up:reconnect", "state_seq": 21 } }, "last_failure": 0, "last_failure_osd_epoch": 29, "max_file_size": 1099511627776, "max_mds": 5, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-05-09T05:56:55.122323+0000", "qdb_cluster": [ 4259, 4263, 4287, 4297 ], "qdb_leader": 4297, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4297, "mds_1": 4287, "mds_2": 4263, "mds_3": 4259, "mds_4": 5007 } } } ], "standbys": [] } 2024-05-09T05:56:59.293 INFO:tasks.workunit.client.0.smithi072.stdout: 2024-05-09T05:56:59.293 INFO:tasks.workunit.client.0.smithi072.stdout: Children see throughput for 1 re-readers = 5305327.50 kB/sec 2024-05-09T05:56:59.293 INFO:tasks.workunit.client.0.smithi072.stdout: Parent sees throughput for 1 re-readers = 5286788.39 kB/sec 2024-05-09T05:56:59.293 INFO:tasks.workunit.client.0.smithi072.stdout: Min throughput per process = 5305327.50 kB/sec 2024-05-09T05:56:59.293 INFO:tasks.workunit.client.0.smithi072.stdout: Max throughput per process = 5305327.50 kB/sec 2024-05-09T05:56:59.293 INFO:tasks.workunit.client.0.smithi072.stdout: Avg throughput per process = 5305327.50 kB/sec 2024-05-09T05:56:59.293 INFO:tasks.workunit.client.0.smithi072.stdout: Min xfer = 1048576.00 kB 2024-05-09T05:56:59.890 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:57:00.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.065+0000 7f2bfb89a640 1 Processor -- start 2024-05-09T05:57:00.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.065+0000 7f2bfb89a640 1 -- start start 2024-05-09T05:57:00.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.065+0000 7f2bfb89a640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2bf4163e70 0x7f2bf4166290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:57:00.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.065+0000 7f2bfb89a640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bf40c7c80 con 0x7f2bf415dea0 2024-05-09T05:57:00.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.065+0000 7f2bfb89a640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bf415a4f0 con 0x7f2bf415da90 2024-05-09T05:57:00.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.065+0000 7f2bfb89a640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f2bf41513f0 con 0x7f2bf4163e70 2024-05-09T05:57:00.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.065+0000 7f2bf8e35640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f2bf415dea0 0x7f2bf40745b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52236/0 (socket says 172.21.15.72:52236) 2024-05-09T05:57:00.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.065+0000 7f2bf8e35640 1 -- 172.21.15.72:0/1934265700 learned_addr learned my addr 172.21.15.72:0/1934265700 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:57:00.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.065+0000 7f2bf9e37640 1 --2- 172.21.15.72:0/1934265700 >> v2:172.21.15.110:3300/0 conn(0x7f2bf4163e70 0x7f2bf4166290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:57:00.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.065+0000 7f2bebfff640 1 -- 172.21.15.72:0/1934265700 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2937741743 0 0) 0x7f2bf40c7c80 con 0x7f2bf415dea0 2024-05-09T05:57:00.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.065+0000 7f2bebfff640 1 -- 172.21.15.72:0/1934265700 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2be0003530 con 0x7f2bf415dea0 2024-05-09T05:57:00.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.065+0000 7f2bebfff640 1 -- 172.21.15.72:0/1934265700 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2326533393 0 0) 0x7f2be0003530 con 0x7f2bf415dea0 2024-05-09T05:57:00.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.065+0000 7f2bebfff640 1 -- 172.21.15.72:0/1934265700 >> v2:172.21.15.110:3300/0 conn(0x7f2bf4163e70 msgr2=0x7f2bf4166290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:57:00.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.065+0000 7f2bebfff640 1 --2- 172.21.15.72:0/1934265700 >> v2:172.21.15.110:3300/0 conn(0x7f2bf4163e70 0x7f2bf4166290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:57:00.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.065+0000 7f2bebfff640 1 -- 172.21.15.72:0/1934265700 >> v1:172.21.15.110:6789/0 conn(0x7f2bf415da90 legacy=0x7f2bf40c7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:57:00.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.065+0000 7f2bebfff640 1 -- 172.21.15.72:0/1934265700 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bf40c84f0 con 0x7f2bf415dea0 2024-05-09T05:57:00.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.065+0000 7f2bebfff640 1 -- 172.21.15.72:0/1934265700 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2749052815 0 0) 0x7f2be4001700 con 0x7f2bf415dea0 2024-05-09T05:57:00.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.065+0000 7f2bebfff640 1 -- 172.21.15.72:0/1934265700 >> v1:172.21.15.72:6789/0 conn(0x7f2bf415dea0 legacy=0x7f2bf40745b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:57:00.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.065+0000 7f2bebfff640 1 --2- 172.21.15.72:0/1934265700 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2be0003a60 0x7f2be0003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:57:00.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.065+0000 7f2bebfff640 1 --2- 172.21.15.72:0/1934265700 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2be0004810 0x7f2be0004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:57:00.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.065+0000 7f2bebfff640 1 --2- 172.21.15.72:0/1934265700 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2be0005260 0x7f2be000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:57:00.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.065+0000 7f2bebfff640 1 -- 172.21.15.72:0/1934265700 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f2be000c1c0 con 0x7f2be0004810 2024-05-09T05:57:00.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.065+0000 7f2bebfff640 1 -- 172.21.15.72:0/1934265700 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f2be000c370 con 0x7f2be0003a60 2024-05-09T05:57:00.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.065+0000 7f2bebfff640 1 -- 172.21.15.72:0/1934265700 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f2be000c570 con 0x7f2be0005260 2024-05-09T05:57:00.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.065+0000 7f2bf8e35640 1 --2- 172.21.15.72:0/1934265700 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2be0004810 0x7f2be0004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:57:00.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.065+0000 7f2bf9e37640 1 --2- 172.21.15.72:0/1934265700 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2be0005260 0x7f2be000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:57:00.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.065+0000 7f2bf9636640 1 --2- 172.21.15.72:0/1934265700 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2be0003a60 0x7f2be0003ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:57:00.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.069+0000 7f2bf8e35640 1 -- 172.21.15.72:0/1934265700 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2be0005260 msgr2=0x7f2be000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:57:00.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.069+0000 7f2bf8e35640 1 --2- 172.21.15.72:0/1934265700 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2be0005260 0x7f2be000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:57:00.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.069+0000 7f2bf8e35640 1 -- 172.21.15.72:0/1934265700 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2be0003a60 msgr2=0x7f2be0003ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:57:00.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.069+0000 7f2bf8e35640 1 --2- 172.21.15.72:0/1934265700 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2be0003a60 0x7f2be0003ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:57:00.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.069+0000 7f2bf8e35640 1 -- 172.21.15.72:0/1934265700 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2be0003530 con 0x7f2be0004810 2024-05-09T05:57:00.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.069+0000 7f2bf9e37640 1 -- 172.21.15.72:0/1934265700 reap_dead start 2024-05-09T05:57:00.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.069+0000 7f2bf8e35640 1 --2- 172.21.15.72:0/1934265700 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2be0004810 0x7f2be0004c20 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f2be4001060 tx=0x7f2be401f270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2faf738f90da8a31 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:57:00.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.069+0000 7f2bebfff640 1 -- 172.21.15.72:0/1934265700 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be4007d20 con 0x7f2be0004810 2024-05-09T05:57:00.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.069+0000 7f2bebfff640 1 -- 172.21.15.72:0/1934265700 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2be4005ae0 con 0x7f2be0004810 2024-05-09T05:57:00.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.069+0000 7f2bebfff640 1 -- 172.21.15.72:0/1934265700 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be4007070 con 0x7f2be0004810 2024-05-09T05:57:00.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.069+0000 7f2bfb89a640 1 -- 172.21.15.72:0/1934265700 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2be0004810 msgr2=0x7f2be0004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:57:00.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.069+0000 7f2bfb89a640 1 --2- 172.21.15.72:0/1934265700 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2be0004810 0x7f2be0004c20 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f2be4001060 tx=0x7f2be401f270 comp rx=0 tx=0).stop 2024-05-09T05:57:00.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.069+0000 7f2bfb89a640 1 -- 172.21.15.72:0/1934265700 shutdown_connections 2024-05-09T05:57:00.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.069+0000 7f2bfb89a640 1 --2- 172.21.15.72:0/1934265700 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2be0004810 0x7f2be0004c20 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:57:00.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.069+0000 7f2bfb89a640 1 -- 172.21.15.72:0/1934265700 >> 172.21.15.72:0/1934265700 conn(0x7f2bf40cde90 msgr2=0x7f2bf40ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:57:00.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.069+0000 7f2bfb89a640 1 -- 172.21.15.72:0/1934265700 shutdown_connections 2024-05-09T05:57:00.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.069+0000 7f2bfb89a640 1 -- 172.21.15.72:0/1934265700 wait complete. 2024-05-09T05:57:00.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.073+0000 7f2bfb89a640 1 Processor -- start 2024-05-09T05:57:00.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.073+0000 7f2bfb89a640 1 -- start start 2024-05-09T05:57:00.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.073+0000 7f2bfb89a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2be0004810 0x7f2bf41507a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:57:00.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.073+0000 7f2bfb89a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2bf414d9d0 0x7f2bf41f0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:57:00.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.073+0000 7f2bfb89a640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bf40cc900 0x7f2bf4146f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:57:00.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.073+0000 7f2bfb89a640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf415aa90 con 0x7f2bf40cc900 2024-05-09T05:57:00.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.073+0000 7f2bfb89a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf415a7b0 con 0x7f2bf414d9d0 2024-05-09T05:57:00.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.073+0000 7f2bfb89a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f2bf415ad70 con 0x7f2be0004810 2024-05-09T05:57:00.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.073+0000 7f2bf9e37640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bf40cc900 0x7f2bf4146f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:57:00.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.073+0000 7f2bf9e37640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bf40cc900 0x7f2bf4146f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56258/0 (socket says 172.21.15.72:56258) 2024-05-09T05:57:00.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.073+0000 7f2bf9e37640 1 -- 172.21.15.72:0/2239606824 learned_addr learned my addr 172.21.15.72:0/2239606824 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:57:00.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.073+0000 7f2bf9636640 1 --2- 172.21.15.72:0/2239606824 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2be0004810 0x7f2bf41507a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:57:00.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.073+0000 7f2bf8e35640 1 --2- 172.21.15.72:0/2239606824 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2bf414d9d0 0x7f2bf41f0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:57:00.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.073+0000 7f2bf9e37640 1 -- 172.21.15.72:0/2239606824 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2be0004810 msgr2=0x7f2bf41507a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:57:00.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.073+0000 7f2bf9e37640 1 --2- 172.21.15.72:0/2239606824 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2be0004810 0x7f2bf41507a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:57:00.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.073+0000 7f2bf9e37640 1 -- 172.21.15.72:0/2239606824 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2bf414d9d0 msgr2=0x7f2bf41f0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:57:00.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.073+0000 7f2bf9e37640 1 --2- 172.21.15.72:0/2239606824 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2bf414d9d0 0x7f2bf41f0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:57:00.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.073+0000 7f2bf9e37640 1 -- 172.21.15.72:0/2239606824 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bf414c200 con 0x7f2bf40cc900 2024-05-09T05:57:00.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.073+0000 7f2bf9e37640 1 --2- 172.21.15.72:0/2239606824 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bf40cc900 0x7f2bf4146f10 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4070f50 tx=0x7f2bec0115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:57:00.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.073+0000 7f2be9ffb640 1 -- 172.21.15.72:0/2239606824 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bec011de0 con 0x7f2bf40cc900 2024-05-09T05:57:00.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.073+0000 7f2be9ffb640 1 -- 172.21.15.72:0/2239606824 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bec01b070 con 0x7f2bf40cc900 2024-05-09T05:57:00.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.073+0000 7f2bfb89a640 1 -- 172.21.15.72:0/2239606824 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bf41f3d70 con 0x7f2bf40cc900 2024-05-09T05:57:00.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.073+0000 7f2be9ffb640 1 -- 172.21.15.72:0/2239606824 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bec0039a0 con 0x7f2bf40cc900 2024-05-09T05:57:00.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.073+0000 7f2bfb89a640 1 -- 172.21.15.72:0/2239606824 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bf41f42f0 con 0x7f2bf40cc900 2024-05-09T05:57:00.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.077+0000 7f2bfb89a640 1 -- 172.21.15.72:0/2239606824 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bf406a520 con 0x7f2bf40cc900 2024-05-09T05:57:00.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.077+0000 7f2be9ffb640 1 -- 172.21.15.72:0/2239606824 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f2bec003b40 con 0x7f2bf40cc900 2024-05-09T05:57:00.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.077+0000 7f2be9ffb640 1 --2- 172.21.15.72:0/2239606824 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f2bd806f430 0x7f2bd8071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:57:00.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.077+0000 7f2be9ffb640 1 -- 172.21.15.72:0/2239606824 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6762+0+0 (secure 0 0 0) 0x7f2bec08ff50 con 0x7f2bf40cc900 2024-05-09T05:57:00.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.077+0000 7f2bf9636640 1 --2- 172.21.15.72:0/2239606824 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f2bd806f430 0x7f2bd8071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:57:00.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.077+0000 7f2bf9636640 1 --2- 172.21.15.72:0/2239606824 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f2bd806f430 0x7f2bd8071940 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2bf40754b0 tx=0x7f2bf0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:57:00.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.081+0000 7f2be9ffb640 1 -- 172.21.15.72:0/2239606824 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f2bec025020 con 0x7f2bf40cc900 2024-05-09T05:57:00.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.277+0000 7f2bfb89a640 1 -- 172.21.15.72:0/2239606824 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2bf40c8b30 con 0x7f2bf40cc900 2024-05-09T05:57:00.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.281+0000 7f2be9ffb640 1 -- 172.21.15.72:0/2239606824 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+6091 (secure 0 0 0) 0x7f2bec05cab0 con 0x7f2bf40cc900 2024-05-09T05:57:00.266 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:57:00.266 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:53:23.494975+0000","modified":"2024-05-09T05:56:55.122323+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4297,"mds_1":4287,"mds_2":4263,"mds_3":4259,"mds_4":5007},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4259":{"gid":4259,"name":"f","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.110:6838/840351907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":840351907},{"type":"v1","addr":"172.21.15.110:6838","nonce":840351907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4263":{"gid":4263,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.72:6837/1048256382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":1048256382},{"type":"v1","addr":"172.21.15.72:6837","nonce":1048256382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.110:6839/966325499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6837","nonce":966325499},{"type":"v1","addr":"172.21.15.110:6839","nonce":966325499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6836/4134424941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":4134424941},{"type":"v1","addr":"172.21.15.110:6836","nonce":4134424941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5007":{"gid":5007,"name":"a","rank":4,"incarnation":26,"state":"up:reconnect","state_seq":21,"addr":"172.21.15.72:6835/1972750715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":1972750715},{"type":"v1","addr":"172.21.15.72:6835","nonce":1972750715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4259,4263,4287,4297]},"id":1}]} 2024-05-09T05:57:00.267 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 28 2024-05-09T05:57:00.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.281+0000 7f2bfb89a640 1 -- 172.21.15.72:0/2239606824 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f2bd806f430 msgr2=0x7f2bd8071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:57:00.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.281+0000 7f2bfb89a640 1 --2- 172.21.15.72:0/2239606824 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f2bd806f430 0x7f2bd8071940 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2bf40754b0 tx=0x7f2bf0009040 comp rx=0 tx=0).stop 2024-05-09T05:57:00.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.281+0000 7f2bfb89a640 1 -- 172.21.15.72:0/2239606824 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bf40cc900 msgr2=0x7f2bf4146f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:57:00.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.281+0000 7f2bfb89a640 1 --2- 172.21.15.72:0/2239606824 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bf40cc900 0x7f2bf4146f10 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4070f50 tx=0x7f2bec0115a0 comp rx=0 tx=0).stop 2024-05-09T05:57:00.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.281+0000 7f2bfb89a640 1 -- 172.21.15.72:0/2239606824 shutdown_connections 2024-05-09T05:57:00.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.281+0000 7f2bfb89a640 1 --2- 172.21.15.72:0/2239606824 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f2bd806f430 0x7f2bd8071940 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:57:00.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.281+0000 7f2bfb89a640 1 --2- 172.21.15.72:0/2239606824 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bf40cc900 0x7f2bf4146f10 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:57:00.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.281+0000 7f2bfb89a640 1 --2- 172.21.15.72:0/2239606824 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2bf414d9d0 0x7f2bf41f0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:57:00.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.281+0000 7f2bfb89a640 1 --2- 172.21.15.72:0/2239606824 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2be0004810 0x7f2bf41507a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:57:00.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.281+0000 7f2bfb89a640 1 -- 172.21.15.72:0/2239606824 >> 172.21.15.72:0/2239606824 conn(0x7f2bf40cde90 msgr2=0x7f2bf4159880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:57:00.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.281+0000 7f2bfb89a640 1 -- 172.21.15.72:0/2239606824 shutdown_connections 2024-05-09T05:57:00.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:00.281+0000 7f2bfb89a640 1 -- 172.21.15.72:0/2239606824 wait complete. 2024-05-09T05:57:00.286 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-05-09T05:57:02.287 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:57:02.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.461+0000 7f5eff454640 1 Processor -- start 2024-05-09T05:57:02.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.461+0000 7f5eff454640 1 -- start start 2024-05-09T05:57:02.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.465+0000 7f5eff454640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5ef8153860 0x7f5ef80c6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:57:02.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.465+0000 7f5eff454640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ef8072b00 con 0x7f5ef8159ed0 2024-05-09T05:57:02.453 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.465+0000 7f5eff454640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ef8072540 con 0x7f5ef80c7210 2024-05-09T05:57:02.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.465+0000 7f5eff454640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f5ef8153c70 con 0x7f5ef8153860 2024-05-09T05:57:02.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.465+0000 7f5efd1f0640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f5ef8159ed0 0x7f5ef8072f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:40768/0 (socket says 172.21.15.72:40768) 2024-05-09T05:57:02.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.465+0000 7f5efd1f0640 1 -- 172.21.15.72:0/1757267194 learned_addr learned my addr 172.21.15.72:0/1757267194 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:57:02.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.465+0000 7f5efc9ef640 1 --2- 172.21.15.72:0/1757267194 >> v2:172.21.15.110:3300/0 conn(0x7f5ef8153860 0x7f5ef80c6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:57:02.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.465+0000 7f5eeffff640 1 -- 172.21.15.72:0/1757267194 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3997203961 0 0) 0x7f5ef8072b00 con 0x7f5ef8159ed0 2024-05-09T05:57:02.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.465+0000 7f5eeffff640 1 -- 172.21.15.72:0/1757267194 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ee4003530 con 0x7f5ef8159ed0 2024-05-09T05:57:02.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.465+0000 7f5eeffff640 1 -- 172.21.15.72:0/1757267194 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3267362059 0 0) 0x7f5ee4003530 con 0x7f5ef8159ed0 2024-05-09T05:57:02.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.465+0000 7f5eeffff640 1 -- 172.21.15.72:0/1757267194 >> v2:172.21.15.110:3300/0 conn(0x7f5ef8153860 msgr2=0x7f5ef80c6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:57:02.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.465+0000 7f5eeffff640 1 --2- 172.21.15.72:0/1757267194 >> v2:172.21.15.110:3300/0 conn(0x7f5ef8153860 0x7f5ef80c6cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:57:02.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.465+0000 7f5eeffff640 1 -- 172.21.15.72:0/1757267194 >> v1:172.21.15.110:6789/0 conn(0x7f5ef80c7210 legacy=0x7f5ef8163d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:57:02.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.465+0000 7f5eeffff640 1 -- 172.21.15.72:0/1757267194 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ef8072820 con 0x7f5ef8159ed0 2024-05-09T05:57:02.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.465+0000 7f5eeffff640 1 -- 172.21.15.72:0/1757267194 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2749052815 0 0) 0x7f5ef4001700 con 0x7f5ef8159ed0 2024-05-09T05:57:02.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.465+0000 7f5eeffff640 1 -- 172.21.15.72:0/1757267194 >> v1:172.21.15.72:6789/0 conn(0x7f5ef8159ed0 legacy=0x7f5ef8072f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:57:02.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.465+0000 7f5eeffff640 1 --2- 172.21.15.72:0/1757267194 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ee4003a60 0x7f5ee4003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:57:02.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.465+0000 7f5eeffff640 1 --2- 172.21.15.72:0/1757267194 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ee4004810 0x7f5ee4004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:57:02.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.465+0000 7f5eeffff640 1 --2- 172.21.15.72:0/1757267194 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ee4005260 0x7f5ee400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:57:02.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.465+0000 7f5eeffff640 1 -- 172.21.15.72:0/1757267194 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f5ef8153c70 con 0x7f5ee4004810 2024-05-09T05:57:02.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.465+0000 7f5eeffff640 1 -- 172.21.15.72:0/1757267194 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee400c1e0 con 0x7f5ee4005260 2024-05-09T05:57:02.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.465+0000 7f5eeffff640 1 -- 172.21.15.72:0/1757267194 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f5ee400c3e0 con 0x7f5ee4003a60 2024-05-09T05:57:02.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.465+0000 7f5efc9ef640 1 --2- 172.21.15.72:0/1757267194 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ee4004810 0x7f5ee4004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:57:02.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.465+0000 7f5efd1f0640 1 --2- 172.21.15.72:0/1757267194 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ee4003a60 0x7f5ee4003ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:57:02.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.465+0000 7f5efd9f1640 1 --2- 172.21.15.72:0/1757267194 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ee4005260 0x7f5ee400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:57:02.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.465+0000 7f5efc9ef640 1 -- 172.21.15.72:0/1757267194 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ee4003a60 msgr2=0x7f5ee4003ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:57:02.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.465+0000 7f5efc9ef640 1 --2- 172.21.15.72:0/1757267194 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ee4003a60 0x7f5ee4003ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:57:02.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.465+0000 7f5efc9ef640 1 -- 172.21.15.72:0/1757267194 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ee4005260 msgr2=0x7f5ee400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:57:02.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.465+0000 7f5efc9ef640 1 --2- 172.21.15.72:0/1757267194 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ee4005260 0x7f5ee400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:57:02.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.465+0000 7f5efc9ef640 1 -- 172.21.15.72:0/1757267194 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ee4003530 con 0x7f5ee4004810 2024-05-09T05:57:02.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.465+0000 7f5efd9f1640 1 --2- 172.21.15.72:0/1757267194 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ee4005260 0x7f5ee400b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:57:02.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.465+0000 7f5efd9f1640 1 -- 172.21.15.72:0/1757267194 reap_dead start 2024-05-09T05:57:02.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.469+0000 7f5efc9ef640 1 --2- 172.21.15.72:0/1757267194 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ee4004810 0x7f5ee4004c20 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f5ee8009ab0 tx=0x7f5ee801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=200c1b96f59ea12c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:57:02.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.469+0000 7f5eeffff640 1 -- 172.21.15.72:0/1757267194 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee80b2070 con 0x7f5ee4004810 2024-05-09T05:57:02.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.469+0000 7f5eeffff640 1 -- 172.21.15.72:0/1757267194 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ee80a5640 con 0x7f5ee4004810 2024-05-09T05:57:02.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.469+0000 7f5eeffff640 1 -- 172.21.15.72:0/1757267194 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee80096b0 con 0x7f5ee4004810 2024-05-09T05:57:02.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.469+0000 7f5eff454640 1 -- 172.21.15.72:0/1757267194 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ee4004810 msgr2=0x7f5ee4004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:57:02.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.469+0000 7f5eff454640 1 --2- 172.21.15.72:0/1757267194 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ee4004810 0x7f5ee4004c20 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f5ee8009ab0 tx=0x7f5ee801ca50 comp rx=0 tx=0).stop 2024-05-09T05:57:02.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.469+0000 7f5eff454640 1 -- 172.21.15.72:0/1757267194 shutdown_connections 2024-05-09T05:57:02.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.469+0000 7f5eff454640 1 --2- 172.21.15.72:0/1757267194 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ee4004810 0x7f5ee4004c20 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:57:02.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.469+0000 7f5eff454640 1 -- 172.21.15.72:0/1757267194 >> 172.21.15.72:0/1757267194 conn(0x7f5ef80cde90 msgr2=0x7f5ef80ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:57:02.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.469+0000 7f5eff454640 1 -- 172.21.15.72:0/1757267194 shutdown_connections 2024-05-09T05:57:02.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.469+0000 7f5eff454640 1 -- 172.21.15.72:0/1757267194 wait complete. 2024-05-09T05:57:02.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.469+0000 7f5eff454640 1 Processor -- start 2024-05-09T05:57:02.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.473+0000 7f5eff454640 1 -- start start 2024-05-09T05:57:02.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.473+0000 7f5eff454640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ee4004810 0x7f5ef8156a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:57:02.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.473+0000 7f5eff454640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ef815d3a0 0x7f5ef81499d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:57:02.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.473+0000 7f5eff454640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ef815c610 0x7f5ef815ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:57:02.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.473+0000 7f5eff454640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f5ef80c4920 con 0x7f5ee4004810 2024-05-09T05:57:02.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.473+0000 7f5eff454640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f5ef80c7620 con 0x7f5ef815d3a0 2024-05-09T05:57:02.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.473+0000 7f5eff454640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f5ef80c4cb0 con 0x7f5ef815c610 2024-05-09T05:57:02.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.473+0000 7f5efd1f0640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ee4004810 0x7f5ef8156a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:57:02.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.473+0000 7f5efd1f0640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ee4004810 0x7f5ef8156a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55202/0 (socket says 172.21.15.72:55202) 2024-05-09T05:57:02.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.473+0000 7f5efd1f0640 1 -- 172.21.15.72:0/3323250911 learned_addr learned my addr 172.21.15.72:0/3323250911 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:57:02.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.473+0000 7f5efc9ef640 1 --2- 172.21.15.72:0/3323250911 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ef815d3a0 0x7f5ef81499d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:57:02.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.473+0000 7f5efd9f1640 1 --2- 172.21.15.72:0/3323250911 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ef815c610 0x7f5ef815ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:57:02.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.473+0000 7f5efd1f0640 1 -- 172.21.15.72:0/3323250911 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ef815c610 msgr2=0x7f5ef815ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:57:02.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.473+0000 7f5efd1f0640 1 --2- 172.21.15.72:0/3323250911 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ef815c610 0x7f5ef815ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:57:02.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.473+0000 7f5efd1f0640 1 -- 172.21.15.72:0/3323250911 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ef815d3a0 msgr2=0x7f5ef81499d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:57:02.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.473+0000 7f5efd1f0640 1 --2- 172.21.15.72:0/3323250911 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ef815d3a0 0x7f5ef81499d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:57:02.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.473+0000 7f5efd1f0640 1 -- 172.21.15.72:0/3323250911 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ef8149f10 con 0x7f5ee4004810 2024-05-09T05:57:02.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.473+0000 7f5efd9f1640 1 --2- 172.21.15.72:0/3323250911 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ef815c610 0x7f5ef815ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:57:02.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.473+0000 7f5efd1f0640 1 --2- 172.21.15.72:0/3323250911 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ee4004810 0x7f5ef8156a20 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5ef400d800 tx=0x7f5ef400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:57:02.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.473+0000 7f5eedffb640 1 -- 172.21.15.72:0/3323250911 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef40074e0 con 0x7f5ee4004810 2024-05-09T05:57:02.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.473+0000 7f5eedffb640 1 -- 172.21.15.72:0/3323250911 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ef40047f0 con 0x7f5ee4004810 2024-05-09T05:57:02.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.473+0000 7f5eff454640 1 -- 172.21.15.72:0/3323250911 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ef815cf60 con 0x7f5ee4004810 2024-05-09T05:57:02.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.473+0000 7f5eedffb640 1 -- 172.21.15.72:0/3323250911 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef4007680 con 0x7f5ee4004810 2024-05-09T05:57:02.462 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.473+0000 7f5eff454640 1 -- 172.21.15.72:0/3323250911 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ef81f14e0 con 0x7f5ee4004810 2024-05-09T05:57:02.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.473+0000 7f5eff454640 1 -- 172.21.15.72:0/3323250911 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ef806a520 con 0x7f5ee4004810 2024-05-09T05:57:02.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.477+0000 7f5eedffb640 1 -- 172.21.15.72:0/3323250911 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f5ef401b020 con 0x7f5ee4004810 2024-05-09T05:57:02.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.477+0000 7f5eedffb640 1 --2- 172.21.15.72:0/3323250911 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f5edc06f430 0x7f5edc071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:57:02.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.477+0000 7f5eedffb640 1 -- 172.21.15.72:0/3323250911 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6762+0+0 (secure 0 0 0) 0x7f5ef408f640 con 0x7f5ee4004810 2024-05-09T05:57:02.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.477+0000 7f5efc9ef640 1 --2- 172.21.15.72:0/3323250911 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f5edc06f430 0x7f5edc071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:57:02.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.477+0000 7f5efc9ef640 1 --2- 172.21.15.72:0/3323250911 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f5edc06f430 0x7f5edc071940 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5ee80af000 tx=0x7f5ee8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:57:02.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.481+0000 7f5eedffb640 1 -- 172.21.15.72:0/3323250911 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f5ef405c110 con 0x7f5ee4004810 2024-05-09T05:57:02.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.673+0000 7f5eff454640 1 -- 172.21.15.72:0/3323250911 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5ef80c5f30 con 0x7f5ee4004810 2024-05-09T05:57:02.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.677+0000 7f5eedffb640 1 -- 172.21.15.72:0/3323250911 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+6088 (secure 0 0 0) 0x7f5ef405ba10 con 0x7f5ee4004810 2024-05-09T05:57:02.663 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:57:02.663 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:53:23.494975+0000","modified":"2024-05-09T05:57:00.634661+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4297,"mds_1":4287,"mds_2":4263,"mds_3":4259,"mds_4":5007},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4259":{"gid":4259,"name":"f","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.110:6838/840351907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":840351907},{"type":"v1","addr":"172.21.15.110:6838","nonce":840351907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4263":{"gid":4263,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.72:6837/1048256382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":1048256382},{"type":"v1","addr":"172.21.15.72:6837","nonce":1048256382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.110:6839/966325499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6837","nonce":966325499},{"type":"v1","addr":"172.21.15.110:6839","nonce":966325499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6836/4134424941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":4134424941},{"type":"v1","addr":"172.21.15.110:6836","nonce":4134424941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5007":{"gid":5007,"name":"a","rank":4,"incarnation":26,"state":"up:rejoin","state_seq":23,"addr":"172.21.15.72:6835/1972750715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":1972750715},{"type":"v1","addr":"172.21.15.72:6835","nonce":1972750715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4297,4287,4263,4259]},"id":1}]} 2024-05-09T05:57:02.664 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 29 2024-05-09T05:57:02.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.677+0000 7f5eff454640 1 -- 172.21.15.72:0/3323250911 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f5edc06f430 msgr2=0x7f5edc071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:57:02.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.677+0000 7f5eff454640 1 --2- 172.21.15.72:0/3323250911 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f5edc06f430 0x7f5edc071940 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5ee80af000 tx=0x7f5ee8008040 comp rx=0 tx=0).stop 2024-05-09T05:57:02.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.677+0000 7f5eff454640 1 -- 172.21.15.72:0/3323250911 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ee4004810 msgr2=0x7f5ef8156a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:57:02.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.677+0000 7f5eff454640 1 --2- 172.21.15.72:0/3323250911 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ee4004810 0x7f5ef8156a20 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5ef400d800 tx=0x7f5ef400dcc0 comp rx=0 tx=0).stop 2024-05-09T05:57:02.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.677+0000 7f5eff454640 1 -- 172.21.15.72:0/3323250911 shutdown_connections 2024-05-09T05:57:02.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.677+0000 7f5eff454640 1 --2- 172.21.15.72:0/3323250911 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f5edc06f430 0x7f5edc071940 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:57:02.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.677+0000 7f5eff454640 1 --2- 172.21.15.72:0/3323250911 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ef815c610 0x7f5ef815ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:57:02.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.677+0000 7f5eff454640 1 --2- 172.21.15.72:0/3323250911 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ef815d3a0 0x7f5ef81499d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:57:02.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.677+0000 7f5eff454640 1 --2- 172.21.15.72:0/3323250911 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ee4004810 0x7f5ef8156a20 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:57:02.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.677+0000 7f5eff454640 1 -- 172.21.15.72:0/3323250911 >> 172.21.15.72:0/3323250911 conn(0x7f5ef80cde90 msgr2=0x7f5ef8073af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:57:02.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.677+0000 7f5eff454640 1 -- 172.21.15.72:0/3323250911 shutdown_connections 2024-05-09T05:57:02.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:02.677+0000 7f5eff454640 1 -- 172.21.15.72:0/3323250911 wait complete. 2024-05-09T05:57:02.685 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-05-09T05:57:04.686 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:57:04.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:04.861+0000 7fa59a1b7640 1 Processor -- start 2024-05-09T05:57:04.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:04.861+0000 7fa59a1b7640 1 -- start start 2024-05-09T05:57:04.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:04.865+0000 7fa59a1b7640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa594154b10 0x7fa5940c9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:57:04.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:04.865+0000 7fa59a1b7640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa594070ef0 0x7fa594071300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:57:04.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:04.865+0000 7fa59a1b7640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa594071dc0 con 0x7fa5940734b0 2024-05-09T05:57:04.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:04.865+0000 7fa59a1b7640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fa5940c8340 con 0x7fa594154b10 2024-05-09T05:57:04.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:04.865+0000 7fa59a1b7640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fa5940c9600 con 0x7fa594070ef0 2024-05-09T05:57:04.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:04.865+0000 7fa593fff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa594070ef0 0x7fa594071300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:57:04.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:04.865+0000 7fa5937fe640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa594154b10 0x7fa5940c9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:57:04.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:04.865+0000 7fa5937fe640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa594154b10 0x7fa5940c9fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.72:33048/0 (socket says 172.21.15.72:33048) 2024-05-09T05:57:04.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:04.865+0000 7fa593fff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa594070ef0 0x7fa594071300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.72:54990/0 (socket says 172.21.15.72:54990) 2024-05-09T05:57:04.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:04.865+0000 7fa5937fe640 1 -- 172.21.15.72:0/2255276806 learned_addr learned my addr 172.21.15.72:0/2255276806 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:57:04.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:04.865+0000 7fa592ffd640 1 --1- 172.21.15.72:0/2255276806 >> v1:172.21.15.110:6789/0 conn(0x7fa5940734b0 0x7fa59415dc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.72:36056/0 (socket says 172.21.15.72:36056) 2024-05-09T05:57:04.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:04.865+0000 7fa593fff640 1 -- 172.21.15.72:0/2255276806 >> v2:172.21.15.110:3300/0 conn(0x7fa594154b10 msgr2=0x7fa5940c9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:57:04.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:04.865+0000 7fa593fff640 1 --2- 172.21.15.72:0/2255276806 >> v2:172.21.15.110:3300/0 conn(0x7fa594154b10 0x7fa5940c9fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:57:04.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:04.865+0000 7fa593fff640 1 -- 172.21.15.72:0/2255276806 >> v1:172.21.15.110:6789/0 conn(0x7fa5940734b0 legacy=0x7fa59415dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:57:04.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:04.865+0000 7fa593fff640 1 -- 172.21.15.72:0/2255276806 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa594075040 con 0x7fa594070ef0 2024-05-09T05:57:04.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:04.865+0000 7fa5937fe640 1 --2- 172.21.15.72:0/2255276806 >> v2:172.21.15.110:3300/0 conn(0x7fa594154b10 0x7fa5940c9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T05:57:04.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:04.869+0000 7fa593fff640 1 --2- 172.21.15.72:0/2255276806 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa594070ef0 0x7fa594071300 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa58c009d90 tx=0x7fa58c01c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eeca892a2abfeb37 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:57:04.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:04.869+0000 7fa5927fc640 1 -- 172.21.15.72:0/2255276806 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa58c0b2070 con 0x7fa594070ef0 2024-05-09T05:57:04.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:04.869+0000 7fa5927fc640 1 -- 172.21.15.72:0/2255276806 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa58c0a5940 con 0x7fa594070ef0 2024-05-09T05:57:04.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:04.869+0000 7fa5927fc640 1 -- 172.21.15.72:0/2255276806 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa58c0a5d10 con 0x7fa594070ef0 2024-05-09T05:57:04.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:04.869+0000 7fa59a1b7640 1 -- 172.21.15.72:0/2255276806 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa594070ef0 msgr2=0x7fa594071300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:57:04.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:04.869+0000 7fa59a1b7640 1 --2- 172.21.15.72:0/2255276806 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa594070ef0 0x7fa594071300 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa58c009d90 tx=0x7fa58c01c970 comp rx=0 tx=0).stop 2024-05-09T05:57:04.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:04.869+0000 7fa59a1b7640 1 -- 172.21.15.72:0/2255276806 shutdown_connections 2024-05-09T05:57:04.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:04.869+0000 7fa59a1b7640 1 --2- 172.21.15.72:0/2255276806 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa594070ef0 0x7fa594071300 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:57:04.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:04.869+0000 7fa59a1b7640 1 --2- 172.21.15.72:0/2255276806 >> v2:172.21.15.110:3300/0 conn(0x7fa594154b10 0x7fa5940c9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:57:04.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:04.869+0000 7fa59a1b7640 1 -- 172.21.15.72:0/2255276806 >> 172.21.15.72:0/2255276806 conn(0x7fa5940ce8c0 msgr2=0x7fa5940cecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:57:04.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:04.869+0000 7fa59a1b7640 1 -- 172.21.15.72:0/2255276806 shutdown_connections 2024-05-09T05:57:04.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:04.869+0000 7fa59a1b7640 1 -- 172.21.15.72:0/2255276806 wait complete. 2024-05-09T05:57:04.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:04.873+0000 7fa59a1b7640 1 Processor -- start 2024-05-09T05:57:04.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:04.873+0000 7fa59a1b7640 1 -- start start 2024-05-09T05:57:04.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:04.873+0000 7fa59a1b7640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa594070ef0 0x7fa594145a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:57:04.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:04.873+0000 7fa59a1b7640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5940734b0 0x7fa5941f7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:57:04.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:04.873+0000 7fa59a1b7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa594154b10 0x7fa594146140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:57:04.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:04.873+0000 7fa59a1b7640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fa594167980 con 0x7fa5940734b0 2024-05-09T05:57:04.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:04.873+0000 7fa59a1b7640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fa594167800 con 0x7fa594154b10 2024-05-09T05:57:04.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:04.873+0000 7fa59a1b7640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fa594167b00 con 0x7fa594070ef0 2024-05-09T05:57:04.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:04.873+0000 7fa592ffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5940734b0 0x7fa5941f7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:57:04.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:04.873+0000 7fa592ffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5940734b0 0x7fa5941f7920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55214/0 (socket says 172.21.15.72:55214) 2024-05-09T05:57:04.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:04.873+0000 7fa592ffd640 1 -- 172.21.15.72:0/2941621984 learned_addr learned my addr 172.21.15.72:0/2941621984 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:57:04.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:04.873+0000 7fa593fff640 1 --2- 172.21.15.72:0/2941621984 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa594154b10 0x7fa594146140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:57:04.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:04.873+0000 7fa5937fe640 1 --2- 172.21.15.72:0/2941621984 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa594070ef0 0x7fa594145a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:57:04.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:04.873+0000 7fa592ffd640 1 -- 172.21.15.72:0/2941621984 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa594070ef0 msgr2=0x7fa594145a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:57:04.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:04.873+0000 7fa592ffd640 1 --2- 172.21.15.72:0/2941621984 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa594070ef0 0x7fa594145a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:57:04.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:04.873+0000 7fa592ffd640 1 -- 172.21.15.72:0/2941621984 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa594154b10 msgr2=0x7fa594146140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:57:04.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:04.873+0000 7fa592ffd640 1 --2- 172.21.15.72:0/2941621984 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa594154b10 0x7fa594146140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:57:04.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:04.873+0000 7fa592ffd640 1 -- 172.21.15.72:0/2941621984 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5941f7e60 con 0x7fa5940734b0 2024-05-09T05:57:04.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:04.873+0000 7fa5937fe640 1 --2- 172.21.15.72:0/2941621984 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa594070ef0 0x7fa594145a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:57:04.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:04.873+0000 7fa592ffd640 1 --2- 172.21.15.72:0/2941621984 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5940734b0 0x7fa5941f7920 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa58800c430 tx=0x7fa58800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:57:04.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:04.873+0000 7fa57bfff640 1 -- 172.21.15.72:0/2941621984 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5880074e0 con 0x7fa5940734b0 2024-05-09T05:57:04.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:04.873+0000 7fa57bfff640 1 -- 172.21.15.72:0/2941621984 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa588007680 con 0x7fa5940734b0 2024-05-09T05:57:04.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:04.873+0000 7fa57bfff640 1 -- 172.21.15.72:0/2941621984 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa588004a10 con 0x7fa5940734b0 2024-05-09T05:57:04.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:04.873+0000 7fa59a1b7640 1 -- 172.21.15.72:0/2941621984 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa59414df90 con 0x7fa5940734b0 2024-05-09T05:57:04.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:04.873+0000 7fa59a1b7640 1 -- 172.21.15.72:0/2941621984 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa59414e550 con 0x7fa5940734b0 2024-05-09T05:57:04.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:04.877+0000 7fa59a1b7640 1 -- 172.21.15.72:0/2941621984 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa59414e750 con 0x7fa5940734b0 2024-05-09T05:57:04.863 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:04.877+0000 7fa57bfff640 1 -- 172.21.15.72:0/2941621984 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fa58801a020 con 0x7fa5940734b0 2024-05-09T05:57:04.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:04.877+0000 7fa57bfff640 1 --2- 172.21.15.72:0/2941621984 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fa58006f400 0x7fa580071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:57:04.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:04.877+0000 7fa57bfff640 1 -- 172.21.15.72:0/2941621984 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6762+0+0 (secure 0 0 0) 0x7fa58808ef30 con 0x7fa5940734b0 2024-05-09T05:57:04.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:04.877+0000 7fa5937fe640 1 --2- 172.21.15.72:0/2941621984 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fa58006f400 0x7fa580071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:57:04.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:04.877+0000 7fa5937fe640 1 --2- 172.21.15.72:0/2941621984 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fa58006f400 0x7fa580071910 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa584009a30 tx=0x7fa584008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:57:04.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:04.881+0000 7fa57bfff640 1 -- 172.21.15.72:0/2941621984 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fa58805b9f0 con 0x7fa5940734b0 2024-05-09T05:57:05.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:05.065+0000 7fa59a1b7640 1 -- 172.21.15.72:0/2941621984 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa59406a520 con 0x7fa5940734b0 2024-05-09T05:57:05.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:05.065+0000 7fa57bfff640 1 -- 172.21.15.72:0/2941621984 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+6088 (secure 0 0 0) 0x7fa58805b2f0 con 0x7fa5940734b0 2024-05-09T05:57:05.053 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:57:05.054 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:53:23.494975+0000","modified":"2024-05-09T05:57:00.634661+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4297,"mds_1":4287,"mds_2":4263,"mds_3":4259,"mds_4":5007},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4259":{"gid":4259,"name":"f","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.110:6838/840351907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":840351907},{"type":"v1","addr":"172.21.15.110:6838","nonce":840351907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4263":{"gid":4263,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.72:6837/1048256382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":1048256382},{"type":"v1","addr":"172.21.15.72:6837","nonce":1048256382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.110:6839/966325499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6837","nonce":966325499},{"type":"v1","addr":"172.21.15.110:6839","nonce":966325499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6836/4134424941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":4134424941},{"type":"v1","addr":"172.21.15.110:6836","nonce":4134424941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5007":{"gid":5007,"name":"a","rank":4,"incarnation":26,"state":"up:rejoin","state_seq":23,"addr":"172.21.15.72:6835/1972750715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":1972750715},{"type":"v1","addr":"172.21.15.72:6835","nonce":1972750715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4297,4287,4263,4259]},"id":1}]} 2024-05-09T05:57:05.054 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 29 2024-05-09T05:57:05.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:05.069+0000 7fa59a1b7640 1 -- 172.21.15.72:0/2941621984 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fa58006f400 msgr2=0x7fa580071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:57:05.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:05.069+0000 7fa59a1b7640 1 --2- 172.21.15.72:0/2941621984 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fa58006f400 0x7fa580071910 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa584009a30 tx=0x7fa584008040 comp rx=0 tx=0).stop 2024-05-09T05:57:05.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:05.069+0000 7fa59a1b7640 1 -- 172.21.15.72:0/2941621984 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5940734b0 msgr2=0x7fa5941f7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:57:05.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:05.069+0000 7fa59a1b7640 1 --2- 172.21.15.72:0/2941621984 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5940734b0 0x7fa5941f7920 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa58800c430 tx=0x7fa58800c8f0 comp rx=0 tx=0).stop 2024-05-09T05:57:05.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:05.069+0000 7fa59a1b7640 1 -- 172.21.15.72:0/2941621984 shutdown_connections 2024-05-09T05:57:05.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:05.069+0000 7fa59a1b7640 1 --2- 172.21.15.72:0/2941621984 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fa58006f400 0x7fa580071910 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:57:05.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:05.069+0000 7fa59a1b7640 1 --2- 172.21.15.72:0/2941621984 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa594154b10 0x7fa594146140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:57:05.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:05.069+0000 7fa59a1b7640 1 --2- 172.21.15.72:0/2941621984 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5940734b0 0x7fa5941f7920 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:57:05.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:05.069+0000 7fa59a1b7640 1 --2- 172.21.15.72:0/2941621984 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa594070ef0 0x7fa594145a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:57:05.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:05.069+0000 7fa59a1b7640 1 -- 172.21.15.72:0/2941621984 >> 172.21.15.72:0/2941621984 conn(0x7fa5940ce8c0 msgr2=0x7fa594075d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:57:05.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:05.069+0000 7fa59a1b7640 1 -- 172.21.15.72:0/2941621984 shutdown_connections 2024-05-09T05:57:05.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:05.069+0000 7fa59a1b7640 1 -- 172.21.15.72:0/2941621984 wait complete. 2024-05-09T05:57:05.076 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-05-09T05:57:05.835 INFO:tasks.workunit.client.0.smithi072.stdout: 2024-05-09T05:57:05.835 INFO:tasks.workunit.client.0.smithi072.stdout: 2024-05-09T05:57:05.836 INFO:tasks.workunit.client.0.smithi072.stdout: 2024-05-09T05:57:05.836 INFO:tasks.workunit.client.0.smithi072.stdout:iozone test complete. 2024-05-09T05:57:05.837 INFO:tasks.workunit.client.0.smithi072.stderr:+ iozone -c -e -s 10240M -r 1M -t 1 -F f3 -i 0 -i 1 2024-05-09T05:57:05.914 INFO:tasks.workunit.client.0.smithi072.stdout: Iozone: Performance Test of File I/O 2024-05-09T05:57:05.914 INFO:tasks.workunit.client.0.smithi072.stdout: Version $Revision: 3.489 $ 2024-05-09T05:57:05.914 INFO:tasks.workunit.client.0.smithi072.stdout: Compiled for 64 bit mode. 2024-05-09T05:57:05.914 INFO:tasks.workunit.client.0.smithi072.stdout: Build: linux-AMD64 2024-05-09T05:57:05.914 INFO:tasks.workunit.client.0.smithi072.stdout: 2024-05-09T05:57:05.914 INFO:tasks.workunit.client.0.smithi072.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-05-09T05:57:05.914 INFO:tasks.workunit.client.0.smithi072.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-05-09T05:57:05.914 INFO:tasks.workunit.client.0.smithi072.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-05-09T05:57:05.914 INFO:tasks.workunit.client.0.smithi072.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-05-09T05:57:05.915 INFO:tasks.workunit.client.0.smithi072.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-05-09T05:57:05.915 INFO:tasks.workunit.client.0.smithi072.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-05-09T05:57:05.915 INFO:tasks.workunit.client.0.smithi072.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-05-09T05:57:05.915 INFO:tasks.workunit.client.0.smithi072.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-05-09T05:57:05.915 INFO:tasks.workunit.client.0.smithi072.stdout: Alexey Skidanov, Sudhir Kumar. 2024-05-09T05:57:05.915 INFO:tasks.workunit.client.0.smithi072.stdout: 2024-05-09T05:57:05.915 INFO:tasks.workunit.client.0.smithi072.stdout: Run began: Thu May 9 05:57:05 2024 2024-05-09T05:57:05.915 INFO:tasks.workunit.client.0.smithi072.stdout: 2024-05-09T05:57:05.915 INFO:tasks.workunit.client.0.smithi072.stdout: Include close in write timing 2024-05-09T05:57:05.915 INFO:tasks.workunit.client.0.smithi072.stdout: Include fsync in write timing 2024-05-09T05:57:05.915 INFO:tasks.workunit.client.0.smithi072.stdout: File size set to 10485760 kB 2024-05-09T05:57:05.916 INFO:tasks.workunit.client.0.smithi072.stdout: Record Size 1024 kB 2024-05-09T05:57:05.916 INFO:tasks.workunit.client.0.smithi072.stdout: Command line used: iozone -c -e -s 10240M -r 1M -t 1 -F f3 -i 0 -i 1 2024-05-09T05:57:05.916 INFO:tasks.workunit.client.0.smithi072.stdout: Output is in kBytes/sec 2024-05-09T05:57:05.916 INFO:tasks.workunit.client.0.smithi072.stdout: Time Resolution = 0.000001 seconds. 2024-05-09T05:57:05.916 INFO:tasks.workunit.client.0.smithi072.stdout: Processor cache size set to 1024 kBytes. 2024-05-09T05:57:05.916 INFO:tasks.workunit.client.0.smithi072.stdout: Processor cache line size set to 32 bytes. 2024-05-09T05:57:05.916 INFO:tasks.workunit.client.0.smithi072.stdout: File stride size set to 17 * record size. 2024-05-09T05:57:05.916 INFO:tasks.workunit.client.0.smithi072.stdout: Throughput test with 1 process 2024-05-09T05:57:05.916 INFO:tasks.workunit.client.0.smithi072.stdout: Each process writes a 10485760 kByte file in 1024 kByte records 2024-05-09T05:57:07.077 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:57:07.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.293+0000 7fb015175640 1 Processor -- start 2024-05-09T05:57:07.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.293+0000 7fb015175640 1 -- start start 2024-05-09T05:57:07.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.293+0000 7fb015175640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb0100c7480 0x7fb0100c7890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:57:07.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.293+0000 7fb015175640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb01006e960 con 0x7fb010075020 2024-05-09T05:57:07.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.293+0000 7fb015175640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb010072b20 con 0x7fb010161f80 2024-05-09T05:57:07.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.293+0000 7fb015175640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fb010072840 con 0x7fb0100c7480 2024-05-09T05:57:07.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.293+0000 7fb00ed9d640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fb010075020 0x7fb010074090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:40780/0 (socket says 172.21.15.72:40780) 2024-05-09T05:57:07.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.293+0000 7fb00ed9d640 1 -- 172.21.15.72:0/3845201283 learned_addr learned my addr 172.21.15.72:0/3845201283 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:57:07.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.297+0000 7fb00dd9b640 1 -- 172.21.15.72:0/3845201283 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1708666257 0 0) 0x7fb01006e960 con 0x7fb010075020 2024-05-09T05:57:07.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.297+0000 7fb00dd9b640 1 -- 172.21.15.72:0/3845201283 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faff8003530 con 0x7fb010075020 2024-05-09T05:57:07.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.297+0000 7fb00dd9b640 1 -- 172.21.15.72:0/3845201283 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4167189772 0 0) 0x7fb010072b20 con 0x7fb010161f80 2024-05-09T05:57:07.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.297+0000 7fb00dd9b640 1 -- 172.21.15.72:0/3845201283 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb01006e960 con 0x7fb010161f80 2024-05-09T05:57:07.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.297+0000 7fb00e59c640 1 --2- 172.21.15.72:0/3845201283 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb0100c7480 0x7fb0100c7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:57:07.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.297+0000 7fb00dd9b640 1 -- 172.21.15.72:0/3845201283 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4022087491 0 0) 0x7faff8003530 con 0x7fb010075020 2024-05-09T05:57:07.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.297+0000 7fb00dd9b640 1 -- 172.21.15.72:0/3845201283 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb0100c7480 msgr2=0x7fb0100c7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:57:07.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.297+0000 7fb00dd9b640 1 --2- 172.21.15.72:0/3845201283 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb0100c7480 0x7fb0100c7890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:57:07.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.297+0000 7fb00dd9b640 1 -- 172.21.15.72:0/3845201283 >> v1:172.21.15.110:6789/0 conn(0x7fb010161f80 legacy=0x7fb0101643a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:57:07.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.297+0000 7fb00dd9b640 1 -- 172.21.15.72:0/3845201283 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb01006ec20 con 0x7fb010075020 2024-05-09T05:57:07.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.297+0000 7fb00dd9b640 1 -- 172.21.15.72:0/3845201283 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2749052815 0 0) 0x7fb000001700 con 0x7fb010075020 2024-05-09T05:57:07.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.297+0000 7fb00dd9b640 1 -- 172.21.15.72:0/3845201283 >> v1:172.21.15.72:6789/0 conn(0x7fb010075020 legacy=0x7fb010074090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:57:07.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.297+0000 7fb00dd9b640 1 --2- 172.21.15.72:0/3845201283 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb0100c7480 0x7faff8004c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:57:07.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.297+0000 7fb00dd9b640 1 --2- 172.21.15.72:0/3845201283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faff80051c0 0x7faff80037b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:57:07.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.297+0000 7fb00dd9b640 1 --2- 172.21.15.72:0/3845201283 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faff8003d40 0x7faff8004210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:57:07.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.297+0000 7fb00dd9b640 1 -- 172.21.15.72:0/3845201283 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fb010072840 con 0x7faff80051c0 2024-05-09T05:57:07.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.297+0000 7fb00dd9b640 1 -- 172.21.15.72:0/3845201283 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7faff800bc60 con 0x7faff8003d40 2024-05-09T05:57:07.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.297+0000 7fb00dd9b640 1 -- 172.21.15.72:0/3845201283 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7faff800be60 con 0x7fb0100c7480 2024-05-09T05:57:07.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.297+0000 7fb00e59c640 1 --2- 172.21.15.72:0/3845201283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faff80051c0 0x7faff80037b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:57:07.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.297+0000 7fb00f59e640 1 --2- 172.21.15.72:0/3845201283 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faff8003d40 0x7faff8004210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:57:07.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.297+0000 7fb00ed9d640 1 --2- 172.21.15.72:0/3845201283 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb0100c7480 0x7faff8004c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:57:07.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.297+0000 7fb00f59e640 1 -- 172.21.15.72:0/3845201283 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb0100c7480 msgr2=0x7faff8004c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:57:07.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.297+0000 7fb00f59e640 1 --2- 172.21.15.72:0/3845201283 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb0100c7480 0x7faff8004c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:57:07.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.297+0000 7fb00f59e640 1 -- 172.21.15.72:0/3845201283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faff80051c0 msgr2=0x7faff80037b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:57:07.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.297+0000 7fb00f59e640 1 --2- 172.21.15.72:0/3845201283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faff80051c0 0x7faff80037b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:57:07.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.297+0000 7fb00f59e640 1 -- 172.21.15.72:0/3845201283 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb01006ec20 con 0x7faff8003d40 2024-05-09T05:57:07.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.297+0000 7fb00e59c640 1 --2- 172.21.15.72:0/3845201283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faff80051c0 0x7faff80037b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T05:57:07.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.297+0000 7fb00f59e640 1 --2- 172.21.15.72:0/3845201283 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faff8003d40 0x7faff8004210 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb01006f1e0 tx=0x7fb00801ccf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4425d43a8e8a94e9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:57:07.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.301+0000 7fb00dd9b640 1 -- 172.21.15.72:0/3845201283 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0080b2070 con 0x7faff8003d40 2024-05-09T05:57:07.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.301+0000 7fb00dd9b640 1 -- 172.21.15.72:0/3845201283 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0080a5c50 con 0x7faff8003d40 2024-05-09T05:57:07.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.301+0000 7fb00dd9b640 1 -- 172.21.15.72:0/3845201283 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb00800c0e0 con 0x7faff8003d40 2024-05-09T05:57:07.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.301+0000 7fb015175640 1 -- 172.21.15.72:0/3845201283 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faff8003d40 msgr2=0x7faff8004210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:57:07.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.301+0000 7fb015175640 1 --2- 172.21.15.72:0/3845201283 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faff8003d40 0x7faff8004210 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb01006f1e0 tx=0x7fb00801ccf0 comp rx=0 tx=0).stop 2024-05-09T05:57:07.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.301+0000 7fb00f59e640 1 -- 172.21.15.72:0/3845201283 reap_dead start 2024-05-09T05:57:07.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.301+0000 7fb015175640 1 -- 172.21.15.72:0/3845201283 shutdown_connections 2024-05-09T05:57:07.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.301+0000 7fb015175640 1 -- 172.21.15.72:0/3845201283 >> 172.21.15.72:0/3845201283 conn(0x7fb0100cb350 msgr2=0x7fb0100cb760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:57:07.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.301+0000 7fb015175640 1 -- 172.21.15.72:0/3845201283 shutdown_connections 2024-05-09T05:57:07.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.301+0000 7fb015175640 1 -- 172.21.15.72:0/3845201283 wait complete. 2024-05-09T05:57:07.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.305+0000 7fb015175640 1 Processor -- start 2024-05-09T05:57:07.291 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.305+0000 7fb015175640 1 -- start start 2024-05-09T05:57:07.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.305+0000 7fb015175640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb010140fd0 0x7fb0101f2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:57:07.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.305+0000 7fb015175640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb01014ed70 0x7fb0101ef200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:57:07.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.305+0000 7fb015175640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb010075f20 0x7fb01013e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:57:07.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.305+0000 7fb015175640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fb010159dc0 con 0x7fb01014ed70 2024-05-09T05:57:07.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.305+0000 7fb015175640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fb010159ae0 con 0x7fb010140fd0 2024-05-09T05:57:07.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.305+0000 7fb015175640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fb01015a0a0 con 0x7fb010075f20 2024-05-09T05:57:07.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.305+0000 7fb00ed9d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb010140fd0 0x7fb0101f2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:57:07.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.305+0000 7fb00ed9d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb010140fd0 0x7fb0101f2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.72:33076/0 (socket says 172.21.15.72:33076) 2024-05-09T05:57:07.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.305+0000 7fb00ed9d640 1 -- 172.21.15.72:0/2697851475 learned_addr learned my addr 172.21.15.72:0/2697851475 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:57:07.294 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.305+0000 7fb00f59e640 1 --2- 172.21.15.72:0/2697851475 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb010075f20 0x7fb01013e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:57:07.295 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.305+0000 7fb00ed9d640 1 -- 172.21.15.72:0/2697851475 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb010075f20 msgr2=0x7fb01013e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:57:07.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.305+0000 7fb00ed9d640 1 --2- 172.21.15.72:0/2697851475 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb010075f20 0x7fb01013e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:57:07.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.305+0000 7fb00ed9d640 1 -- 172.21.15.72:0/2697851475 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb01014ed70 msgr2=0x7fb0101ef200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:57:07.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.305+0000 7fb00ed9d640 1 --2- 172.21.15.72:0/2697851475 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb01014ed70 0x7fb0101ef200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:57:07.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.305+0000 7fb00ed9d640 1 -- 172.21.15.72:0/2697851475 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb01014fa70 con 0x7fb010140fd0 2024-05-09T05:57:07.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.309+0000 7fb00ed9d640 1 --2- 172.21.15.72:0/2697851475 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb010140fd0 0x7fb0101f2870 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb0000124a0 tx=0x7fb000012960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:57:07.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.309+0000 7faff77fe640 1 -- 172.21.15.72:0/2697851475 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb000014810 con 0x7fb010140fd0 2024-05-09T05:57:07.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.309+0000 7faff77fe640 1 -- 172.21.15.72:0/2697851475 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb00001b070 con 0x7fb010140fd0 2024-05-09T05:57:07.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.309+0000 7fb015175640 1 -- 172.21.15.72:0/2697851475 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb01014f4b0 con 0x7fb010140fd0 2024-05-09T05:57:07.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.309+0000 7faff77fe640 1 -- 172.21.15.72:0/2697851475 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb000014bf0 con 0x7fb010140fd0 2024-05-09T05:57:07.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.309+0000 7fb015175640 1 -- 172.21.15.72:0/2697851475 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0101f1d90 con 0x7fb010140fd0 2024-05-09T05:57:07.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.309+0000 7fb015175640 1 -- 172.21.15.72:0/2697851475 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb01006a520 con 0x7fb010140fd0 2024-05-09T05:57:07.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.309+0000 7faff77fe640 1 -- 172.21.15.72:0/2697851475 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fb000016480 con 0x7fb010140fd0 2024-05-09T05:57:07.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.309+0000 7faff77fe640 1 --2- 172.21.15.72:0/2697851475 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7faffc06f400 0x7faffc071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:57:07.297 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.309+0000 7faff77fe640 1 -- 172.21.15.72:0/2697851475 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6762+0+0 (secure 0 0 0) 0x7fb000092970 con 0x7fb010140fd0 2024-05-09T05:57:07.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.313+0000 7fb00e59c640 1 --2- 172.21.15.72:0/2697851475 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7faffc06f400 0x7faffc071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:57:07.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.313+0000 7fb00e59c640 1 --2- 172.21.15.72:0/2697851475 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7faffc06f400 0x7faffc071910 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb0100ce050 tx=0x7fb00400bb70 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:57:07.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.325+0000 7faff77fe640 1 -- 172.21.15.72:0/2697851475 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fb00005f4d0 con 0x7fb010140fd0 2024-05-09T05:57:07.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.645+0000 7fb015175640 1 -- 172.21.15.72:0/2697851475 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb01014d650 con 0x7fb010140fd0 2024-05-09T05:57:07.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.649+0000 7faff77fe640 1 -- 172.21.15.72:0/2697851475 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+6093 (secure 0 0 0) 0x7fb00005edd0 con 0x7fb010140fd0 2024-05-09T05:57:07.635 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:57:07.635 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:53:23.494975+0000","modified":"2024-05-09T05:57:05.675817+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4297,"mds_1":4287,"mds_2":4263,"mds_3":4259,"mds_4":5007},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4259":{"gid":4259,"name":"f","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.110:6838/840351907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":840351907},{"type":"v1","addr":"172.21.15.110:6838","nonce":840351907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4263":{"gid":4263,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.72:6837/1048256382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":1048256382},{"type":"v1","addr":"172.21.15.72:6837","nonce":1048256382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.110:6839/966325499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6837","nonce":966325499},{"type":"v1","addr":"172.21.15.110:6839","nonce":966325499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6836/4134424941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":4134424941},{"type":"v1","addr":"172.21.15.110:6836","nonce":4134424941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5007":{"gid":5007,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":25,"addr":"172.21.15.72:6835/1972750715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":1972750715},{"type":"v1","addr":"172.21.15.72:6835","nonce":1972750715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4259,4263,4287,4297,5007]},"id":1}]} 2024-05-09T05:57:07.635 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 30 2024-05-09T05:57:07.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.649+0000 7fb015175640 1 -- 172.21.15.72:0/2697851475 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7faffc06f400 msgr2=0x7faffc071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:57:07.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.649+0000 7fb015175640 1 --2- 172.21.15.72:0/2697851475 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7faffc06f400 0x7faffc071910 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb0100ce050 tx=0x7fb00400bb70 comp rx=0 tx=0).stop 2024-05-09T05:57:07.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.649+0000 7fb015175640 1 -- 172.21.15.72:0/2697851475 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb010140fd0 msgr2=0x7fb0101f2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:57:07.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.649+0000 7fb015175640 1 --2- 172.21.15.72:0/2697851475 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb010140fd0 0x7fb0101f2870 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb0000124a0 tx=0x7fb000012960 comp rx=0 tx=0).stop 2024-05-09T05:57:07.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.649+0000 7fb015175640 1 -- 172.21.15.72:0/2697851475 shutdown_connections 2024-05-09T05:57:07.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.649+0000 7fb015175640 1 --2- 172.21.15.72:0/2697851475 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7faffc06f400 0x7faffc071910 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:57:07.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.649+0000 7fb015175640 1 --2- 172.21.15.72:0/2697851475 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb010075f20 0x7fb01013e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:57:07.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.649+0000 7fb015175640 1 --2- 172.21.15.72:0/2697851475 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb01014ed70 0x7fb0101ef200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:57:07.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.649+0000 7fb015175640 1 --2- 172.21.15.72:0/2697851475 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb010140fd0 0x7fb0101f2870 secure :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb0000124a0 tx=0x7fb000012960 comp rx=0 tx=0).stop 2024-05-09T05:57:07.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.649+0000 7fb015175640 1 -- 172.21.15.72:0/2697851475 >> 172.21.15.72:0/2697851475 conn(0x7fb0100cb350 msgr2=0x7fb0100cd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:57:07.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.649+0000 7fb015175640 1 -- 172.21.15.72:0/2697851475 shutdown_connections 2024-05-09T05:57:07.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:07.649+0000 7fb015175640 1 -- 172.21.15.72:0/2697851475 wait complete. 2024-05-09T05:57:07.672 INFO:tasks.mds_thrash.fs.[cephfs]:mds.a has gained rank=4, replacing gid=4254 2024-05-09T05:57:07.672 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 3 secs before reviving mds.e 2024-05-09T05:57:09.072 INFO:tasks.ceph.mds.b.smithi110.stderr:2024-05-09T05:57:09.082+0000 7f6833aba640 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-05-09T05:57:10.673 INFO:tasks.mds_thrash.fs.[cephfs]:reviving mds.e 2024-05-09T05:57:10.674 INFO:tasks.ceph.mds.e:Restarting daemon 2024-05-09T05:57:10.674 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2024-05-09T05:57:10.676 INFO:tasks.ceph.mds.e:Started 2024-05-09T05:57:10.676 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:57:10.809 INFO:tasks.ceph.mds.e.smithi072.stdout:starting mds.e at 2024-05-09T05:57:10.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.921+0000 7f3c218ba640 1 Processor -- start 2024-05-09T05:57:10.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.921+0000 7f3c218ba640 1 -- start start 2024-05-09T05:57:10.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.921+0000 7f3c218ba640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c1c074d30 0x7f3c1c0ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:57:10.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.921+0000 7f3c218ba640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c1c0cad30 con 0x7f3c1c15e4a0 2024-05-09T05:57:10.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.921+0000 7f3c218ba640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c1c0c9a30 con 0x7f3c1c0cc6b0 2024-05-09T05:57:10.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.921+0000 7f3c218ba640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f3c1c0cc200 con 0x7f3c1c074d30 2024-05-09T05:57:10.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.921+0000 7f3c1affd640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f3c1c15e4a0 0x7f3c1c0ca620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:40796/0 (socket says 172.21.15.72:40796) 2024-05-09T05:57:10.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.921+0000 7f3c1affd640 1 -- 172.21.15.72:0/3212905982 learned_addr learned my addr 172.21.15.72:0/3212905982 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:57:10.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.921+0000 7f3c1b7fe640 1 --2- 172.21.15.72:0/3212905982 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c1c074d30 0x7f3c1c0ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:57:10.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.921+0000 7f3c19ffb640 1 -- 172.21.15.72:0/3212905982 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1292444389 0 0) 0x7f3c1c0cad30 con 0x7f3c1c15e4a0 2024-05-09T05:57:10.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.921+0000 7f3c19ffb640 1 -- 172.21.15.72:0/3212905982 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c04003530 con 0x7f3c1c15e4a0 2024-05-09T05:57:10.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.925+0000 7f3c19ffb640 1 -- 172.21.15.72:0/3212905982 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 604029305 0 0) 0x7f3c04003530 con 0x7f3c1c15e4a0 2024-05-09T05:57:10.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.925+0000 7f3c19ffb640 1 -- 172.21.15.72:0/3212905982 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c1c074d30 msgr2=0x7f3c1c0ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:57:10.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.925+0000 7f3c19ffb640 1 --2- 172.21.15.72:0/3212905982 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c1c074d30 0x7f3c1c0ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:57:10.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.925+0000 7f3c19ffb640 1 -- 172.21.15.72:0/3212905982 >> v1:172.21.15.110:6789/0 conn(0x7f3c1c0cc6b0 legacy=0x7f3c1c074620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:57:10.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.925+0000 7f3c19ffb640 1 -- 172.21.15.72:0/3212905982 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c1c0c9d10 con 0x7f3c1c15e4a0 2024-05-09T05:57:10.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.925+0000 7f3c19ffb640 1 -- 172.21.15.72:0/3212905982 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2749052815 0 0) 0x7f3c0c001700 con 0x7f3c1c15e4a0 2024-05-09T05:57:10.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.925+0000 7f3c19ffb640 1 -- 172.21.15.72:0/3212905982 >> v1:172.21.15.72:6789/0 conn(0x7f3c1c15e4a0 legacy=0x7f3c1c0ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:57:10.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.925+0000 7f3c19ffb640 1 --2- 172.21.15.72:0/3212905982 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c04003a40 0x7f3c04003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:57:10.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.925+0000 7f3c19ffb640 1 --2- 172.21.15.72:0/3212905982 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c04004810 0x7f3c04004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:57:10.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.925+0000 7f3c19ffb640 1 --2- 172.21.15.72:0/3212905982 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c04005360 0x7f3c0400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:57:10.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.925+0000 7f3c19ffb640 1 -- 172.21.15.72:0/3212905982 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f3c1c0cc200 con 0x7f3c04004810 2024-05-09T05:57:10.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.925+0000 7f3c19ffb640 1 -- 172.21.15.72:0/3212905982 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f3c0400c210 con 0x7f3c04005360 2024-05-09T05:57:10.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.925+0000 7f3c19ffb640 1 -- 172.21.15.72:0/3212905982 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f3c0400c410 con 0x7f3c04003a40 2024-05-09T05:57:10.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.925+0000 7f3c1a7fc640 1 --2- 172.21.15.72:0/3212905982 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c04004810 0x7f3c04004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:57:10.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.925+0000 7f3c1affd640 1 --2- 172.21.15.72:0/3212905982 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c04003a40 0x7f3c04003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:57:10.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.925+0000 7f3c1a7fc640 1 -- 172.21.15.72:0/3212905982 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c04003a40 msgr2=0x7f3c04003eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:57:10.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.925+0000 7f3c1a7fc640 1 --2- 172.21.15.72:0/3212905982 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c04003a40 0x7f3c04003eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:57:10.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.925+0000 7f3c1a7fc640 1 -- 172.21.15.72:0/3212905982 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c04005360 msgr2=0x7f3c0400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:57:10.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.925+0000 7f3c1a7fc640 1 --2- 172.21.15.72:0/3212905982 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c04005360 0x7f3c0400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:57:10.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.925+0000 7f3c1a7fc640 1 -- 172.21.15.72:0/3212905982 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c04003530 con 0x7f3c04004810 2024-05-09T05:57:10.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.925+0000 7f3c1affd640 1 --2- 172.21.15.72:0/3212905982 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c04003a40 0x7f3c04003eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:57:10.913 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.925+0000 7f3c1a7fc640 1 --2- 172.21.15.72:0/3212905982 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c04004810 0x7f3c04004c20 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3c10001790 tx=0x7f3c1001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c70273fbc81295d2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:57:10.913 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.925+0000 7f3c19ffb640 1 -- 172.21.15.72:0/3212905982 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c100013e0 con 0x7f3c04004810 2024-05-09T05:57:10.913 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.925+0000 7f3c19ffb640 1 -- 172.21.15.72:0/3212905982 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c100052d0 con 0x7f3c04004810 2024-05-09T05:57:10.913 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.925+0000 7f3c19ffb640 1 -- 172.21.15.72:0/3212905982 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c10003840 con 0x7f3c04004810 2024-05-09T05:57:10.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.929+0000 7f3c218ba640 1 -- 172.21.15.72:0/3212905982 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c04004810 msgr2=0x7f3c04004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:57:10.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.929+0000 7f3c218ba640 1 --2- 172.21.15.72:0/3212905982 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c04004810 0x7f3c04004c20 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3c10001790 tx=0x7f3c1001c3b0 comp rx=0 tx=0).stop 2024-05-09T05:57:10.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.929+0000 7f3c1b7fe640 1 -- 172.21.15.72:0/3212905982 reap_dead start 2024-05-09T05:57:10.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.929+0000 7f3c218ba640 1 -- 172.21.15.72:0/3212905982 shutdown_connections 2024-05-09T05:57:10.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.929+0000 7f3c218ba640 1 -- 172.21.15.72:0/3212905982 >> 172.21.15.72:0/3212905982 conn(0x7f3c1c0cfc20 msgr2=0x7f3c1c0d0030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:57:10.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.929+0000 7f3c218ba640 1 -- 172.21.15.72:0/3212905982 shutdown_connections 2024-05-09T05:57:10.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.929+0000 7f3c218ba640 1 -- 172.21.15.72:0/3212905982 wait complete. 2024-05-09T05:57:10.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.929+0000 7f3c218ba640 1 Processor -- start 2024-05-09T05:57:10.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.929+0000 7f3c218ba640 1 -- start start 2024-05-09T05:57:10.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.933+0000 7f3c218ba640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c1c0c6910 0x7f3c1c163010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:57:10.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.933+0000 7f3c218ba640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c1c15d5b0 0x7f3c1c151050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:57:10.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.933+0000 7f3c218ba640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c1c151590 0x7f3c1c149360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:57:10.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.933+0000 7f3c218ba640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f3c1c166640 con 0x7f3c1c151590 2024-05-09T05:57:10.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.933+0000 7f3c218ba640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f3c1c15e8b0 con 0x7f3c1c0c6910 2024-05-09T05:57:10.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.933+0000 7f3c218ba640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f3c1c1667c0 con 0x7f3c1c15d5b0 2024-05-09T05:57:10.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.933+0000 7f3c1b7fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c1c151590 0x7f3c1c149360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:57:10.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.933+0000 7f3c1b7fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c1c151590 0x7f3c1c149360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55292/0 (socket says 172.21.15.72:55292) 2024-05-09T05:57:10.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.933+0000 7f3c1b7fe640 1 -- 172.21.15.72:0/381882076 learned_addr learned my addr 172.21.15.72:0/381882076 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:57:10.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.933+0000 7f3c1affd640 1 --2- 172.21.15.72:0/381882076 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c1c0c6910 0x7f3c1c163010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:57:10.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.933+0000 7f3c1a7fc640 1 --2- 172.21.15.72:0/381882076 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c1c15d5b0 0x7f3c1c151050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:57:10.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.933+0000 7f3c1b7fe640 1 -- 172.21.15.72:0/381882076 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c1c15d5b0 msgr2=0x7f3c1c151050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:57:10.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.933+0000 7f3c1b7fe640 1 --2- 172.21.15.72:0/381882076 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c1c15d5b0 0x7f3c1c151050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:57:10.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.933+0000 7f3c1b7fe640 1 -- 172.21.15.72:0/381882076 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c1c0c6910 msgr2=0x7f3c1c163010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:57:10.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.933+0000 7f3c1b7fe640 1 --2- 172.21.15.72:0/381882076 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c1c0c6910 0x7f3c1c163010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:57:10.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.933+0000 7f3c1b7fe640 1 -- 172.21.15.72:0/381882076 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c1c06e2c0 con 0x7f3c1c151590 2024-05-09T05:57:10.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.933+0000 7f3c1b7fe640 1 --2- 172.21.15.72:0/381882076 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c1c151590 0x7f3c1c149360 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c0cdad0 tx=0x7f3c1400eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:57:10.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.933+0000 7f3c03fff640 1 -- 172.21.15.72:0/381882076 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c1400c710 con 0x7f3c1c151590 2024-05-09T05:57:10.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.933+0000 7f3c03fff640 1 -- 172.21.15.72:0/381882076 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c14019070 con 0x7f3c1c151590 2024-05-09T05:57:10.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.933+0000 7f3c03fff640 1 -- 172.21.15.72:0/381882076 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c1400caf0 con 0x7f3c1c151590 2024-05-09T05:57:10.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.933+0000 7f3c218ba640 1 -- 172.21.15.72:0/381882076 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c1c0c6460 con 0x7f3c1c151590 2024-05-09T05:57:10.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.933+0000 7f3c218ba640 1 -- 172.21.15.72:0/381882076 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c1c06f050 con 0x7f3c1c151590 2024-05-09T05:57:10.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.937+0000 7f3c03fff640 1 -- 172.21.15.72:0/381882076 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f3c14012050 con 0x7f3c1c151590 2024-05-09T05:57:10.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.937+0000 7f3c03fff640 1 --2- 172.21.15.72:0/381882076 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f3c0806f450 0x7f3c08071960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:57:10.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.937+0000 7f3c03fff640 1 -- 172.21.15.72:0/381882076 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6762+0+0 (secure 0 0 0) 0x7f3c1408fac0 con 0x7f3c1c151590 2024-05-09T05:57:10.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.937+0000 7f3c1affd640 1 --2- 172.21.15.72:0/381882076 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f3c0806f450 0x7f3c08071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:57:10.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.941+0000 7f3c1affd640 1 --2- 172.21.15.72:0/381882076 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f3c0806f450 0x7f3c08071960 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c005aa0 tx=0x7f3c0c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:57:10.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.941+0000 7f3c218ba640 1 -- 172.21.15.72:0/381882076 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bfc0052a0 con 0x7f3c1c151590 2024-05-09T05:57:10.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:10.949+0000 7f3c03fff640 1 -- 172.21.15.72:0/381882076 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f3c14023020 con 0x7f3c1c151590 2024-05-09T05:57:11.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:11.261+0000 7f3c218ba640 1 -- 172.21.15.72:0/381882076 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3bfc005860 con 0x7f3c1c151590 2024-05-09T05:57:11.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:11.261+0000 7f3c03fff640 1 -- 172.21.15.72:0/381882076 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+6093 (secure 0 0 0) 0x7f3c14010040 con 0x7f3c1c151590 2024-05-09T05:57:11.247 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:57:11.247 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:53:23.494975+0000","modified":"2024-05-09T05:57:05.675817+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4297,"mds_1":4287,"mds_2":4263,"mds_3":4259,"mds_4":5007},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4259":{"gid":4259,"name":"f","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.110:6838/840351907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":840351907},{"type":"v1","addr":"172.21.15.110:6838","nonce":840351907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4263":{"gid":4263,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.72:6837/1048256382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":1048256382},{"type":"v1","addr":"172.21.15.72:6837","nonce":1048256382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.110:6839/966325499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6837","nonce":966325499},{"type":"v1","addr":"172.21.15.110:6839","nonce":966325499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6836/4134424941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":4134424941},{"type":"v1","addr":"172.21.15.110:6836","nonce":4134424941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5007":{"gid":5007,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":25,"addr":"172.21.15.72:6835/1972750715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":1972750715},{"type":"v1","addr":"172.21.15.72:6835","nonce":1972750715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4259,4263,4287,4297,5007]},"id":1}]} 2024-05-09T05:57:11.247 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 30 2024-05-09T05:57:11.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:11.265+0000 7f3c218ba640 1 -- 172.21.15.72:0/381882076 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f3c0806f450 msgr2=0x7f3c08071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:57:11.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:11.265+0000 7f3c218ba640 1 --2- 172.21.15.72:0/381882076 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f3c0806f450 0x7f3c08071960 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c005aa0 tx=0x7f3c0c009040 comp rx=0 tx=0).stop 2024-05-09T05:57:11.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:11.265+0000 7f3c218ba640 1 -- 172.21.15.72:0/381882076 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c1c151590 msgr2=0x7f3c1c149360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:57:11.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:11.265+0000 7f3c218ba640 1 --2- 172.21.15.72:0/381882076 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c1c151590 0x7f3c1c149360 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c0cdad0 tx=0x7f3c1400eed0 comp rx=0 tx=0).stop 2024-05-09T05:57:11.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:11.265+0000 7f3c218ba640 1 -- 172.21.15.72:0/381882076 shutdown_connections 2024-05-09T05:57:11.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:11.265+0000 7f3c218ba640 1 --2- 172.21.15.72:0/381882076 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f3c0806f450 0x7f3c08071960 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:57:11.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:11.265+0000 7f3c218ba640 1 --2- 172.21.15.72:0/381882076 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c1c151590 0x7f3c1c149360 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:57:11.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:11.265+0000 7f3c218ba640 1 --2- 172.21.15.72:0/381882076 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c1c15d5b0 0x7f3c1c151050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:57:11.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:11.265+0000 7f3c218ba640 1 --2- 172.21.15.72:0/381882076 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c1c0c6910 0x7f3c1c163010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:57:11.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:11.265+0000 7f3c218ba640 1 -- 172.21.15.72:0/381882076 >> 172.21.15.72:0/381882076 conn(0x7f3c1c0cfc20 msgr2=0x7f3c1c153d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:57:11.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:11.265+0000 7f3c218ba640 1 -- 172.21.15.72:0/381882076 shutdown_connections 2024-05-09T05:57:11.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:11.265+0000 7f3c218ba640 1 -- 172.21.15.72:0/381882076 wait complete. 2024-05-09T05:57:11.289 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is in active, standby or standby-replay 2024-05-09T05:57:13.290 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:57:13.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.508+0000 7ff2635c0640 1 Processor -- start 2024-05-09T05:57:13.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.508+0000 7ff2635c0640 1 -- start start 2024-05-09T05:57:13.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.512+0000 7ff2635c0640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff25c156b50 0x7ff25c073ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:57:13.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.512+0000 7ff2635c0640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff25c15f480 0x7ff25c15f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:57:13.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.512+0000 7ff2635c0640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff25c0cda30 con 0x7ff25c074410 2024-05-09T05:57:13.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.512+0000 7ff2635c0640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7ff25c0cc020 con 0x7ff25c156b50 2024-05-09T05:57:13.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.512+0000 7ff2635c0640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7ff25c15dfe0 con 0x7ff25c15f480 2024-05-09T05:57:13.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.512+0000 7ff260b5b640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff25c074410 0x7ff25c0cc4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34874/0 (socket says 172.21.15.72:34874) 2024-05-09T05:57:13.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.512+0000 7ff260b5b640 1 -- 172.21.15.72:0/591114867 learned_addr learned my addr 172.21.15.72:0/591114867 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:57:13.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.512+0000 7ff26135c640 1 --2- 172.21.15.72:0/591114867 >> v2:172.21.15.110:3300/0 conn(0x7ff25c156b50 0x7ff25c073ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:57:13.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.512+0000 7ff261b5d640 1 --2- 172.21.15.72:0/591114867 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff25c15f480 0x7ff25c15f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:57:13.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.512+0000 7ff253fff640 1 -- 172.21.15.72:0/591114867 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 830807921 0 0) 0x7ff24c001120 con 0x7ff25c074410 2024-05-09T05:57:13.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.512+0000 7ff253fff640 1 -- 172.21.15.72:0/591114867 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff248003530 con 0x7ff25c074410 2024-05-09T05:57:13.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.512+0000 7ff253fff640 1 -- 172.21.15.72:0/591114867 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 965751719 0 0) 0x7ff248003530 con 0x7ff25c074410 2024-05-09T05:57:13.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.512+0000 7ff253fff640 1 -- 172.21.15.72:0/591114867 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff25c15f480 msgr2=0x7ff25c15f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:57:13.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.512+0000 7ff253fff640 1 --2- 172.21.15.72:0/591114867 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff25c15f480 0x7ff25c15f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:57:13.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.512+0000 7ff253fff640 1 -- 172.21.15.72:0/591114867 >> v2:172.21.15.110:3300/0 conn(0x7ff25c156b50 msgr2=0x7ff25c073ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:57:13.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.512+0000 7ff253fff640 1 --2- 172.21.15.72:0/591114867 >> v2:172.21.15.110:3300/0 conn(0x7ff25c156b50 0x7ff25c073ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:57:13.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.512+0000 7ff253fff640 1 -- 172.21.15.72:0/591114867 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff25c15cdd0 con 0x7ff25c074410 2024-05-09T05:57:13.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.512+0000 7ff253fff640 1 -- 172.21.15.72:0/591114867 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2749052815 0 0) 0x7ff24c0018d0 con 0x7ff25c074410 2024-05-09T05:57:13.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.512+0000 7ff253fff640 1 -- 172.21.15.72:0/591114867 >> v1:172.21.15.72:6789/0 conn(0x7ff25c074410 legacy=0x7ff25c0cc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:57:13.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.512+0000 7ff253fff640 1 --2- 172.21.15.72:0/591114867 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff25c15f480 0x7ff248003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:57:13.503 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.512+0000 7ff253fff640 1 --2- 172.21.15.72:0/591114867 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff248003fe0 0x7ff248004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:57:13.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.512+0000 7ff253fff640 1 --2- 172.21.15.72:0/591114867 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff248004d50 0x7ff248005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:57:13.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.512+0000 7ff253fff640 1 -- 172.21.15.72:0/591114867 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff25c0cc020 con 0x7ff248003fe0 2024-05-09T05:57:13.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.512+0000 7ff253fff640 1 -- 172.21.15.72:0/591114867 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ff25c15dfe0 con 0x7ff248004d50 2024-05-09T05:57:13.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.512+0000 7ff253fff640 1 -- 172.21.15.72:0/591114867 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7ff24800bad0 con 0x7ff25c15f480 2024-05-09T05:57:13.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.512+0000 7ff260b5b640 1 --2- 172.21.15.72:0/591114867 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff248003fe0 0x7ff248004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:57:13.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.512+0000 7ff261b5d640 1 --2- 172.21.15.72:0/591114867 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff248004d50 0x7ff248005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:57:13.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.512+0000 7ff26135c640 1 --2- 172.21.15.72:0/591114867 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff25c15f480 0x7ff248003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:57:13.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.512+0000 7ff260b5b640 1 -- 172.21.15.72:0/591114867 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff25c15f480 msgr2=0x7ff248003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:57:13.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.512+0000 7ff260b5b640 1 --2- 172.21.15.72:0/591114867 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff25c15f480 0x7ff248003a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:57:13.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.512+0000 7ff260b5b640 1 -- 172.21.15.72:0/591114867 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff248004d50 msgr2=0x7ff248005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:57:13.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.512+0000 7ff260b5b640 1 --2- 172.21.15.72:0/591114867 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff248004d50 0x7ff248005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:57:13.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.512+0000 7ff260b5b640 1 -- 172.21.15.72:0/591114867 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff248003530 con 0x7ff248003fe0 2024-05-09T05:57:13.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.512+0000 7ff26135c640 1 --2- 172.21.15.72:0/591114867 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff25c15f480 0x7ff248003a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:57:13.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.516+0000 7ff260b5b640 1 --2- 172.21.15.72:0/591114867 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff248003fe0 0x7ff248004810 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ff24c00c4c0 tx=0x7ff24c01f360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0d3616aa7f71f7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:57:13.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.516+0000 7ff253fff640 1 -- 172.21.15.72:0/591114867 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff24c00c0e0 con 0x7ff248003fe0 2024-05-09T05:57:13.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.516+0000 7ff253fff640 1 -- 172.21.15.72:0/591114867 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff24c005b00 con 0x7ff248003fe0 2024-05-09T05:57:13.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.516+0000 7ff253fff640 1 -- 172.21.15.72:0/591114867 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff24c007070 con 0x7ff248003fe0 2024-05-09T05:57:13.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.516+0000 7ff2635c0640 1 -- 172.21.15.72:0/591114867 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff248003fe0 msgr2=0x7ff248004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:57:13.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.516+0000 7ff2635c0640 1 --2- 172.21.15.72:0/591114867 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff248003fe0 0x7ff248004810 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ff24c00c4c0 tx=0x7ff24c01f360 comp rx=0 tx=0).stop 2024-05-09T05:57:13.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.516+0000 7ff261b5d640 1 -- 172.21.15.72:0/591114867 reap_dead start 2024-05-09T05:57:13.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.516+0000 7ff2635c0640 1 -- 172.21.15.72:0/591114867 shutdown_connections 2024-05-09T05:57:13.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.516+0000 7ff2635c0640 1 -- 172.21.15.72:0/591114867 >> 172.21.15.72:0/591114867 conn(0x7ff25c0d1b70 msgr2=0x7ff25c0d1f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:57:13.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.516+0000 7ff2635c0640 1 -- 172.21.15.72:0/591114867 shutdown_connections 2024-05-09T05:57:13.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.516+0000 7ff2635c0640 1 -- 172.21.15.72:0/591114867 wait complete. 2024-05-09T05:57:13.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.520+0000 7ff2635c0640 1 Processor -- start 2024-05-09T05:57:13.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.520+0000 7ff2635c0640 1 -- start start 2024-05-09T05:57:13.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.524+0000 7ff2635c0640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff25c1f6e90 0x7ff25c156390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:57:13.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.524+0000 7ff2635c0640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff25c1f2ca0 0x7ff25c15a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:57:13.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.524+0000 7ff2635c0640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff25c1e96e0 0x7ff25c1e9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:57:13.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.524+0000 7ff2635c0640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff25c15d390 con 0x7ff25c1f6e90 2024-05-09T05:57:13.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.524+0000 7ff2635c0640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ff25c15d950 con 0x7ff25c1f2ca0 2024-05-09T05:57:13.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.524+0000 7ff2635c0640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7ff25c15d670 con 0x7ff25c1e96e0 2024-05-09T05:57:13.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.524+0000 7ff26135c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff25c1f6e90 0x7ff25c156390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:57:13.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.524+0000 7ff26135c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff25c1f6e90 0x7ff25c156390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49766/0 (socket says 172.21.15.72:49766) 2024-05-09T05:57:13.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.524+0000 7ff26135c640 1 -- 172.21.15.72:0/2720847286 learned_addr learned my addr 172.21.15.72:0/2720847286 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:57:13.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.524+0000 7ff260b5b640 1 --2- 172.21.15.72:0/2720847286 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff25c1f2ca0 0x7ff25c15a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:57:13.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.524+0000 7ff261b5d640 1 --2- 172.21.15.72:0/2720847286 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff25c1e96e0 0x7ff25c1e9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:57:13.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.524+0000 7ff26135c640 1 -- 172.21.15.72:0/2720847286 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff25c1e96e0 msgr2=0x7ff25c1e9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:57:13.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.524+0000 7ff26135c640 1 --2- 172.21.15.72:0/2720847286 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff25c1e96e0 0x7ff25c1e9af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:57:13.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.524+0000 7ff26135c640 1 -- 172.21.15.72:0/2720847286 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff25c1f2ca0 msgr2=0x7ff25c15a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:57:13.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.524+0000 7ff26135c640 1 --2- 172.21.15.72:0/2720847286 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff25c1f2ca0 0x7ff25c15a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:57:13.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.524+0000 7ff26135c640 1 -- 172.21.15.72:0/2720847286 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff25c157760 con 0x7ff25c1f6e90 2024-05-09T05:57:13.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.524+0000 7ff26135c640 1 --2- 172.21.15.72:0/2720847286 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff25c1f6e90 0x7ff25c156390 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff2580108d0 tx=0x7ff258010d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:57:13.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.524+0000 7ff251ffb640 1 -- 172.21.15.72:0/2720847286 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff25800f040 con 0x7ff25c1f6e90 2024-05-09T05:57:13.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.524+0000 7ff251ffb640 1 -- 172.21.15.72:0/2720847286 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff258004220 con 0x7ff25c1f6e90 2024-05-09T05:57:13.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.524+0000 7ff251ffb640 1 -- 172.21.15.72:0/2720847286 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff25800e900 con 0x7ff25c1f6e90 2024-05-09T05:57:13.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.528+0000 7ff2635c0640 1 -- 172.21.15.72:0/2720847286 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff25c157a40 con 0x7ff25c1f6e90 2024-05-09T05:57:13.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.528+0000 7ff2635c0640 1 -- 172.21.15.72:0/2720847286 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff25c1f6690 con 0x7ff25c1f6e90 2024-05-09T05:57:13.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.528+0000 7ff251ffb640 1 -- 172.21.15.72:0/2720847286 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff25800eaa0 con 0x7ff25c1f6e90 2024-05-09T05:57:13.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.532+0000 7ff251ffb640 1 --2- 172.21.15.72:0/2720847286 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7ff24006f430 0x7ff240071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:57:13.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.532+0000 7ff251ffb640 1 -- 172.21.15.72:0/2720847286 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6762+0+0 (secure 0 0 0) 0x7ff25808ef00 con 0x7ff25c1f6e90 2024-05-09T05:57:13.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.532+0000 7ff260b5b640 1 --2- 172.21.15.72:0/2720847286 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7ff24006f430 0x7ff240071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:57:13.519 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.532+0000 7ff2635c0640 1 -- 172.21.15.72:0/2720847286 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff25c1f61c0 con 0x7ff25c1f6e90 2024-05-09T05:57:13.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.532+0000 7ff260b5b640 1 --2- 172.21.15.72:0/2720847286 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7ff24006f430 0x7ff240071940 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff248004790 tx=0x7ff24c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:57:13.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.544+0000 7ff251ffb640 1 -- 172.21.15.72:0/2720847286 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7ff258018030 con 0x7ff25c1f6e90 2024-05-09T05:57:13.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.852+0000 7ff2635c0640 1 -- 172.21.15.72:0/2720847286 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff25c06a520 con 0x7ff25c1f6e90 2024-05-09T05:57:13.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.852+0000 7ff251ffb640 1 -- 172.21.15.72:0/2720847286 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+6917 (secure 0 0 0) 0x7ff25805b380 con 0x7ff25c1f6e90 2024-05-09T05:57:13.841 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:57:13.842 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5139,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6834/2067223840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":2067223840},{"type":"v1","addr":"172.21.15.72:6834","nonce":2067223840}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:53:23.494975+0000","modified":"2024-05-09T05:57:05.675817+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4297,"mds_1":4287,"mds_2":4263,"mds_3":4259,"mds_4":5007},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4259":{"gid":4259,"name":"f","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.110:6838/840351907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":840351907},{"type":"v1","addr":"172.21.15.110:6838","nonce":840351907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4263":{"gid":4263,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.72:6837/1048256382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":1048256382},{"type":"v1","addr":"172.21.15.72:6837","nonce":1048256382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.110:6839/966325499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6837","nonce":966325499},{"type":"v1","addr":"172.21.15.110:6839","nonce":966325499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6836/4134424941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":4134424941},{"type":"v1","addr":"172.21.15.110:6836","nonce":4134424941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5007":{"gid":5007,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":25,"addr":"172.21.15.72:6835/1972750715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":1972750715},{"type":"v1","addr":"172.21.15.72:6835","nonce":1972750715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[5007,4297,4287,4263,4259]},"id":1}]} 2024-05-09T05:57:13.842 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 31 2024-05-09T05:57:13.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.856+0000 7ff2635c0640 1 -- 172.21.15.72:0/2720847286 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7ff24006f430 msgr2=0x7ff240071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:57:13.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.856+0000 7ff2635c0640 1 --2- 172.21.15.72:0/2720847286 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7ff24006f430 0x7ff240071940 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff248004790 tx=0x7ff24c009040 comp rx=0 tx=0).stop 2024-05-09T05:57:13.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.856+0000 7ff2635c0640 1 -- 172.21.15.72:0/2720847286 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff25c1f6e90 msgr2=0x7ff25c156390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:57:13.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.856+0000 7ff2635c0640 1 --2- 172.21.15.72:0/2720847286 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff25c1f6e90 0x7ff25c156390 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff2580108d0 tx=0x7ff258010d90 comp rx=0 tx=0).stop 2024-05-09T05:57:13.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.856+0000 7ff2635c0640 1 -- 172.21.15.72:0/2720847286 shutdown_connections 2024-05-09T05:57:13.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.856+0000 7ff2635c0640 1 --2- 172.21.15.72:0/2720847286 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7ff24006f430 0x7ff240071940 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:57:13.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.856+0000 7ff2635c0640 1 --2- 172.21.15.72:0/2720847286 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff25c1e96e0 0x7ff25c1e9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:57:13.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.856+0000 7ff2635c0640 1 --2- 172.21.15.72:0/2720847286 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff25c1f2ca0 0x7ff25c15a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:57:13.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.856+0000 7ff2635c0640 1 --2- 172.21.15.72:0/2720847286 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff25c1f6e90 0x7ff25c156390 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:57:13.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.856+0000 7ff2635c0640 1 -- 172.21.15.72:0/2720847286 >> 172.21.15.72:0/2720847286 conn(0x7ff25c0d1b70 msgr2=0x7ff25c0ced10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:57:13.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.856+0000 7ff2635c0640 1 -- 172.21.15.72:0/2720847286 shutdown_connections 2024-05-09T05:57:13.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:57:13.856+0000 7ff2635c0640 1 -- 172.21.15.72:0/2720847286 wait complete. 2024-05-09T05:57:13.876 INFO:tasks.mds_thrash.fs.[cephfs]:mds.e reported in up:standby state 2024-05-09T05:57:13.877 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 94 secs before thrashing 2024-05-09T05:57:25.767 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T05:57:25.770 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T05:57:26.737 INFO:tasks.workunit.client.0.smithi072.stdout: 2024-05-09T05:57:26.738 INFO:tasks.workunit.client.0.smithi072.stdout: Children see throughput for 1 initial writers = 504581.88 kB/sec 2024-05-09T05:57:26.738 INFO:tasks.workunit.client.0.smithi072.stdout: Parent sees throughput for 1 initial writers = 504550.93 kB/sec 2024-05-09T05:57:26.738 INFO:tasks.workunit.client.0.smithi072.stdout: Min throughput per process = 504581.88 kB/sec 2024-05-09T05:57:26.738 INFO:tasks.workunit.client.0.smithi072.stdout: Max throughput per process = 504581.88 kB/sec 2024-05-09T05:57:26.738 INFO:tasks.workunit.client.0.smithi072.stdout: Avg throughput per process = 504581.88 kB/sec 2024-05-09T05:57:26.738 INFO:tasks.workunit.client.0.smithi072.stdout: Min xfer = 10485760.00 kB 2024-05-09T05:57:54.353 INFO:tasks.workunit.client.0.smithi072.stdout: 2024-05-09T05:57:54.354 INFO:tasks.workunit.client.0.smithi072.stdout: Children see throughput for 1 rewriters = 557843.88 kB/sec 2024-05-09T05:57:54.354 INFO:tasks.workunit.client.0.smithi072.stdout: Parent sees throughput for 1 rewriters = 557820.01 kB/sec 2024-05-09T05:57:54.354 INFO:tasks.workunit.client.0.smithi072.stdout: Min throughput per process = 557843.88 kB/sec 2024-05-09T05:57:54.354 INFO:tasks.workunit.client.0.smithi072.stdout: Max throughput per process = 557843.88 kB/sec 2024-05-09T05:57:54.354 INFO:tasks.workunit.client.0.smithi072.stdout: Avg throughput per process = 557843.88 kB/sec 2024-05-09T05:57:54.354 INFO:tasks.workunit.client.0.smithi072.stdout: Min xfer = 10485760.00 kB 2024-05-09T05:57:56.344 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T05:57:56.347 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T05:58:17.879 INFO:tasks.workunit.client.0.smithi072.stdout: 2024-05-09T05:58:17.880 INFO:tasks.workunit.client.0.smithi072.stdout: Children see throughput for 1 readers = 7582278.00 kB/sec 2024-05-09T05:58:17.880 INFO:tasks.workunit.client.0.smithi072.stdout: Parent sees throughput for 1 readers = 7578733.48 kB/sec 2024-05-09T05:58:17.880 INFO:tasks.workunit.client.0.smithi072.stdout: Min throughput per process = 7582278.00 kB/sec 2024-05-09T05:58:17.880 INFO:tasks.workunit.client.0.smithi072.stdout: Max throughput per process = 7582278.00 kB/sec 2024-05-09T05:58:17.880 INFO:tasks.workunit.client.0.smithi072.stdout: Avg throughput per process = 7582278.00 kB/sec 2024-05-09T05:58:17.880 INFO:tasks.workunit.client.0.smithi072.stdout: Min xfer = 10485760.00 kB 2024-05-09T05:58:21.740 INFO:tasks.workunit.client.0.smithi072.stdout: 2024-05-09T05:58:21.740 INFO:tasks.workunit.client.0.smithi072.stdout: Children see throughput for 1 re-readers = 6229679.50 kB/sec 2024-05-09T05:58:21.740 INFO:tasks.workunit.client.0.smithi072.stdout: Parent sees throughput for 1 re-readers = 6227268.00 kB/sec 2024-05-09T05:58:21.740 INFO:tasks.workunit.client.0.smithi072.stdout: Min throughput per process = 6229679.50 kB/sec 2024-05-09T05:58:21.740 INFO:tasks.workunit.client.0.smithi072.stdout: Max throughput per process = 6229679.50 kB/sec 2024-05-09T05:58:21.741 INFO:tasks.workunit.client.0.smithi072.stdout: Avg throughput per process = 6229679.50 kB/sec 2024-05-09T05:58:21.741 INFO:tasks.workunit.client.0.smithi072.stdout: Min xfer = 10485760.00 kB 2024-05-09T05:58:27.124 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T05:58:27.127 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T05:58:28.749 INFO:tasks.workunit.client.0.smithi072.stdout: 2024-05-09T05:58:28.749 INFO:tasks.workunit.client.0.smithi072.stdout: 2024-05-09T05:58:28.750 INFO:tasks.workunit.client.0.smithi072.stdout: 2024-05-09T05:58:28.750 INFO:tasks.workunit.client.0.smithi072.stdout:iozone test complete. 2024-05-09T05:58:28.753 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-05-09T05:58:28.754 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-05-09T05:58:28.788 INFO:tasks.workunit:Stopping ['suites/iozone.sh'] on client.0... 2024-05-09T05:58:28.789 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-05-09T05:58:29.125 DEBUG:teuthology.parallel:result is None 2024-05-09T05:58:29.126 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-05-09T05:58:29.162 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-05-09T05:58:29.162 DEBUG:teuthology.run_tasks:Unwinding manager mds_thrash 2024-05-09T05:58:29.172 INFO:tasks.mds_thrash:joining mds_thrasher 2024-05-09T05:58:29.172 ERROR:tasks.mds_thrash.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_c9da4049f638c0f84bdd9b4e33c42e86046ac554/qa/tasks/mds_thrash.py", line 121, in _run self.do_thrash() File "/home/teuthworker/src/git.ceph.com_ceph-c_c9da4049f638c0f84bdd9b4e33c42e86046ac554/qa/tasks/mds_thrash.py", line 237, in do_thrash self.sleep_unless_stopped(delay) File "/home/teuthworker/src/git.ceph.com_ceph-c_c9da4049f638c0f84bdd9b4e33c42e86046ac554/qa/tasks/thrasher.py", line 47, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-05-09T05:58:29.172 INFO:tasks.mds_thrash:done joining 2024-05-09T05:58:29.173 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-05-09T05:58:29.209 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-05-09T05:58:29.209 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-09T05:58:29.209 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T05:58:29.214 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-09T05:58:29.215 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T05:58:29.262 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-09T05:58:29.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.475+0000 7f3a77760640 1 Processor -- start 2024-05-09T05:58:29.463 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.475+0000 7f3a77760640 1 -- start start 2024-05-09T05:58:29.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.475+0000 7f3a77760640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3a700c9200 0x7f3a70160750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:29.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.475+0000 7f3a77760640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3a700cb500 0x7f3a700cb910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:29.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.475+0000 7f3a77760640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a7015cf70 con 0x7f3a700c9d10 2024-05-09T05:58:29.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.475+0000 7f3a77760640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f3a7015fd00 con 0x7f3a700cb500 2024-05-09T05:58:29.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.475+0000 7f3a77760640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f3a70160c90 con 0x7f3a700c9200 2024-05-09T05:58:29.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.475+0000 7f3a75cfd640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3a700cb500 0x7f3a700cb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:29.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.475+0000 7f3a74cfb640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3a700c9200 0x7f3a70160750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:29.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.475+0000 7f3a74cfb640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3a700c9200 0x7f3a70160750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.72:49794/0 (socket says 172.21.15.72:49794) 2024-05-09T05:58:29.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.475+0000 7f3a74cfb640 1 -- 172.21.15.72:0/2927212700 learned_addr learned my addr 172.21.15.72:0/2927212700 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:58:29.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.475+0000 7f3a754fc640 1 --1- 172.21.15.72:0/2927212700 >> v1:172.21.15.110:6789/0 conn(0x7f3a700c9d10 0x7f3a7015c750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.72:51474/0 (socket says 172.21.15.72:51474) 2024-05-09T05:58:29.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.475+0000 7f3a75cfd640 1 -- 172.21.15.72:0/2927212700 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3a700c9200 msgr2=0x7f3a70160750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:58:29.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.475+0000 7f3a75cfd640 1 --2- 172.21.15.72:0/2927212700 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3a700c9200 0x7f3a70160750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:29.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.475+0000 7f3a75cfd640 1 -- 172.21.15.72:0/2927212700 >> v1:172.21.15.110:6789/0 conn(0x7f3a700c9d10 legacy=0x7f3a7015c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:29.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.475+0000 7f3a75cfd640 1 -- 172.21.15.72:0/2927212700 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a7015d230 con 0x7f3a700cb500 2024-05-09T05:58:29.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.479+0000 7f3a75cfd640 1 --2- 172.21.15.72:0/2927212700 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a700cb500 0x7f3a700cb910 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c009d90 tx=0x7f3a6c01c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=497a6731e031bc6c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:29.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.479+0000 7f3a67fff640 1 -- 172.21.15.72:0/2927212700 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c0b2070 con 0x7f3a700cb500 2024-05-09T05:58:29.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.479+0000 7f3a67fff640 1 -- 172.21.15.72:0/2927212700 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a6c0a5830 con 0x7f3a700cb500 2024-05-09T05:58:29.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.479+0000 7f3a67fff640 1 -- 172.21.15.72:0/2927212700 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c0a5c00 con 0x7f3a700cb500 2024-05-09T05:58:29.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.479+0000 7f3a77760640 1 -- 172.21.15.72:0/2927212700 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a700cb500 msgr2=0x7f3a700cb910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:29.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.479+0000 7f3a77760640 1 --2- 172.21.15.72:0/2927212700 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a700cb500 0x7f3a700cb910 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c009d90 tx=0x7f3a6c01c970 comp rx=0 tx=0).stop 2024-05-09T05:58:29.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.479+0000 7f3a77760640 1 -- 172.21.15.72:0/2927212700 shutdown_connections 2024-05-09T05:58:29.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.479+0000 7f3a77760640 1 --2- 172.21.15.72:0/2927212700 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a700cb500 0x7f3a700cb910 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:29.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.479+0000 7f3a77760640 1 --2- 172.21.15.72:0/2927212700 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3a700c9200 0x7f3a70160750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:29.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.479+0000 7f3a77760640 1 -- 172.21.15.72:0/2927212700 >> 172.21.15.72:0/2927212700 conn(0x7f3a7006dab0 msgr2=0x7f3a7006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:58:29.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.479+0000 7f3a77760640 1 -- 172.21.15.72:0/2927212700 shutdown_connections 2024-05-09T05:58:29.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.479+0000 7f3a77760640 1 -- 172.21.15.72:0/2927212700 wait complete. 2024-05-09T05:58:29.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.483+0000 7f3a77760640 1 Processor -- start 2024-05-09T05:58:29.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.483+0000 7f3a77760640 1 -- start start 2024-05-09T05:58:29.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.483+0000 7f3a77760640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a700c9200 0x7f3a700c69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:29.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.483+0000 7f3a77760640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3a700c9d10 0x7f3a7014d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:29.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.483+0000 7f3a77760640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a700cb500 0x7f3a701f8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:29.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.483+0000 7f3a77760640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f3a700cf650 con 0x7f3a700c9200 2024-05-09T05:58:29.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.483+0000 7f3a77760640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f3a700cf4d0 con 0x7f3a700cb500 2024-05-09T05:58:29.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.483+0000 7f3a77760640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f3a701698b0 con 0x7f3a700c9d10 2024-05-09T05:58:29.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.483+0000 7f3a754fc640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a700c9200 0x7f3a700c69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:29.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.483+0000 7f3a754fc640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a700c9200 0x7f3a700c69c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40348/0 (socket says 172.21.15.72:40348) 2024-05-09T05:58:29.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.483+0000 7f3a754fc640 1 -- 172.21.15.72:0/11241222 learned_addr learned my addr 172.21.15.72:0/11241222 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:58:29.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.483+0000 7f3a74cfb640 1 --2- 172.21.15.72:0/11241222 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3a700c9d10 0x7f3a7014d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:29.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.483+0000 7f3a75cfd640 1 --2- 172.21.15.72:0/11241222 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a700cb500 0x7f3a701f8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:29.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.483+0000 7f3a754fc640 1 -- 172.21.15.72:0/11241222 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3a700c9d10 msgr2=0x7f3a7014d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:29.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.483+0000 7f3a754fc640 1 --2- 172.21.15.72:0/11241222 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3a700c9d10 0x7f3a7014d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:29.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.483+0000 7f3a754fc640 1 -- 172.21.15.72:0/11241222 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a700cb500 msgr2=0x7f3a701f8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:29.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.483+0000 7f3a754fc640 1 --2- 172.21.15.72:0/11241222 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a700cb500 0x7f3a701f8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:29.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.483+0000 7f3a754fc640 1 -- 172.21.15.72:0/11241222 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a701f9ca0 con 0x7f3a700c9200 2024-05-09T05:58:29.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.483+0000 7f3a754fc640 1 --2- 172.21.15.72:0/11241222 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a700c9200 0x7f3a700c69c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3a6800c460 tx=0x7f3a6800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:29.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.483+0000 7f3a65ffb640 1 -- 172.21.15.72:0/11241222 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a68018070 con 0x7f3a700c9200 2024-05-09T05:58:29.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.483+0000 7f3a65ffb640 1 -- 172.21.15.72:0/11241222 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a68007480 con 0x7f3a700c9200 2024-05-09T05:58:29.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.483+0000 7f3a77760640 1 -- 172.21.15.72:0/11241222 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a700c6f00 con 0x7f3a700c9200 2024-05-09T05:58:29.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.483+0000 7f3a65ffb640 1 -- 172.21.15.72:0/11241222 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a680047f0 con 0x7f3a700c9200 2024-05-09T05:58:29.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.483+0000 7f3a77760640 1 -- 172.21.15.72:0/11241222 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a701f99c0 con 0x7f3a700c9200 2024-05-09T05:58:29.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.487+0000 7f3a77760640 1 -- 172.21.15.72:0/11241222 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a7006a520 con 0x7f3a700c9200 2024-05-09T05:58:29.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.487+0000 7f3a65ffb640 1 -- 172.21.15.72:0/11241222 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f3a680049b0 con 0x7f3a700c9200 2024-05-09T05:58:29.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.487+0000 7f3a65ffb640 1 --2- 172.21.15.72:0/11241222 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f3a5406f400 0x7f3a54071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:29.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.487+0000 7f3a65ffb640 1 -- 172.21.15.72:0/11241222 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6762+0+0 (secure 0 0 0) 0x7f3a6808ea40 con 0x7f3a700c9200 2024-05-09T05:58:29.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.487+0000 7f3a74cfb640 1 --2- 172.21.15.72:0/11241222 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f3a5406f400 0x7f3a54071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:29.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.487+0000 7f3a74cfb640 1 --2- 172.21.15.72:0/11241222 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f3a5406f400 0x7f3a54071910 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3a70167060 tx=0x7f3a60009240 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:29.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.491+0000 7f3a65ffb640 1 -- 172.21.15.72:0/11241222 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f3a68021080 con 0x7f3a700c9200 2024-05-09T05:58:29.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.659+0000 7f3a77760640 1 -- 172.21.15.72:0/11241222 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f3a700c5880 con 0x7f3a700c9200 2024-05-09T05:58:29.647 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.659+0000 7f3a65ffb640 1 -- 172.21.15.72:0/11241222 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 4 entries v29) ==== 80+0+244 (secure 0 0 0) 0x7f3a701f9ca0 con 0x7f3a700c9200 2024-05-09T05:58:29.648 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:6834/1142956298 2024-05-10T05:56:44.361730+0000 2024-05-09T05:58:29.648 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:6832/1142956298 2024-05-10T05:56:44.361730+0000 2024-05-09T05:58:29.648 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:6835/3946563056 2024-05-10T05:55:14.344999+0000 2024-05-09T05:58:29.648 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:6833/3946563056 2024-05-10T05:55:14.344999+0000 2024-05-09T05:58:29.648 INFO:teuthology.orchestra.run.smithi072.stderr:listed 4 entries 2024-05-09T05:58:29.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.663+0000 7f3a77760640 1 -- 172.21.15.72:0/11241222 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f3a5406f400 msgr2=0x7f3a54071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:29.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.663+0000 7f3a77760640 1 --2- 172.21.15.72:0/11241222 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f3a5406f400 0x7f3a54071910 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3a70167060 tx=0x7f3a60009240 comp rx=0 tx=0).stop 2024-05-09T05:58:29.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.663+0000 7f3a77760640 1 -- 172.21.15.72:0/11241222 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a700c9200 msgr2=0x7f3a700c69c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:29.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.663+0000 7f3a77760640 1 --2- 172.21.15.72:0/11241222 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a700c9200 0x7f3a700c69c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3a6800c460 tx=0x7f3a6800c920 comp rx=0 tx=0).stop 2024-05-09T05:58:29.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.663+0000 7f3a77760640 1 -- 172.21.15.72:0/11241222 shutdown_connections 2024-05-09T05:58:29.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.663+0000 7f3a77760640 1 --2- 172.21.15.72:0/11241222 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f3a5406f400 0x7f3a54071910 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:29.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.663+0000 7f3a77760640 1 --2- 172.21.15.72:0/11241222 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a700cb500 0x7f3a701f8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:29.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.663+0000 7f3a77760640 1 --2- 172.21.15.72:0/11241222 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3a700c9d10 0x7f3a7014d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:29.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.663+0000 7f3a77760640 1 --2- 172.21.15.72:0/11241222 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a700c9200 0x7f3a700c69c0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:29.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.663+0000 7f3a77760640 1 -- 172.21.15.72:0/11241222 >> 172.21.15.72:0/11241222 conn(0x7f3a7006dab0 msgr2=0x7f3a7015e1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:58:29.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.663+0000 7f3a77760640 1 -- 172.21.15.72:0/11241222 shutdown_connections 2024-05-09T05:58:29.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.663+0000 7f3a77760640 1 -- 172.21.15.72:0/11241222 wait complete. 2024-05-09T05:58:29.670 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-09T05:58:29.670 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T05:58:29.676 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-09T05:58:29.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.875+0000 7f712c7aa640 1 Processor -- start 2024-05-09T05:58:29.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.875+0000 7f712c7aa640 1 -- start start 2024-05-09T05:58:29.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.879+0000 7f712c7aa640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f71241537d0 0x7f7124074740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:29.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.879+0000 7f712c7aa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7124161d70 0x7f7124164190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:29.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.879+0000 7f712c7aa640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71240c72c0 con 0x7f71240c77a0 2024-05-09T05:58:29.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.879+0000 7f712c7aa640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f7124074c80 con 0x7f71241537d0 2024-05-09T05:58:29.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.879+0000 7f712c7aa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f71240c7bb0 con 0x7f7124161d70 2024-05-09T05:58:29.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.879+0000 7f7129d45640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f71241537d0 0x7f7124074740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:29.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.879+0000 7f712a546640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f71240c77a0 0x7f7124072e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39478/0 (socket says 172.21.15.72:39478) 2024-05-09T05:58:29.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.879+0000 7f712a546640 1 -- 172.21.15.72:0/2320991063 learned_addr learned my addr 172.21.15.72:0/2320991063 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:58:29.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.879+0000 7f712ad47640 1 --2- 172.21.15.72:0/2320991063 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7124161d70 0x7f7124164190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:29.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.879+0000 7f7129d45640 1 -- 172.21.15.72:0/2320991063 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7124161d70 msgr2=0x7f7124164190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:58:29.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.879+0000 7f7129d45640 1 --2- 172.21.15.72:0/2320991063 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7124161d70 0x7f7124164190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:29.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.879+0000 7f7129d45640 1 -- 172.21.15.72:0/2320991063 >> v1:172.21.15.72:6789/0 conn(0x7f71240c77a0 legacy=0x7f7124072e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:29.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.879+0000 7f7129d45640 1 -- 172.21.15.72:0/2320991063 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7124153be0 con 0x7f71241537d0 2024-05-09T05:58:29.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.879+0000 7f7129544640 1 -- 172.21.15.72:0/2320991063 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 21413057 0 0) 0x7f71240c72c0 con 0x7f71240c77a0 2024-05-09T05:58:29.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.879+0000 7f7129d45640 1 --2- 172.21.15.72:0/2320991063 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71241537d0 0x7f7124074740 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f71140097c0 tx=0x7f711401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aeea29c8631c613 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:29.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.879+0000 7f7129544640 1 -- 172.21.15.72:0/2320991063 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71140a7070 con 0x7f71241537d0 2024-05-09T05:58:29.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.879+0000 7f7129544640 1 -- 172.21.15.72:0/2320991063 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71140b0070 con 0x7f71241537d0 2024-05-09T05:58:29.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.879+0000 7f7129544640 1 -- 172.21.15.72:0/2320991063 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71140ab890 con 0x7f71241537d0 2024-05-09T05:58:29.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.883+0000 7f712c7aa640 1 -- 172.21.15.72:0/2320991063 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71241537d0 msgr2=0x7f7124074740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:29.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.883+0000 7f712c7aa640 1 --2- 172.21.15.72:0/2320991063 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71241537d0 0x7f7124074740 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f71140097c0 tx=0x7f711401c470 comp rx=0 tx=0).stop 2024-05-09T05:58:29.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.883+0000 7f712c7aa640 1 -- 172.21.15.72:0/2320991063 shutdown_connections 2024-05-09T05:58:29.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.883+0000 7f712c7aa640 1 --2- 172.21.15.72:0/2320991063 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7124161d70 0x7f7124164190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:29.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.883+0000 7f712c7aa640 1 --2- 172.21.15.72:0/2320991063 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71241537d0 0x7f7124074740 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:29.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.883+0000 7f712c7aa640 1 -- 172.21.15.72:0/2320991063 >> 172.21.15.72:0/2320991063 conn(0x7f71240cde90 msgr2=0x7f71240ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:58:29.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.883+0000 7f712c7aa640 1 -- 172.21.15.72:0/2320991063 shutdown_connections 2024-05-09T05:58:29.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.883+0000 7f712c7aa640 1 -- 172.21.15.72:0/2320991063 wait complete. 2024-05-09T05:58:29.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.883+0000 7f712c7aa640 1 Processor -- start 2024-05-09T05:58:29.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.883+0000 7f712c7aa640 1 -- start start 2024-05-09T05:58:29.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.883+0000 7f712c7aa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71240c77a0 0x7f7124162260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:29.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.883+0000 7f712c7aa640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71241537d0 0x7f7124146050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:29.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.883+0000 7f712c7aa640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7124161d70 0x7f7124146590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:29.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.883+0000 7f712c7aa640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7124072940 con 0x7f7124161d70 2024-05-09T05:58:29.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.883+0000 7f712c7aa640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f71240740b0 con 0x7f71241537d0 2024-05-09T05:58:29.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.883+0000 7f712c7aa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f71240c4cb0 con 0x7f71240c77a0 2024-05-09T05:58:29.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.883+0000 7f712ad47640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7124161d70 0x7f7124146590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:29.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.883+0000 7f712ad47640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7124161d70 0x7f7124146590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40370/0 (socket says 172.21.15.72:40370) 2024-05-09T05:58:29.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.883+0000 7f712ad47640 1 -- 172.21.15.72:0/3561062869 learned_addr learned my addr 172.21.15.72:0/3561062869 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:58:29.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.883+0000 7f712a546640 1 --2- 172.21.15.72:0/3561062869 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71240c77a0 0x7f7124162260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:29.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.883+0000 7f7129d45640 1 --2- 172.21.15.72:0/3561062869 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71241537d0 0x7f7124146050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:29.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.887+0000 7f712ad47640 1 -- 172.21.15.72:0/3561062869 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71240c77a0 msgr2=0x7f7124162260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:29.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.887+0000 7f712ad47640 1 --2- 172.21.15.72:0/3561062869 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71240c77a0 0x7f7124162260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:29.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.887+0000 7f712ad47640 1 -- 172.21.15.72:0/3561062869 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71241537d0 msgr2=0x7f7124146050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:29.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.887+0000 7f712ad47640 1 --2- 172.21.15.72:0/3561062869 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71241537d0 0x7f7124146050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:29.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.887+0000 7f712ad47640 1 -- 172.21.15.72:0/3561062869 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71241627a0 con 0x7f7124161d70 2024-05-09T05:58:29.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.887+0000 7f7129d45640 1 --2- 172.21.15.72:0/3561062869 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71241537d0 0x7f7124146050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:58:29.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.887+0000 7f712ad47640 1 --2- 172.21.15.72:0/3561062869 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7124161d70 0x7f7124146590 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f711c00cc30 tx=0x7f711c00a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:29.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.887+0000 7f711affd640 1 -- 172.21.15.72:0/3561062869 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f711c00ce40 con 0x7f7124161d70 2024-05-09T05:58:29.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.887+0000 7f711affd640 1 -- 172.21.15.72:0/3561062869 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f711c0039a0 con 0x7f7124161d70 2024-05-09T05:58:29.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.887+0000 7f711affd640 1 -- 172.21.15.72:0/3561062869 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f711c003d50 con 0x7f7124161d70 2024-05-09T05:58:29.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.887+0000 7f712c7aa640 1 -- 172.21.15.72:0/3561062869 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71241f5b50 con 0x7f7124161d70 2024-05-09T05:58:29.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.887+0000 7f712c7aa640 1 -- 172.21.15.72:0/3561062869 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71241f60d0 con 0x7f7124161d70 2024-05-09T05:58:29.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.887+0000 7f712c7aa640 1 -- 172.21.15.72:0/3561062869 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f712406a520 con 0x7f7124161d70 2024-05-09T05:58:29.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.887+0000 7f711affd640 1 -- 172.21.15.72:0/3561062869 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f711c003f10 con 0x7f7124161d70 2024-05-09T05:58:29.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.887+0000 7f711affd640 1 --2- 172.21.15.72:0/3561062869 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f710806f400 0x7f7108071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:29.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.887+0000 7f711affd640 1 -- 172.21.15.72:0/3561062869 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6762+0+0 (secure 0 0 0) 0x7f711c08fea0 con 0x7f7124161d70 2024-05-09T05:58:29.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.887+0000 7f712a546640 1 --2- 172.21.15.72:0/3561062869 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f710806f400 0x7f7108071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:29.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.887+0000 7f712a546640 1 --2- 172.21.15.72:0/3561062869 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f710806f400 0x7f7108071910 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7120007fd0 tx=0x7f7120009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:29.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:29.891+0000 7f711affd640 1 -- 172.21.15.72:0/3561062869 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f711c014030 con 0x7f7124161d70 2024-05-09T05:58:30.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:30.051+0000 7f712c7aa640 1 -- 172.21.15.72:0/3561062869 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f71240c85e0 con 0x7f7124161d70 2024-05-09T05:58:30.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:30.055+0000 7f711affd640 1 -- 172.21.15.72:0/3561062869 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 4 entries v29) ==== 80+0+244 (secure 0 0 0) 0x7f711c05cae0 con 0x7f7124161d70 2024-05-09T05:58:30.041 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:6834/1142956298 2024-05-10T05:56:44.361730+0000 2024-05-09T05:58:30.041 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:6832/1142956298 2024-05-10T05:56:44.361730+0000 2024-05-09T05:58:30.042 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:6835/3946563056 2024-05-10T05:55:14.344999+0000 2024-05-09T05:58:30.042 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:6833/3946563056 2024-05-10T05:55:14.344999+0000 2024-05-09T05:58:30.042 INFO:teuthology.orchestra.run.smithi072.stderr:listed 4 entries 2024-05-09T05:58:30.043 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:30.055+0000 7f712c7aa640 1 -- 172.21.15.72:0/3561062869 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f710806f400 msgr2=0x7f7108071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:30.043 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:30.055+0000 7f712c7aa640 1 --2- 172.21.15.72:0/3561062869 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f710806f400 0x7f7108071910 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7120007fd0 tx=0x7f7120009040 comp rx=0 tx=0).stop 2024-05-09T05:58:30.043 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:30.055+0000 7f712c7aa640 1 -- 172.21.15.72:0/3561062869 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7124161d70 msgr2=0x7f7124146590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:30.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:30.055+0000 7f712c7aa640 1 --2- 172.21.15.72:0/3561062869 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7124161d70 0x7f7124146590 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f711c00cc30 tx=0x7f711c00a5c0 comp rx=0 tx=0).stop 2024-05-09T05:58:30.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:30.055+0000 7f712c7aa640 1 -- 172.21.15.72:0/3561062869 shutdown_connections 2024-05-09T05:58:30.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:30.055+0000 7f712c7aa640 1 --2- 172.21.15.72:0/3561062869 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f710806f400 0x7f7108071910 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:30.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:30.055+0000 7f712c7aa640 1 --2- 172.21.15.72:0/3561062869 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7124161d70 0x7f7124146590 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:30.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:30.055+0000 7f712c7aa640 1 --2- 172.21.15.72:0/3561062869 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71241537d0 0x7f7124146050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:30.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:30.055+0000 7f712c7aa640 1 --2- 172.21.15.72:0/3561062869 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71240c77a0 0x7f7124162260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:30.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:30.055+0000 7f712c7aa640 1 -- 172.21.15.72:0/3561062869 >> 172.21.15.72:0/3561062869 conn(0x7f71240cde90 msgr2=0x7f71240c43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:58:30.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:30.055+0000 7f712c7aa640 1 -- 172.21.15.72:0/3561062869 shutdown_connections 2024-05-09T05:58:30.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:30.055+0000 7f712c7aa640 1 -- 172.21.15.72:0/3561062869 wait complete. 2024-05-09T05:58:30.063 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi072.front.sepia.ceph.com... 2024-05-09T05:58:30.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:58:30.064 DEBUG:teuthology.orchestra.run.smithi072:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-05-09T05:58:30.073 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T05:58:30.075 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi072.stderr:ceph-fuse[35468]: fuse finished with error 0 and tester_r 0 2024-05-09T05:58:36.175 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi072.front.sepia.ceph.com 2024-05-09T05:58:36.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:58:36.175 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-09T05:58:36.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:58:36.183 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2024-05-09T05:58:36.230 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-09T05:58:36.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:58:36.231 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-09T05:58:36.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:58:36.286 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link delete ceph-brx 2024-05-09T05:58:36.471 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-05-09T05:58:36.481 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-09T05:58:36.481 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T05:58:36.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.655+0000 7fd628386640 1 Processor -- start 2024-05-09T05:58:36.642 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.655+0000 7fd628386640 1 -- start start 2024-05-09T05:58:36.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.655+0000 7fd628386640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd6201537d0 0x7fd620074740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:36.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.655+0000 7fd628386640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd620161d70 0x7fd620164190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:36.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.655+0000 7fd628386640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6200c72c0 con 0x7fd6200c77a0 2024-05-09T05:58:36.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.655+0000 7fd628386640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fd620074c80 con 0x7fd6201537d0 2024-05-09T05:58:36.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.655+0000 7fd628386640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fd6200c7bb0 con 0x7fd620161d70 2024-05-09T05:58:36.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.655+0000 7fd625921640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd6201537d0 0x7fd620074740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:36.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.655+0000 7fd626122640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fd6200c77a0 0x7fd620072e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:38456/0 (socket says 172.21.15.72:38456) 2024-05-09T05:58:36.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.655+0000 7fd626122640 1 -- 172.21.15.72:0/805128926 learned_addr learned my addr 172.21.15.72:0/805128926 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:58:36.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.655+0000 7fd626923640 1 --2- 172.21.15.72:0/805128926 >> v2:172.21.15.110:3300/0 conn(0x7fd620161d70 0x7fd620164190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:36.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.655+0000 7fd625921640 1 -- 172.21.15.72:0/805128926 >> v2:172.21.15.110:3300/0 conn(0x7fd620161d70 msgr2=0x7fd620164190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:58:36.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.655+0000 7fd625921640 1 --2- 172.21.15.72:0/805128926 >> v2:172.21.15.110:3300/0 conn(0x7fd620161d70 0x7fd620164190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:36.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.655+0000 7fd625921640 1 -- 172.21.15.72:0/805128926 >> v1:172.21.15.72:6789/0 conn(0x7fd6200c77a0 legacy=0x7fd620072e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:36.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.655+0000 7fd625921640 1 -- 172.21.15.72:0/805128926 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd620153be0 con 0x7fd6201537d0 2024-05-09T05:58:36.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.655+0000 7fd626923640 1 --2- 172.21.15.72:0/805128926 >> v2:172.21.15.110:3300/0 conn(0x7fd620161d70 0x7fd620164190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:58:36.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.659+0000 7fd625921640 1 --2- 172.21.15.72:0/805128926 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6201537d0 0x7fd620074740 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd6200ca000 tx=0x7fd61001e660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=422d36bcc4159277 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:36.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.659+0000 7fd625120640 1 -- 172.21.15.72:0/805128926 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6100ab630 con 0x7fd6201537d0 2024-05-09T05:58:36.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.659+0000 7fd625120640 1 -- 172.21.15.72:0/805128926 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6100ab7d0 con 0x7fd6201537d0 2024-05-09T05:58:36.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.659+0000 7fd625120640 1 -- 172.21.15.72:0/805128926 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6100abba0 con 0x7fd6201537d0 2024-05-09T05:58:36.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.659+0000 7fd628386640 1 -- 172.21.15.72:0/805128926 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6201537d0 msgr2=0x7fd620074740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:36.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.659+0000 7fd628386640 1 --2- 172.21.15.72:0/805128926 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6201537d0 0x7fd620074740 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd6200ca000 tx=0x7fd61001e660 comp rx=0 tx=0).stop 2024-05-09T05:58:36.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.659+0000 7fd628386640 1 -- 172.21.15.72:0/805128926 shutdown_connections 2024-05-09T05:58:36.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.659+0000 7fd628386640 1 --2- 172.21.15.72:0/805128926 >> v2:172.21.15.110:3300/0 conn(0x7fd620161d70 0x7fd620164190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:36.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.659+0000 7fd628386640 1 --2- 172.21.15.72:0/805128926 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6201537d0 0x7fd620074740 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:36.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.659+0000 7fd628386640 1 -- 172.21.15.72:0/805128926 >> 172.21.15.72:0/805128926 conn(0x7fd6200cde90 msgr2=0x7fd6200ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:58:36.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.659+0000 7fd628386640 1 -- 172.21.15.72:0/805128926 shutdown_connections 2024-05-09T05:58:36.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.659+0000 7fd628386640 1 -- 172.21.15.72:0/805128926 wait complete. 2024-05-09T05:58:36.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.659+0000 7fd628386640 1 Processor -- start 2024-05-09T05:58:36.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.659+0000 7fd628386640 1 -- start start 2024-05-09T05:58:36.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.663+0000 7fd628386640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6200c77a0 0x7fd62015a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:36.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.663+0000 7fd628386640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6201537d0 0x7fd62015b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:36.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.663+0000 7fd628386640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd620161d70 0x7fd6201f4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:36.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.663+0000 7fd628386640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fd620072940 con 0x7fd6201537d0 2024-05-09T05:58:36.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.663+0000 7fd628386640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fd6200740b0 con 0x7fd6200c77a0 2024-05-09T05:58:36.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.663+0000 7fd628386640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fd6200c4cb0 con 0x7fd620161d70 2024-05-09T05:58:36.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.663+0000 7fd625921640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6201537d0 0x7fd62015b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:36.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.663+0000 7fd625921640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6201537d0 0x7fd62015b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54280/0 (socket says 172.21.15.72:54280) 2024-05-09T05:58:36.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.663+0000 7fd625921640 1 -- 172.21.15.72:0/1633686279 learned_addr learned my addr 172.21.15.72:0/1633686279 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:58:36.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.663+0000 7fd626122640 1 --2- 172.21.15.72:0/1633686279 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6200c77a0 0x7fd62015a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:36.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.663+0000 7fd626923640 1 --2- 172.21.15.72:0/1633686279 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd620161d70 0x7fd6201f4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:36.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.663+0000 7fd625921640 1 -- 172.21.15.72:0/1633686279 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd620161d70 msgr2=0x7fd6201f4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:36.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.663+0000 7fd625921640 1 --2- 172.21.15.72:0/1633686279 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd620161d70 0x7fd6201f4840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:36.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.663+0000 7fd625921640 1 -- 172.21.15.72:0/1633686279 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6200c77a0 msgr2=0x7fd62015a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:36.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.663+0000 7fd625921640 1 --2- 172.21.15.72:0/1633686279 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6200c77a0 0x7fd62015a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:36.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.663+0000 7fd625921640 1 -- 172.21.15.72:0/1633686279 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6201f4d80 con 0x7fd6201537d0 2024-05-09T05:58:36.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.663+0000 7fd625921640 1 --2- 172.21.15.72:0/1633686279 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6201537d0 0x7fd62015b240 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd61001c290 tx=0x7fd61001cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:36.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.663+0000 7fd616ffd640 1 -- 172.21.15.72:0/1633686279 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6100c1070 con 0x7fd6201537d0 2024-05-09T05:58:36.653 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.663+0000 7fd616ffd640 1 -- 172.21.15.72:0/1633686279 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6100b3800 con 0x7fd6201537d0 2024-05-09T05:58:36.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.663+0000 7fd628386640 1 -- 172.21.15.72:0/1633686279 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6201541e0 con 0x7fd6201537d0 2024-05-09T05:58:36.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.663+0000 7fd616ffd640 1 -- 172.21.15.72:0/1633686279 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6100b3bf0 con 0x7fd6201537d0 2024-05-09T05:58:36.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.663+0000 7fd628386640 1 -- 172.21.15.72:0/1633686279 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6201547a0 con 0x7fd6201537d0 2024-05-09T05:58:36.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.663+0000 7fd628386640 1 -- 172.21.15.72:0/1633686279 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd62006a520 con 0x7fd6201537d0 2024-05-09T05:58:36.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.663+0000 7fd616ffd640 1 -- 172.21.15.72:0/1633686279 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fd6100c4070 con 0x7fd6201537d0 2024-05-09T05:58:36.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.667+0000 7fd616ffd640 1 --2- 172.21.15.72:0/1633686279 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fd60406f430 0x7fd604071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:36.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.667+0000 7fd616ffd640 1 -- 172.21.15.72:0/1633686279 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6762+0+0 (secure 0 0 0) 0x7fd610129e70 con 0x7fd6201537d0 2024-05-09T05:58:36.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.667+0000 7fd626122640 1 --2- 172.21.15.72:0/1633686279 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fd60406f430 0x7fd604071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:36.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.667+0000 7fd626122640 1 --2- 172.21.15.72:0/1633686279 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fd60406f430 0x7fd604071940 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd61c000f70 tx=0x7fd61c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:36.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.671+0000 7fd616ffd640 1 -- 172.21.15.72:0/1633686279 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fd6100af020 con 0x7fd6201537d0 2024-05-09T05:58:36.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.831+0000 7fd628386640 1 -- 172.21.15.72:0/1633686279 --> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd620153f40 con 0x7fd60406f430 2024-05-09T05:58:36.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.859+0000 7fd616ffd640 1 -- 172.21.15.72:0/1633686279 <== mgr.4102 v2:172.21.15.110:6832/1113420672 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+333978 (secure 0 0 0) 0x7fd620153f40 con 0x7fd60406f430 2024-05-09T05:58:36.849 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:58:36.851 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2024-05-09T05:58:36.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.863+0000 7fd628386640 1 -- 172.21.15.72:0/1633686279 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fd60406f430 msgr2=0x7fd604071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:36.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.863+0000 7fd628386640 1 --2- 172.21.15.72:0/1633686279 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fd60406f430 0x7fd604071940 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd61c000f70 tx=0x7fd61c009040 comp rx=0 tx=0).stop 2024-05-09T05:58:36.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.863+0000 7fd628386640 1 -- 172.21.15.72:0/1633686279 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6201537d0 msgr2=0x7fd62015b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:36.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.863+0000 7fd628386640 1 --2- 172.21.15.72:0/1633686279 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6201537d0 0x7fd62015b240 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd61001c290 tx=0x7fd61001cea0 comp rx=0 tx=0).stop 2024-05-09T05:58:36.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.863+0000 7fd628386640 1 -- 172.21.15.72:0/1633686279 shutdown_connections 2024-05-09T05:58:36.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.863+0000 7fd628386640 1 --2- 172.21.15.72:0/1633686279 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fd60406f430 0x7fd604071940 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:36.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.863+0000 7fd628386640 1 --2- 172.21.15.72:0/1633686279 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd620161d70 0x7fd6201f4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:36.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.863+0000 7fd628386640 1 --2- 172.21.15.72:0/1633686279 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6201537d0 0x7fd62015b240 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:36.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.863+0000 7fd628386640 1 --2- 172.21.15.72:0/1633686279 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6200c77a0 0x7fd62015a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:36.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.863+0000 7fd628386640 1 -- 172.21.15.72:0/1633686279 >> 172.21.15.72:0/1633686279 conn(0x7fd6200cde90 msgr2=0x7fd6200c41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:58:36.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.863+0000 7fd628386640 1 -- 172.21.15.72:0/1633686279 shutdown_connections 2024-05-09T05:58:36.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:36.863+0000 7fd628386640 1 -- 172.21.15.72:0/1633686279 wait complete. 2024-05-09T05:58:36.872 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":186,"stamp":"2024-05-09T05:58:36.602970+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3830211560,"num_objects":1014,"num_object_clones":0,"num_object_copies":3854,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1014,"num_whiteouts":0,"num_read":219,"num_read_kb":214,"num_write":8760,"num_write_kb":25167790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9209,"ondisk_log_size":9209,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":10157832,"kb_used_data":9726088,"kb_used_omap":12,"kb_used_meta":425523,"kb_avail":744816888,"statfs":{"total":773094113280,"available":762692493312,"internally_reserved":0,"allocated":9959514112,"data_stored":9957840136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":435736113},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,3,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6908003453,"num_objects":-1647,"num_object_clones":0,"num_object_copies":-6588,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1647,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":1670,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005632"},"pg_stats":[{"pgid":"2.1f","version":"29'15","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:56:49.474376+0000","last_change":"2024-05-09T05:53:23.121824+0000","last_active":"2024-05-09T05:56:49.474376+0000","last_peered":"2024-05-09T05:56:49.474376+0000","last_clean":"2024-05-09T05:56:49.474376+0000","last_became_active":"2024-05-09T05:53:23.121097+0000","last_became_peered":"2024-05-09T05:53:23.121097+0000","last_unstale":"2024-05-09T05:56:49.474376+0000","last_undegraded":"2024-05-09T05:56:49.474376+0000","last_fullsized":"2024-05-09T05:56:49.474376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:50:51.880238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"29'5","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.177886+0000","last_change":"2024-05-09T05:53:24.146985+0000","last_active":"2024-05-09T05:58:30.177886+0000","last_peered":"2024-05-09T05:58:30.177886+0000","last_clean":"2024-05-09T05:58:30.177886+0000","last_became_active":"2024-05-09T05:53:24.146540+0000","last_became_peered":"2024-05-09T05:53:24.146540+0000","last_unstale":"2024-05-09T05:58:30.177886+0000","last_undegraded":"2024-05-09T05:58:30.177886+0000","last_fullsized":"2024-05-09T05:58:30.177886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:02:29.318131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"29'273","reported_seq":297,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.709963+0000","last_change":"2024-05-09T05:53:28.236386+0000","last_active":"2024-05-09T05:58:31.709963+0000","last_peered":"2024-05-09T05:58:31.709963+0000","last_clean":"2024-05-09T05:58:31.709963+0000","last_became_active":"2024-05-09T05:53:28.235305+0000","last_became_peered":"2024-05-09T05:53:28.235305+0000","last_unstale":"2024-05-09T05:58:31.709963+0000","last_undegraded":"2024-05-09T05:58:31.709963+0000","last_fullsized":"2024-05-09T05:58:31.709963+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:57:57.134819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":835584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"25'2","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:56:44.380636+0000","last_change":"2024-05-09T05:53:23.139000+0000","last_active":"2024-05-09T05:56:44.380636+0000","last_peered":"2024-05-09T05:56:44.380636+0000","last_clean":"2024-05-09T05:56:44.380636+0000","last_became_active":"2024-05-09T05:53:23.138431+0000","last_became_peered":"2024-05-09T05:53:23.138431+0000","last_unstale":"2024-05-09T05:56:44.380636+0000","last_undegraded":"2024-05-09T05:56:44.380636+0000","last_fullsized":"2024-05-09T05:56:44.380636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:33:56.977263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"29'6","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.184685+0000","last_change":"2024-05-09T05:53:24.151811+0000","last_active":"2024-05-09T05:58:30.184685+0000","last_peered":"2024-05-09T05:58:30.184685+0000","last_clean":"2024-05-09T05:58:30.184685+0000","last_became_active":"2024-05-09T05:53:24.151407+0000","last_became_peered":"2024-05-09T05:53:24.151407+0000","last_unstale":"2024-05-09T05:58:30.184685+0000","last_undegraded":"2024-05-09T05:58:30.184685+0000","last_fullsized":"2024-05-09T05:58:30.184685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:54:17.819787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"29'297","reported_seq":321,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.701764+0000","last_change":"2024-05-09T05:53:28.213485+0000","last_active":"2024-05-09T05:58:31.701764+0000","last_peered":"2024-05-09T05:58:31.701764+0000","last_clean":"2024-05-09T05:58:31.701764+0000","last_became_active":"2024-05-09T05:53:28.213021+0000","last_became_peered":"2024-05-09T05:53:28.213021+0000","last_unstale":"2024-05-09T05:58:31.701764+0000","last_undegraded":"2024-05-09T05:58:31.701764+0000","last_fullsized":"2024-05-09T05:58:31.701764+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:58:22.493166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":176160768,"num_objects":42,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":297,"num_write_kb":925696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"29'15","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:57:10.712258+0000","last_change":"2024-05-09T05:53:23.095209+0000","last_active":"2024-05-09T05:57:10.712258+0000","last_peered":"2024-05-09T05:57:10.712258+0000","last_clean":"2024-05-09T05:57:10.712258+0000","last_became_active":"2024-05-09T05:53:23.094826+0000","last_became_peered":"2024-05-09T05:53:23.094826+0000","last_unstale":"2024-05-09T05:57:10.712258+0000","last_undegraded":"2024-05-09T05:57:10.712258+0000","last_fullsized":"2024-05-09T05:57:10.712258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:38:47.390311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"29'9","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.147951+0000","last_change":"2024-05-09T05:53:24.135281+0000","last_active":"2024-05-09T05:58:30.147951+0000","last_peered":"2024-05-09T05:58:30.147951+0000","last_clean":"2024-05-09T05:58:30.147951+0000","last_became_active":"2024-05-09T05:53:24.134610+0000","last_became_peered":"2024-05-09T05:53:24.134610+0000","last_unstale":"2024-05-09T05:58:30.147951+0000","last_undegraded":"2024-05-09T05:58:30.147951+0000","last_fullsized":"2024-05-09T05:58:30.147951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:28:03.947961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"29'232","reported_seq":256,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.632959+0000","last_change":"2024-05-09T05:53:28.205763+0000","last_active":"2024-05-09T05:58:31.632959+0000","last_peered":"2024-05-09T05:58:31.632959+0000","last_clean":"2024-05-09T05:58:31.632959+0000","last_became_active":"2024-05-09T05:53:28.205229+0000","last_became_peered":"2024-05-09T05:53:28.205229+0000","last_unstale":"2024-05-09T05:58:31.632959+0000","last_undegraded":"2024-05-09T05:58:31.632959+0000","last_fullsized":"2024-05-09T05:58:31.632959+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:38:51.267769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171966464,"num_objects":41,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"27'5","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:57:10.703703+0000","last_change":"2024-05-09T05:53:23.097616+0000","last_active":"2024-05-09T05:57:10.703703+0000","last_peered":"2024-05-09T05:57:10.703703+0000","last_clean":"2024-05-09T05:57:10.703703+0000","last_became_active":"2024-05-09T05:53:23.094760+0000","last_became_peered":"2024-05-09T05:53:23.094760+0000","last_unstale":"2024-05-09T05:57:10.703703+0000","last_undegraded":"2024-05-09T05:57:10.703703+0000","last_fullsized":"2024-05-09T05:57:10.703703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:21:32.558852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"29'15","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.160427+0000","last_change":"2024-05-09T05:53:24.139467+0000","last_active":"2024-05-09T05:58:30.160427+0000","last_peered":"2024-05-09T05:58:30.160427+0000","last_clean":"2024-05-09T05:58:30.160427+0000","last_became_active":"2024-05-09T05:53:24.139109+0000","last_became_peered":"2024-05-09T05:53:24.139109+0000","last_unstale":"2024-05-09T05:58:30.160427+0000","last_undegraded":"2024-05-09T05:58:30.160427+0000","last_fullsized":"2024-05-09T05:58:30.160427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:36.783615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"29'220","reported_seq":244,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.644680+0000","last_change":"2024-05-09T05:53:28.216127+0000","last_active":"2024-05-09T05:58:31.644680+0000","last_peered":"2024-05-09T05:58:31.644680+0000","last_clean":"2024-05-09T05:58:31.644680+0000","last_became_active":"2024-05-09T05:53:28.215482+0000","last_became_peered":"2024-05-09T05:53:28.215482+0000","last_unstale":"2024-05-09T05:58:31.644680+0000","last_undegraded":"2024-05-09T05:58:31.644680+0000","last_fullsized":"2024-05-09T05:58:31.644680+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:48:58.387701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":688128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"29'5","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.160135+0000","last_change":"2024-05-09T05:53:24.132483+0000","last_active":"2024-05-09T05:58:30.160135+0000","last_peered":"2024-05-09T05:58:30.160135+0000","last_clean":"2024-05-09T05:58:30.160135+0000","last_became_active":"2024-05-09T05:53:24.132118+0000","last_became_peered":"2024-05-09T05:53:24.132118+0000","last_unstale":"2024-05-09T05:58:30.160135+0000","last_undegraded":"2024-05-09T05:58:30.160135+0000","last_fullsized":"2024-05-09T05:58:30.160135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:06:01.787707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:56:45.401141+0000","last_change":"2024-05-09T05:53:23.117460+0000","last_active":"2024-05-09T05:56:45.401141+0000","last_peered":"2024-05-09T05:56:45.401141+0000","last_clean":"2024-05-09T05:56:45.401141+0000","last_became_active":"2024-05-09T05:53:23.114179+0000","last_became_peered":"2024-05-09T05:53:23.114179+0000","last_unstale":"2024-05-09T05:56:45.401141+0000","last_undegraded":"2024-05-09T05:56:45.401141+0000","last_fullsized":"2024-05-09T05:56:45.401141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:44:01.784905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"29'309","reported_seq":333,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:32.986876+0000","last_change":"2024-05-09T05:53:28.227135+0000","last_active":"2024-05-09T05:58:32.986876+0000","last_peered":"2024-05-09T05:58:32.986876+0000","last_clean":"2024-05-09T05:58:32.986876+0000","last_became_active":"2024-05-09T05:53:28.226427+0000","last_became_peered":"2024-05-09T05:53:28.226427+0000","last_unstale":"2024-05-09T05:58:32.986876+0000","last_undegraded":"2024-05-09T05:58:32.986876+0000","last_fullsized":"2024-05-09T05:58:32.986876+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:37:04.413804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":309,"num_write_kb":843776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"29'8","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.188143+0000","last_change":"2024-05-09T05:53:24.135982+0000","last_active":"2024-05-09T05:58:30.188143+0000","last_peered":"2024-05-09T05:58:30.188143+0000","last_clean":"2024-05-09T05:58:30.188143+0000","last_became_active":"2024-05-09T05:53:24.135580+0000","last_became_peered":"2024-05-09T05:53:24.135580+0000","last_unstale":"2024-05-09T05:58:30.188143+0000","last_undegraded":"2024-05-09T05:58:30.188143+0000","last_fullsized":"2024-05-09T05:58:30.188143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:03:04.589608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"27'3","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:56:44.379284+0000","last_change":"2024-05-09T05:53:23.142679+0000","last_active":"2024-05-09T05:56:44.379284+0000","last_peered":"2024-05-09T05:56:44.379284+0000","last_clean":"2024-05-09T05:56:44.379284+0000","last_became_active":"2024-05-09T05:53:23.142018+0000","last_became_peered":"2024-05-09T05:53:23.142018+0000","last_unstale":"2024-05-09T05:56:44.379284+0000","last_undegraded":"2024-05-09T05:56:44.379284+0000","last_fullsized":"2024-05-09T05:56:44.379284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:08:29.312049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"29'248","reported_seq":272,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.662278+0000","last_change":"2024-05-09T05:53:28.214167+0000","last_active":"2024-05-09T05:58:31.662278+0000","last_peered":"2024-05-09T05:58:31.662278+0000","last_clean":"2024-05-09T05:58:31.662278+0000","last_became_active":"2024-05-09T05:53:28.213623+0000","last_became_peered":"2024-05-09T05:53:28.213623+0000","last_unstale":"2024-05-09T05:58:31.662278+0000","last_undegraded":"2024-05-09T05:58:31.662278+0000","last_fullsized":"2024-05-09T05:58:31.662278+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:53:53.976485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180355072,"num_objects":43,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":794624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"29'9","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.191092+0000","last_change":"2024-05-09T05:53:24.130342+0000","last_active":"2024-05-09T05:58:30.191092+0000","last_peered":"2024-05-09T05:58:30.191092+0000","last_clean":"2024-05-09T05:58:30.191092+0000","last_became_active":"2024-05-09T05:53:24.129938+0000","last_became_peered":"2024-05-09T05:53:24.129938+0000","last_unstale":"2024-05-09T05:58:30.191092+0000","last_undegraded":"2024-05-09T05:58:30.191092+0000","last_fullsized":"2024-05-09T05:58:30.191092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:58:13.879633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"27'7","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:57:10.705303+0000","last_change":"2024-05-09T05:53:23.111169+0000","last_active":"2024-05-09T05:57:10.705303+0000","last_peered":"2024-05-09T05:57:10.705303+0000","last_clean":"2024-05-09T05:57:10.705303+0000","last_became_active":"2024-05-09T05:53:23.110140+0000","last_became_peered":"2024-05-09T05:53:23.110140+0000","last_unstale":"2024-05-09T05:57:10.705303+0000","last_undegraded":"2024-05-09T05:57:10.705303+0000","last_fullsized":"2024-05-09T05:57:10.705303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:18:55.367553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"29'223","reported_seq":247,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.680856+0000","last_change":"2024-05-09T05:53:28.233648+0000","last_active":"2024-05-09T05:58:31.680856+0000","last_peered":"2024-05-09T05:58:31.680856+0000","last_clean":"2024-05-09T05:58:31.680856+0000","last_became_active":"2024-05-09T05:53:28.227087+0000","last_became_peered":"2024-05-09T05:53:28.227087+0000","last_unstale":"2024-05-09T05:58:31.680856+0000","last_undegraded":"2024-05-09T05:58:31.680856+0000","last_fullsized":"2024-05-09T05:58:31.680856+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:03:49.709580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184549376,"num_objects":44,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":223,"num_write_kb":729088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"29'2","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.125901+0000","last_change":"2024-05-09T05:53:24.147343+0000","last_active":"2024-05-09T05:58:30.125901+0000","last_peered":"2024-05-09T05:58:30.125901+0000","last_clean":"2024-05-09T05:58:30.125901+0000","last_became_active":"2024-05-09T05:53:24.144596+0000","last_became_peered":"2024-05-09T05:53:24.144596+0000","last_unstale":"2024-05-09T05:58:30.125901+0000","last_undegraded":"2024-05-09T05:58:30.125901+0000","last_fullsized":"2024-05-09T05:58:30.125901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:52:43.052055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"25'2","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:56:44.377895+0000","last_change":"2024-05-09T05:53:23.102976+0000","last_active":"2024-05-09T05:56:44.377895+0000","last_peered":"2024-05-09T05:56:44.377895+0000","last_clean":"2024-05-09T05:56:44.377895+0000","last_became_active":"2024-05-09T05:53:23.102420+0000","last_became_peered":"2024-05-09T05:53:23.102420+0000","last_unstale":"2024-05-09T05:56:44.377895+0000","last_undegraded":"2024-05-09T05:56:44.377895+0000","last_fullsized":"2024-05-09T05:56:44.377895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:45:11.479140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"29'240","reported_seq":264,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.647707+0000","last_change":"2024-05-09T05:53:28.195537+0000","last_active":"2024-05-09T05:58:31.647707+0000","last_peered":"2024-05-09T05:58:31.647707+0000","last_clean":"2024-05-09T05:58:31.647707+0000","last_became_active":"2024-05-09T05:53:28.194915+0000","last_became_peered":"2024-05-09T05:53:28.194915+0000","last_unstale":"2024-05-09T05:58:31.647707+0000","last_undegraded":"2024-05-09T05:58:31.647707+0000","last_fullsized":"2024-05-09T05:58:31.647707+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:07.554137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201326592,"num_objects":48,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":786432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"29'7","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.191355+0000","last_change":"2024-05-09T05:53:24.130312+0000","last_active":"2024-05-09T05:58:30.191355+0000","last_peered":"2024-05-09T05:58:30.191355+0000","last_clean":"2024-05-09T05:58:30.191355+0000","last_became_active":"2024-05-09T05:53:24.129953+0000","last_became_peered":"2024-05-09T05:53:24.129953+0000","last_unstale":"2024-05-09T05:58:30.191355+0000","last_undegraded":"2024-05-09T05:58:30.191355+0000","last_fullsized":"2024-05-09T05:58:30.191355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:07:09.368521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"29'8","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:57:43.751407+0000","last_change":"2024-05-09T05:53:23.127219+0000","last_active":"2024-05-09T05:57:43.751407+0000","last_peered":"2024-05-09T05:57:43.751407+0000","last_clean":"2024-05-09T05:57:43.751407+0000","last_became_active":"2024-05-09T05:53:23.126691+0000","last_became_peered":"2024-05-09T05:53:23.126691+0000","last_unstale":"2024-05-09T05:57:43.751407+0000","last_undegraded":"2024-05-09T05:57:43.751407+0000","last_fullsized":"2024-05-09T05:57:43.751407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:17:26.711941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"29'222","reported_seq":246,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.672382+0000","last_change":"2024-05-09T05:53:28.191045+0000","last_active":"2024-05-09T05:58:31.672382+0000","last_peered":"2024-05-09T05:58:31.672382+0000","last_clean":"2024-05-09T05:58:31.672382+0000","last_became_active":"2024-05-09T05:53:28.190564+0000","last_became_peered":"2024-05-09T05:53:28.190564+0000","last_unstale":"2024-05-09T05:58:31.672382+0000","last_undegraded":"2024-05-09T05:58:31.672382+0000","last_fullsized":"2024-05-09T05:58:31.672382+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:53:30.541681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":679936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"29'5","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.191251+0000","last_change":"2024-05-09T05:53:24.138682+0000","last_active":"2024-05-09T05:58:30.191251+0000","last_peered":"2024-05-09T05:58:30.191251+0000","last_clean":"2024-05-09T05:58:30.191251+0000","last_became_active":"2024-05-09T05:53:24.138417+0000","last_became_peered":"2024-05-09T05:53:24.138417+0000","last_unstale":"2024-05-09T05:58:30.191251+0000","last_undegraded":"2024-05-09T05:58:30.191251+0000","last_fullsized":"2024-05-09T05:58:30.191251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:57:55.403156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"29'27","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:29.274497+0000","last_change":"2024-05-09T05:53:23.102986+0000","last_active":"2024-05-09T05:58:29.274497+0000","last_peered":"2024-05-09T05:58:29.274497+0000","last_clean":"2024-05-09T05:58:29.274497+0000","last_became_active":"2024-05-09T05:53:23.102020+0000","last_became_peered":"2024-05-09T05:53:23.102020+0000","last_unstale":"2024-05-09T05:58:29.274497+0000","last_undegraded":"2024-05-09T05:58:29.274497+0000","last_fullsized":"2024-05-09T05:58:29.274497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:18:11.582575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"29'227","reported_seq":251,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.719078+0000","last_change":"2024-05-09T05:53:28.218326+0000","last_active":"2024-05-09T05:58:31.719078+0000","last_peered":"2024-05-09T05:58:31.719078+0000","last_clean":"2024-05-09T05:58:31.719078+0000","last_became_active":"2024-05-09T05:53:28.216634+0000","last_became_peered":"2024-05-09T05:53:28.216634+0000","last_unstale":"2024-05-09T05:58:31.719078+0000","last_undegraded":"2024-05-09T05:58:31.719078+0000","last_fullsized":"2024-05-09T05:58:31.719078+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:13:05.321932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155189248,"num_objects":37,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":227,"num_write_kb":720896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"29'9","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.180943+0000","last_change":"2024-05-09T05:53:24.143161+0000","last_active":"2024-05-09T05:58:30.180943+0000","last_peered":"2024-05-09T05:58:30.180943+0000","last_clean":"2024-05-09T05:58:30.180943+0000","last_became_active":"2024-05-09T05:53:24.139369+0000","last_became_peered":"2024-05-09T05:53:24.139369+0000","last_unstale":"2024-05-09T05:58:30.180943+0000","last_undegraded":"2024-05-09T05:58:30.180943+0000","last_fullsized":"2024-05-09T05:58:30.180943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:25:21.472460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"27'4","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:56:49.370643+0000","last_change":"2024-05-09T05:53:23.123560+0000","last_active":"2024-05-09T05:56:49.370643+0000","last_peered":"2024-05-09T05:56:49.370643+0000","last_clean":"2024-05-09T05:56:49.370643+0000","last_became_active":"2024-05-09T05:53:23.123081+0000","last_became_peered":"2024-05-09T05:53:23.123081+0000","last_unstale":"2024-05-09T05:56:49.370643+0000","last_undegraded":"2024-05-09T05:56:49.370643+0000","last_fullsized":"2024-05-09T05:56:49.370643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:15:31.371756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"29'211","reported_seq":235,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.674405+0000","last_change":"2024-05-09T05:53:28.229352+0000","last_active":"2024-05-09T05:58:31.674405+0000","last_peered":"2024-05-09T05:58:31.674405+0000","last_clean":"2024-05-09T05:58:31.674405+0000","last_became_active":"2024-05-09T05:53:28.225810+0000","last_became_peered":"2024-05-09T05:53:28.225810+0000","last_unstale":"2024-05-09T05:58:31.674405+0000","last_undegraded":"2024-05-09T05:58:31.674405+0000","last_fullsized":"2024-05-09T05:58:31.674405+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:17:07.192105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159383552,"num_objects":38,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":211,"num_write_kb":679936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"29'5","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.146938+0000","last_change":"2024-05-09T05:53:24.130533+0000","last_active":"2024-05-09T05:58:30.146938+0000","last_peered":"2024-05-09T05:58:30.146938+0000","last_clean":"2024-05-09T05:58:30.146938+0000","last_became_active":"2024-05-09T05:53:24.129787+0000","last_became_peered":"2024-05-09T05:53:24.129787+0000","last_unstale":"2024-05-09T05:58:30.146938+0000","last_undegraded":"2024-05-09T05:58:30.146938+0000","last_fullsized":"2024-05-09T05:58:30.146938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:37:36.036271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"26'1","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:56:44.379023+0000","last_change":"2024-05-09T05:53:23.134379+0000","last_active":"2024-05-09T05:56:44.379023+0000","last_peered":"2024-05-09T05:56:44.379023+0000","last_clean":"2024-05-09T05:56:44.379023+0000","last_became_active":"2024-05-09T05:53:23.133587+0000","last_became_peered":"2024-05-09T05:53:23.133587+0000","last_unstale":"2024-05-09T05:56:44.379023+0000","last_undegraded":"2024-05-09T05:56:44.379023+0000","last_fullsized":"2024-05-09T05:56:44.379023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:00:33.973787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"29'228","reported_seq":252,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.725996+0000","last_change":"2024-05-09T05:53:28.233620+0000","last_active":"2024-05-09T05:58:31.725996+0000","last_peered":"2024-05-09T05:58:31.725996+0000","last_clean":"2024-05-09T05:58:31.725996+0000","last_became_active":"2024-05-09T05:53:28.232539+0000","last_became_peered":"2024-05-09T05:53:28.232539+0000","last_unstale":"2024-05-09T05:58:31.725996+0000","last_undegraded":"2024-05-09T05:58:31.725996+0000","last_fullsized":"2024-05-09T05:58:31.725996+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":228,"log_dups_size":0,"ondisk_log_size":228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:13.789448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188743680,"num_objects":45,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":228,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"29'7","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.144931+0000","last_change":"2024-05-09T05:53:24.132702+0000","last_active":"2024-05-09T05:58:30.144931+0000","last_peered":"2024-05-09T05:58:30.144931+0000","last_clean":"2024-05-09T05:58:30.144931+0000","last_became_active":"2024-05-09T05:53:24.132309+0000","last_became_peered":"2024-05-09T05:53:24.132309+0000","last_unstale":"2024-05-09T05:58:30.144931+0000","last_undegraded":"2024-05-09T05:58:30.144931+0000","last_fullsized":"2024-05-09T05:58:30.144931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:53:13.592038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"29'7","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:57:10.708672+0000","last_change":"2024-05-09T05:53:23.120384+0000","last_active":"2024-05-09T05:57:10.708672+0000","last_peered":"2024-05-09T05:57:10.708672+0000","last_clean":"2024-05-09T05:57:10.708672+0000","last_became_active":"2024-05-09T05:53:23.118321+0000","last_became_peered":"2024-05-09T05:53:23.118321+0000","last_unstale":"2024-05-09T05:57:10.708672+0000","last_undegraded":"2024-05-09T05:57:10.708672+0000","last_fullsized":"2024-05-09T05:57:10.708672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:15:51.297111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":14,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'227","reported_seq":251,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.747888+0000","last_change":"2024-05-09T05:53:28.208383+0000","last_active":"2024-05-09T05:58:31.747888+0000","last_peered":"2024-05-09T05:58:31.747888+0000","last_clean":"2024-05-09T05:58:31.747888+0000","last_became_active":"2024-05-09T05:53:28.199359+0000","last_became_peered":"2024-05-09T05:53:28.199359+0000","last_unstale":"2024-05-09T05:58:31.747888+0000","last_undegraded":"2024-05-09T05:58:31.747888+0000","last_fullsized":"2024-05-09T05:58:31.747888+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:50:19.715242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155189248,"num_objects":37,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":227,"num_write_kb":720896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"29'8","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.189540+0000","last_change":"2024-05-09T05:53:24.142740+0000","last_active":"2024-05-09T05:58:30.189540+0000","last_peered":"2024-05-09T05:58:30.189540+0000","last_clean":"2024-05-09T05:58:30.189540+0000","last_became_active":"2024-05-09T05:53:24.142265+0000","last_became_peered":"2024-05-09T05:53:24.142265+0000","last_unstale":"2024-05-09T05:58:30.189540+0000","last_undegraded":"2024-05-09T05:58:30.189540+0000","last_fullsized":"2024-05-09T05:58:30.189540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:46:53.729151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"29'13","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.475397+0000","last_change":"2024-05-09T05:53:23.142455+0000","last_active":"2024-05-09T05:58:30.475397+0000","last_peered":"2024-05-09T05:58:30.475397+0000","last_clean":"2024-05-09T05:58:30.475397+0000","last_became_active":"2024-05-09T05:53:23.141770+0000","last_became_peered":"2024-05-09T05:53:23.141770+0000","last_unstale":"2024-05-09T05:58:30.475397+0000","last_undegraded":"2024-05-09T05:58:30.475397+0000","last_fullsized":"2024-05-09T05:58:30.475397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:30:34.301349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":641,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"29'227","reported_seq":251,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.701157+0000","last_change":"2024-05-09T05:53:28.212176+0000","last_active":"2024-05-09T05:58:31.701157+0000","last_peered":"2024-05-09T05:58:31.701157+0000","last_clean":"2024-05-09T05:58:31.701157+0000","last_became_active":"2024-05-09T05:53:28.210981+0000","last_became_peered":"2024-05-09T05:53:28.210981+0000","last_unstale":"2024-05-09T05:58:31.701157+0000","last_undegraded":"2024-05-09T05:58:31.701157+0000","last_fullsized":"2024-05-09T05:58:31.701157+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:17:24.122805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180355072,"num_objects":43,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":227,"num_write_kb":737280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"29'5","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.181917+0000","last_change":"2024-05-09T05:53:24.132887+0000","last_active":"2024-05-09T05:58:30.181917+0000","last_peered":"2024-05-09T05:58:30.181917+0000","last_clean":"2024-05-09T05:58:30.181917+0000","last_became_active":"2024-05-09T05:53:24.132398+0000","last_became_peered":"2024-05-09T05:53:24.132398+0000","last_unstale":"2024-05-09T05:58:30.181917+0000","last_undegraded":"2024-05-09T05:58:30.181917+0000","last_fullsized":"2024-05-09T05:58:30.181917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:36:49.369162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"29'6","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:56:49.477057+0000","last_change":"2024-05-09T05:53:23.126202+0000","last_active":"2024-05-09T05:56:49.477057+0000","last_peered":"2024-05-09T05:56:49.477057+0000","last_clean":"2024-05-09T05:56:49.477057+0000","last_became_active":"2024-05-09T05:53:23.125799+0000","last_became_peered":"2024-05-09T05:53:23.125799+0000","last_unstale":"2024-05-09T05:56:49.477057+0000","last_undegraded":"2024-05-09T05:56:49.477057+0000","last_fullsized":"2024-05-09T05:56:49.477057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:33:12.831705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"29'339","reported_seq":370,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:32.972228+0000","last_change":"2024-05-09T05:54:06.916943+0000","last_active":"2024-05-09T05:58:32.972228+0000","last_peered":"2024-05-09T05:58:32.972228+0000","last_clean":"2024-05-09T05:58:32.972228+0000","last_became_active":"2024-05-09T05:54:06.915734+0000","last_became_peered":"2024-05-09T05:54:06.915734+0000","last_unstale":"2024-05-09T05:58:32.972228+0000","last_undegraded":"2024-05-09T05:58:32.972228+0000","last_fullsized":"2024-05-09T05:58:32.972228+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:59:44.265794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":925696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,6,1],"acting":[5,0,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"29'8","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.179473+0000","last_change":"2024-05-09T05:53:24.139586+0000","last_active":"2024-05-09T05:58:30.179473+0000","last_peered":"2024-05-09T05:58:30.179473+0000","last_clean":"2024-05-09T05:58:30.179473+0000","last_became_active":"2024-05-09T05:53:24.138835+0000","last_became_peered":"2024-05-09T05:53:24.138835+0000","last_unstale":"2024-05-09T05:58:30.179473+0000","last_undegraded":"2024-05-09T05:58:30.179473+0000","last_fullsized":"2024-05-09T05:58:30.179473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:37:13.012588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"27'6","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:56:49.370370+0000","last_change":"2024-05-09T05:53:23.117121+0000","last_active":"2024-05-09T05:56:49.370370+0000","last_peered":"2024-05-09T05:56:49.370370+0000","last_clean":"2024-05-09T05:56:49.370370+0000","last_became_active":"2024-05-09T05:53:23.113294+0000","last_became_peered":"2024-05-09T05:53:23.113294+0000","last_unstale":"2024-05-09T05:56:49.370370+0000","last_undegraded":"2024-05-09T05:56:49.370370+0000","last_fullsized":"2024-05-09T05:56:49.370370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:53:41.591371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":127,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:56:44.385637+0000","last_change":"2024-05-09T05:53:12.484358+0000","last_active":"2024-05-09T05:56:44.385637+0000","last_peered":"2024-05-09T05:56:44.385637+0000","last_clean":"2024-05-09T05:56:44.385637+0000","last_became_active":"2024-05-09T05:53:12.481529+0000","last_became_peered":"2024-05-09T05:53:12.481529+0000","last_unstale":"2024-05-09T05:56:44.385637+0000","last_undegraded":"2024-05-09T05:56:44.385637+0000","last_fullsized":"2024-05-09T05:56:44.385637+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:10.902489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:10.902489+0000","last_clean_scrub_stamp":"2024-05-09T05:53:10.902489+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:28:50.650299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'276","reported_seq":300,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:32.994680+0000","last_change":"2024-05-09T05:53:28.190861+0000","last_active":"2024-05-09T05:58:32.994680+0000","last_peered":"2024-05-09T05:58:32.994680+0000","last_clean":"2024-05-09T05:58:32.994680+0000","last_became_active":"2024-05-09T05:53:28.190393+0000","last_became_peered":"2024-05-09T05:53:28.190393+0000","last_unstale":"2024-05-09T05:58:32.994680+0000","last_undegraded":"2024-05-09T05:58:32.994680+0000","last_fullsized":"2024-05-09T05:58:32.994680+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:05:37.653010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":276,"num_write_kb":753664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"29'7","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.163539+0000","last_change":"2024-05-09T05:53:24.143283+0000","last_active":"2024-05-09T05:58:30.163539+0000","last_peered":"2024-05-09T05:58:30.163539+0000","last_clean":"2024-05-09T05:58:30.163539+0000","last_became_active":"2024-05-09T05:53:24.139813+0000","last_became_peered":"2024-05-09T05:53:24.139813+0000","last_unstale":"2024-05-09T05:58:30.163539+0000","last_undegraded":"2024-05-09T05:58:30.163539+0000","last_fullsized":"2024-05-09T05:58:30.163539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:07:38.471778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"29'7","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:57:56.748839+0000","last_change":"2024-05-09T05:53:23.115534+0000","last_active":"2024-05-09T05:57:56.748839+0000","last_peered":"2024-05-09T05:57:56.748839+0000","last_clean":"2024-05-09T05:57:56.748839+0000","last_became_active":"2024-05-09T05:53:23.112260+0000","last_became_peered":"2024-05-09T05:53:23.112260+0000","last_unstale":"2024-05-09T05:57:56.748839+0000","last_undegraded":"2024-05-09T05:57:56.748839+0000","last_fullsized":"2024-05-09T05:57:56.748839+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:46:53.520691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"29'242","reported_seq":266,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.710353+0000","last_change":"2024-05-09T05:53:28.195687+0000","last_active":"2024-05-09T05:58:31.710353+0000","last_peered":"2024-05-09T05:58:31.710353+0000","last_clean":"2024-05-09T05:58:31.710353+0000","last_became_active":"2024-05-09T05:53:28.195082+0000","last_became_peered":"2024-05-09T05:53:28.195082+0000","last_unstale":"2024-05-09T05:58:31.710353+0000","last_undegraded":"2024-05-09T05:58:31.710353+0000","last_fullsized":"2024-05-09T05:58:31.710353+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:45:56.633547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155189248,"num_objects":37,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":242,"num_write_kb":761856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"29'6","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.185190+0000","last_change":"2024-05-09T05:53:24.130460+0000","last_active":"2024-05-09T05:58:30.185190+0000","last_peered":"2024-05-09T05:58:30.185190+0000","last_clean":"2024-05-09T05:58:30.185190+0000","last_became_active":"2024-05-09T05:53:24.129808+0000","last_became_peered":"2024-05-09T05:53:24.129808+0000","last_unstale":"2024-05-09T05:58:30.185190+0000","last_undegraded":"2024-05-09T05:58:30.185190+0000","last_fullsized":"2024-05-09T05:58:30.185190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:36:04.881676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:56:49.475046+0000","last_change":"2024-05-09T05:53:23.139063+0000","last_active":"2024-05-09T05:56:49.475046+0000","last_peered":"2024-05-09T05:56:49.475046+0000","last_clean":"2024-05-09T05:56:49.475046+0000","last_became_active":"2024-05-09T05:53:23.138303+0000","last_became_peered":"2024-05-09T05:53:23.138303+0000","last_unstale":"2024-05-09T05:56:49.475046+0000","last_undegraded":"2024-05-09T05:56:49.475046+0000","last_fullsized":"2024-05-09T05:56:49.475046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:18:20.172877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"29'261","reported_seq":285,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:33.010968+0000","last_change":"2024-05-09T05:53:28.214251+0000","last_active":"2024-05-09T05:58:33.010968+0000","last_peered":"2024-05-09T05:58:33.010968+0000","last_clean":"2024-05-09T05:58:33.010968+0000","last_became_active":"2024-05-09T05:53:28.206229+0000","last_became_peered":"2024-05-09T05:53:28.206229+0000","last_unstale":"2024-05-09T05:58:33.010968+0000","last_undegraded":"2024-05-09T05:58:33.010968+0000","last_fullsized":"2024-05-09T05:58:33.010968+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":261,"log_dups_size":0,"ondisk_log_size":261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:12:26.761543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":261,"num_write_kb":712704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"29'9","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.148788+0000","last_change":"2024-05-09T05:53:24.135578+0000","last_active":"2024-05-09T05:58:30.148788+0000","last_peered":"2024-05-09T05:58:30.148788+0000","last_clean":"2024-05-09T05:58:30.148788+0000","last_became_active":"2024-05-09T05:53:24.135253+0000","last_became_peered":"2024-05-09T05:53:24.135253+0000","last_unstale":"2024-05-09T05:58:30.148788+0000","last_undegraded":"2024-05-09T05:58:30.148788+0000","last_fullsized":"2024-05-09T05:58:30.148788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:20:23.093397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"27'5","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:57:10.701585+0000","last_change":"2024-05-09T05:53:23.140175+0000","last_active":"2024-05-09T05:57:10.701585+0000","last_peered":"2024-05-09T05:57:10.701585+0000","last_clean":"2024-05-09T05:57:10.701585+0000","last_became_active":"2024-05-09T05:53:23.139516+0000","last_became_peered":"2024-05-09T05:53:23.139516+0000","last_unstale":"2024-05-09T05:57:10.701585+0000","last_undegraded":"2024-05-09T05:57:10.701585+0000","last_fullsized":"2024-05-09T05:57:10.701585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:48:42.473155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"29'318","reported_seq":342,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:32.979280+0000","last_change":"2024-05-09T05:53:28.199385+0000","last_active":"2024-05-09T05:58:32.979280+0000","last_peered":"2024-05-09T05:58:32.979280+0000","last_clean":"2024-05-09T05:58:32.979280+0000","last_became_active":"2024-05-09T05:53:28.198825+0000","last_became_peered":"2024-05-09T05:53:28.198825+0000","last_unstale":"2024-05-09T05:58:32.979280+0000","last_undegraded":"2024-05-09T05:58:32.979280+0000","last_fullsized":"2024-05-09T05:58:32.979280+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:48:22.224140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":318,"num_write_kb":868352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"29'5","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.131274+0000","last_change":"2024-05-09T05:53:24.133293+0000","last_active":"2024-05-09T05:58:30.131274+0000","last_peered":"2024-05-09T05:58:30.131274+0000","last_clean":"2024-05-09T05:58:30.131274+0000","last_became_active":"2024-05-09T05:53:24.131741+0000","last_became_peered":"2024-05-09T05:53:24.131741+0000","last_unstale":"2024-05-09T05:58:30.131274+0000","last_undegraded":"2024-05-09T05:58:30.131274+0000","last_fullsized":"2024-05-09T05:58:30.131274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:01:33.701742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"26'2","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:56:44.378626+0000","last_change":"2024-05-09T05:53:23.112592+0000","last_active":"2024-05-09T05:56:44.378626+0000","last_peered":"2024-05-09T05:56:44.378626+0000","last_clean":"2024-05-09T05:56:44.378626+0000","last_became_active":"2024-05-09T05:53:23.111968+0000","last_became_peered":"2024-05-09T05:53:23.111968+0000","last_unstale":"2024-05-09T05:56:44.378626+0000","last_undegraded":"2024-05-09T05:56:44.378626+0000","last_fullsized":"2024-05-09T05:56:44.378626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:32:54.694588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"29'225","reported_seq":249,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.547246+0000","last_change":"2024-05-09T05:53:28.227755+0000","last_active":"2024-05-09T05:58:31.547246+0000","last_peered":"2024-05-09T05:58:31.547246+0000","last_clean":"2024-05-09T05:58:31.547246+0000","last_became_active":"2024-05-09T05:53:28.227272+0000","last_became_peered":"2024-05-09T05:53:28.227272+0000","last_unstale":"2024-05-09T05:58:31.547246+0000","last_undegraded":"2024-05-09T05:58:31.547246+0000","last_fullsized":"2024-05-09T05:58:31.547246+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":225,"log_dups_size":0,"ondisk_log_size":225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:13:32.020862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":225,"num_write_kb":704512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"29'6","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.158182+0000","last_change":"2024-05-09T05:53:24.144025+0000","last_active":"2024-05-09T05:58:30.158182+0000","last_peered":"2024-05-09T05:58:30.158182+0000","last_clean":"2024-05-09T05:58:30.158182+0000","last_became_active":"2024-05-09T05:53:24.143540+0000","last_became_peered":"2024-05-09T05:53:24.143540+0000","last_unstale":"2024-05-09T05:58:30.158182+0000","last_undegraded":"2024-05-09T05:58:30.158182+0000","last_fullsized":"2024-05-09T05:58:30.158182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:22:58.062541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"29'20","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:06.736201+0000","last_change":"2024-05-09T05:53:23.104452+0000","last_active":"2024-05-09T05:58:06.736201+0000","last_peered":"2024-05-09T05:58:06.736201+0000","last_clean":"2024-05-09T05:58:06.736201+0000","last_became_active":"2024-05-09T05:53:23.103471+0000","last_became_peered":"2024-05-09T05:53:23.103471+0000","last_unstale":"2024-05-09T05:58:06.736201+0000","last_undegraded":"2024-05-09T05:58:06.736201+0000","last_fullsized":"2024-05-09T05:58:06.736201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:33:30.508464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"29'360","reported_seq":384,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:33.029867+0000","last_change":"2024-05-09T05:53:28.241338+0000","last_active":"2024-05-09T05:58:33.029867+0000","last_peered":"2024-05-09T05:58:33.029867+0000","last_clean":"2024-05-09T05:58:33.029867+0000","last_became_active":"2024-05-09T05:53:28.239841+0000","last_became_peered":"2024-05-09T05:53:28.239841+0000","last_unstale":"2024-05-09T05:58:33.029867+0000","last_undegraded":"2024-05-09T05:58:33.029867+0000","last_fullsized":"2024-05-09T05:58:33.029867+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:44:47.854598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":360,"num_write_kb":983040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"29'6","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.181244+0000","last_change":"2024-05-09T05:53:24.149958+0000","last_active":"2024-05-09T05:58:30.181244+0000","last_peered":"2024-05-09T05:58:30.181244+0000","last_clean":"2024-05-09T05:58:30.181244+0000","last_became_active":"2024-05-09T05:53:24.149578+0000","last_became_peered":"2024-05-09T05:53:24.149578+0000","last_unstale":"2024-05-09T05:58:30.181244+0000","last_undegraded":"2024-05-09T05:58:30.181244+0000","last_fullsized":"2024-05-09T05:58:30.181244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:27:43.555218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"29'7","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:06.727523+0000","last_change":"2024-05-09T05:53:23.121266+0000","last_active":"2024-05-09T05:58:06.727523+0000","last_peered":"2024-05-09T05:58:06.727523+0000","last_clean":"2024-05-09T05:58:06.727523+0000","last_became_active":"2024-05-09T05:53:23.120857+0000","last_became_peered":"2024-05-09T05:53:23.120857+0000","last_unstale":"2024-05-09T05:58:06.727523+0000","last_undegraded":"2024-05-09T05:58:06.727523+0000","last_fullsized":"2024-05-09T05:58:06.727523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:03:30.185640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"29'273","reported_seq":297,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:33.018216+0000","last_change":"2024-05-09T05:53:28.240774+0000","last_active":"2024-05-09T05:58:33.018216+0000","last_peered":"2024-05-09T05:58:33.018216+0000","last_clean":"2024-05-09T05:58:33.018216+0000","last_became_active":"2024-05-09T05:53:28.240070+0000","last_became_peered":"2024-05-09T05:53:28.240070+0000","last_unstale":"2024-05-09T05:58:33.018216+0000","last_undegraded":"2024-05-09T05:58:33.018216+0000","last_fullsized":"2024-05-09T05:58:33.018216+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:25:24.019344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"29'15","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.166939+0000","last_change":"2024-05-09T05:54:06.645397+0000","last_active":"2024-05-09T05:58:30.166939+0000","last_peered":"2024-05-09T05:58:30.166939+0000","last_clean":"2024-05-09T05:58:30.166939+0000","last_became_active":"2024-05-09T05:54:06.644437+0000","last_became_peered":"2024-05-09T05:54:06.644437+0000","last_unstale":"2024-05-09T05:58:30.166939+0000","last_undegraded":"2024-05-09T05:58:30.166939+0000","last_fullsized":"2024-05-09T05:58:30.166939+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:41:52.843192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'5","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:56:49.370721+0000","last_change":"2024-05-09T05:53:23.120680+0000","last_active":"2024-05-09T05:56:49.370721+0000","last_peered":"2024-05-09T05:56:49.370721+0000","last_clean":"2024-05-09T05:56:49.370721+0000","last_became_active":"2024-05-09T05:53:23.118358+0000","last_became_peered":"2024-05-09T05:53:23.118358+0000","last_unstale":"2024-05-09T05:56:49.370721+0000","last_undegraded":"2024-05-09T05:56:49.370721+0000","last_fullsized":"2024-05-09T05:56:49.370721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:52:52.360128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"29'238","reported_seq":262,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.725696+0000","last_change":"2024-05-09T05:53:28.222341+0000","last_active":"2024-05-09T05:58:31.725696+0000","last_peered":"2024-05-09T05:58:31.725696+0000","last_clean":"2024-05-09T05:58:31.725696+0000","last_became_active":"2024-05-09T05:53:28.219636+0000","last_became_peered":"2024-05-09T05:53:28.219636+0000","last_unstale":"2024-05-09T05:58:31.725696+0000","last_undegraded":"2024-05-09T05:58:31.725696+0000","last_fullsized":"2024-05-09T05:58:31.725696+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:29:03.459851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":238,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"29'10","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.170796+0000","last_change":"2024-05-09T05:53:24.143495+0000","last_active":"2024-05-09T05:58:30.170796+0000","last_peered":"2024-05-09T05:58:30.170796+0000","last_clean":"2024-05-09T05:58:30.170796+0000","last_became_active":"2024-05-09T05:53:24.143181+0000","last_became_peered":"2024-05-09T05:53:24.143181+0000","last_unstale":"2024-05-09T05:58:30.170796+0000","last_undegraded":"2024-05-09T05:58:30.170796+0000","last_fullsized":"2024-05-09T05:58:30.170796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:40:20.997659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"27'9","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:57:10.706735+0000","last_change":"2024-05-09T05:53:23.114815+0000","last_active":"2024-05-09T05:57:10.706735+0000","last_peered":"2024-05-09T05:57:10.706735+0000","last_clean":"2024-05-09T05:57:10.706735+0000","last_became_active":"2024-05-09T05:53:23.113524+0000","last_became_peered":"2024-05-09T05:53:23.113524+0000","last_unstale":"2024-05-09T05:57:10.706735+0000","last_undegraded":"2024-05-09T05:57:10.706735+0000","last_fullsized":"2024-05-09T05:57:10.706735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:35:45.537715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"29'327","reported_seq":351,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:32.902431+0000","last_change":"2024-05-09T05:53:28.226682+0000","last_active":"2024-05-09T05:58:32.902431+0000","last_peered":"2024-05-09T05:58:32.902431+0000","last_clean":"2024-05-09T05:58:32.902431+0000","last_became_active":"2024-05-09T05:53:28.226279+0000","last_became_peered":"2024-05-09T05:53:28.226279+0000","last_unstale":"2024-05-09T05:58:32.902431+0000","last_undegraded":"2024-05-09T05:58:32.902431+0000","last_fullsized":"2024-05-09T05:58:32.902431+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:15:55.146695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":327,"num_write_kb":892928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"29'6","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.174448+0000","last_change":"2024-05-09T05:53:24.135119+0000","last_active":"2024-05-09T05:58:30.174448+0000","last_peered":"2024-05-09T05:58:30.174448+0000","last_clean":"2024-05-09T05:58:30.174448+0000","last_became_active":"2024-05-09T05:53:24.134690+0000","last_became_peered":"2024-05-09T05:53:24.134690+0000","last_unstale":"2024-05-09T05:58:30.174448+0000","last_undegraded":"2024-05-09T05:58:30.174448+0000","last_fullsized":"2024-05-09T05:58:30.174448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:15:36.608441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"29'101","reported_seq":137,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.487064+0000","last_change":"2024-05-09T05:53:23.119626+0000","last_active":"2024-05-09T05:58:30.487064+0000","last_peered":"2024-05-09T05:58:30.487064+0000","last_clean":"2024-05-09T05:58:30.487064+0000","last_became_active":"2024-05-09T05:53:23.119173+0000","last_became_peered":"2024-05-09T05:53:23.119173+0000","last_unstale":"2024-05-09T05:58:30.487064+0000","last_undegraded":"2024-05-09T05:58:30.487064+0000","last_fullsized":"2024-05-09T05:58:30.487064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:24:03.188897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":212943,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":102,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"29'250","reported_seq":274,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.724425+0000","last_change":"2024-05-09T05:53:28.223167+0000","last_active":"2024-05-09T05:58:31.724425+0000","last_peered":"2024-05-09T05:58:31.724425+0000","last_clean":"2024-05-09T05:58:31.724425+0000","last_became_active":"2024-05-09T05:53:28.221846+0000","last_became_peered":"2024-05-09T05:53:28.221846+0000","last_unstale":"2024-05-09T05:58:31.724425+0000","last_undegraded":"2024-05-09T05:58:31.724425+0000","last_fullsized":"2024-05-09T05:58:31.724425+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:47:12.366900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163577856,"num_objects":39,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":249,"num_write_kb":786432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"29'11","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.160480+0000","last_change":"2024-05-09T05:53:24.133007+0000","last_active":"2024-05-09T05:58:30.160480+0000","last_peered":"2024-05-09T05:58:30.160480+0000","last_clean":"2024-05-09T05:58:30.160480+0000","last_became_active":"2024-05-09T05:53:24.132545+0000","last_became_peered":"2024-05-09T05:53:24.132545+0000","last_unstale":"2024-05-09T05:58:30.160480+0000","last_undegraded":"2024-05-09T05:58:30.160480+0000","last_fullsized":"2024-05-09T05:58:30.160480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:10:26.299015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"29'9","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:16.732696+0000","last_change":"2024-05-09T05:53:23.121124+0000","last_active":"2024-05-09T05:58:16.732696+0000","last_peered":"2024-05-09T05:58:16.732696+0000","last_clean":"2024-05-09T05:58:16.732696+0000","last_became_active":"2024-05-09T05:53:23.120303+0000","last_became_peered":"2024-05-09T05:53:23.120303+0000","last_unstale":"2024-05-09T05:58:16.732696+0000","last_undegraded":"2024-05-09T05:58:16.732696+0000","last_fullsized":"2024-05-09T05:58:16.732696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:36:49.445673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"29'256","reported_seq":280,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.714538+0000","last_change":"2024-05-09T05:53:28.188712+0000","last_active":"2024-05-09T05:58:31.714538+0000","last_peered":"2024-05-09T05:58:31.714538+0000","last_clean":"2024-05-09T05:58:31.714538+0000","last_became_active":"2024-05-09T05:53:28.184259+0000","last_became_peered":"2024-05-09T05:53:28.184259+0000","last_unstale":"2024-05-09T05:58:31.714538+0000","last_undegraded":"2024-05-09T05:58:31.714538+0000","last_fullsized":"2024-05-09T05:58:31.714538+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:56:39.668106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171966464,"num_objects":41,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":256,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"29'9","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.183972+0000","last_change":"2024-05-09T05:53:24.146147+0000","last_active":"2024-05-09T05:58:30.183972+0000","last_peered":"2024-05-09T05:58:30.183972+0000","last_clean":"2024-05-09T05:58:30.183972+0000","last_became_active":"2024-05-09T05:53:24.145704+0000","last_became_peered":"2024-05-09T05:53:24.145704+0000","last_unstale":"2024-05-09T05:58:30.183972+0000","last_undegraded":"2024-05-09T05:58:30.183972+0000","last_fullsized":"2024-05-09T05:58:30.183972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:47:03.047479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"27'4","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:57:10.705335+0000","last_change":"2024-05-09T05:53:23.095689+0000","last_active":"2024-05-09T05:57:10.705335+0000","last_peered":"2024-05-09T05:57:10.705335+0000","last_clean":"2024-05-09T05:57:10.705335+0000","last_became_active":"2024-05-09T05:53:23.094889+0000","last_became_peered":"2024-05-09T05:53:23.094889+0000","last_unstale":"2024-05-09T05:57:10.705335+0000","last_undegraded":"2024-05-09T05:57:10.705335+0000","last_fullsized":"2024-05-09T05:57:10.705335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:25:35.069184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"29'270","reported_seq":294,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.697472+0000","last_change":"2024-05-09T05:53:28.223954+0000","last_active":"2024-05-09T05:58:31.697472+0000","last_peered":"2024-05-09T05:58:31.697472+0000","last_clean":"2024-05-09T05:58:31.697472+0000","last_became_active":"2024-05-09T05:53:28.222700+0000","last_became_peered":"2024-05-09T05:53:28.222700+0000","last_unstale":"2024-05-09T05:58:31.697472+0000","last_undegraded":"2024-05-09T05:58:31.697472+0000","last_fullsized":"2024-05-09T05:58:31.697472+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:17:17.864782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"29'10","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.161629+0000","last_change":"2024-05-09T05:53:24.140698+0000","last_active":"2024-05-09T05:58:30.161629+0000","last_peered":"2024-05-09T05:58:30.161629+0000","last_clean":"2024-05-09T05:58:30.161629+0000","last_became_active":"2024-05-09T05:53:24.139612+0000","last_became_peered":"2024-05-09T05:53:24.139612+0000","last_unstale":"2024-05-09T05:58:30.161629+0000","last_undegraded":"2024-05-09T05:58:30.161629+0000","last_fullsized":"2024-05-09T05:58:30.161629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:09:39.609750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"29'8","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.103000+0000","last_change":"2024-05-09T05:53:23.106167+0000","last_active":"2024-05-09T05:58:30.103000+0000","last_peered":"2024-05-09T05:58:30.103000+0000","last_clean":"2024-05-09T05:58:30.103000+0000","last_became_active":"2024-05-09T05:53:23.105346+0000","last_became_peered":"2024-05-09T05:53:23.105346+0000","last_unstale":"2024-05-09T05:58:30.103000+0000","last_undegraded":"2024-05-09T05:58:30.103000+0000","last_fullsized":"2024-05-09T05:58:30.103000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:06:46.109056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"29'283","reported_seq":307,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.714555+0000","last_change":"2024-05-09T05:53:28.194037+0000","last_active":"2024-05-09T05:58:31.714555+0000","last_peered":"2024-05-09T05:58:31.714555+0000","last_clean":"2024-05-09T05:58:31.714555+0000","last_became_active":"2024-05-09T05:53:28.192944+0000","last_became_peered":"2024-05-09T05:53:28.192944+0000","last_unstale":"2024-05-09T05:58:31.714555+0000","last_undegraded":"2024-05-09T05:58:31.714555+0000","last_fullsized":"2024-05-09T05:58:31.714555+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:28:47.664198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184549376,"num_objects":44,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":283,"num_write_kb":892928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"29'229","reported_seq":253,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.675312+0000","last_change":"2024-05-09T05:53:28.226664+0000","last_active":"2024-05-09T05:58:31.675312+0000","last_peered":"2024-05-09T05:58:31.675312+0000","last_clean":"2024-05-09T05:58:31.675312+0000","last_became_active":"2024-05-09T05:53:28.222225+0000","last_became_peered":"2024-05-09T05:53:28.222225+0000","last_unstale":"2024-05-09T05:58:31.675312+0000","last_undegraded":"2024-05-09T05:58:31.675312+0000","last_fullsized":"2024-05-09T05:58:31.675312+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:24:23.614210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184549376,"num_objects":44,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":229,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"29'11","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.193600+0000","last_change":"2024-05-09T05:53:24.128343+0000","last_active":"2024-05-09T05:58:30.193600+0000","last_peered":"2024-05-09T05:58:30.193600+0000","last_clean":"2024-05-09T05:58:30.193600+0000","last_became_active":"2024-05-09T05:53:24.127989+0000","last_became_peered":"2024-05-09T05:53:24.127989+0000","last_unstale":"2024-05-09T05:58:30.193600+0000","last_undegraded":"2024-05-09T05:58:30.193600+0000","last_fullsized":"2024-05-09T05:58:30.193600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:56:14.176175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:56:49.476291+0000","last_change":"2024-05-09T05:53:23.118882+0000","last_active":"2024-05-09T05:56:49.476291+0000","last_peered":"2024-05-09T05:56:49.476291+0000","last_clean":"2024-05-09T05:56:49.476291+0000","last_became_active":"2024-05-09T05:53:23.118119+0000","last_became_peered":"2024-05-09T05:53:23.118119+0000","last_unstale":"2024-05-09T05:56:49.476291+0000","last_undegraded":"2024-05-09T05:56:49.476291+0000","last_fullsized":"2024-05-09T05:56:49.476291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:06:48.203396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"29'267","reported_seq":291,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:33.001823+0000","last_change":"2024-05-09T05:53:28.235313+0000","last_active":"2024-05-09T05:58:33.001823+0000","last_peered":"2024-05-09T05:58:33.001823+0000","last_clean":"2024-05-09T05:58:33.001823+0000","last_became_active":"2024-05-09T05:53:28.234771+0000","last_became_peered":"2024-05-09T05:53:28.234771+0000","last_unstale":"2024-05-09T05:58:33.001823+0000","last_undegraded":"2024-05-09T05:58:33.001823+0000","last_fullsized":"2024-05-09T05:58:33.001823+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:38:46.942863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":267,"num_write_kb":729088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"29'8","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.179669+0000","last_change":"2024-05-09T05:53:24.141956+0000","last_active":"2024-05-09T05:58:30.179669+0000","last_peered":"2024-05-09T05:58:30.179669+0000","last_clean":"2024-05-09T05:58:30.179669+0000","last_became_active":"2024-05-09T05:53:24.139093+0000","last_became_peered":"2024-05-09T05:53:24.139093+0000","last_unstale":"2024-05-09T05:58:30.179669+0000","last_undegraded":"2024-05-09T05:58:30.179669+0000","last_fullsized":"2024-05-09T05:58:30.179669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:44:32.901168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"27'3","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:57:10.687185+0000","last_change":"2024-05-09T05:53:23.113865+0000","last_active":"2024-05-09T05:57:10.687185+0000","last_peered":"2024-05-09T05:57:10.687185+0000","last_clean":"2024-05-09T05:57:10.687185+0000","last_became_active":"2024-05-09T05:53:23.112020+0000","last_became_peered":"2024-05-09T05:53:23.112020+0000","last_unstale":"2024-05-09T05:57:10.687185+0000","last_undegraded":"2024-05-09T05:57:10.687185+0000","last_fullsized":"2024-05-09T05:57:10.687185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:37:04.425229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":14,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"26'7","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:56:44.375056+0000","last_change":"2024-05-09T05:53:23.127463+0000","last_active":"2024-05-09T05:56:44.375056+0000","last_peered":"2024-05-09T05:56:44.375056+0000","last_clean":"2024-05-09T05:56:44.375056+0000","last_became_active":"2024-05-09T05:53:23.126911+0000","last_became_peered":"2024-05-09T05:53:23.126911+0000","last_unstale":"2024-05-09T05:56:44.375056+0000","last_undegraded":"2024-05-09T05:56:44.375056+0000","last_fullsized":"2024-05-09T05:56:44.375056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:06:28.458926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"29'8","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.192543+0000","last_change":"2024-05-09T05:53:24.134391+0000","last_active":"2024-05-09T05:58:30.192543+0000","last_peered":"2024-05-09T05:58:30.192543+0000","last_clean":"2024-05-09T05:58:30.192543+0000","last_became_active":"2024-05-09T05:53:24.133994+0000","last_became_peered":"2024-05-09T05:53:24.133994+0000","last_unstale":"2024-05-09T05:58:30.192543+0000","last_undegraded":"2024-05-09T05:58:30.192543+0000","last_fullsized":"2024-05-09T05:58:30.192543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:30:32.872657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"29'248","reported_seq":272,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.603281+0000","last_change":"2024-05-09T05:53:28.223524+0000","last_active":"2024-05-09T05:58:31.603281+0000","last_peered":"2024-05-09T05:58:31.603281+0000","last_clean":"2024-05-09T05:58:31.603281+0000","last_became_active":"2024-05-09T05:53:28.222433+0000","last_became_peered":"2024-05-09T05:53:28.222433+0000","last_unstale":"2024-05-09T05:58:31.603281+0000","last_undegraded":"2024-05-09T05:58:31.603281+0000","last_fullsized":"2024-05-09T05:58:31.603281+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:52:35.361812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205520896,"num_objects":49,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"29'7","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:24.721349+0000","last_change":"2024-05-09T05:53:23.133700+0000","last_active":"2024-05-09T05:58:24.721349+0000","last_peered":"2024-05-09T05:58:24.721349+0000","last_clean":"2024-05-09T05:58:24.721349+0000","last_became_active":"2024-05-09T05:53:23.132946+0000","last_became_peered":"2024-05-09T05:53:23.132946+0000","last_unstale":"2024-05-09T05:58:24.721349+0000","last_undegraded":"2024-05-09T05:58:24.721349+0000","last_fullsized":"2024-05-09T05:58:24.721349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:39:49.829592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"29'7","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.163659+0000","last_change":"2024-05-09T05:53:24.138174+0000","last_active":"2024-05-09T05:58:30.163659+0000","last_peered":"2024-05-09T05:58:30.163659+0000","last_clean":"2024-05-09T05:58:30.163659+0000","last_became_active":"2024-05-09T05:53:24.137794+0000","last_became_peered":"2024-05-09T05:53:24.137794+0000","last_unstale":"2024-05-09T05:58:30.163659+0000","last_undegraded":"2024-05-09T05:58:30.163659+0000","last_fullsized":"2024-05-09T05:58:30.163659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:57:26.359258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"29'258","reported_seq":282,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.730396+0000","last_change":"2024-05-09T05:53:28.238375+0000","last_active":"2024-05-09T05:58:31.730396+0000","last_peered":"2024-05-09T05:58:31.730396+0000","last_clean":"2024-05-09T05:58:31.730396+0000","last_became_active":"2024-05-09T05:53:28.237414+0000","last_became_peered":"2024-05-09T05:53:28.237414+0000","last_unstale":"2024-05-09T05:58:31.730396+0000","last_undegraded":"2024-05-09T05:58:31.730396+0000","last_fullsized":"2024-05-09T05:58:31.730396+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:13:50.396951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":226492416,"num_objects":54,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":258,"num_write_kb":851968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"29'9","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.147744+0000","last_change":"2024-05-09T05:53:24.130839+0000","last_active":"2024-05-09T05:58:30.147744+0000","last_peered":"2024-05-09T05:58:30.147744+0000","last_clean":"2024-05-09T05:58:30.147744+0000","last_became_active":"2024-05-09T05:53:24.130201+0000","last_became_peered":"2024-05-09T05:53:24.130201+0000","last_unstale":"2024-05-09T05:58:30.147744+0000","last_undegraded":"2024-05-09T05:58:30.147744+0000","last_fullsized":"2024-05-09T05:58:30.147744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:26:03.973553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"29'12","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.179014+0000","last_change":"2024-05-09T05:53:24.138681+0000","last_active":"2024-05-09T05:58:30.179014+0000","last_peered":"2024-05-09T05:58:30.179014+0000","last_clean":"2024-05-09T05:58:30.179014+0000","last_became_active":"2024-05-09T05:53:24.138366+0000","last_became_peered":"2024-05-09T05:53:24.138366+0000","last_unstale":"2024-05-09T05:58:30.179014+0000","last_undegraded":"2024-05-09T05:58:30.179014+0000","last_fullsized":"2024-05-09T05:58:30.179014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:49.856205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"29'8","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.159685+0000","last_change":"2024-05-09T05:53:24.139915+0000","last_active":"2024-05-09T05:58:30.159685+0000","last_peered":"2024-05-09T05:58:30.159685+0000","last_clean":"2024-05-09T05:58:30.159685+0000","last_became_active":"2024-05-09T05:53:24.139058+0000","last_became_peered":"2024-05-09T05:53:24.139058+0000","last_unstale":"2024-05-09T05:58:30.159685+0000","last_undegraded":"2024-05-09T05:58:30.159685+0000","last_fullsized":"2024-05-09T05:58:30.159685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:06:00.768431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"29'7","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.189065+0000","last_change":"2024-05-09T05:53:24.149759+0000","last_active":"2024-05-09T05:58:30.189065+0000","last_peered":"2024-05-09T05:58:30.189065+0000","last_clean":"2024-05-09T05:58:30.189065+0000","last_became_active":"2024-05-09T05:53:24.142812+0000","last_became_peered":"2024-05-09T05:53:24.142812+0000","last_unstale":"2024-05-09T05:58:30.189065+0000","last_undegraded":"2024-05-09T05:58:30.189065+0000","last_fullsized":"2024-05-09T05:58:30.189065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:04.522514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"29'4","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.185763+0000","last_change":"2024-05-09T05:53:24.135373+0000","last_active":"2024-05-09T05:58:30.185763+0000","last_peered":"2024-05-09T05:58:30.185763+0000","last_clean":"2024-05-09T05:58:30.185763+0000","last_became_active":"2024-05-09T05:53:24.135043+0000","last_became_peered":"2024-05-09T05:53:24.135043+0000","last_unstale":"2024-05-09T05:58:30.185763+0000","last_undegraded":"2024-05-09T05:58:30.185763+0000","last_fullsized":"2024-05-09T05:58:30.185763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:20:03.245696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"29'6","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.185380+0000","last_change":"2024-05-09T05:53:24.134712+0000","last_active":"2024-05-09T05:58:30.185380+0000","last_peered":"2024-05-09T05:58:30.185380+0000","last_clean":"2024-05-09T05:58:30.185380+0000","last_became_active":"2024-05-09T05:53:24.132453+0000","last_became_peered":"2024-05-09T05:53:24.132453+0000","last_unstale":"2024-05-09T05:58:30.185380+0000","last_undegraded":"2024-05-09T05:58:30.185380+0000","last_fullsized":"2024-05-09T05:58:30.185380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:47:30.716995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"29'15","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.161321+0000","last_change":"2024-05-09T05:53:24.140714+0000","last_active":"2024-05-09T05:58:30.161321+0000","last_peered":"2024-05-09T05:58:30.161321+0000","last_clean":"2024-05-09T05:58:30.161321+0000","last_became_active":"2024-05-09T05:53:24.140045+0000","last_became_peered":"2024-05-09T05:53:24.140045+0000","last_unstale":"2024-05-09T05:58:30.161321+0000","last_undegraded":"2024-05-09T05:58:30.161321+0000","last_fullsized":"2024-05-09T05:58:30.161321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:36:06.166411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"29'2","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.183512+0000","last_change":"2024-05-09T05:53:24.151591+0000","last_active":"2024-05-09T05:58:30.183512+0000","last_peered":"2024-05-09T05:58:30.183512+0000","last_clean":"2024-05-09T05:58:30.183512+0000","last_became_active":"2024-05-09T05:53:24.151275+0000","last_became_peered":"2024-05-09T05:53:24.151275+0000","last_unstale":"2024-05-09T05:58:30.183512+0000","last_undegraded":"2024-05-09T05:58:30.183512+0000","last_fullsized":"2024-05-09T05:58:30.183512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:28:28.552732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"29'6","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.183409+0000","last_change":"2024-05-09T05:53:24.144315+0000","last_active":"2024-05-09T05:58:30.183409+0000","last_peered":"2024-05-09T05:58:30.183409+0000","last_clean":"2024-05-09T05:58:30.183409+0000","last_became_active":"2024-05-09T05:53:24.144005+0000","last_became_peered":"2024-05-09T05:53:24.144005+0000","last_unstale":"2024-05-09T05:58:30.183409+0000","last_undegraded":"2024-05-09T05:58:30.183409+0000","last_fullsized":"2024-05-09T05:58:30.183409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:06:37.312541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"29'8","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.180625+0000","last_change":"2024-05-09T05:53:24.149852+0000","last_active":"2024-05-09T05:58:30.180625+0000","last_peered":"2024-05-09T05:58:30.180625+0000","last_clean":"2024-05-09T05:58:30.180625+0000","last_became_active":"2024-05-09T05:53:24.146965+0000","last_became_peered":"2024-05-09T05:53:24.146965+0000","last_unstale":"2024-05-09T05:58:30.180625+0000","last_undegraded":"2024-05-09T05:58:30.180625+0000","last_fullsized":"2024-05-09T05:58:30.180625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:02:26.991425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"29'10","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.146017+0000","last_change":"2024-05-09T05:53:24.131735+0000","last_active":"2024-05-09T05:58:30.146017+0000","last_peered":"2024-05-09T05:58:30.146017+0000","last_clean":"2024-05-09T05:58:30.146017+0000","last_became_active":"2024-05-09T05:53:24.131417+0000","last_became_peered":"2024-05-09T05:53:24.131417+0000","last_unstale":"2024-05-09T05:58:30.146017+0000","last_undegraded":"2024-05-09T05:58:30.146017+0000","last_fullsized":"2024-05-09T05:58:30.146017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:59.750972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"29'11","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.192644+0000","last_change":"2024-05-09T05:53:24.140697+0000","last_active":"2024-05-09T05:58:30.192644+0000","last_peered":"2024-05-09T05:58:30.192644+0000","last_clean":"2024-05-09T05:58:30.192644+0000","last_became_active":"2024-05-09T05:53:24.140024+0000","last_became_peered":"2024-05-09T05:53:24.140024+0000","last_unstale":"2024-05-09T05:58:30.192644+0000","last_undegraded":"2024-05-09T05:58:30.192644+0000","last_fullsized":"2024-05-09T05:58:30.192644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:14:14.543827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"29'8","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.148226+0000","last_change":"2024-05-09T05:53:24.136878+0000","last_active":"2024-05-09T05:58:30.148226+0000","last_peered":"2024-05-09T05:58:30.148226+0000","last_clean":"2024-05-09T05:58:30.148226+0000","last_became_active":"2024-05-09T05:53:24.136572+0000","last_became_peered":"2024-05-09T05:53:24.136572+0000","last_unstale":"2024-05-09T05:58:30.148226+0000","last_undegraded":"2024-05-09T05:58:30.148226+0000","last_fullsized":"2024-05-09T05:58:30.148226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:46:47.509355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"29'7","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.163381+0000","last_change":"2024-05-09T05:53:24.147372+0000","last_active":"2024-05-09T05:58:30.163381+0000","last_peered":"2024-05-09T05:58:30.163381+0000","last_clean":"2024-05-09T05:58:30.163381+0000","last_became_active":"2024-05-09T05:53:24.144573+0000","last_became_peered":"2024-05-09T05:53:24.144573+0000","last_unstale":"2024-05-09T05:58:30.163381+0000","last_undegraded":"2024-05-09T05:58:30.163381+0000","last_fullsized":"2024-05-09T05:58:30.163381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:51:09.845748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"29'10","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.179342+0000","last_change":"2024-05-09T05:53:24.135964+0000","last_active":"2024-05-09T05:58:30.179342+0000","last_peered":"2024-05-09T05:58:30.179342+0000","last_clean":"2024-05-09T05:58:30.179342+0000","last_became_active":"2024-05-09T05:53:24.135625+0000","last_became_peered":"2024-05-09T05:53:24.135625+0000","last_unstale":"2024-05-09T05:58:30.179342+0000","last_undegraded":"2024-05-09T05:58:30.179342+0000","last_fullsized":"2024-05-09T05:58:30.179342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:52:02.026146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"29'8","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.157333+0000","last_change":"2024-05-09T05:53:24.133916+0000","last_active":"2024-05-09T05:58:30.157333+0000","last_peered":"2024-05-09T05:58:30.157333+0000","last_clean":"2024-05-09T05:58:30.157333+0000","last_became_active":"2024-05-09T05:53:24.133405+0000","last_became_peered":"2024-05-09T05:53:24.133405+0000","last_unstale":"2024-05-09T05:58:30.157333+0000","last_undegraded":"2024-05-09T05:58:30.157333+0000","last_fullsized":"2024-05-09T05:58:30.157333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:30:16.477715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"29'9","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.158011+0000","last_change":"2024-05-09T05:53:24.139697+0000","last_active":"2024-05-09T05:58:30.158011+0000","last_peered":"2024-05-09T05:58:30.158011+0000","last_clean":"2024-05-09T05:58:30.158011+0000","last_became_active":"2024-05-09T05:53:24.139374+0000","last_became_peered":"2024-05-09T05:53:24.139374+0000","last_unstale":"2024-05-09T05:58:30.158011+0000","last_undegraded":"2024-05-09T05:58:30.158011+0000","last_fullsized":"2024-05-09T05:58:30.158011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:26:28.502867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"29'7","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.180122+0000","last_change":"2024-05-09T05:53:24.147755+0000","last_active":"2024-05-09T05:58:30.180122+0000","last_peered":"2024-05-09T05:58:30.180122+0000","last_clean":"2024-05-09T05:58:30.180122+0000","last_became_active":"2024-05-09T05:53:24.145616+0000","last_became_peered":"2024-05-09T05:53:24.145616+0000","last_unstale":"2024-05-09T05:58:30.180122+0000","last_undegraded":"2024-05-09T05:58:30.180122+0000","last_fullsized":"2024-05-09T05:58:30.180122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:21:10.387393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"29'8","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.185016+0000","last_change":"2024-05-09T05:53:24.131741+0000","last_active":"2024-05-09T05:58:30.185016+0000","last_peered":"2024-05-09T05:58:30.185016+0000","last_clean":"2024-05-09T05:58:30.185016+0000","last_became_active":"2024-05-09T05:53:24.128870+0000","last_became_peered":"2024-05-09T05:53:24.128870+0000","last_unstale":"2024-05-09T05:58:30.185016+0000","last_undegraded":"2024-05-09T05:58:30.185016+0000","last_fullsized":"2024-05-09T05:58:30.185016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:28:25.103524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"29'10","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.189062+0000","last_change":"2024-05-09T05:53:24.133443+0000","last_active":"2024-05-09T05:58:30.189062+0000","last_peered":"2024-05-09T05:58:30.189062+0000","last_clean":"2024-05-09T05:58:30.189062+0000","last_became_active":"2024-05-09T05:53:24.132688+0000","last_became_peered":"2024-05-09T05:53:24.132688+0000","last_unstale":"2024-05-09T05:58:30.189062+0000","last_undegraded":"2024-05-09T05:58:30.189062+0000","last_fullsized":"2024-05-09T05:58:30.189062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:43:24.750805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"29'7","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.156337+0000","last_change":"2024-05-09T05:53:24.142600+0000","last_active":"2024-05-09T05:58:30.156337+0000","last_peered":"2024-05-09T05:58:30.156337+0000","last_clean":"2024-05-09T05:58:30.156337+0000","last_became_active":"2024-05-09T05:53:24.142280+0000","last_became_peered":"2024-05-09T05:53:24.142280+0000","last_unstale":"2024-05-09T05:58:30.156337+0000","last_undegraded":"2024-05-09T05:58:30.156337+0000","last_fullsized":"2024-05-09T05:58:30.156337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:20:58.962379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"29'6","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.151928+0000","last_change":"2024-05-09T05:53:24.144839+0000","last_active":"2024-05-09T05:58:30.151928+0000","last_peered":"2024-05-09T05:58:30.151928+0000","last_clean":"2024-05-09T05:58:30.151928+0000","last_became_active":"2024-05-09T05:53:24.144381+0000","last_became_peered":"2024-05-09T05:53:24.144381+0000","last_unstale":"2024-05-09T05:58:30.151928+0000","last_undegraded":"2024-05-09T05:58:30.151928+0000","last_fullsized":"2024-05-09T05:58:30.151928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:40:46.738053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"29'16","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.147352+0000","last_change":"2024-05-09T05:53:24.131521+0000","last_active":"2024-05-09T05:58:30.147352+0000","last_peered":"2024-05-09T05:58:30.147352+0000","last_clean":"2024-05-09T05:58:30.147352+0000","last_became_active":"2024-05-09T05:53:24.131218+0000","last_became_peered":"2024-05-09T05:53:24.131218+0000","last_unstale":"2024-05-09T05:58:30.147352+0000","last_undegraded":"2024-05-09T05:58:30.147352+0000","last_fullsized":"2024-05-09T05:58:30.147352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:25:59.410270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"29'11","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.160728+0000","last_change":"2024-05-09T05:53:24.139922+0000","last_active":"2024-05-09T05:58:30.160728+0000","last_peered":"2024-05-09T05:58:30.160728+0000","last_clean":"2024-05-09T05:58:30.160728+0000","last_became_active":"2024-05-09T05:53:24.139473+0000","last_became_peered":"2024-05-09T05:53:24.139473+0000","last_unstale":"2024-05-09T05:58:30.160728+0000","last_undegraded":"2024-05-09T05:58:30.160728+0000","last_fullsized":"2024-05-09T05:58:30.160728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:37:50.839899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"29'9","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.180793+0000","last_change":"2024-05-09T05:53:24.143338+0000","last_active":"2024-05-09T05:58:30.180793+0000","last_peered":"2024-05-09T05:58:30.180793+0000","last_clean":"2024-05-09T05:58:30.180793+0000","last_became_active":"2024-05-09T05:53:24.143053+0000","last_became_peered":"2024-05-09T05:53:24.143053+0000","last_unstale":"2024-05-09T05:58:30.180793+0000","last_undegraded":"2024-05-09T05:58:30.180793+0000","last_fullsized":"2024-05-09T05:58:30.180793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:22:16.337090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"29'5","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.182540+0000","last_change":"2024-05-09T05:53:24.145517+0000","last_active":"2024-05-09T05:58:30.182540+0000","last_peered":"2024-05-09T05:58:30.182540+0000","last_clean":"2024-05-09T05:58:30.182540+0000","last_became_active":"2024-05-09T05:53:24.145150+0000","last_became_peered":"2024-05-09T05:53:24.145150+0000","last_unstale":"2024-05-09T05:58:30.182540+0000","last_undegraded":"2024-05-09T05:58:30.182540+0000","last_fullsized":"2024-05-09T05:58:30.182540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:19:53.947349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"29'6","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.182235+0000","last_change":"2024-05-09T05:53:24.129669+0000","last_active":"2024-05-09T05:58:30.182235+0000","last_peered":"2024-05-09T05:58:30.182235+0000","last_clean":"2024-05-09T05:58:30.182235+0000","last_became_active":"2024-05-09T05:53:24.129339+0000","last_became_peered":"2024-05-09T05:53:24.129339+0000","last_unstale":"2024-05-09T05:58:30.182235+0000","last_undegraded":"2024-05-09T05:58:30.182235+0000","last_fullsized":"2024-05-09T05:58:30.182235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:05:51.845643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"29'4","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.177393+0000","last_change":"2024-05-09T05:53:24.138914+0000","last_active":"2024-05-09T05:58:30.177393+0000","last_peered":"2024-05-09T05:58:30.177393+0000","last_clean":"2024-05-09T05:58:30.177393+0000","last_became_active":"2024-05-09T05:53:24.138499+0000","last_became_peered":"2024-05-09T05:53:24.138499+0000","last_unstale":"2024-05-09T05:58:30.177393+0000","last_undegraded":"2024-05-09T05:58:30.177393+0000","last_fullsized":"2024-05-09T05:58:30.177393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:29:00.338046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"29'8","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.182277+0000","last_change":"2024-05-09T05:53:24.144296+0000","last_active":"2024-05-09T05:58:30.182277+0000","last_peered":"2024-05-09T05:58:30.182277+0000","last_clean":"2024-05-09T05:58:30.182277+0000","last_became_active":"2024-05-09T05:53:24.143890+0000","last_became_peered":"2024-05-09T05:53:24.143890+0000","last_unstale":"2024-05-09T05:58:30.182277+0000","last_undegraded":"2024-05-09T05:58:30.182277+0000","last_fullsized":"2024-05-09T05:58:30.182277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:34:56.860849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"29'7","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.178572+0000","last_change":"2024-05-09T05:53:24.152635+0000","last_active":"2024-05-09T05:58:30.178572+0000","last_peered":"2024-05-09T05:58:30.178572+0000","last_clean":"2024-05-09T05:58:30.178572+0000","last_became_active":"2024-05-09T05:53:24.151674+0000","last_became_peered":"2024-05-09T05:53:24.151674+0000","last_unstale":"2024-05-09T05:58:30.178572+0000","last_undegraded":"2024-05-09T05:58:30.178572+0000","last_fullsized":"2024-05-09T05:58:30.178572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:18:47.495857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"29'4","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.177792+0000","last_change":"2024-05-09T05:53:24.152746+0000","last_active":"2024-05-09T05:58:30.177792+0000","last_peered":"2024-05-09T05:58:30.177792+0000","last_clean":"2024-05-09T05:58:30.177792+0000","last_became_active":"2024-05-09T05:53:24.151418+0000","last_became_peered":"2024-05-09T05:53:24.151418+0000","last_unstale":"2024-05-09T05:58:30.177792+0000","last_undegraded":"2024-05-09T05:58:30.177792+0000","last_fullsized":"2024-05-09T05:58:30.177792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:27:19.121790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"29'8","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.161043+0000","last_change":"2024-05-09T05:53:24.140908+0000","last_active":"2024-05-09T05:58:30.161043+0000","last_peered":"2024-05-09T05:58:30.161043+0000","last_clean":"2024-05-09T05:58:30.161043+0000","last_became_active":"2024-05-09T05:53:24.140589+0000","last_became_peered":"2024-05-09T05:53:24.140589+0000","last_unstale":"2024-05-09T05:58:30.161043+0000","last_undegraded":"2024-05-09T05:58:30.161043+0000","last_fullsized":"2024-05-09T05:58:30.161043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:51:03.458547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3829399552,"num_objects":913,"num_object_clones":0,"num_object_copies":3652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":913,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8303,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":7973371904,"data_stored":7973371904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8304,"ondisk_log_size":8304,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":503,"ondisk_log_size":503,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":221640,"num_objects":99,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":153,"num_read_kb":159,"num_write":356,"num_write_kb":338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":688128,"data_stored":443280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":330,"ondisk_log_size":330,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509506,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1728924,"kb_used_data":1679700,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":92642916,"statfs":{"total":96636764160,"available":94866345984,"internally_reserved":0,"allocated":1720012800,"data_stored":1719795670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509509,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1517960,"kb_used_data":1464640,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":92853880,"statfs":{"total":96636764160,"available":95082373120,"internally_reserved":0,"allocated":1499791360,"data_stored":1499596671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509509,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1833528,"kb_used_data":1788464,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":92538312,"statfs":{"total":96636764160,"available":94759231488,"internally_reserved":0,"allocated":1831387136,"data_stored":1831157924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509506,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1268372,"kb_used_data":1212940,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":93103468,"statfs":{"total":96636764160,"available":95337951232,"internally_reserved":0,"allocated":1242050560,"data_stored":1241856442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509508,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2011596,"kb_used_data":1948548,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":92360244,"statfs":{"total":96636764160,"available":94576889856,"internally_reserved":0,"allocated":1995313152,"data_stored":1995112781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64551365},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509508,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1677720,"kb_used_data":1628496,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":92694120,"statfs":{"total":96636764160,"available":94918778880,"internally_reserved":0,"allocated":1667579904,"data_stored":1667368993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574915,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50132,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321708,"statfs":{"total":96636764160,"available":96585428992,"internally_reserved":0,"allocated":929792,"data_stored":721752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574916,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69600,"kb_used_data":2392,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94302240,"statfs":{"total":96636764160,"available":96565493760,"internally_reserved":0,"allocated":2449408,"data_stored":2229903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68811207},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":3706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":229376,"data_stored":213011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":266240,"data_stored":214781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1008730112,"data_stored":1008730112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1623195648,"data_stored":1623195648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1111490560,"data_stored":1111490560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2097152,"data_stored":2097152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1249902592,"data_stored":1249902592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1447034880,"data_stored":1447034880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1530920960,"data_stored":1530920960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T05:58:36.878 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T05:58:37.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.075+0000 7f8ce51f0640 1 Processor -- start 2024-05-09T05:58:37.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.075+0000 7f8ce51f0640 1 -- start start 2024-05-09T05:58:37.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.075+0000 7f8ce51f0640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8ce0156780 0x7f8ce00748b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:37.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.075+0000 7f8ce51f0640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ce006e040 con 0x7f8ce0074df0 2024-05-09T05:58:37.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.075+0000 7f8ce51f0640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ce006eb50 con 0x7f8ce0160850 2024-05-09T05:58:37.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.075+0000 7f8ce51f0640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f8ce0156e10 con 0x7f8ce0156780 2024-05-09T05:58:37.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.075+0000 7f8cded9d640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8ce0156780 0x7f8ce00748b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:37.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.075+0000 7f8cde59c640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f8ce0074df0 0x7f8ce0160140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:38462/0 (socket says 172.21.15.72:38462) 2024-05-09T05:58:37.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.075+0000 7f8cde59c640 1 -- 172.21.15.72:0/3330971490 learned_addr learned my addr 172.21.15.72:0/3330971490 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:58:37.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.075+0000 7f8cded9d640 1 -- 172.21.15.72:0/3330971490 >> v1:172.21.15.110:6789/0 conn(0x7f8ce0160850 legacy=0x7f8ce01670f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:58:37.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.075+0000 7f8cded9d640 1 -- 172.21.15.72:0/3330971490 >> v1:172.21.15.72:6789/0 conn(0x7f8ce0074df0 legacy=0x7f8ce0160140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:37.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.075+0000 7f8cded9d640 1 -- 172.21.15.72:0/3330971490 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ce0156b90 con 0x7f8ce0156780 2024-05-09T05:58:37.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.079+0000 7f8cded9d640 1 --2- 172.21.15.72:0/3330971490 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ce0156780 0x7f8ce00748b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8cd00097f0 tx=0x7f8cd001c230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3de1f7b905160940 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:37.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.079+0000 7f8cddd9b640 1 -- 172.21.15.72:0/3330971490 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd00b0070 con 0x7f8ce0156780 2024-05-09T05:58:37.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.079+0000 7f8cddd9b640 1 -- 172.21.15.72:0/3330971490 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cd00ab600 con 0x7f8ce0156780 2024-05-09T05:58:37.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.079+0000 7f8cddd9b640 1 -- 172.21.15.72:0/3330971490 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd00ab9d0 con 0x7f8ce0156780 2024-05-09T05:58:37.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.079+0000 7f8ce51f0640 1 -- 172.21.15.72:0/3330971490 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ce0156780 msgr2=0x7f8ce00748b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:37.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.079+0000 7f8ce51f0640 1 --2- 172.21.15.72:0/3330971490 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ce0156780 0x7f8ce00748b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8cd00097f0 tx=0x7f8cd001c230 comp rx=0 tx=0).stop 2024-05-09T05:58:37.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.079+0000 7f8ce51f0640 1 -- 172.21.15.72:0/3330971490 shutdown_connections 2024-05-09T05:58:37.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.079+0000 7f8ce51f0640 1 --2- 172.21.15.72:0/3330971490 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ce0156780 0x7f8ce00748b0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:37.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.079+0000 7f8ce51f0640 1 -- 172.21.15.72:0/3330971490 >> 172.21.15.72:0/3330971490 conn(0x7f8ce0072300 msgr2=0x7f8ce0072710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:58:37.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.079+0000 7f8ce51f0640 1 -- 172.21.15.72:0/3330971490 shutdown_connections 2024-05-09T05:58:37.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.079+0000 7f8ce51f0640 1 -- 172.21.15.72:0/3330971490 wait complete. 2024-05-09T05:58:37.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.083+0000 7f8ce51f0640 1 Processor -- start 2024-05-09T05:58:37.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.083+0000 7f8ce51f0640 1 -- start start 2024-05-09T05:58:37.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.083+0000 7f8ce51f0640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8ce0074df0 0x7f8ce00c8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:37.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.083+0000 7f8ce51f0640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ce0156780 0x7f8ce0149700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:37.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.083+0000 7f8ce51f0640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8ce0160850 0x7f8ce0149c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:37.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.083+0000 7f8ce51f0640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce015d5d0 con 0x7f8ce0156780 2024-05-09T05:58:37.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.083+0000 7f8ce51f0640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce00cd170 con 0x7f8ce0074df0 2024-05-09T05:58:37.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.083+0000 7f8ce51f0640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f8ce015d1f0 con 0x7f8ce0160850 2024-05-09T05:58:37.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.083+0000 7f8cde59c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ce0156780 0x7f8ce0149700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:37.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.083+0000 7f8cde59c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ce0156780 0x7f8ce0149700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54286/0 (socket says 172.21.15.72:54286) 2024-05-09T05:58:37.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.083+0000 7f8cde59c640 1 -- 172.21.15.72:0/1411119961 learned_addr learned my addr 172.21.15.72:0/1411119961 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:58:37.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.083+0000 7f8cded9d640 1 --2- 172.21.15.72:0/1411119961 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8ce0074df0 0x7f8ce00c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:37.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.083+0000 7f8cde59c640 1 -- 172.21.15.72:0/1411119961 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8ce0160850 msgr2=0x7f8ce0149c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:37.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.083+0000 7f8cdf59e640 1 --2- 172.21.15.72:0/1411119961 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8ce0160850 0x7f8ce0149c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:37.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.083+0000 7f8cde59c640 1 --2- 172.21.15.72:0/1411119961 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8ce0160850 0x7f8ce0149c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:37.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.083+0000 7f8cde59c640 1 -- 172.21.15.72:0/1411119961 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8ce0074df0 msgr2=0x7f8ce00c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:37.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.083+0000 7f8cde59c640 1 --2- 172.21.15.72:0/1411119961 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8ce0074df0 0x7f8ce00c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:37.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.083+0000 7f8cde59c640 1 -- 172.21.15.72:0/1411119961 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ce00c8650 con 0x7f8ce0156780 2024-05-09T05:58:37.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.083+0000 7f8cded9d640 1 --2- 172.21.15.72:0/1411119961 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8ce0074df0 0x7f8ce00c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:58:37.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.083+0000 7f8cde59c640 1 --2- 172.21.15.72:0/1411119961 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ce0156780 0x7f8ce0149700 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8cd400c3f0 tx=0x7f8cd400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:37.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.083+0000 7f8cc77fe640 1 -- 172.21.15.72:0/1411119961 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd4017070 con 0x7f8ce0156780 2024-05-09T05:58:37.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.083+0000 7f8cc77fe640 1 -- 172.21.15.72:0/1411119961 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cd4005cf0 con 0x7f8ce0156780 2024-05-09T05:58:37.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.083+0000 7f8ce51f0640 1 -- 172.21.15.72:0/1411119961 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ce015db60 con 0x7f8ce0156780 2024-05-09T05:58:37.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.083+0000 7f8cc77fe640 1 -- 172.21.15.72:0/1411119961 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd40072f0 con 0x7f8ce0156780 2024-05-09T05:58:37.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.083+0000 7f8ce51f0640 1 -- 172.21.15.72:0/1411119961 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ce0152ed0 con 0x7f8ce0156780 2024-05-09T05:58:37.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.083+0000 7f8ce51f0640 1 -- 172.21.15.72:0/1411119961 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ce006a520 con 0x7f8ce0156780 2024-05-09T05:58:37.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.087+0000 7f8cc77fe640 1 -- 172.21.15.72:0/1411119961 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f8cd401a070 con 0x7f8ce0156780 2024-05-09T05:58:37.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.087+0000 7f8cc77fe640 1 --2- 172.21.15.72:0/1411119961 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f8ccc06f430 0x7f8ccc071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:37.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.087+0000 7f8cc77fe640 1 -- 172.21.15.72:0/1411119961 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6762+0+0 (secure 0 0 0) 0x7f8cd408ed40 con 0x7f8ce0156780 2024-05-09T05:58:37.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.087+0000 7f8cded9d640 1 --2- 172.21.15.72:0/1411119961 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f8ccc06f430 0x7f8ccc071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:37.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.087+0000 7f8cded9d640 1 --2- 172.21.15.72:0/1411119961 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f8ccc06f430 0x7f8ccc071940 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8cd00ad000 tx=0x7f8cd0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:37.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.091+0000 7f8cc77fe640 1 -- 172.21.15.72:0/1411119961 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f8cd4021020 con 0x7f8ce0156780 2024-05-09T05:58:37.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.239+0000 7f8ce51f0640 1 -- 172.21.15.72:0/1411119961 --> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8ce00c8e70 con 0x7f8ccc06f430 2024-05-09T05:58:37.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.263+0000 7f8cc77fe640 1 -- 172.21.15.72:0/1411119961 <== mgr.4102 v2:172.21.15.110:6832/1113420672 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+333978 (secure 0 0 0) 0x7f8ce00c8e70 con 0x7f8ccc06f430 2024-05-09T05:58:37.255 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:58:37.258 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2024-05-09T05:58:37.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.271+0000 7f8ce51f0640 1 -- 172.21.15.72:0/1411119961 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f8ccc06f430 msgr2=0x7f8ccc071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:37.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.271+0000 7f8ce51f0640 1 --2- 172.21.15.72:0/1411119961 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f8ccc06f430 0x7f8ccc071940 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8cd00ad000 tx=0x7f8cd0008040 comp rx=0 tx=0).stop 2024-05-09T05:58:37.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.271+0000 7f8ce51f0640 1 -- 172.21.15.72:0/1411119961 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ce0156780 msgr2=0x7f8ce0149700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:37.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.271+0000 7f8ce51f0640 1 --2- 172.21.15.72:0/1411119961 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ce0156780 0x7f8ce0149700 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8cd400c3f0 tx=0x7f8cd400c8b0 comp rx=0 tx=0).stop 2024-05-09T05:58:37.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.271+0000 7f8ce51f0640 1 -- 172.21.15.72:0/1411119961 shutdown_connections 2024-05-09T05:58:37.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.271+0000 7f8ce51f0640 1 --2- 172.21.15.72:0/1411119961 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f8ccc06f430 0x7f8ccc071940 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:37.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.271+0000 7f8ce51f0640 1 --2- 172.21.15.72:0/1411119961 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8ce0160850 0x7f8ce0149c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:37.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.271+0000 7f8ce51f0640 1 --2- 172.21.15.72:0/1411119961 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ce0156780 0x7f8ce0149700 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:37.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.271+0000 7f8ce51f0640 1 --2- 172.21.15.72:0/1411119961 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8ce0074df0 0x7f8ce00c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:37.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.271+0000 7f8ce51f0640 1 -- 172.21.15.72:0/1411119961 >> 172.21.15.72:0/1411119961 conn(0x7f8ce0072300 msgr2=0x7f8ce0072710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:58:37.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.271+0000 7f8ce51f0640 1 -- 172.21.15.72:0/1411119961 shutdown_connections 2024-05-09T05:58:37.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.271+0000 7f8ce51f0640 1 -- 172.21.15.72:0/1411119961 wait complete. 2024-05-09T05:58:37.278 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":186,"stamp":"2024-05-09T05:58:36.602970+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3830211560,"num_objects":1014,"num_object_clones":0,"num_object_copies":3854,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1014,"num_whiteouts":0,"num_read":219,"num_read_kb":214,"num_write":8760,"num_write_kb":25167790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9209,"ondisk_log_size":9209,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":10157832,"kb_used_data":9726088,"kb_used_omap":12,"kb_used_meta":425523,"kb_avail":744816888,"statfs":{"total":773094113280,"available":762692493312,"internally_reserved":0,"allocated":9959514112,"data_stored":9957840136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":435736113},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,3,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6908003453,"num_objects":-1647,"num_object_clones":0,"num_object_copies":-6588,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1647,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":1670,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005632"},"pg_stats":[{"pgid":"2.1f","version":"29'15","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:56:49.474376+0000","last_change":"2024-05-09T05:53:23.121824+0000","last_active":"2024-05-09T05:56:49.474376+0000","last_peered":"2024-05-09T05:56:49.474376+0000","last_clean":"2024-05-09T05:56:49.474376+0000","last_became_active":"2024-05-09T05:53:23.121097+0000","last_became_peered":"2024-05-09T05:53:23.121097+0000","last_unstale":"2024-05-09T05:56:49.474376+0000","last_undegraded":"2024-05-09T05:56:49.474376+0000","last_fullsized":"2024-05-09T05:56:49.474376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:50:51.880238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"29'5","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.177886+0000","last_change":"2024-05-09T05:53:24.146985+0000","last_active":"2024-05-09T05:58:30.177886+0000","last_peered":"2024-05-09T05:58:30.177886+0000","last_clean":"2024-05-09T05:58:30.177886+0000","last_became_active":"2024-05-09T05:53:24.146540+0000","last_became_peered":"2024-05-09T05:53:24.146540+0000","last_unstale":"2024-05-09T05:58:30.177886+0000","last_undegraded":"2024-05-09T05:58:30.177886+0000","last_fullsized":"2024-05-09T05:58:30.177886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:02:29.318131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"29'273","reported_seq":297,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.709963+0000","last_change":"2024-05-09T05:53:28.236386+0000","last_active":"2024-05-09T05:58:31.709963+0000","last_peered":"2024-05-09T05:58:31.709963+0000","last_clean":"2024-05-09T05:58:31.709963+0000","last_became_active":"2024-05-09T05:53:28.235305+0000","last_became_peered":"2024-05-09T05:53:28.235305+0000","last_unstale":"2024-05-09T05:58:31.709963+0000","last_undegraded":"2024-05-09T05:58:31.709963+0000","last_fullsized":"2024-05-09T05:58:31.709963+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:57:57.134819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":835584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"25'2","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:56:44.380636+0000","last_change":"2024-05-09T05:53:23.139000+0000","last_active":"2024-05-09T05:56:44.380636+0000","last_peered":"2024-05-09T05:56:44.380636+0000","last_clean":"2024-05-09T05:56:44.380636+0000","last_became_active":"2024-05-09T05:53:23.138431+0000","last_became_peered":"2024-05-09T05:53:23.138431+0000","last_unstale":"2024-05-09T05:56:44.380636+0000","last_undegraded":"2024-05-09T05:56:44.380636+0000","last_fullsized":"2024-05-09T05:56:44.380636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:33:56.977263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"29'6","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.184685+0000","last_change":"2024-05-09T05:53:24.151811+0000","last_active":"2024-05-09T05:58:30.184685+0000","last_peered":"2024-05-09T05:58:30.184685+0000","last_clean":"2024-05-09T05:58:30.184685+0000","last_became_active":"2024-05-09T05:53:24.151407+0000","last_became_peered":"2024-05-09T05:53:24.151407+0000","last_unstale":"2024-05-09T05:58:30.184685+0000","last_undegraded":"2024-05-09T05:58:30.184685+0000","last_fullsized":"2024-05-09T05:58:30.184685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:54:17.819787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"29'297","reported_seq":321,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.701764+0000","last_change":"2024-05-09T05:53:28.213485+0000","last_active":"2024-05-09T05:58:31.701764+0000","last_peered":"2024-05-09T05:58:31.701764+0000","last_clean":"2024-05-09T05:58:31.701764+0000","last_became_active":"2024-05-09T05:53:28.213021+0000","last_became_peered":"2024-05-09T05:53:28.213021+0000","last_unstale":"2024-05-09T05:58:31.701764+0000","last_undegraded":"2024-05-09T05:58:31.701764+0000","last_fullsized":"2024-05-09T05:58:31.701764+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:58:22.493166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":176160768,"num_objects":42,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":297,"num_write_kb":925696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"29'15","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:57:10.712258+0000","last_change":"2024-05-09T05:53:23.095209+0000","last_active":"2024-05-09T05:57:10.712258+0000","last_peered":"2024-05-09T05:57:10.712258+0000","last_clean":"2024-05-09T05:57:10.712258+0000","last_became_active":"2024-05-09T05:53:23.094826+0000","last_became_peered":"2024-05-09T05:53:23.094826+0000","last_unstale":"2024-05-09T05:57:10.712258+0000","last_undegraded":"2024-05-09T05:57:10.712258+0000","last_fullsized":"2024-05-09T05:57:10.712258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:38:47.390311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"29'9","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.147951+0000","last_change":"2024-05-09T05:53:24.135281+0000","last_active":"2024-05-09T05:58:30.147951+0000","last_peered":"2024-05-09T05:58:30.147951+0000","last_clean":"2024-05-09T05:58:30.147951+0000","last_became_active":"2024-05-09T05:53:24.134610+0000","last_became_peered":"2024-05-09T05:53:24.134610+0000","last_unstale":"2024-05-09T05:58:30.147951+0000","last_undegraded":"2024-05-09T05:58:30.147951+0000","last_fullsized":"2024-05-09T05:58:30.147951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:28:03.947961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"29'232","reported_seq":256,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.632959+0000","last_change":"2024-05-09T05:53:28.205763+0000","last_active":"2024-05-09T05:58:31.632959+0000","last_peered":"2024-05-09T05:58:31.632959+0000","last_clean":"2024-05-09T05:58:31.632959+0000","last_became_active":"2024-05-09T05:53:28.205229+0000","last_became_peered":"2024-05-09T05:53:28.205229+0000","last_unstale":"2024-05-09T05:58:31.632959+0000","last_undegraded":"2024-05-09T05:58:31.632959+0000","last_fullsized":"2024-05-09T05:58:31.632959+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:38:51.267769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171966464,"num_objects":41,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"27'5","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:57:10.703703+0000","last_change":"2024-05-09T05:53:23.097616+0000","last_active":"2024-05-09T05:57:10.703703+0000","last_peered":"2024-05-09T05:57:10.703703+0000","last_clean":"2024-05-09T05:57:10.703703+0000","last_became_active":"2024-05-09T05:53:23.094760+0000","last_became_peered":"2024-05-09T05:53:23.094760+0000","last_unstale":"2024-05-09T05:57:10.703703+0000","last_undegraded":"2024-05-09T05:57:10.703703+0000","last_fullsized":"2024-05-09T05:57:10.703703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:21:32.558852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"29'15","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.160427+0000","last_change":"2024-05-09T05:53:24.139467+0000","last_active":"2024-05-09T05:58:30.160427+0000","last_peered":"2024-05-09T05:58:30.160427+0000","last_clean":"2024-05-09T05:58:30.160427+0000","last_became_active":"2024-05-09T05:53:24.139109+0000","last_became_peered":"2024-05-09T05:53:24.139109+0000","last_unstale":"2024-05-09T05:58:30.160427+0000","last_undegraded":"2024-05-09T05:58:30.160427+0000","last_fullsized":"2024-05-09T05:58:30.160427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:36.783615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"29'220","reported_seq":244,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.644680+0000","last_change":"2024-05-09T05:53:28.216127+0000","last_active":"2024-05-09T05:58:31.644680+0000","last_peered":"2024-05-09T05:58:31.644680+0000","last_clean":"2024-05-09T05:58:31.644680+0000","last_became_active":"2024-05-09T05:53:28.215482+0000","last_became_peered":"2024-05-09T05:53:28.215482+0000","last_unstale":"2024-05-09T05:58:31.644680+0000","last_undegraded":"2024-05-09T05:58:31.644680+0000","last_fullsized":"2024-05-09T05:58:31.644680+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:48:58.387701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":688128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"29'5","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.160135+0000","last_change":"2024-05-09T05:53:24.132483+0000","last_active":"2024-05-09T05:58:30.160135+0000","last_peered":"2024-05-09T05:58:30.160135+0000","last_clean":"2024-05-09T05:58:30.160135+0000","last_became_active":"2024-05-09T05:53:24.132118+0000","last_became_peered":"2024-05-09T05:53:24.132118+0000","last_unstale":"2024-05-09T05:58:30.160135+0000","last_undegraded":"2024-05-09T05:58:30.160135+0000","last_fullsized":"2024-05-09T05:58:30.160135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:06:01.787707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:56:45.401141+0000","last_change":"2024-05-09T05:53:23.117460+0000","last_active":"2024-05-09T05:56:45.401141+0000","last_peered":"2024-05-09T05:56:45.401141+0000","last_clean":"2024-05-09T05:56:45.401141+0000","last_became_active":"2024-05-09T05:53:23.114179+0000","last_became_peered":"2024-05-09T05:53:23.114179+0000","last_unstale":"2024-05-09T05:56:45.401141+0000","last_undegraded":"2024-05-09T05:56:45.401141+0000","last_fullsized":"2024-05-09T05:56:45.401141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:44:01.784905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"29'309","reported_seq":333,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:32.986876+0000","last_change":"2024-05-09T05:53:28.227135+0000","last_active":"2024-05-09T05:58:32.986876+0000","last_peered":"2024-05-09T05:58:32.986876+0000","last_clean":"2024-05-09T05:58:32.986876+0000","last_became_active":"2024-05-09T05:53:28.226427+0000","last_became_peered":"2024-05-09T05:53:28.226427+0000","last_unstale":"2024-05-09T05:58:32.986876+0000","last_undegraded":"2024-05-09T05:58:32.986876+0000","last_fullsized":"2024-05-09T05:58:32.986876+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:37:04.413804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":309,"num_write_kb":843776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"29'8","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.188143+0000","last_change":"2024-05-09T05:53:24.135982+0000","last_active":"2024-05-09T05:58:30.188143+0000","last_peered":"2024-05-09T05:58:30.188143+0000","last_clean":"2024-05-09T05:58:30.188143+0000","last_became_active":"2024-05-09T05:53:24.135580+0000","last_became_peered":"2024-05-09T05:53:24.135580+0000","last_unstale":"2024-05-09T05:58:30.188143+0000","last_undegraded":"2024-05-09T05:58:30.188143+0000","last_fullsized":"2024-05-09T05:58:30.188143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:03:04.589608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"27'3","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:56:44.379284+0000","last_change":"2024-05-09T05:53:23.142679+0000","last_active":"2024-05-09T05:56:44.379284+0000","last_peered":"2024-05-09T05:56:44.379284+0000","last_clean":"2024-05-09T05:56:44.379284+0000","last_became_active":"2024-05-09T05:53:23.142018+0000","last_became_peered":"2024-05-09T05:53:23.142018+0000","last_unstale":"2024-05-09T05:56:44.379284+0000","last_undegraded":"2024-05-09T05:56:44.379284+0000","last_fullsized":"2024-05-09T05:56:44.379284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:08:29.312049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"29'248","reported_seq":272,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.662278+0000","last_change":"2024-05-09T05:53:28.214167+0000","last_active":"2024-05-09T05:58:31.662278+0000","last_peered":"2024-05-09T05:58:31.662278+0000","last_clean":"2024-05-09T05:58:31.662278+0000","last_became_active":"2024-05-09T05:53:28.213623+0000","last_became_peered":"2024-05-09T05:53:28.213623+0000","last_unstale":"2024-05-09T05:58:31.662278+0000","last_undegraded":"2024-05-09T05:58:31.662278+0000","last_fullsized":"2024-05-09T05:58:31.662278+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:53:53.976485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180355072,"num_objects":43,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":794624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"29'9","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.191092+0000","last_change":"2024-05-09T05:53:24.130342+0000","last_active":"2024-05-09T05:58:30.191092+0000","last_peered":"2024-05-09T05:58:30.191092+0000","last_clean":"2024-05-09T05:58:30.191092+0000","last_became_active":"2024-05-09T05:53:24.129938+0000","last_became_peered":"2024-05-09T05:53:24.129938+0000","last_unstale":"2024-05-09T05:58:30.191092+0000","last_undegraded":"2024-05-09T05:58:30.191092+0000","last_fullsized":"2024-05-09T05:58:30.191092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:58:13.879633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"27'7","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:57:10.705303+0000","last_change":"2024-05-09T05:53:23.111169+0000","last_active":"2024-05-09T05:57:10.705303+0000","last_peered":"2024-05-09T05:57:10.705303+0000","last_clean":"2024-05-09T05:57:10.705303+0000","last_became_active":"2024-05-09T05:53:23.110140+0000","last_became_peered":"2024-05-09T05:53:23.110140+0000","last_unstale":"2024-05-09T05:57:10.705303+0000","last_undegraded":"2024-05-09T05:57:10.705303+0000","last_fullsized":"2024-05-09T05:57:10.705303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:18:55.367553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"29'223","reported_seq":247,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.680856+0000","last_change":"2024-05-09T05:53:28.233648+0000","last_active":"2024-05-09T05:58:31.680856+0000","last_peered":"2024-05-09T05:58:31.680856+0000","last_clean":"2024-05-09T05:58:31.680856+0000","last_became_active":"2024-05-09T05:53:28.227087+0000","last_became_peered":"2024-05-09T05:53:28.227087+0000","last_unstale":"2024-05-09T05:58:31.680856+0000","last_undegraded":"2024-05-09T05:58:31.680856+0000","last_fullsized":"2024-05-09T05:58:31.680856+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:03:49.709580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184549376,"num_objects":44,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":223,"num_write_kb":729088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"29'2","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.125901+0000","last_change":"2024-05-09T05:53:24.147343+0000","last_active":"2024-05-09T05:58:30.125901+0000","last_peered":"2024-05-09T05:58:30.125901+0000","last_clean":"2024-05-09T05:58:30.125901+0000","last_became_active":"2024-05-09T05:53:24.144596+0000","last_became_peered":"2024-05-09T05:53:24.144596+0000","last_unstale":"2024-05-09T05:58:30.125901+0000","last_undegraded":"2024-05-09T05:58:30.125901+0000","last_fullsized":"2024-05-09T05:58:30.125901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:52:43.052055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"25'2","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:56:44.377895+0000","last_change":"2024-05-09T05:53:23.102976+0000","last_active":"2024-05-09T05:56:44.377895+0000","last_peered":"2024-05-09T05:56:44.377895+0000","last_clean":"2024-05-09T05:56:44.377895+0000","last_became_active":"2024-05-09T05:53:23.102420+0000","last_became_peered":"2024-05-09T05:53:23.102420+0000","last_unstale":"2024-05-09T05:56:44.377895+0000","last_undegraded":"2024-05-09T05:56:44.377895+0000","last_fullsized":"2024-05-09T05:56:44.377895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:45:11.479140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"29'240","reported_seq":264,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.647707+0000","last_change":"2024-05-09T05:53:28.195537+0000","last_active":"2024-05-09T05:58:31.647707+0000","last_peered":"2024-05-09T05:58:31.647707+0000","last_clean":"2024-05-09T05:58:31.647707+0000","last_became_active":"2024-05-09T05:53:28.194915+0000","last_became_peered":"2024-05-09T05:53:28.194915+0000","last_unstale":"2024-05-09T05:58:31.647707+0000","last_undegraded":"2024-05-09T05:58:31.647707+0000","last_fullsized":"2024-05-09T05:58:31.647707+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:07.554137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201326592,"num_objects":48,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":786432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"29'7","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.191355+0000","last_change":"2024-05-09T05:53:24.130312+0000","last_active":"2024-05-09T05:58:30.191355+0000","last_peered":"2024-05-09T05:58:30.191355+0000","last_clean":"2024-05-09T05:58:30.191355+0000","last_became_active":"2024-05-09T05:53:24.129953+0000","last_became_peered":"2024-05-09T05:53:24.129953+0000","last_unstale":"2024-05-09T05:58:30.191355+0000","last_undegraded":"2024-05-09T05:58:30.191355+0000","last_fullsized":"2024-05-09T05:58:30.191355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:07:09.368521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"29'8","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:57:43.751407+0000","last_change":"2024-05-09T05:53:23.127219+0000","last_active":"2024-05-09T05:57:43.751407+0000","last_peered":"2024-05-09T05:57:43.751407+0000","last_clean":"2024-05-09T05:57:43.751407+0000","last_became_active":"2024-05-09T05:53:23.126691+0000","last_became_peered":"2024-05-09T05:53:23.126691+0000","last_unstale":"2024-05-09T05:57:43.751407+0000","last_undegraded":"2024-05-09T05:57:43.751407+0000","last_fullsized":"2024-05-09T05:57:43.751407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:17:26.711941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"29'222","reported_seq":246,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.672382+0000","last_change":"2024-05-09T05:53:28.191045+0000","last_active":"2024-05-09T05:58:31.672382+0000","last_peered":"2024-05-09T05:58:31.672382+0000","last_clean":"2024-05-09T05:58:31.672382+0000","last_became_active":"2024-05-09T05:53:28.190564+0000","last_became_peered":"2024-05-09T05:53:28.190564+0000","last_unstale":"2024-05-09T05:58:31.672382+0000","last_undegraded":"2024-05-09T05:58:31.672382+0000","last_fullsized":"2024-05-09T05:58:31.672382+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:53:30.541681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":679936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"29'5","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.191251+0000","last_change":"2024-05-09T05:53:24.138682+0000","last_active":"2024-05-09T05:58:30.191251+0000","last_peered":"2024-05-09T05:58:30.191251+0000","last_clean":"2024-05-09T05:58:30.191251+0000","last_became_active":"2024-05-09T05:53:24.138417+0000","last_became_peered":"2024-05-09T05:53:24.138417+0000","last_unstale":"2024-05-09T05:58:30.191251+0000","last_undegraded":"2024-05-09T05:58:30.191251+0000","last_fullsized":"2024-05-09T05:58:30.191251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:57:55.403156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"29'27","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:29.274497+0000","last_change":"2024-05-09T05:53:23.102986+0000","last_active":"2024-05-09T05:58:29.274497+0000","last_peered":"2024-05-09T05:58:29.274497+0000","last_clean":"2024-05-09T05:58:29.274497+0000","last_became_active":"2024-05-09T05:53:23.102020+0000","last_became_peered":"2024-05-09T05:53:23.102020+0000","last_unstale":"2024-05-09T05:58:29.274497+0000","last_undegraded":"2024-05-09T05:58:29.274497+0000","last_fullsized":"2024-05-09T05:58:29.274497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:18:11.582575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"29'227","reported_seq":251,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.719078+0000","last_change":"2024-05-09T05:53:28.218326+0000","last_active":"2024-05-09T05:58:31.719078+0000","last_peered":"2024-05-09T05:58:31.719078+0000","last_clean":"2024-05-09T05:58:31.719078+0000","last_became_active":"2024-05-09T05:53:28.216634+0000","last_became_peered":"2024-05-09T05:53:28.216634+0000","last_unstale":"2024-05-09T05:58:31.719078+0000","last_undegraded":"2024-05-09T05:58:31.719078+0000","last_fullsized":"2024-05-09T05:58:31.719078+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:13:05.321932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155189248,"num_objects":37,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":227,"num_write_kb":720896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"29'9","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.180943+0000","last_change":"2024-05-09T05:53:24.143161+0000","last_active":"2024-05-09T05:58:30.180943+0000","last_peered":"2024-05-09T05:58:30.180943+0000","last_clean":"2024-05-09T05:58:30.180943+0000","last_became_active":"2024-05-09T05:53:24.139369+0000","last_became_peered":"2024-05-09T05:53:24.139369+0000","last_unstale":"2024-05-09T05:58:30.180943+0000","last_undegraded":"2024-05-09T05:58:30.180943+0000","last_fullsized":"2024-05-09T05:58:30.180943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:25:21.472460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"27'4","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:56:49.370643+0000","last_change":"2024-05-09T05:53:23.123560+0000","last_active":"2024-05-09T05:56:49.370643+0000","last_peered":"2024-05-09T05:56:49.370643+0000","last_clean":"2024-05-09T05:56:49.370643+0000","last_became_active":"2024-05-09T05:53:23.123081+0000","last_became_peered":"2024-05-09T05:53:23.123081+0000","last_unstale":"2024-05-09T05:56:49.370643+0000","last_undegraded":"2024-05-09T05:56:49.370643+0000","last_fullsized":"2024-05-09T05:56:49.370643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:15:31.371756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"29'211","reported_seq":235,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.674405+0000","last_change":"2024-05-09T05:53:28.229352+0000","last_active":"2024-05-09T05:58:31.674405+0000","last_peered":"2024-05-09T05:58:31.674405+0000","last_clean":"2024-05-09T05:58:31.674405+0000","last_became_active":"2024-05-09T05:53:28.225810+0000","last_became_peered":"2024-05-09T05:53:28.225810+0000","last_unstale":"2024-05-09T05:58:31.674405+0000","last_undegraded":"2024-05-09T05:58:31.674405+0000","last_fullsized":"2024-05-09T05:58:31.674405+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:17:07.192105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159383552,"num_objects":38,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":211,"num_write_kb":679936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"29'5","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.146938+0000","last_change":"2024-05-09T05:53:24.130533+0000","last_active":"2024-05-09T05:58:30.146938+0000","last_peered":"2024-05-09T05:58:30.146938+0000","last_clean":"2024-05-09T05:58:30.146938+0000","last_became_active":"2024-05-09T05:53:24.129787+0000","last_became_peered":"2024-05-09T05:53:24.129787+0000","last_unstale":"2024-05-09T05:58:30.146938+0000","last_undegraded":"2024-05-09T05:58:30.146938+0000","last_fullsized":"2024-05-09T05:58:30.146938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:37:36.036271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"26'1","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:56:44.379023+0000","last_change":"2024-05-09T05:53:23.134379+0000","last_active":"2024-05-09T05:56:44.379023+0000","last_peered":"2024-05-09T05:56:44.379023+0000","last_clean":"2024-05-09T05:56:44.379023+0000","last_became_active":"2024-05-09T05:53:23.133587+0000","last_became_peered":"2024-05-09T05:53:23.133587+0000","last_unstale":"2024-05-09T05:56:44.379023+0000","last_undegraded":"2024-05-09T05:56:44.379023+0000","last_fullsized":"2024-05-09T05:56:44.379023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:00:33.973787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"29'228","reported_seq":252,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.725996+0000","last_change":"2024-05-09T05:53:28.233620+0000","last_active":"2024-05-09T05:58:31.725996+0000","last_peered":"2024-05-09T05:58:31.725996+0000","last_clean":"2024-05-09T05:58:31.725996+0000","last_became_active":"2024-05-09T05:53:28.232539+0000","last_became_peered":"2024-05-09T05:53:28.232539+0000","last_unstale":"2024-05-09T05:58:31.725996+0000","last_undegraded":"2024-05-09T05:58:31.725996+0000","last_fullsized":"2024-05-09T05:58:31.725996+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":228,"log_dups_size":0,"ondisk_log_size":228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:13.789448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188743680,"num_objects":45,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":228,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"29'7","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.144931+0000","last_change":"2024-05-09T05:53:24.132702+0000","last_active":"2024-05-09T05:58:30.144931+0000","last_peered":"2024-05-09T05:58:30.144931+0000","last_clean":"2024-05-09T05:58:30.144931+0000","last_became_active":"2024-05-09T05:53:24.132309+0000","last_became_peered":"2024-05-09T05:53:24.132309+0000","last_unstale":"2024-05-09T05:58:30.144931+0000","last_undegraded":"2024-05-09T05:58:30.144931+0000","last_fullsized":"2024-05-09T05:58:30.144931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:53:13.592038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"29'7","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:57:10.708672+0000","last_change":"2024-05-09T05:53:23.120384+0000","last_active":"2024-05-09T05:57:10.708672+0000","last_peered":"2024-05-09T05:57:10.708672+0000","last_clean":"2024-05-09T05:57:10.708672+0000","last_became_active":"2024-05-09T05:53:23.118321+0000","last_became_peered":"2024-05-09T05:53:23.118321+0000","last_unstale":"2024-05-09T05:57:10.708672+0000","last_undegraded":"2024-05-09T05:57:10.708672+0000","last_fullsized":"2024-05-09T05:57:10.708672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:15:51.297111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":14,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'227","reported_seq":251,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.747888+0000","last_change":"2024-05-09T05:53:28.208383+0000","last_active":"2024-05-09T05:58:31.747888+0000","last_peered":"2024-05-09T05:58:31.747888+0000","last_clean":"2024-05-09T05:58:31.747888+0000","last_became_active":"2024-05-09T05:53:28.199359+0000","last_became_peered":"2024-05-09T05:53:28.199359+0000","last_unstale":"2024-05-09T05:58:31.747888+0000","last_undegraded":"2024-05-09T05:58:31.747888+0000","last_fullsized":"2024-05-09T05:58:31.747888+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:50:19.715242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155189248,"num_objects":37,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":227,"num_write_kb":720896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"29'8","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.189540+0000","last_change":"2024-05-09T05:53:24.142740+0000","last_active":"2024-05-09T05:58:30.189540+0000","last_peered":"2024-05-09T05:58:30.189540+0000","last_clean":"2024-05-09T05:58:30.189540+0000","last_became_active":"2024-05-09T05:53:24.142265+0000","last_became_peered":"2024-05-09T05:53:24.142265+0000","last_unstale":"2024-05-09T05:58:30.189540+0000","last_undegraded":"2024-05-09T05:58:30.189540+0000","last_fullsized":"2024-05-09T05:58:30.189540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:46:53.729151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"29'13","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.475397+0000","last_change":"2024-05-09T05:53:23.142455+0000","last_active":"2024-05-09T05:58:30.475397+0000","last_peered":"2024-05-09T05:58:30.475397+0000","last_clean":"2024-05-09T05:58:30.475397+0000","last_became_active":"2024-05-09T05:53:23.141770+0000","last_became_peered":"2024-05-09T05:53:23.141770+0000","last_unstale":"2024-05-09T05:58:30.475397+0000","last_undegraded":"2024-05-09T05:58:30.475397+0000","last_fullsized":"2024-05-09T05:58:30.475397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:30:34.301349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":641,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"29'227","reported_seq":251,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.701157+0000","last_change":"2024-05-09T05:53:28.212176+0000","last_active":"2024-05-09T05:58:31.701157+0000","last_peered":"2024-05-09T05:58:31.701157+0000","last_clean":"2024-05-09T05:58:31.701157+0000","last_became_active":"2024-05-09T05:53:28.210981+0000","last_became_peered":"2024-05-09T05:53:28.210981+0000","last_unstale":"2024-05-09T05:58:31.701157+0000","last_undegraded":"2024-05-09T05:58:31.701157+0000","last_fullsized":"2024-05-09T05:58:31.701157+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:17:24.122805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180355072,"num_objects":43,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":227,"num_write_kb":737280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"29'5","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.181917+0000","last_change":"2024-05-09T05:53:24.132887+0000","last_active":"2024-05-09T05:58:30.181917+0000","last_peered":"2024-05-09T05:58:30.181917+0000","last_clean":"2024-05-09T05:58:30.181917+0000","last_became_active":"2024-05-09T05:53:24.132398+0000","last_became_peered":"2024-05-09T05:53:24.132398+0000","last_unstale":"2024-05-09T05:58:30.181917+0000","last_undegraded":"2024-05-09T05:58:30.181917+0000","last_fullsized":"2024-05-09T05:58:30.181917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:36:49.369162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"29'6","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:56:49.477057+0000","last_change":"2024-05-09T05:53:23.126202+0000","last_active":"2024-05-09T05:56:49.477057+0000","last_peered":"2024-05-09T05:56:49.477057+0000","last_clean":"2024-05-09T05:56:49.477057+0000","last_became_active":"2024-05-09T05:53:23.125799+0000","last_became_peered":"2024-05-09T05:53:23.125799+0000","last_unstale":"2024-05-09T05:56:49.477057+0000","last_undegraded":"2024-05-09T05:56:49.477057+0000","last_fullsized":"2024-05-09T05:56:49.477057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:33:12.831705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"29'339","reported_seq":370,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:32.972228+0000","last_change":"2024-05-09T05:54:06.916943+0000","last_active":"2024-05-09T05:58:32.972228+0000","last_peered":"2024-05-09T05:58:32.972228+0000","last_clean":"2024-05-09T05:58:32.972228+0000","last_became_active":"2024-05-09T05:54:06.915734+0000","last_became_peered":"2024-05-09T05:54:06.915734+0000","last_unstale":"2024-05-09T05:58:32.972228+0000","last_undegraded":"2024-05-09T05:58:32.972228+0000","last_fullsized":"2024-05-09T05:58:32.972228+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:59:44.265794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":925696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,6,1],"acting":[5,0,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"29'8","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.179473+0000","last_change":"2024-05-09T05:53:24.139586+0000","last_active":"2024-05-09T05:58:30.179473+0000","last_peered":"2024-05-09T05:58:30.179473+0000","last_clean":"2024-05-09T05:58:30.179473+0000","last_became_active":"2024-05-09T05:53:24.138835+0000","last_became_peered":"2024-05-09T05:53:24.138835+0000","last_unstale":"2024-05-09T05:58:30.179473+0000","last_undegraded":"2024-05-09T05:58:30.179473+0000","last_fullsized":"2024-05-09T05:58:30.179473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:37:13.012588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"27'6","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:56:49.370370+0000","last_change":"2024-05-09T05:53:23.117121+0000","last_active":"2024-05-09T05:56:49.370370+0000","last_peered":"2024-05-09T05:56:49.370370+0000","last_clean":"2024-05-09T05:56:49.370370+0000","last_became_active":"2024-05-09T05:53:23.113294+0000","last_became_peered":"2024-05-09T05:53:23.113294+0000","last_unstale":"2024-05-09T05:56:49.370370+0000","last_undegraded":"2024-05-09T05:56:49.370370+0000","last_fullsized":"2024-05-09T05:56:49.370370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:53:41.591371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":127,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:56:44.385637+0000","last_change":"2024-05-09T05:53:12.484358+0000","last_active":"2024-05-09T05:56:44.385637+0000","last_peered":"2024-05-09T05:56:44.385637+0000","last_clean":"2024-05-09T05:56:44.385637+0000","last_became_active":"2024-05-09T05:53:12.481529+0000","last_became_peered":"2024-05-09T05:53:12.481529+0000","last_unstale":"2024-05-09T05:56:44.385637+0000","last_undegraded":"2024-05-09T05:56:44.385637+0000","last_fullsized":"2024-05-09T05:56:44.385637+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:10.902489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:10.902489+0000","last_clean_scrub_stamp":"2024-05-09T05:53:10.902489+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:28:50.650299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'276","reported_seq":300,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:32.994680+0000","last_change":"2024-05-09T05:53:28.190861+0000","last_active":"2024-05-09T05:58:32.994680+0000","last_peered":"2024-05-09T05:58:32.994680+0000","last_clean":"2024-05-09T05:58:32.994680+0000","last_became_active":"2024-05-09T05:53:28.190393+0000","last_became_peered":"2024-05-09T05:53:28.190393+0000","last_unstale":"2024-05-09T05:58:32.994680+0000","last_undegraded":"2024-05-09T05:58:32.994680+0000","last_fullsized":"2024-05-09T05:58:32.994680+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:05:37.653010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":276,"num_write_kb":753664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"29'7","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.163539+0000","last_change":"2024-05-09T05:53:24.143283+0000","last_active":"2024-05-09T05:58:30.163539+0000","last_peered":"2024-05-09T05:58:30.163539+0000","last_clean":"2024-05-09T05:58:30.163539+0000","last_became_active":"2024-05-09T05:53:24.139813+0000","last_became_peered":"2024-05-09T05:53:24.139813+0000","last_unstale":"2024-05-09T05:58:30.163539+0000","last_undegraded":"2024-05-09T05:58:30.163539+0000","last_fullsized":"2024-05-09T05:58:30.163539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:07:38.471778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"29'7","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:57:56.748839+0000","last_change":"2024-05-09T05:53:23.115534+0000","last_active":"2024-05-09T05:57:56.748839+0000","last_peered":"2024-05-09T05:57:56.748839+0000","last_clean":"2024-05-09T05:57:56.748839+0000","last_became_active":"2024-05-09T05:53:23.112260+0000","last_became_peered":"2024-05-09T05:53:23.112260+0000","last_unstale":"2024-05-09T05:57:56.748839+0000","last_undegraded":"2024-05-09T05:57:56.748839+0000","last_fullsized":"2024-05-09T05:57:56.748839+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:46:53.520691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"29'242","reported_seq":266,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.710353+0000","last_change":"2024-05-09T05:53:28.195687+0000","last_active":"2024-05-09T05:58:31.710353+0000","last_peered":"2024-05-09T05:58:31.710353+0000","last_clean":"2024-05-09T05:58:31.710353+0000","last_became_active":"2024-05-09T05:53:28.195082+0000","last_became_peered":"2024-05-09T05:53:28.195082+0000","last_unstale":"2024-05-09T05:58:31.710353+0000","last_undegraded":"2024-05-09T05:58:31.710353+0000","last_fullsized":"2024-05-09T05:58:31.710353+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:45:56.633547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155189248,"num_objects":37,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":242,"num_write_kb":761856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"29'6","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.185190+0000","last_change":"2024-05-09T05:53:24.130460+0000","last_active":"2024-05-09T05:58:30.185190+0000","last_peered":"2024-05-09T05:58:30.185190+0000","last_clean":"2024-05-09T05:58:30.185190+0000","last_became_active":"2024-05-09T05:53:24.129808+0000","last_became_peered":"2024-05-09T05:53:24.129808+0000","last_unstale":"2024-05-09T05:58:30.185190+0000","last_undegraded":"2024-05-09T05:58:30.185190+0000","last_fullsized":"2024-05-09T05:58:30.185190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:36:04.881676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:56:49.475046+0000","last_change":"2024-05-09T05:53:23.139063+0000","last_active":"2024-05-09T05:56:49.475046+0000","last_peered":"2024-05-09T05:56:49.475046+0000","last_clean":"2024-05-09T05:56:49.475046+0000","last_became_active":"2024-05-09T05:53:23.138303+0000","last_became_peered":"2024-05-09T05:53:23.138303+0000","last_unstale":"2024-05-09T05:56:49.475046+0000","last_undegraded":"2024-05-09T05:56:49.475046+0000","last_fullsized":"2024-05-09T05:56:49.475046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:18:20.172877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"29'261","reported_seq":285,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:33.010968+0000","last_change":"2024-05-09T05:53:28.214251+0000","last_active":"2024-05-09T05:58:33.010968+0000","last_peered":"2024-05-09T05:58:33.010968+0000","last_clean":"2024-05-09T05:58:33.010968+0000","last_became_active":"2024-05-09T05:53:28.206229+0000","last_became_peered":"2024-05-09T05:53:28.206229+0000","last_unstale":"2024-05-09T05:58:33.010968+0000","last_undegraded":"2024-05-09T05:58:33.010968+0000","last_fullsized":"2024-05-09T05:58:33.010968+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":261,"log_dups_size":0,"ondisk_log_size":261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:12:26.761543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":261,"num_write_kb":712704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"29'9","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.148788+0000","last_change":"2024-05-09T05:53:24.135578+0000","last_active":"2024-05-09T05:58:30.148788+0000","last_peered":"2024-05-09T05:58:30.148788+0000","last_clean":"2024-05-09T05:58:30.148788+0000","last_became_active":"2024-05-09T05:53:24.135253+0000","last_became_peered":"2024-05-09T05:53:24.135253+0000","last_unstale":"2024-05-09T05:58:30.148788+0000","last_undegraded":"2024-05-09T05:58:30.148788+0000","last_fullsized":"2024-05-09T05:58:30.148788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:20:23.093397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"27'5","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:57:10.701585+0000","last_change":"2024-05-09T05:53:23.140175+0000","last_active":"2024-05-09T05:57:10.701585+0000","last_peered":"2024-05-09T05:57:10.701585+0000","last_clean":"2024-05-09T05:57:10.701585+0000","last_became_active":"2024-05-09T05:53:23.139516+0000","last_became_peered":"2024-05-09T05:53:23.139516+0000","last_unstale":"2024-05-09T05:57:10.701585+0000","last_undegraded":"2024-05-09T05:57:10.701585+0000","last_fullsized":"2024-05-09T05:57:10.701585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:48:42.473155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"29'318","reported_seq":342,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:32.979280+0000","last_change":"2024-05-09T05:53:28.199385+0000","last_active":"2024-05-09T05:58:32.979280+0000","last_peered":"2024-05-09T05:58:32.979280+0000","last_clean":"2024-05-09T05:58:32.979280+0000","last_became_active":"2024-05-09T05:53:28.198825+0000","last_became_peered":"2024-05-09T05:53:28.198825+0000","last_unstale":"2024-05-09T05:58:32.979280+0000","last_undegraded":"2024-05-09T05:58:32.979280+0000","last_fullsized":"2024-05-09T05:58:32.979280+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:48:22.224140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":318,"num_write_kb":868352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"29'5","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.131274+0000","last_change":"2024-05-09T05:53:24.133293+0000","last_active":"2024-05-09T05:58:30.131274+0000","last_peered":"2024-05-09T05:58:30.131274+0000","last_clean":"2024-05-09T05:58:30.131274+0000","last_became_active":"2024-05-09T05:53:24.131741+0000","last_became_peered":"2024-05-09T05:53:24.131741+0000","last_unstale":"2024-05-09T05:58:30.131274+0000","last_undegraded":"2024-05-09T05:58:30.131274+0000","last_fullsized":"2024-05-09T05:58:30.131274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:01:33.701742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"26'2","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:56:44.378626+0000","last_change":"2024-05-09T05:53:23.112592+0000","last_active":"2024-05-09T05:56:44.378626+0000","last_peered":"2024-05-09T05:56:44.378626+0000","last_clean":"2024-05-09T05:56:44.378626+0000","last_became_active":"2024-05-09T05:53:23.111968+0000","last_became_peered":"2024-05-09T05:53:23.111968+0000","last_unstale":"2024-05-09T05:56:44.378626+0000","last_undegraded":"2024-05-09T05:56:44.378626+0000","last_fullsized":"2024-05-09T05:56:44.378626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:32:54.694588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"29'225","reported_seq":249,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.547246+0000","last_change":"2024-05-09T05:53:28.227755+0000","last_active":"2024-05-09T05:58:31.547246+0000","last_peered":"2024-05-09T05:58:31.547246+0000","last_clean":"2024-05-09T05:58:31.547246+0000","last_became_active":"2024-05-09T05:53:28.227272+0000","last_became_peered":"2024-05-09T05:53:28.227272+0000","last_unstale":"2024-05-09T05:58:31.547246+0000","last_undegraded":"2024-05-09T05:58:31.547246+0000","last_fullsized":"2024-05-09T05:58:31.547246+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":225,"log_dups_size":0,"ondisk_log_size":225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:13:32.020862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":225,"num_write_kb":704512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"29'6","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.158182+0000","last_change":"2024-05-09T05:53:24.144025+0000","last_active":"2024-05-09T05:58:30.158182+0000","last_peered":"2024-05-09T05:58:30.158182+0000","last_clean":"2024-05-09T05:58:30.158182+0000","last_became_active":"2024-05-09T05:53:24.143540+0000","last_became_peered":"2024-05-09T05:53:24.143540+0000","last_unstale":"2024-05-09T05:58:30.158182+0000","last_undegraded":"2024-05-09T05:58:30.158182+0000","last_fullsized":"2024-05-09T05:58:30.158182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:22:58.062541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"29'20","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:06.736201+0000","last_change":"2024-05-09T05:53:23.104452+0000","last_active":"2024-05-09T05:58:06.736201+0000","last_peered":"2024-05-09T05:58:06.736201+0000","last_clean":"2024-05-09T05:58:06.736201+0000","last_became_active":"2024-05-09T05:53:23.103471+0000","last_became_peered":"2024-05-09T05:53:23.103471+0000","last_unstale":"2024-05-09T05:58:06.736201+0000","last_undegraded":"2024-05-09T05:58:06.736201+0000","last_fullsized":"2024-05-09T05:58:06.736201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:33:30.508464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"29'360","reported_seq":384,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:33.029867+0000","last_change":"2024-05-09T05:53:28.241338+0000","last_active":"2024-05-09T05:58:33.029867+0000","last_peered":"2024-05-09T05:58:33.029867+0000","last_clean":"2024-05-09T05:58:33.029867+0000","last_became_active":"2024-05-09T05:53:28.239841+0000","last_became_peered":"2024-05-09T05:53:28.239841+0000","last_unstale":"2024-05-09T05:58:33.029867+0000","last_undegraded":"2024-05-09T05:58:33.029867+0000","last_fullsized":"2024-05-09T05:58:33.029867+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:44:47.854598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":360,"num_write_kb":983040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"29'6","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.181244+0000","last_change":"2024-05-09T05:53:24.149958+0000","last_active":"2024-05-09T05:58:30.181244+0000","last_peered":"2024-05-09T05:58:30.181244+0000","last_clean":"2024-05-09T05:58:30.181244+0000","last_became_active":"2024-05-09T05:53:24.149578+0000","last_became_peered":"2024-05-09T05:53:24.149578+0000","last_unstale":"2024-05-09T05:58:30.181244+0000","last_undegraded":"2024-05-09T05:58:30.181244+0000","last_fullsized":"2024-05-09T05:58:30.181244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:27:43.555218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"29'7","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:06.727523+0000","last_change":"2024-05-09T05:53:23.121266+0000","last_active":"2024-05-09T05:58:06.727523+0000","last_peered":"2024-05-09T05:58:06.727523+0000","last_clean":"2024-05-09T05:58:06.727523+0000","last_became_active":"2024-05-09T05:53:23.120857+0000","last_became_peered":"2024-05-09T05:53:23.120857+0000","last_unstale":"2024-05-09T05:58:06.727523+0000","last_undegraded":"2024-05-09T05:58:06.727523+0000","last_fullsized":"2024-05-09T05:58:06.727523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:03:30.185640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"29'273","reported_seq":297,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:33.018216+0000","last_change":"2024-05-09T05:53:28.240774+0000","last_active":"2024-05-09T05:58:33.018216+0000","last_peered":"2024-05-09T05:58:33.018216+0000","last_clean":"2024-05-09T05:58:33.018216+0000","last_became_active":"2024-05-09T05:53:28.240070+0000","last_became_peered":"2024-05-09T05:53:28.240070+0000","last_unstale":"2024-05-09T05:58:33.018216+0000","last_undegraded":"2024-05-09T05:58:33.018216+0000","last_fullsized":"2024-05-09T05:58:33.018216+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:25:24.019344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"29'15","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.166939+0000","last_change":"2024-05-09T05:54:06.645397+0000","last_active":"2024-05-09T05:58:30.166939+0000","last_peered":"2024-05-09T05:58:30.166939+0000","last_clean":"2024-05-09T05:58:30.166939+0000","last_became_active":"2024-05-09T05:54:06.644437+0000","last_became_peered":"2024-05-09T05:54:06.644437+0000","last_unstale":"2024-05-09T05:58:30.166939+0000","last_undegraded":"2024-05-09T05:58:30.166939+0000","last_fullsized":"2024-05-09T05:58:30.166939+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:41:52.843192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'5","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:56:49.370721+0000","last_change":"2024-05-09T05:53:23.120680+0000","last_active":"2024-05-09T05:56:49.370721+0000","last_peered":"2024-05-09T05:56:49.370721+0000","last_clean":"2024-05-09T05:56:49.370721+0000","last_became_active":"2024-05-09T05:53:23.118358+0000","last_became_peered":"2024-05-09T05:53:23.118358+0000","last_unstale":"2024-05-09T05:56:49.370721+0000","last_undegraded":"2024-05-09T05:56:49.370721+0000","last_fullsized":"2024-05-09T05:56:49.370721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:52:52.360128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"29'238","reported_seq":262,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.725696+0000","last_change":"2024-05-09T05:53:28.222341+0000","last_active":"2024-05-09T05:58:31.725696+0000","last_peered":"2024-05-09T05:58:31.725696+0000","last_clean":"2024-05-09T05:58:31.725696+0000","last_became_active":"2024-05-09T05:53:28.219636+0000","last_became_peered":"2024-05-09T05:53:28.219636+0000","last_unstale":"2024-05-09T05:58:31.725696+0000","last_undegraded":"2024-05-09T05:58:31.725696+0000","last_fullsized":"2024-05-09T05:58:31.725696+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:29:03.459851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":238,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"29'10","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.170796+0000","last_change":"2024-05-09T05:53:24.143495+0000","last_active":"2024-05-09T05:58:30.170796+0000","last_peered":"2024-05-09T05:58:30.170796+0000","last_clean":"2024-05-09T05:58:30.170796+0000","last_became_active":"2024-05-09T05:53:24.143181+0000","last_became_peered":"2024-05-09T05:53:24.143181+0000","last_unstale":"2024-05-09T05:58:30.170796+0000","last_undegraded":"2024-05-09T05:58:30.170796+0000","last_fullsized":"2024-05-09T05:58:30.170796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:40:20.997659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"27'9","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:57:10.706735+0000","last_change":"2024-05-09T05:53:23.114815+0000","last_active":"2024-05-09T05:57:10.706735+0000","last_peered":"2024-05-09T05:57:10.706735+0000","last_clean":"2024-05-09T05:57:10.706735+0000","last_became_active":"2024-05-09T05:53:23.113524+0000","last_became_peered":"2024-05-09T05:53:23.113524+0000","last_unstale":"2024-05-09T05:57:10.706735+0000","last_undegraded":"2024-05-09T05:57:10.706735+0000","last_fullsized":"2024-05-09T05:57:10.706735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:35:45.537715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"29'327","reported_seq":351,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:32.902431+0000","last_change":"2024-05-09T05:53:28.226682+0000","last_active":"2024-05-09T05:58:32.902431+0000","last_peered":"2024-05-09T05:58:32.902431+0000","last_clean":"2024-05-09T05:58:32.902431+0000","last_became_active":"2024-05-09T05:53:28.226279+0000","last_became_peered":"2024-05-09T05:53:28.226279+0000","last_unstale":"2024-05-09T05:58:32.902431+0000","last_undegraded":"2024-05-09T05:58:32.902431+0000","last_fullsized":"2024-05-09T05:58:32.902431+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:15:55.146695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":327,"num_write_kb":892928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"29'6","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.174448+0000","last_change":"2024-05-09T05:53:24.135119+0000","last_active":"2024-05-09T05:58:30.174448+0000","last_peered":"2024-05-09T05:58:30.174448+0000","last_clean":"2024-05-09T05:58:30.174448+0000","last_became_active":"2024-05-09T05:53:24.134690+0000","last_became_peered":"2024-05-09T05:53:24.134690+0000","last_unstale":"2024-05-09T05:58:30.174448+0000","last_undegraded":"2024-05-09T05:58:30.174448+0000","last_fullsized":"2024-05-09T05:58:30.174448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:15:36.608441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"29'101","reported_seq":137,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.487064+0000","last_change":"2024-05-09T05:53:23.119626+0000","last_active":"2024-05-09T05:58:30.487064+0000","last_peered":"2024-05-09T05:58:30.487064+0000","last_clean":"2024-05-09T05:58:30.487064+0000","last_became_active":"2024-05-09T05:53:23.119173+0000","last_became_peered":"2024-05-09T05:53:23.119173+0000","last_unstale":"2024-05-09T05:58:30.487064+0000","last_undegraded":"2024-05-09T05:58:30.487064+0000","last_fullsized":"2024-05-09T05:58:30.487064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:24:03.188897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":212943,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":102,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"29'250","reported_seq":274,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.724425+0000","last_change":"2024-05-09T05:53:28.223167+0000","last_active":"2024-05-09T05:58:31.724425+0000","last_peered":"2024-05-09T05:58:31.724425+0000","last_clean":"2024-05-09T05:58:31.724425+0000","last_became_active":"2024-05-09T05:53:28.221846+0000","last_became_peered":"2024-05-09T05:53:28.221846+0000","last_unstale":"2024-05-09T05:58:31.724425+0000","last_undegraded":"2024-05-09T05:58:31.724425+0000","last_fullsized":"2024-05-09T05:58:31.724425+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:47:12.366900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163577856,"num_objects":39,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":249,"num_write_kb":786432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"29'11","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.160480+0000","last_change":"2024-05-09T05:53:24.133007+0000","last_active":"2024-05-09T05:58:30.160480+0000","last_peered":"2024-05-09T05:58:30.160480+0000","last_clean":"2024-05-09T05:58:30.160480+0000","last_became_active":"2024-05-09T05:53:24.132545+0000","last_became_peered":"2024-05-09T05:53:24.132545+0000","last_unstale":"2024-05-09T05:58:30.160480+0000","last_undegraded":"2024-05-09T05:58:30.160480+0000","last_fullsized":"2024-05-09T05:58:30.160480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:10:26.299015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"29'9","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:16.732696+0000","last_change":"2024-05-09T05:53:23.121124+0000","last_active":"2024-05-09T05:58:16.732696+0000","last_peered":"2024-05-09T05:58:16.732696+0000","last_clean":"2024-05-09T05:58:16.732696+0000","last_became_active":"2024-05-09T05:53:23.120303+0000","last_became_peered":"2024-05-09T05:53:23.120303+0000","last_unstale":"2024-05-09T05:58:16.732696+0000","last_undegraded":"2024-05-09T05:58:16.732696+0000","last_fullsized":"2024-05-09T05:58:16.732696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:36:49.445673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"29'256","reported_seq":280,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.714538+0000","last_change":"2024-05-09T05:53:28.188712+0000","last_active":"2024-05-09T05:58:31.714538+0000","last_peered":"2024-05-09T05:58:31.714538+0000","last_clean":"2024-05-09T05:58:31.714538+0000","last_became_active":"2024-05-09T05:53:28.184259+0000","last_became_peered":"2024-05-09T05:53:28.184259+0000","last_unstale":"2024-05-09T05:58:31.714538+0000","last_undegraded":"2024-05-09T05:58:31.714538+0000","last_fullsized":"2024-05-09T05:58:31.714538+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:56:39.668106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171966464,"num_objects":41,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":256,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"29'9","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.183972+0000","last_change":"2024-05-09T05:53:24.146147+0000","last_active":"2024-05-09T05:58:30.183972+0000","last_peered":"2024-05-09T05:58:30.183972+0000","last_clean":"2024-05-09T05:58:30.183972+0000","last_became_active":"2024-05-09T05:53:24.145704+0000","last_became_peered":"2024-05-09T05:53:24.145704+0000","last_unstale":"2024-05-09T05:58:30.183972+0000","last_undegraded":"2024-05-09T05:58:30.183972+0000","last_fullsized":"2024-05-09T05:58:30.183972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:47:03.047479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"27'4","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:57:10.705335+0000","last_change":"2024-05-09T05:53:23.095689+0000","last_active":"2024-05-09T05:57:10.705335+0000","last_peered":"2024-05-09T05:57:10.705335+0000","last_clean":"2024-05-09T05:57:10.705335+0000","last_became_active":"2024-05-09T05:53:23.094889+0000","last_became_peered":"2024-05-09T05:53:23.094889+0000","last_unstale":"2024-05-09T05:57:10.705335+0000","last_undegraded":"2024-05-09T05:57:10.705335+0000","last_fullsized":"2024-05-09T05:57:10.705335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:25:35.069184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"29'270","reported_seq":294,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.697472+0000","last_change":"2024-05-09T05:53:28.223954+0000","last_active":"2024-05-09T05:58:31.697472+0000","last_peered":"2024-05-09T05:58:31.697472+0000","last_clean":"2024-05-09T05:58:31.697472+0000","last_became_active":"2024-05-09T05:53:28.222700+0000","last_became_peered":"2024-05-09T05:53:28.222700+0000","last_unstale":"2024-05-09T05:58:31.697472+0000","last_undegraded":"2024-05-09T05:58:31.697472+0000","last_fullsized":"2024-05-09T05:58:31.697472+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:17:17.864782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"29'10","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.161629+0000","last_change":"2024-05-09T05:53:24.140698+0000","last_active":"2024-05-09T05:58:30.161629+0000","last_peered":"2024-05-09T05:58:30.161629+0000","last_clean":"2024-05-09T05:58:30.161629+0000","last_became_active":"2024-05-09T05:53:24.139612+0000","last_became_peered":"2024-05-09T05:53:24.139612+0000","last_unstale":"2024-05-09T05:58:30.161629+0000","last_undegraded":"2024-05-09T05:58:30.161629+0000","last_fullsized":"2024-05-09T05:58:30.161629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:09:39.609750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"29'8","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.103000+0000","last_change":"2024-05-09T05:53:23.106167+0000","last_active":"2024-05-09T05:58:30.103000+0000","last_peered":"2024-05-09T05:58:30.103000+0000","last_clean":"2024-05-09T05:58:30.103000+0000","last_became_active":"2024-05-09T05:53:23.105346+0000","last_became_peered":"2024-05-09T05:53:23.105346+0000","last_unstale":"2024-05-09T05:58:30.103000+0000","last_undegraded":"2024-05-09T05:58:30.103000+0000","last_fullsized":"2024-05-09T05:58:30.103000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:06:46.109056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"29'283","reported_seq":307,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.714555+0000","last_change":"2024-05-09T05:53:28.194037+0000","last_active":"2024-05-09T05:58:31.714555+0000","last_peered":"2024-05-09T05:58:31.714555+0000","last_clean":"2024-05-09T05:58:31.714555+0000","last_became_active":"2024-05-09T05:53:28.192944+0000","last_became_peered":"2024-05-09T05:53:28.192944+0000","last_unstale":"2024-05-09T05:58:31.714555+0000","last_undegraded":"2024-05-09T05:58:31.714555+0000","last_fullsized":"2024-05-09T05:58:31.714555+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:28:47.664198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184549376,"num_objects":44,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":283,"num_write_kb":892928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"29'229","reported_seq":253,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.675312+0000","last_change":"2024-05-09T05:53:28.226664+0000","last_active":"2024-05-09T05:58:31.675312+0000","last_peered":"2024-05-09T05:58:31.675312+0000","last_clean":"2024-05-09T05:58:31.675312+0000","last_became_active":"2024-05-09T05:53:28.222225+0000","last_became_peered":"2024-05-09T05:53:28.222225+0000","last_unstale":"2024-05-09T05:58:31.675312+0000","last_undegraded":"2024-05-09T05:58:31.675312+0000","last_fullsized":"2024-05-09T05:58:31.675312+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:24:23.614210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184549376,"num_objects":44,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":229,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"29'11","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.193600+0000","last_change":"2024-05-09T05:53:24.128343+0000","last_active":"2024-05-09T05:58:30.193600+0000","last_peered":"2024-05-09T05:58:30.193600+0000","last_clean":"2024-05-09T05:58:30.193600+0000","last_became_active":"2024-05-09T05:53:24.127989+0000","last_became_peered":"2024-05-09T05:53:24.127989+0000","last_unstale":"2024-05-09T05:58:30.193600+0000","last_undegraded":"2024-05-09T05:58:30.193600+0000","last_fullsized":"2024-05-09T05:58:30.193600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:56:14.176175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:56:49.476291+0000","last_change":"2024-05-09T05:53:23.118882+0000","last_active":"2024-05-09T05:56:49.476291+0000","last_peered":"2024-05-09T05:56:49.476291+0000","last_clean":"2024-05-09T05:56:49.476291+0000","last_became_active":"2024-05-09T05:53:23.118119+0000","last_became_peered":"2024-05-09T05:53:23.118119+0000","last_unstale":"2024-05-09T05:56:49.476291+0000","last_undegraded":"2024-05-09T05:56:49.476291+0000","last_fullsized":"2024-05-09T05:56:49.476291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:06:48.203396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"29'267","reported_seq":291,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:33.001823+0000","last_change":"2024-05-09T05:53:28.235313+0000","last_active":"2024-05-09T05:58:33.001823+0000","last_peered":"2024-05-09T05:58:33.001823+0000","last_clean":"2024-05-09T05:58:33.001823+0000","last_became_active":"2024-05-09T05:53:28.234771+0000","last_became_peered":"2024-05-09T05:53:28.234771+0000","last_unstale":"2024-05-09T05:58:33.001823+0000","last_undegraded":"2024-05-09T05:58:33.001823+0000","last_fullsized":"2024-05-09T05:58:33.001823+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:38:46.942863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":267,"num_write_kb":729088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"29'8","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.179669+0000","last_change":"2024-05-09T05:53:24.141956+0000","last_active":"2024-05-09T05:58:30.179669+0000","last_peered":"2024-05-09T05:58:30.179669+0000","last_clean":"2024-05-09T05:58:30.179669+0000","last_became_active":"2024-05-09T05:53:24.139093+0000","last_became_peered":"2024-05-09T05:53:24.139093+0000","last_unstale":"2024-05-09T05:58:30.179669+0000","last_undegraded":"2024-05-09T05:58:30.179669+0000","last_fullsized":"2024-05-09T05:58:30.179669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:44:32.901168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"27'3","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:57:10.687185+0000","last_change":"2024-05-09T05:53:23.113865+0000","last_active":"2024-05-09T05:57:10.687185+0000","last_peered":"2024-05-09T05:57:10.687185+0000","last_clean":"2024-05-09T05:57:10.687185+0000","last_became_active":"2024-05-09T05:53:23.112020+0000","last_became_peered":"2024-05-09T05:53:23.112020+0000","last_unstale":"2024-05-09T05:57:10.687185+0000","last_undegraded":"2024-05-09T05:57:10.687185+0000","last_fullsized":"2024-05-09T05:57:10.687185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:37:04.425229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":14,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"26'7","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:56:44.375056+0000","last_change":"2024-05-09T05:53:23.127463+0000","last_active":"2024-05-09T05:56:44.375056+0000","last_peered":"2024-05-09T05:56:44.375056+0000","last_clean":"2024-05-09T05:56:44.375056+0000","last_became_active":"2024-05-09T05:53:23.126911+0000","last_became_peered":"2024-05-09T05:53:23.126911+0000","last_unstale":"2024-05-09T05:56:44.375056+0000","last_undegraded":"2024-05-09T05:56:44.375056+0000","last_fullsized":"2024-05-09T05:56:44.375056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:06:28.458926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"29'8","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.192543+0000","last_change":"2024-05-09T05:53:24.134391+0000","last_active":"2024-05-09T05:58:30.192543+0000","last_peered":"2024-05-09T05:58:30.192543+0000","last_clean":"2024-05-09T05:58:30.192543+0000","last_became_active":"2024-05-09T05:53:24.133994+0000","last_became_peered":"2024-05-09T05:53:24.133994+0000","last_unstale":"2024-05-09T05:58:30.192543+0000","last_undegraded":"2024-05-09T05:58:30.192543+0000","last_fullsized":"2024-05-09T05:58:30.192543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:30:32.872657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"29'248","reported_seq":272,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.603281+0000","last_change":"2024-05-09T05:53:28.223524+0000","last_active":"2024-05-09T05:58:31.603281+0000","last_peered":"2024-05-09T05:58:31.603281+0000","last_clean":"2024-05-09T05:58:31.603281+0000","last_became_active":"2024-05-09T05:53:28.222433+0000","last_became_peered":"2024-05-09T05:53:28.222433+0000","last_unstale":"2024-05-09T05:58:31.603281+0000","last_undegraded":"2024-05-09T05:58:31.603281+0000","last_fullsized":"2024-05-09T05:58:31.603281+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:52:35.361812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205520896,"num_objects":49,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"29'7","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:24.721349+0000","last_change":"2024-05-09T05:53:23.133700+0000","last_active":"2024-05-09T05:58:24.721349+0000","last_peered":"2024-05-09T05:58:24.721349+0000","last_clean":"2024-05-09T05:58:24.721349+0000","last_became_active":"2024-05-09T05:53:23.132946+0000","last_became_peered":"2024-05-09T05:53:23.132946+0000","last_unstale":"2024-05-09T05:58:24.721349+0000","last_undegraded":"2024-05-09T05:58:24.721349+0000","last_fullsized":"2024-05-09T05:58:24.721349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:39:49.829592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"29'7","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.163659+0000","last_change":"2024-05-09T05:53:24.138174+0000","last_active":"2024-05-09T05:58:30.163659+0000","last_peered":"2024-05-09T05:58:30.163659+0000","last_clean":"2024-05-09T05:58:30.163659+0000","last_became_active":"2024-05-09T05:53:24.137794+0000","last_became_peered":"2024-05-09T05:53:24.137794+0000","last_unstale":"2024-05-09T05:58:30.163659+0000","last_undegraded":"2024-05-09T05:58:30.163659+0000","last_fullsized":"2024-05-09T05:58:30.163659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:57:26.359258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"29'258","reported_seq":282,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.730396+0000","last_change":"2024-05-09T05:53:28.238375+0000","last_active":"2024-05-09T05:58:31.730396+0000","last_peered":"2024-05-09T05:58:31.730396+0000","last_clean":"2024-05-09T05:58:31.730396+0000","last_became_active":"2024-05-09T05:53:28.237414+0000","last_became_peered":"2024-05-09T05:53:28.237414+0000","last_unstale":"2024-05-09T05:58:31.730396+0000","last_undegraded":"2024-05-09T05:58:31.730396+0000","last_fullsized":"2024-05-09T05:58:31.730396+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:13:50.396951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":226492416,"num_objects":54,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":258,"num_write_kb":851968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"29'9","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.147744+0000","last_change":"2024-05-09T05:53:24.130839+0000","last_active":"2024-05-09T05:58:30.147744+0000","last_peered":"2024-05-09T05:58:30.147744+0000","last_clean":"2024-05-09T05:58:30.147744+0000","last_became_active":"2024-05-09T05:53:24.130201+0000","last_became_peered":"2024-05-09T05:53:24.130201+0000","last_unstale":"2024-05-09T05:58:30.147744+0000","last_undegraded":"2024-05-09T05:58:30.147744+0000","last_fullsized":"2024-05-09T05:58:30.147744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:26:03.973553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"29'12","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.179014+0000","last_change":"2024-05-09T05:53:24.138681+0000","last_active":"2024-05-09T05:58:30.179014+0000","last_peered":"2024-05-09T05:58:30.179014+0000","last_clean":"2024-05-09T05:58:30.179014+0000","last_became_active":"2024-05-09T05:53:24.138366+0000","last_became_peered":"2024-05-09T05:53:24.138366+0000","last_unstale":"2024-05-09T05:58:30.179014+0000","last_undegraded":"2024-05-09T05:58:30.179014+0000","last_fullsized":"2024-05-09T05:58:30.179014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:49.856205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"29'8","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.159685+0000","last_change":"2024-05-09T05:53:24.139915+0000","last_active":"2024-05-09T05:58:30.159685+0000","last_peered":"2024-05-09T05:58:30.159685+0000","last_clean":"2024-05-09T05:58:30.159685+0000","last_became_active":"2024-05-09T05:53:24.139058+0000","last_became_peered":"2024-05-09T05:53:24.139058+0000","last_unstale":"2024-05-09T05:58:30.159685+0000","last_undegraded":"2024-05-09T05:58:30.159685+0000","last_fullsized":"2024-05-09T05:58:30.159685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:06:00.768431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"29'7","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.189065+0000","last_change":"2024-05-09T05:53:24.149759+0000","last_active":"2024-05-09T05:58:30.189065+0000","last_peered":"2024-05-09T05:58:30.189065+0000","last_clean":"2024-05-09T05:58:30.189065+0000","last_became_active":"2024-05-09T05:53:24.142812+0000","last_became_peered":"2024-05-09T05:53:24.142812+0000","last_unstale":"2024-05-09T05:58:30.189065+0000","last_undegraded":"2024-05-09T05:58:30.189065+0000","last_fullsized":"2024-05-09T05:58:30.189065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:04.522514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"29'4","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.185763+0000","last_change":"2024-05-09T05:53:24.135373+0000","last_active":"2024-05-09T05:58:30.185763+0000","last_peered":"2024-05-09T05:58:30.185763+0000","last_clean":"2024-05-09T05:58:30.185763+0000","last_became_active":"2024-05-09T05:53:24.135043+0000","last_became_peered":"2024-05-09T05:53:24.135043+0000","last_unstale":"2024-05-09T05:58:30.185763+0000","last_undegraded":"2024-05-09T05:58:30.185763+0000","last_fullsized":"2024-05-09T05:58:30.185763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:20:03.245696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"29'6","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.185380+0000","last_change":"2024-05-09T05:53:24.134712+0000","last_active":"2024-05-09T05:58:30.185380+0000","last_peered":"2024-05-09T05:58:30.185380+0000","last_clean":"2024-05-09T05:58:30.185380+0000","last_became_active":"2024-05-09T05:53:24.132453+0000","last_became_peered":"2024-05-09T05:53:24.132453+0000","last_unstale":"2024-05-09T05:58:30.185380+0000","last_undegraded":"2024-05-09T05:58:30.185380+0000","last_fullsized":"2024-05-09T05:58:30.185380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:47:30.716995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"29'15","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.161321+0000","last_change":"2024-05-09T05:53:24.140714+0000","last_active":"2024-05-09T05:58:30.161321+0000","last_peered":"2024-05-09T05:58:30.161321+0000","last_clean":"2024-05-09T05:58:30.161321+0000","last_became_active":"2024-05-09T05:53:24.140045+0000","last_became_peered":"2024-05-09T05:53:24.140045+0000","last_unstale":"2024-05-09T05:58:30.161321+0000","last_undegraded":"2024-05-09T05:58:30.161321+0000","last_fullsized":"2024-05-09T05:58:30.161321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:36:06.166411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"29'2","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.183512+0000","last_change":"2024-05-09T05:53:24.151591+0000","last_active":"2024-05-09T05:58:30.183512+0000","last_peered":"2024-05-09T05:58:30.183512+0000","last_clean":"2024-05-09T05:58:30.183512+0000","last_became_active":"2024-05-09T05:53:24.151275+0000","last_became_peered":"2024-05-09T05:53:24.151275+0000","last_unstale":"2024-05-09T05:58:30.183512+0000","last_undegraded":"2024-05-09T05:58:30.183512+0000","last_fullsized":"2024-05-09T05:58:30.183512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:28:28.552732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"29'6","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.183409+0000","last_change":"2024-05-09T05:53:24.144315+0000","last_active":"2024-05-09T05:58:30.183409+0000","last_peered":"2024-05-09T05:58:30.183409+0000","last_clean":"2024-05-09T05:58:30.183409+0000","last_became_active":"2024-05-09T05:53:24.144005+0000","last_became_peered":"2024-05-09T05:53:24.144005+0000","last_unstale":"2024-05-09T05:58:30.183409+0000","last_undegraded":"2024-05-09T05:58:30.183409+0000","last_fullsized":"2024-05-09T05:58:30.183409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:06:37.312541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"29'8","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.180625+0000","last_change":"2024-05-09T05:53:24.149852+0000","last_active":"2024-05-09T05:58:30.180625+0000","last_peered":"2024-05-09T05:58:30.180625+0000","last_clean":"2024-05-09T05:58:30.180625+0000","last_became_active":"2024-05-09T05:53:24.146965+0000","last_became_peered":"2024-05-09T05:53:24.146965+0000","last_unstale":"2024-05-09T05:58:30.180625+0000","last_undegraded":"2024-05-09T05:58:30.180625+0000","last_fullsized":"2024-05-09T05:58:30.180625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:02:26.991425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"29'10","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.146017+0000","last_change":"2024-05-09T05:53:24.131735+0000","last_active":"2024-05-09T05:58:30.146017+0000","last_peered":"2024-05-09T05:58:30.146017+0000","last_clean":"2024-05-09T05:58:30.146017+0000","last_became_active":"2024-05-09T05:53:24.131417+0000","last_became_peered":"2024-05-09T05:53:24.131417+0000","last_unstale":"2024-05-09T05:58:30.146017+0000","last_undegraded":"2024-05-09T05:58:30.146017+0000","last_fullsized":"2024-05-09T05:58:30.146017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:59.750972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"29'11","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.192644+0000","last_change":"2024-05-09T05:53:24.140697+0000","last_active":"2024-05-09T05:58:30.192644+0000","last_peered":"2024-05-09T05:58:30.192644+0000","last_clean":"2024-05-09T05:58:30.192644+0000","last_became_active":"2024-05-09T05:53:24.140024+0000","last_became_peered":"2024-05-09T05:53:24.140024+0000","last_unstale":"2024-05-09T05:58:30.192644+0000","last_undegraded":"2024-05-09T05:58:30.192644+0000","last_fullsized":"2024-05-09T05:58:30.192644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:14:14.543827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"29'8","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.148226+0000","last_change":"2024-05-09T05:53:24.136878+0000","last_active":"2024-05-09T05:58:30.148226+0000","last_peered":"2024-05-09T05:58:30.148226+0000","last_clean":"2024-05-09T05:58:30.148226+0000","last_became_active":"2024-05-09T05:53:24.136572+0000","last_became_peered":"2024-05-09T05:53:24.136572+0000","last_unstale":"2024-05-09T05:58:30.148226+0000","last_undegraded":"2024-05-09T05:58:30.148226+0000","last_fullsized":"2024-05-09T05:58:30.148226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:46:47.509355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"29'7","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.163381+0000","last_change":"2024-05-09T05:53:24.147372+0000","last_active":"2024-05-09T05:58:30.163381+0000","last_peered":"2024-05-09T05:58:30.163381+0000","last_clean":"2024-05-09T05:58:30.163381+0000","last_became_active":"2024-05-09T05:53:24.144573+0000","last_became_peered":"2024-05-09T05:53:24.144573+0000","last_unstale":"2024-05-09T05:58:30.163381+0000","last_undegraded":"2024-05-09T05:58:30.163381+0000","last_fullsized":"2024-05-09T05:58:30.163381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:51:09.845748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"29'10","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.179342+0000","last_change":"2024-05-09T05:53:24.135964+0000","last_active":"2024-05-09T05:58:30.179342+0000","last_peered":"2024-05-09T05:58:30.179342+0000","last_clean":"2024-05-09T05:58:30.179342+0000","last_became_active":"2024-05-09T05:53:24.135625+0000","last_became_peered":"2024-05-09T05:53:24.135625+0000","last_unstale":"2024-05-09T05:58:30.179342+0000","last_undegraded":"2024-05-09T05:58:30.179342+0000","last_fullsized":"2024-05-09T05:58:30.179342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:52:02.026146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"29'8","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.157333+0000","last_change":"2024-05-09T05:53:24.133916+0000","last_active":"2024-05-09T05:58:30.157333+0000","last_peered":"2024-05-09T05:58:30.157333+0000","last_clean":"2024-05-09T05:58:30.157333+0000","last_became_active":"2024-05-09T05:53:24.133405+0000","last_became_peered":"2024-05-09T05:53:24.133405+0000","last_unstale":"2024-05-09T05:58:30.157333+0000","last_undegraded":"2024-05-09T05:58:30.157333+0000","last_fullsized":"2024-05-09T05:58:30.157333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:30:16.477715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"29'9","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.158011+0000","last_change":"2024-05-09T05:53:24.139697+0000","last_active":"2024-05-09T05:58:30.158011+0000","last_peered":"2024-05-09T05:58:30.158011+0000","last_clean":"2024-05-09T05:58:30.158011+0000","last_became_active":"2024-05-09T05:53:24.139374+0000","last_became_peered":"2024-05-09T05:53:24.139374+0000","last_unstale":"2024-05-09T05:58:30.158011+0000","last_undegraded":"2024-05-09T05:58:30.158011+0000","last_fullsized":"2024-05-09T05:58:30.158011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:26:28.502867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"29'7","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.180122+0000","last_change":"2024-05-09T05:53:24.147755+0000","last_active":"2024-05-09T05:58:30.180122+0000","last_peered":"2024-05-09T05:58:30.180122+0000","last_clean":"2024-05-09T05:58:30.180122+0000","last_became_active":"2024-05-09T05:53:24.145616+0000","last_became_peered":"2024-05-09T05:53:24.145616+0000","last_unstale":"2024-05-09T05:58:30.180122+0000","last_undegraded":"2024-05-09T05:58:30.180122+0000","last_fullsized":"2024-05-09T05:58:30.180122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:21:10.387393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"29'8","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.185016+0000","last_change":"2024-05-09T05:53:24.131741+0000","last_active":"2024-05-09T05:58:30.185016+0000","last_peered":"2024-05-09T05:58:30.185016+0000","last_clean":"2024-05-09T05:58:30.185016+0000","last_became_active":"2024-05-09T05:53:24.128870+0000","last_became_peered":"2024-05-09T05:53:24.128870+0000","last_unstale":"2024-05-09T05:58:30.185016+0000","last_undegraded":"2024-05-09T05:58:30.185016+0000","last_fullsized":"2024-05-09T05:58:30.185016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:28:25.103524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"29'10","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.189062+0000","last_change":"2024-05-09T05:53:24.133443+0000","last_active":"2024-05-09T05:58:30.189062+0000","last_peered":"2024-05-09T05:58:30.189062+0000","last_clean":"2024-05-09T05:58:30.189062+0000","last_became_active":"2024-05-09T05:53:24.132688+0000","last_became_peered":"2024-05-09T05:53:24.132688+0000","last_unstale":"2024-05-09T05:58:30.189062+0000","last_undegraded":"2024-05-09T05:58:30.189062+0000","last_fullsized":"2024-05-09T05:58:30.189062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:43:24.750805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"29'7","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.156337+0000","last_change":"2024-05-09T05:53:24.142600+0000","last_active":"2024-05-09T05:58:30.156337+0000","last_peered":"2024-05-09T05:58:30.156337+0000","last_clean":"2024-05-09T05:58:30.156337+0000","last_became_active":"2024-05-09T05:53:24.142280+0000","last_became_peered":"2024-05-09T05:53:24.142280+0000","last_unstale":"2024-05-09T05:58:30.156337+0000","last_undegraded":"2024-05-09T05:58:30.156337+0000","last_fullsized":"2024-05-09T05:58:30.156337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:20:58.962379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"29'6","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.151928+0000","last_change":"2024-05-09T05:53:24.144839+0000","last_active":"2024-05-09T05:58:30.151928+0000","last_peered":"2024-05-09T05:58:30.151928+0000","last_clean":"2024-05-09T05:58:30.151928+0000","last_became_active":"2024-05-09T05:53:24.144381+0000","last_became_peered":"2024-05-09T05:53:24.144381+0000","last_unstale":"2024-05-09T05:58:30.151928+0000","last_undegraded":"2024-05-09T05:58:30.151928+0000","last_fullsized":"2024-05-09T05:58:30.151928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:40:46.738053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"29'16","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.147352+0000","last_change":"2024-05-09T05:53:24.131521+0000","last_active":"2024-05-09T05:58:30.147352+0000","last_peered":"2024-05-09T05:58:30.147352+0000","last_clean":"2024-05-09T05:58:30.147352+0000","last_became_active":"2024-05-09T05:53:24.131218+0000","last_became_peered":"2024-05-09T05:53:24.131218+0000","last_unstale":"2024-05-09T05:58:30.147352+0000","last_undegraded":"2024-05-09T05:58:30.147352+0000","last_fullsized":"2024-05-09T05:58:30.147352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:25:59.410270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"29'11","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.160728+0000","last_change":"2024-05-09T05:53:24.139922+0000","last_active":"2024-05-09T05:58:30.160728+0000","last_peered":"2024-05-09T05:58:30.160728+0000","last_clean":"2024-05-09T05:58:30.160728+0000","last_became_active":"2024-05-09T05:53:24.139473+0000","last_became_peered":"2024-05-09T05:53:24.139473+0000","last_unstale":"2024-05-09T05:58:30.160728+0000","last_undegraded":"2024-05-09T05:58:30.160728+0000","last_fullsized":"2024-05-09T05:58:30.160728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:37:50.839899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"29'9","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.180793+0000","last_change":"2024-05-09T05:53:24.143338+0000","last_active":"2024-05-09T05:58:30.180793+0000","last_peered":"2024-05-09T05:58:30.180793+0000","last_clean":"2024-05-09T05:58:30.180793+0000","last_became_active":"2024-05-09T05:53:24.143053+0000","last_became_peered":"2024-05-09T05:53:24.143053+0000","last_unstale":"2024-05-09T05:58:30.180793+0000","last_undegraded":"2024-05-09T05:58:30.180793+0000","last_fullsized":"2024-05-09T05:58:30.180793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:22:16.337090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"29'5","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.182540+0000","last_change":"2024-05-09T05:53:24.145517+0000","last_active":"2024-05-09T05:58:30.182540+0000","last_peered":"2024-05-09T05:58:30.182540+0000","last_clean":"2024-05-09T05:58:30.182540+0000","last_became_active":"2024-05-09T05:53:24.145150+0000","last_became_peered":"2024-05-09T05:53:24.145150+0000","last_unstale":"2024-05-09T05:58:30.182540+0000","last_undegraded":"2024-05-09T05:58:30.182540+0000","last_fullsized":"2024-05-09T05:58:30.182540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:19:53.947349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"29'6","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.182235+0000","last_change":"2024-05-09T05:53:24.129669+0000","last_active":"2024-05-09T05:58:30.182235+0000","last_peered":"2024-05-09T05:58:30.182235+0000","last_clean":"2024-05-09T05:58:30.182235+0000","last_became_active":"2024-05-09T05:53:24.129339+0000","last_became_peered":"2024-05-09T05:53:24.129339+0000","last_unstale":"2024-05-09T05:58:30.182235+0000","last_undegraded":"2024-05-09T05:58:30.182235+0000","last_fullsized":"2024-05-09T05:58:30.182235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:05:51.845643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"29'4","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.177393+0000","last_change":"2024-05-09T05:53:24.138914+0000","last_active":"2024-05-09T05:58:30.177393+0000","last_peered":"2024-05-09T05:58:30.177393+0000","last_clean":"2024-05-09T05:58:30.177393+0000","last_became_active":"2024-05-09T05:53:24.138499+0000","last_became_peered":"2024-05-09T05:53:24.138499+0000","last_unstale":"2024-05-09T05:58:30.177393+0000","last_undegraded":"2024-05-09T05:58:30.177393+0000","last_fullsized":"2024-05-09T05:58:30.177393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:29:00.338046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"29'8","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.182277+0000","last_change":"2024-05-09T05:53:24.144296+0000","last_active":"2024-05-09T05:58:30.182277+0000","last_peered":"2024-05-09T05:58:30.182277+0000","last_clean":"2024-05-09T05:58:30.182277+0000","last_became_active":"2024-05-09T05:53:24.143890+0000","last_became_peered":"2024-05-09T05:53:24.143890+0000","last_unstale":"2024-05-09T05:58:30.182277+0000","last_undegraded":"2024-05-09T05:58:30.182277+0000","last_fullsized":"2024-05-09T05:58:30.182277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:34:56.860849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"29'7","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.178572+0000","last_change":"2024-05-09T05:53:24.152635+0000","last_active":"2024-05-09T05:58:30.178572+0000","last_peered":"2024-05-09T05:58:30.178572+0000","last_clean":"2024-05-09T05:58:30.178572+0000","last_became_active":"2024-05-09T05:53:24.151674+0000","last_became_peered":"2024-05-09T05:53:24.151674+0000","last_unstale":"2024-05-09T05:58:30.178572+0000","last_undegraded":"2024-05-09T05:58:30.178572+0000","last_fullsized":"2024-05-09T05:58:30.178572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:18:47.495857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"29'4","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.177792+0000","last_change":"2024-05-09T05:53:24.152746+0000","last_active":"2024-05-09T05:58:30.177792+0000","last_peered":"2024-05-09T05:58:30.177792+0000","last_clean":"2024-05-09T05:58:30.177792+0000","last_became_active":"2024-05-09T05:53:24.151418+0000","last_became_peered":"2024-05-09T05:53:24.151418+0000","last_unstale":"2024-05-09T05:58:30.177792+0000","last_undegraded":"2024-05-09T05:58:30.177792+0000","last_fullsized":"2024-05-09T05:58:30.177792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:27:19.121790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"29'8","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.161043+0000","last_change":"2024-05-09T05:53:24.140908+0000","last_active":"2024-05-09T05:58:30.161043+0000","last_peered":"2024-05-09T05:58:30.161043+0000","last_clean":"2024-05-09T05:58:30.161043+0000","last_became_active":"2024-05-09T05:53:24.140589+0000","last_became_peered":"2024-05-09T05:53:24.140589+0000","last_unstale":"2024-05-09T05:58:30.161043+0000","last_undegraded":"2024-05-09T05:58:30.161043+0000","last_fullsized":"2024-05-09T05:58:30.161043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:51:03.458547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3829399552,"num_objects":913,"num_object_clones":0,"num_object_copies":3652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":913,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8303,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":7973371904,"data_stored":7973371904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8304,"ondisk_log_size":8304,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":503,"ondisk_log_size":503,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":221640,"num_objects":99,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":153,"num_read_kb":159,"num_write":356,"num_write_kb":338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":688128,"data_stored":443280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":330,"ondisk_log_size":330,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509506,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1728924,"kb_used_data":1679700,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":92642916,"statfs":{"total":96636764160,"available":94866345984,"internally_reserved":0,"allocated":1720012800,"data_stored":1719795670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509509,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1517960,"kb_used_data":1464640,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":92853880,"statfs":{"total":96636764160,"available":95082373120,"internally_reserved":0,"allocated":1499791360,"data_stored":1499596671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509509,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1833528,"kb_used_data":1788464,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":92538312,"statfs":{"total":96636764160,"available":94759231488,"internally_reserved":0,"allocated":1831387136,"data_stored":1831157924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509506,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1268372,"kb_used_data":1212940,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":93103468,"statfs":{"total":96636764160,"available":95337951232,"internally_reserved":0,"allocated":1242050560,"data_stored":1241856442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509508,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2011596,"kb_used_data":1948548,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":92360244,"statfs":{"total":96636764160,"available":94576889856,"internally_reserved":0,"allocated":1995313152,"data_stored":1995112781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64551365},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509508,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1677720,"kb_used_data":1628496,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":92694120,"statfs":{"total":96636764160,"available":94918778880,"internally_reserved":0,"allocated":1667579904,"data_stored":1667368993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574915,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50132,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321708,"statfs":{"total":96636764160,"available":96585428992,"internally_reserved":0,"allocated":929792,"data_stored":721752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574916,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69600,"kb_used_data":2392,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94302240,"statfs":{"total":96636764160,"available":96565493760,"internally_reserved":0,"allocated":2449408,"data_stored":2229903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68811207},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":3706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":229376,"data_stored":213011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":266240,"data_stored":214781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1008730112,"data_stored":1008730112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1623195648,"data_stored":1623195648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1111490560,"data_stored":1111490560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2097152,"data_stored":2097152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1249902592,"data_stored":1249902592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1447034880,"data_stored":1447034880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1530920960,"data_stored":1530920960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T05:58:37.283 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-09T05:58:37.283 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T05:58:37.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.483+0000 7fbfb9517640 1 Processor -- start 2024-05-09T05:58:37.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.483+0000 7fbfb9517640 1 -- start start 2024-05-09T05:58:37.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.487+0000 7fbfb9517640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfb4153860 0x7fbfb40c6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:37.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.487+0000 7fbfb9517640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbfb40c7210 0x7fbfb4163d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:37.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.487+0000 7fbfb9517640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfb4072b00 con 0x7fbfb4159ed0 2024-05-09T05:58:37.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.487+0000 7fbfb9517640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fbfb4153c70 con 0x7fbfb40c7210 2024-05-09T05:58:37.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.487+0000 7fbfb9517640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fbfb4072540 con 0x7fbfb4153860 2024-05-09T05:58:37.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.487+0000 7fbfb2ffd640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fbfb4159ed0 0x7fbfb4072f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:38468/0 (socket says 172.21.15.72:38468) 2024-05-09T05:58:37.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.487+0000 7fbfb2ffd640 1 -- 172.21.15.72:0/2840169620 learned_addr learned my addr 172.21.15.72:0/2840169620 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:58:37.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.487+0000 7fbfb37fe640 1 --2- 172.21.15.72:0/2840169620 >> v2:172.21.15.72:3300/0 conn(0x7fbfb40c7210 0x7fbfb4163d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:37.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.487+0000 7fbfb27fc640 1 --2- 172.21.15.72:0/2840169620 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfb4153860 0x7fbfb40c6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:37.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.487+0000 7fbfb37fe640 1 -- 172.21.15.72:0/2840169620 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfb4153860 msgr2=0x7fbfb40c6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:58:37.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.487+0000 7fbfb37fe640 1 --2- 172.21.15.72:0/2840169620 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfb4153860 0x7fbfb40c6cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:37.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.487+0000 7fbfb37fe640 1 -- 172.21.15.72:0/2840169620 >> v1:172.21.15.72:6789/0 conn(0x7fbfb4159ed0 legacy=0x7fbfb4072f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:37.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.487+0000 7fbfb1ffb640 1 -- 172.21.15.72:0/2840169620 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 300257708 0 0) 0x7fbfb4072b00 con 0x7fbfb4159ed0 2024-05-09T05:58:37.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.487+0000 7fbfb37fe640 1 -- 172.21.15.72:0/2840169620 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfb4072820 con 0x7fbfb40c7210 2024-05-09T05:58:37.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.491+0000 7fbfb37fe640 1 --2- 172.21.15.72:0/2840169620 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfb40c7210 0x7fbfb4163d80 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fbfa4009d90 tx=0x7fbfa401f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33f50a0268f4e4d1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:37.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.491+0000 7fbfb1ffb640 1 -- 172.21.15.72:0/2840169620 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa40b4070 con 0x7fbfb40c7210 2024-05-09T05:58:37.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.491+0000 7fbfb1ffb640 1 -- 172.21.15.72:0/2840169620 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfa40af600 con 0x7fbfb40c7210 2024-05-09T05:58:37.477 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.491+0000 7fbfb1ffb640 1 -- 172.21.15.72:0/2840169620 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa40af9d0 con 0x7fbfb40c7210 2024-05-09T05:58:37.478 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.491+0000 7fbfb9517640 1 -- 172.21.15.72:0/2840169620 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfb40c7210 msgr2=0x7fbfb4163d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:37.478 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.491+0000 7fbfb9517640 1 --2- 172.21.15.72:0/2840169620 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfb40c7210 0x7fbfb4163d80 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fbfa4009d90 tx=0x7fbfa401f150 comp rx=0 tx=0).stop 2024-05-09T05:58:37.478 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.491+0000 7fbfb9517640 1 -- 172.21.15.72:0/2840169620 shutdown_connections 2024-05-09T05:58:37.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.491+0000 7fbfb9517640 1 --2- 172.21.15.72:0/2840169620 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfb40c7210 0x7fbfb4163d80 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:37.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.491+0000 7fbfb9517640 1 --2- 172.21.15.72:0/2840169620 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfb4153860 0x7fbfb40c6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:37.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.491+0000 7fbfb9517640 1 -- 172.21.15.72:0/2840169620 >> 172.21.15.72:0/2840169620 conn(0x7fbfb40cde90 msgr2=0x7fbfb40ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:58:37.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.491+0000 7fbfb9517640 1 -- 172.21.15.72:0/2840169620 shutdown_connections 2024-05-09T05:58:37.479 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.491+0000 7fbfb9517640 1 -- 172.21.15.72:0/2840169620 wait complete. 2024-05-09T05:58:37.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.491+0000 7fbfb9517640 1 Processor -- start 2024-05-09T05:58:37.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.491+0000 7fbfb9517640 1 -- start start 2024-05-09T05:58:37.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.495+0000 7fbfb9517640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfb40c7210 0x7fbfb415b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:37.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.495+0000 7fbfb9517640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfb4153860 0x7fbfb41f0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:37.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.495+0000 7fbfb9517640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfb4159ed0 0x7fbfb414b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:37.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.495+0000 7fbfb9517640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb40c4920 con 0x7fbfb40c7210 2024-05-09T05:58:37.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.495+0000 7fbfb9517640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb40c7620 con 0x7fbfb4153860 2024-05-09T05:58:37.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.495+0000 7fbfb9517640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fbfb40c4cb0 con 0x7fbfb4159ed0 2024-05-09T05:58:37.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.495+0000 7fbfb2ffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfb40c7210 0x7fbfb415b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:37.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.495+0000 7fbfb2ffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfb40c7210 0x7fbfb415b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54294/0 (socket says 172.21.15.72:54294) 2024-05-09T05:58:37.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.495+0000 7fbfb2ffd640 1 -- 172.21.15.72:0/2786219264 learned_addr learned my addr 172.21.15.72:0/2786219264 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:58:37.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.495+0000 7fbfb37fe640 1 --2- 172.21.15.72:0/2786219264 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfb4159ed0 0x7fbfb414b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:37.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.495+0000 7fbfb27fc640 1 --2- 172.21.15.72:0/2786219264 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfb4153860 0x7fbfb41f0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:37.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.495+0000 7fbfb2ffd640 1 -- 172.21.15.72:0/2786219264 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfb4159ed0 msgr2=0x7fbfb414b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:37.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.495+0000 7fbfb2ffd640 1 --2- 172.21.15.72:0/2786219264 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfb4159ed0 0x7fbfb414b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:37.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.495+0000 7fbfb2ffd640 1 -- 172.21.15.72:0/2786219264 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfb4153860 msgr2=0x7fbfb41f0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:37.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.495+0000 7fbfb2ffd640 1 --2- 172.21.15.72:0/2786219264 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfb4153860 0x7fbfb41f0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:37.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.495+0000 7fbfb2ffd640 1 -- 172.21.15.72:0/2786219264 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfb41f0aa0 con 0x7fbfb40c7210 2024-05-09T05:58:37.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.495+0000 7fbfb2ffd640 1 --2- 172.21.15.72:0/2786219264 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfb40c7210 0x7fbfb415b390 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fbfac00c430 tx=0x7fbfac00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:37.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.495+0000 7fbfab7fe640 1 -- 172.21.15.72:0/2786219264 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfac0074e0 con 0x7fbfb40c7210 2024-05-09T05:58:37.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.495+0000 7fbfab7fe640 1 -- 172.21.15.72:0/2786219264 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfac0047f0 con 0x7fbfb40c7210 2024-05-09T05:58:37.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.495+0000 7fbfb9517640 1 -- 172.21.15.72:0/2786219264 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfb41f41a0 con 0x7fbfb40c7210 2024-05-09T05:58:37.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.495+0000 7fbfab7fe640 1 -- 172.21.15.72:0/2786219264 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfac004be0 con 0x7fbfb40c7210 2024-05-09T05:58:37.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.495+0000 7fbfb9517640 1 -- 172.21.15.72:0/2786219264 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfb40cc130 con 0x7fbfb40c7210 2024-05-09T05:58:37.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.495+0000 7fbfb9517640 1 -- 172.21.15.72:0/2786219264 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfb41efe70 con 0x7fbfb40c7210 2024-05-09T05:58:37.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.495+0000 7fbfab7fe640 1 -- 172.21.15.72:0/2786219264 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fbfac011070 con 0x7fbfb40c7210 2024-05-09T05:58:37.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.495+0000 7fbfab7fe640 1 --2- 172.21.15.72:0/2786219264 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fbf9406f430 0x7fbf94071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:37.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.495+0000 7fbfab7fe640 1 -- 172.21.15.72:0/2786219264 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6762+0+0 (secure 0 0 0) 0x7fbfac08f180 con 0x7fbfb40c7210 2024-05-09T05:58:37.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.495+0000 7fbfb27fc640 1 --2- 172.21.15.72:0/2786219264 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fbf9406f430 0x7fbf94071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:37.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.499+0000 7fbfb27fc640 1 --2- 172.21.15.72:0/2786219264 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fbf9406f430 0x7fbf94071940 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbfb40cd180 tx=0x7fbf9c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:37.489 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.503+0000 7fbfab7fe640 1 -- 172.21.15.72:0/2786219264 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fbfac05bd70 con 0x7fbfb40c7210 2024-05-09T05:58:37.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.663+0000 7fbfb9517640 1 -- 172.21.15.72:0/2786219264 --> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbfb415bc10 con 0x7fbf9406f430 2024-05-09T05:58:37.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.687+0000 7fbfab7fe640 1 -- 172.21.15.72:0/2786219264 <== mgr.4102 v2:172.21.15.110:6832/1113420672 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+333978 (secure 0 0 0) 0x7fbfb415bc10 con 0x7fbf9406f430 2024-05-09T05:58:37.679 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:58:37.681 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2024-05-09T05:58:37.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.691+0000 7fbfb9517640 1 -- 172.21.15.72:0/2786219264 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fbf9406f430 msgr2=0x7fbf94071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:37.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.691+0000 7fbfb9517640 1 --2- 172.21.15.72:0/2786219264 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fbf9406f430 0x7fbf94071940 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbfb40cd180 tx=0x7fbf9c008040 comp rx=0 tx=0).stop 2024-05-09T05:58:37.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.691+0000 7fbfb9517640 1 -- 172.21.15.72:0/2786219264 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfb40c7210 msgr2=0x7fbfb415b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:37.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.691+0000 7fbfb9517640 1 --2- 172.21.15.72:0/2786219264 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfb40c7210 0x7fbfb415b390 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fbfac00c430 tx=0x7fbfac00c8f0 comp rx=0 tx=0).stop 2024-05-09T05:58:37.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.691+0000 7fbfb9517640 1 -- 172.21.15.72:0/2786219264 shutdown_connections 2024-05-09T05:58:37.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.691+0000 7fbfb9517640 1 --2- 172.21.15.72:0/2786219264 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fbf9406f430 0x7fbf94071940 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:37.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.691+0000 7fbfb9517640 1 --2- 172.21.15.72:0/2786219264 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfb4159ed0 0x7fbfb414b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:37.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.691+0000 7fbfb9517640 1 --2- 172.21.15.72:0/2786219264 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfb4153860 0x7fbfb41f0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:37.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.691+0000 7fbfb9517640 1 --2- 172.21.15.72:0/2786219264 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfb40c7210 0x7fbfb415b390 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:37.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.691+0000 7fbfb9517640 1 -- 172.21.15.72:0/2786219264 >> 172.21.15.72:0/2786219264 conn(0x7fbfb40cde90 msgr2=0x7fbfb4151c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:58:37.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.691+0000 7fbfb9517640 1 -- 172.21.15.72:0/2786219264 shutdown_connections 2024-05-09T05:58:37.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.691+0000 7fbfb9517640 1 -- 172.21.15.72:0/2786219264 wait complete. 2024-05-09T05:58:37.703 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":186,"stamp":"2024-05-09T05:58:36.602970+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3830211560,"num_objects":1014,"num_object_clones":0,"num_object_copies":3854,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1014,"num_whiteouts":0,"num_read":219,"num_read_kb":214,"num_write":8760,"num_write_kb":25167790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9209,"ondisk_log_size":9209,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":10157832,"kb_used_data":9726088,"kb_used_omap":12,"kb_used_meta":425523,"kb_avail":744816888,"statfs":{"total":773094113280,"available":762692493312,"internally_reserved":0,"allocated":9959514112,"data_stored":9957840136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":435736113},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,3,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6908003453,"num_objects":-1647,"num_object_clones":0,"num_object_copies":-6588,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1647,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":1670,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005632"},"pg_stats":[{"pgid":"2.1f","version":"29'15","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:56:49.474376+0000","last_change":"2024-05-09T05:53:23.121824+0000","last_active":"2024-05-09T05:56:49.474376+0000","last_peered":"2024-05-09T05:56:49.474376+0000","last_clean":"2024-05-09T05:56:49.474376+0000","last_became_active":"2024-05-09T05:53:23.121097+0000","last_became_peered":"2024-05-09T05:53:23.121097+0000","last_unstale":"2024-05-09T05:56:49.474376+0000","last_undegraded":"2024-05-09T05:56:49.474376+0000","last_fullsized":"2024-05-09T05:56:49.474376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:50:51.880238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"29'5","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.177886+0000","last_change":"2024-05-09T05:53:24.146985+0000","last_active":"2024-05-09T05:58:30.177886+0000","last_peered":"2024-05-09T05:58:30.177886+0000","last_clean":"2024-05-09T05:58:30.177886+0000","last_became_active":"2024-05-09T05:53:24.146540+0000","last_became_peered":"2024-05-09T05:53:24.146540+0000","last_unstale":"2024-05-09T05:58:30.177886+0000","last_undegraded":"2024-05-09T05:58:30.177886+0000","last_fullsized":"2024-05-09T05:58:30.177886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:02:29.318131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"29'273","reported_seq":297,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.709963+0000","last_change":"2024-05-09T05:53:28.236386+0000","last_active":"2024-05-09T05:58:31.709963+0000","last_peered":"2024-05-09T05:58:31.709963+0000","last_clean":"2024-05-09T05:58:31.709963+0000","last_became_active":"2024-05-09T05:53:28.235305+0000","last_became_peered":"2024-05-09T05:53:28.235305+0000","last_unstale":"2024-05-09T05:58:31.709963+0000","last_undegraded":"2024-05-09T05:58:31.709963+0000","last_fullsized":"2024-05-09T05:58:31.709963+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:57:57.134819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":835584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"25'2","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:56:44.380636+0000","last_change":"2024-05-09T05:53:23.139000+0000","last_active":"2024-05-09T05:56:44.380636+0000","last_peered":"2024-05-09T05:56:44.380636+0000","last_clean":"2024-05-09T05:56:44.380636+0000","last_became_active":"2024-05-09T05:53:23.138431+0000","last_became_peered":"2024-05-09T05:53:23.138431+0000","last_unstale":"2024-05-09T05:56:44.380636+0000","last_undegraded":"2024-05-09T05:56:44.380636+0000","last_fullsized":"2024-05-09T05:56:44.380636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:33:56.977263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"29'6","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.184685+0000","last_change":"2024-05-09T05:53:24.151811+0000","last_active":"2024-05-09T05:58:30.184685+0000","last_peered":"2024-05-09T05:58:30.184685+0000","last_clean":"2024-05-09T05:58:30.184685+0000","last_became_active":"2024-05-09T05:53:24.151407+0000","last_became_peered":"2024-05-09T05:53:24.151407+0000","last_unstale":"2024-05-09T05:58:30.184685+0000","last_undegraded":"2024-05-09T05:58:30.184685+0000","last_fullsized":"2024-05-09T05:58:30.184685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:54:17.819787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"29'297","reported_seq":321,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.701764+0000","last_change":"2024-05-09T05:53:28.213485+0000","last_active":"2024-05-09T05:58:31.701764+0000","last_peered":"2024-05-09T05:58:31.701764+0000","last_clean":"2024-05-09T05:58:31.701764+0000","last_became_active":"2024-05-09T05:53:28.213021+0000","last_became_peered":"2024-05-09T05:53:28.213021+0000","last_unstale":"2024-05-09T05:58:31.701764+0000","last_undegraded":"2024-05-09T05:58:31.701764+0000","last_fullsized":"2024-05-09T05:58:31.701764+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:58:22.493166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":176160768,"num_objects":42,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":297,"num_write_kb":925696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"29'15","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:57:10.712258+0000","last_change":"2024-05-09T05:53:23.095209+0000","last_active":"2024-05-09T05:57:10.712258+0000","last_peered":"2024-05-09T05:57:10.712258+0000","last_clean":"2024-05-09T05:57:10.712258+0000","last_became_active":"2024-05-09T05:53:23.094826+0000","last_became_peered":"2024-05-09T05:53:23.094826+0000","last_unstale":"2024-05-09T05:57:10.712258+0000","last_undegraded":"2024-05-09T05:57:10.712258+0000","last_fullsized":"2024-05-09T05:57:10.712258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:38:47.390311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"29'9","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.147951+0000","last_change":"2024-05-09T05:53:24.135281+0000","last_active":"2024-05-09T05:58:30.147951+0000","last_peered":"2024-05-09T05:58:30.147951+0000","last_clean":"2024-05-09T05:58:30.147951+0000","last_became_active":"2024-05-09T05:53:24.134610+0000","last_became_peered":"2024-05-09T05:53:24.134610+0000","last_unstale":"2024-05-09T05:58:30.147951+0000","last_undegraded":"2024-05-09T05:58:30.147951+0000","last_fullsized":"2024-05-09T05:58:30.147951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:28:03.947961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"29'232","reported_seq":256,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.632959+0000","last_change":"2024-05-09T05:53:28.205763+0000","last_active":"2024-05-09T05:58:31.632959+0000","last_peered":"2024-05-09T05:58:31.632959+0000","last_clean":"2024-05-09T05:58:31.632959+0000","last_became_active":"2024-05-09T05:53:28.205229+0000","last_became_peered":"2024-05-09T05:53:28.205229+0000","last_unstale":"2024-05-09T05:58:31.632959+0000","last_undegraded":"2024-05-09T05:58:31.632959+0000","last_fullsized":"2024-05-09T05:58:31.632959+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:38:51.267769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171966464,"num_objects":41,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"27'5","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:57:10.703703+0000","last_change":"2024-05-09T05:53:23.097616+0000","last_active":"2024-05-09T05:57:10.703703+0000","last_peered":"2024-05-09T05:57:10.703703+0000","last_clean":"2024-05-09T05:57:10.703703+0000","last_became_active":"2024-05-09T05:53:23.094760+0000","last_became_peered":"2024-05-09T05:53:23.094760+0000","last_unstale":"2024-05-09T05:57:10.703703+0000","last_undegraded":"2024-05-09T05:57:10.703703+0000","last_fullsized":"2024-05-09T05:57:10.703703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:21:32.558852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"29'15","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.160427+0000","last_change":"2024-05-09T05:53:24.139467+0000","last_active":"2024-05-09T05:58:30.160427+0000","last_peered":"2024-05-09T05:58:30.160427+0000","last_clean":"2024-05-09T05:58:30.160427+0000","last_became_active":"2024-05-09T05:53:24.139109+0000","last_became_peered":"2024-05-09T05:53:24.139109+0000","last_unstale":"2024-05-09T05:58:30.160427+0000","last_undegraded":"2024-05-09T05:58:30.160427+0000","last_fullsized":"2024-05-09T05:58:30.160427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:36.783615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"29'220","reported_seq":244,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.644680+0000","last_change":"2024-05-09T05:53:28.216127+0000","last_active":"2024-05-09T05:58:31.644680+0000","last_peered":"2024-05-09T05:58:31.644680+0000","last_clean":"2024-05-09T05:58:31.644680+0000","last_became_active":"2024-05-09T05:53:28.215482+0000","last_became_peered":"2024-05-09T05:53:28.215482+0000","last_unstale":"2024-05-09T05:58:31.644680+0000","last_undegraded":"2024-05-09T05:58:31.644680+0000","last_fullsized":"2024-05-09T05:58:31.644680+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:48:58.387701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":688128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"29'5","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.160135+0000","last_change":"2024-05-09T05:53:24.132483+0000","last_active":"2024-05-09T05:58:30.160135+0000","last_peered":"2024-05-09T05:58:30.160135+0000","last_clean":"2024-05-09T05:58:30.160135+0000","last_became_active":"2024-05-09T05:53:24.132118+0000","last_became_peered":"2024-05-09T05:53:24.132118+0000","last_unstale":"2024-05-09T05:58:30.160135+0000","last_undegraded":"2024-05-09T05:58:30.160135+0000","last_fullsized":"2024-05-09T05:58:30.160135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:06:01.787707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:56:45.401141+0000","last_change":"2024-05-09T05:53:23.117460+0000","last_active":"2024-05-09T05:56:45.401141+0000","last_peered":"2024-05-09T05:56:45.401141+0000","last_clean":"2024-05-09T05:56:45.401141+0000","last_became_active":"2024-05-09T05:53:23.114179+0000","last_became_peered":"2024-05-09T05:53:23.114179+0000","last_unstale":"2024-05-09T05:56:45.401141+0000","last_undegraded":"2024-05-09T05:56:45.401141+0000","last_fullsized":"2024-05-09T05:56:45.401141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:44:01.784905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"29'309","reported_seq":333,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:32.986876+0000","last_change":"2024-05-09T05:53:28.227135+0000","last_active":"2024-05-09T05:58:32.986876+0000","last_peered":"2024-05-09T05:58:32.986876+0000","last_clean":"2024-05-09T05:58:32.986876+0000","last_became_active":"2024-05-09T05:53:28.226427+0000","last_became_peered":"2024-05-09T05:53:28.226427+0000","last_unstale":"2024-05-09T05:58:32.986876+0000","last_undegraded":"2024-05-09T05:58:32.986876+0000","last_fullsized":"2024-05-09T05:58:32.986876+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:37:04.413804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":309,"num_write_kb":843776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"29'8","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.188143+0000","last_change":"2024-05-09T05:53:24.135982+0000","last_active":"2024-05-09T05:58:30.188143+0000","last_peered":"2024-05-09T05:58:30.188143+0000","last_clean":"2024-05-09T05:58:30.188143+0000","last_became_active":"2024-05-09T05:53:24.135580+0000","last_became_peered":"2024-05-09T05:53:24.135580+0000","last_unstale":"2024-05-09T05:58:30.188143+0000","last_undegraded":"2024-05-09T05:58:30.188143+0000","last_fullsized":"2024-05-09T05:58:30.188143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:03:04.589608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"27'3","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:56:44.379284+0000","last_change":"2024-05-09T05:53:23.142679+0000","last_active":"2024-05-09T05:56:44.379284+0000","last_peered":"2024-05-09T05:56:44.379284+0000","last_clean":"2024-05-09T05:56:44.379284+0000","last_became_active":"2024-05-09T05:53:23.142018+0000","last_became_peered":"2024-05-09T05:53:23.142018+0000","last_unstale":"2024-05-09T05:56:44.379284+0000","last_undegraded":"2024-05-09T05:56:44.379284+0000","last_fullsized":"2024-05-09T05:56:44.379284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:08:29.312049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"29'248","reported_seq":272,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.662278+0000","last_change":"2024-05-09T05:53:28.214167+0000","last_active":"2024-05-09T05:58:31.662278+0000","last_peered":"2024-05-09T05:58:31.662278+0000","last_clean":"2024-05-09T05:58:31.662278+0000","last_became_active":"2024-05-09T05:53:28.213623+0000","last_became_peered":"2024-05-09T05:53:28.213623+0000","last_unstale":"2024-05-09T05:58:31.662278+0000","last_undegraded":"2024-05-09T05:58:31.662278+0000","last_fullsized":"2024-05-09T05:58:31.662278+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:53:53.976485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180355072,"num_objects":43,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":794624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"29'9","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.191092+0000","last_change":"2024-05-09T05:53:24.130342+0000","last_active":"2024-05-09T05:58:30.191092+0000","last_peered":"2024-05-09T05:58:30.191092+0000","last_clean":"2024-05-09T05:58:30.191092+0000","last_became_active":"2024-05-09T05:53:24.129938+0000","last_became_peered":"2024-05-09T05:53:24.129938+0000","last_unstale":"2024-05-09T05:58:30.191092+0000","last_undegraded":"2024-05-09T05:58:30.191092+0000","last_fullsized":"2024-05-09T05:58:30.191092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:58:13.879633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"27'7","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:57:10.705303+0000","last_change":"2024-05-09T05:53:23.111169+0000","last_active":"2024-05-09T05:57:10.705303+0000","last_peered":"2024-05-09T05:57:10.705303+0000","last_clean":"2024-05-09T05:57:10.705303+0000","last_became_active":"2024-05-09T05:53:23.110140+0000","last_became_peered":"2024-05-09T05:53:23.110140+0000","last_unstale":"2024-05-09T05:57:10.705303+0000","last_undegraded":"2024-05-09T05:57:10.705303+0000","last_fullsized":"2024-05-09T05:57:10.705303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:18:55.367553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"29'223","reported_seq":247,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.680856+0000","last_change":"2024-05-09T05:53:28.233648+0000","last_active":"2024-05-09T05:58:31.680856+0000","last_peered":"2024-05-09T05:58:31.680856+0000","last_clean":"2024-05-09T05:58:31.680856+0000","last_became_active":"2024-05-09T05:53:28.227087+0000","last_became_peered":"2024-05-09T05:53:28.227087+0000","last_unstale":"2024-05-09T05:58:31.680856+0000","last_undegraded":"2024-05-09T05:58:31.680856+0000","last_fullsized":"2024-05-09T05:58:31.680856+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:03:49.709580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184549376,"num_objects":44,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":223,"num_write_kb":729088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"29'2","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.125901+0000","last_change":"2024-05-09T05:53:24.147343+0000","last_active":"2024-05-09T05:58:30.125901+0000","last_peered":"2024-05-09T05:58:30.125901+0000","last_clean":"2024-05-09T05:58:30.125901+0000","last_became_active":"2024-05-09T05:53:24.144596+0000","last_became_peered":"2024-05-09T05:53:24.144596+0000","last_unstale":"2024-05-09T05:58:30.125901+0000","last_undegraded":"2024-05-09T05:58:30.125901+0000","last_fullsized":"2024-05-09T05:58:30.125901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:52:43.052055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"25'2","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:56:44.377895+0000","last_change":"2024-05-09T05:53:23.102976+0000","last_active":"2024-05-09T05:56:44.377895+0000","last_peered":"2024-05-09T05:56:44.377895+0000","last_clean":"2024-05-09T05:56:44.377895+0000","last_became_active":"2024-05-09T05:53:23.102420+0000","last_became_peered":"2024-05-09T05:53:23.102420+0000","last_unstale":"2024-05-09T05:56:44.377895+0000","last_undegraded":"2024-05-09T05:56:44.377895+0000","last_fullsized":"2024-05-09T05:56:44.377895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:45:11.479140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"29'240","reported_seq":264,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.647707+0000","last_change":"2024-05-09T05:53:28.195537+0000","last_active":"2024-05-09T05:58:31.647707+0000","last_peered":"2024-05-09T05:58:31.647707+0000","last_clean":"2024-05-09T05:58:31.647707+0000","last_became_active":"2024-05-09T05:53:28.194915+0000","last_became_peered":"2024-05-09T05:53:28.194915+0000","last_unstale":"2024-05-09T05:58:31.647707+0000","last_undegraded":"2024-05-09T05:58:31.647707+0000","last_fullsized":"2024-05-09T05:58:31.647707+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:07.554137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201326592,"num_objects":48,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":786432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"29'7","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.191355+0000","last_change":"2024-05-09T05:53:24.130312+0000","last_active":"2024-05-09T05:58:30.191355+0000","last_peered":"2024-05-09T05:58:30.191355+0000","last_clean":"2024-05-09T05:58:30.191355+0000","last_became_active":"2024-05-09T05:53:24.129953+0000","last_became_peered":"2024-05-09T05:53:24.129953+0000","last_unstale":"2024-05-09T05:58:30.191355+0000","last_undegraded":"2024-05-09T05:58:30.191355+0000","last_fullsized":"2024-05-09T05:58:30.191355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:07:09.368521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"29'8","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:57:43.751407+0000","last_change":"2024-05-09T05:53:23.127219+0000","last_active":"2024-05-09T05:57:43.751407+0000","last_peered":"2024-05-09T05:57:43.751407+0000","last_clean":"2024-05-09T05:57:43.751407+0000","last_became_active":"2024-05-09T05:53:23.126691+0000","last_became_peered":"2024-05-09T05:53:23.126691+0000","last_unstale":"2024-05-09T05:57:43.751407+0000","last_undegraded":"2024-05-09T05:57:43.751407+0000","last_fullsized":"2024-05-09T05:57:43.751407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:17:26.711941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"29'222","reported_seq":246,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.672382+0000","last_change":"2024-05-09T05:53:28.191045+0000","last_active":"2024-05-09T05:58:31.672382+0000","last_peered":"2024-05-09T05:58:31.672382+0000","last_clean":"2024-05-09T05:58:31.672382+0000","last_became_active":"2024-05-09T05:53:28.190564+0000","last_became_peered":"2024-05-09T05:53:28.190564+0000","last_unstale":"2024-05-09T05:58:31.672382+0000","last_undegraded":"2024-05-09T05:58:31.672382+0000","last_fullsized":"2024-05-09T05:58:31.672382+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:53:30.541681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":679936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"29'5","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.191251+0000","last_change":"2024-05-09T05:53:24.138682+0000","last_active":"2024-05-09T05:58:30.191251+0000","last_peered":"2024-05-09T05:58:30.191251+0000","last_clean":"2024-05-09T05:58:30.191251+0000","last_became_active":"2024-05-09T05:53:24.138417+0000","last_became_peered":"2024-05-09T05:53:24.138417+0000","last_unstale":"2024-05-09T05:58:30.191251+0000","last_undegraded":"2024-05-09T05:58:30.191251+0000","last_fullsized":"2024-05-09T05:58:30.191251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:57:55.403156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"29'27","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:29.274497+0000","last_change":"2024-05-09T05:53:23.102986+0000","last_active":"2024-05-09T05:58:29.274497+0000","last_peered":"2024-05-09T05:58:29.274497+0000","last_clean":"2024-05-09T05:58:29.274497+0000","last_became_active":"2024-05-09T05:53:23.102020+0000","last_became_peered":"2024-05-09T05:53:23.102020+0000","last_unstale":"2024-05-09T05:58:29.274497+0000","last_undegraded":"2024-05-09T05:58:29.274497+0000","last_fullsized":"2024-05-09T05:58:29.274497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:18:11.582575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"29'227","reported_seq":251,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.719078+0000","last_change":"2024-05-09T05:53:28.218326+0000","last_active":"2024-05-09T05:58:31.719078+0000","last_peered":"2024-05-09T05:58:31.719078+0000","last_clean":"2024-05-09T05:58:31.719078+0000","last_became_active":"2024-05-09T05:53:28.216634+0000","last_became_peered":"2024-05-09T05:53:28.216634+0000","last_unstale":"2024-05-09T05:58:31.719078+0000","last_undegraded":"2024-05-09T05:58:31.719078+0000","last_fullsized":"2024-05-09T05:58:31.719078+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:13:05.321932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155189248,"num_objects":37,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":227,"num_write_kb":720896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"29'9","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.180943+0000","last_change":"2024-05-09T05:53:24.143161+0000","last_active":"2024-05-09T05:58:30.180943+0000","last_peered":"2024-05-09T05:58:30.180943+0000","last_clean":"2024-05-09T05:58:30.180943+0000","last_became_active":"2024-05-09T05:53:24.139369+0000","last_became_peered":"2024-05-09T05:53:24.139369+0000","last_unstale":"2024-05-09T05:58:30.180943+0000","last_undegraded":"2024-05-09T05:58:30.180943+0000","last_fullsized":"2024-05-09T05:58:30.180943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:25:21.472460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"27'4","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:56:49.370643+0000","last_change":"2024-05-09T05:53:23.123560+0000","last_active":"2024-05-09T05:56:49.370643+0000","last_peered":"2024-05-09T05:56:49.370643+0000","last_clean":"2024-05-09T05:56:49.370643+0000","last_became_active":"2024-05-09T05:53:23.123081+0000","last_became_peered":"2024-05-09T05:53:23.123081+0000","last_unstale":"2024-05-09T05:56:49.370643+0000","last_undegraded":"2024-05-09T05:56:49.370643+0000","last_fullsized":"2024-05-09T05:56:49.370643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:15:31.371756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"29'211","reported_seq":235,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.674405+0000","last_change":"2024-05-09T05:53:28.229352+0000","last_active":"2024-05-09T05:58:31.674405+0000","last_peered":"2024-05-09T05:58:31.674405+0000","last_clean":"2024-05-09T05:58:31.674405+0000","last_became_active":"2024-05-09T05:53:28.225810+0000","last_became_peered":"2024-05-09T05:53:28.225810+0000","last_unstale":"2024-05-09T05:58:31.674405+0000","last_undegraded":"2024-05-09T05:58:31.674405+0000","last_fullsized":"2024-05-09T05:58:31.674405+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:17:07.192105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159383552,"num_objects":38,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":211,"num_write_kb":679936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"29'5","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.146938+0000","last_change":"2024-05-09T05:53:24.130533+0000","last_active":"2024-05-09T05:58:30.146938+0000","last_peered":"2024-05-09T05:58:30.146938+0000","last_clean":"2024-05-09T05:58:30.146938+0000","last_became_active":"2024-05-09T05:53:24.129787+0000","last_became_peered":"2024-05-09T05:53:24.129787+0000","last_unstale":"2024-05-09T05:58:30.146938+0000","last_undegraded":"2024-05-09T05:58:30.146938+0000","last_fullsized":"2024-05-09T05:58:30.146938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:37:36.036271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"26'1","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:56:44.379023+0000","last_change":"2024-05-09T05:53:23.134379+0000","last_active":"2024-05-09T05:56:44.379023+0000","last_peered":"2024-05-09T05:56:44.379023+0000","last_clean":"2024-05-09T05:56:44.379023+0000","last_became_active":"2024-05-09T05:53:23.133587+0000","last_became_peered":"2024-05-09T05:53:23.133587+0000","last_unstale":"2024-05-09T05:56:44.379023+0000","last_undegraded":"2024-05-09T05:56:44.379023+0000","last_fullsized":"2024-05-09T05:56:44.379023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:00:33.973787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"29'228","reported_seq":252,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.725996+0000","last_change":"2024-05-09T05:53:28.233620+0000","last_active":"2024-05-09T05:58:31.725996+0000","last_peered":"2024-05-09T05:58:31.725996+0000","last_clean":"2024-05-09T05:58:31.725996+0000","last_became_active":"2024-05-09T05:53:28.232539+0000","last_became_peered":"2024-05-09T05:53:28.232539+0000","last_unstale":"2024-05-09T05:58:31.725996+0000","last_undegraded":"2024-05-09T05:58:31.725996+0000","last_fullsized":"2024-05-09T05:58:31.725996+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":228,"log_dups_size":0,"ondisk_log_size":228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:13.789448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188743680,"num_objects":45,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":228,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"29'7","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.144931+0000","last_change":"2024-05-09T05:53:24.132702+0000","last_active":"2024-05-09T05:58:30.144931+0000","last_peered":"2024-05-09T05:58:30.144931+0000","last_clean":"2024-05-09T05:58:30.144931+0000","last_became_active":"2024-05-09T05:53:24.132309+0000","last_became_peered":"2024-05-09T05:53:24.132309+0000","last_unstale":"2024-05-09T05:58:30.144931+0000","last_undegraded":"2024-05-09T05:58:30.144931+0000","last_fullsized":"2024-05-09T05:58:30.144931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:53:13.592038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"29'7","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:57:10.708672+0000","last_change":"2024-05-09T05:53:23.120384+0000","last_active":"2024-05-09T05:57:10.708672+0000","last_peered":"2024-05-09T05:57:10.708672+0000","last_clean":"2024-05-09T05:57:10.708672+0000","last_became_active":"2024-05-09T05:53:23.118321+0000","last_became_peered":"2024-05-09T05:53:23.118321+0000","last_unstale":"2024-05-09T05:57:10.708672+0000","last_undegraded":"2024-05-09T05:57:10.708672+0000","last_fullsized":"2024-05-09T05:57:10.708672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:15:51.297111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":14,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'227","reported_seq":251,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.747888+0000","last_change":"2024-05-09T05:53:28.208383+0000","last_active":"2024-05-09T05:58:31.747888+0000","last_peered":"2024-05-09T05:58:31.747888+0000","last_clean":"2024-05-09T05:58:31.747888+0000","last_became_active":"2024-05-09T05:53:28.199359+0000","last_became_peered":"2024-05-09T05:53:28.199359+0000","last_unstale":"2024-05-09T05:58:31.747888+0000","last_undegraded":"2024-05-09T05:58:31.747888+0000","last_fullsized":"2024-05-09T05:58:31.747888+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:50:19.715242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155189248,"num_objects":37,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":227,"num_write_kb":720896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"29'8","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.189540+0000","last_change":"2024-05-09T05:53:24.142740+0000","last_active":"2024-05-09T05:58:30.189540+0000","last_peered":"2024-05-09T05:58:30.189540+0000","last_clean":"2024-05-09T05:58:30.189540+0000","last_became_active":"2024-05-09T05:53:24.142265+0000","last_became_peered":"2024-05-09T05:53:24.142265+0000","last_unstale":"2024-05-09T05:58:30.189540+0000","last_undegraded":"2024-05-09T05:58:30.189540+0000","last_fullsized":"2024-05-09T05:58:30.189540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:46:53.729151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"29'13","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.475397+0000","last_change":"2024-05-09T05:53:23.142455+0000","last_active":"2024-05-09T05:58:30.475397+0000","last_peered":"2024-05-09T05:58:30.475397+0000","last_clean":"2024-05-09T05:58:30.475397+0000","last_became_active":"2024-05-09T05:53:23.141770+0000","last_became_peered":"2024-05-09T05:53:23.141770+0000","last_unstale":"2024-05-09T05:58:30.475397+0000","last_undegraded":"2024-05-09T05:58:30.475397+0000","last_fullsized":"2024-05-09T05:58:30.475397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:30:34.301349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":641,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"29'227","reported_seq":251,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.701157+0000","last_change":"2024-05-09T05:53:28.212176+0000","last_active":"2024-05-09T05:58:31.701157+0000","last_peered":"2024-05-09T05:58:31.701157+0000","last_clean":"2024-05-09T05:58:31.701157+0000","last_became_active":"2024-05-09T05:53:28.210981+0000","last_became_peered":"2024-05-09T05:53:28.210981+0000","last_unstale":"2024-05-09T05:58:31.701157+0000","last_undegraded":"2024-05-09T05:58:31.701157+0000","last_fullsized":"2024-05-09T05:58:31.701157+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:17:24.122805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180355072,"num_objects":43,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":227,"num_write_kb":737280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"29'5","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.181917+0000","last_change":"2024-05-09T05:53:24.132887+0000","last_active":"2024-05-09T05:58:30.181917+0000","last_peered":"2024-05-09T05:58:30.181917+0000","last_clean":"2024-05-09T05:58:30.181917+0000","last_became_active":"2024-05-09T05:53:24.132398+0000","last_became_peered":"2024-05-09T05:53:24.132398+0000","last_unstale":"2024-05-09T05:58:30.181917+0000","last_undegraded":"2024-05-09T05:58:30.181917+0000","last_fullsized":"2024-05-09T05:58:30.181917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:36:49.369162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"29'6","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:56:49.477057+0000","last_change":"2024-05-09T05:53:23.126202+0000","last_active":"2024-05-09T05:56:49.477057+0000","last_peered":"2024-05-09T05:56:49.477057+0000","last_clean":"2024-05-09T05:56:49.477057+0000","last_became_active":"2024-05-09T05:53:23.125799+0000","last_became_peered":"2024-05-09T05:53:23.125799+0000","last_unstale":"2024-05-09T05:56:49.477057+0000","last_undegraded":"2024-05-09T05:56:49.477057+0000","last_fullsized":"2024-05-09T05:56:49.477057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:33:12.831705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"29'339","reported_seq":370,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:32.972228+0000","last_change":"2024-05-09T05:54:06.916943+0000","last_active":"2024-05-09T05:58:32.972228+0000","last_peered":"2024-05-09T05:58:32.972228+0000","last_clean":"2024-05-09T05:58:32.972228+0000","last_became_active":"2024-05-09T05:54:06.915734+0000","last_became_peered":"2024-05-09T05:54:06.915734+0000","last_unstale":"2024-05-09T05:58:32.972228+0000","last_undegraded":"2024-05-09T05:58:32.972228+0000","last_fullsized":"2024-05-09T05:58:32.972228+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:59:44.265794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":925696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,6,1],"acting":[5,0,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"29'8","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.179473+0000","last_change":"2024-05-09T05:53:24.139586+0000","last_active":"2024-05-09T05:58:30.179473+0000","last_peered":"2024-05-09T05:58:30.179473+0000","last_clean":"2024-05-09T05:58:30.179473+0000","last_became_active":"2024-05-09T05:53:24.138835+0000","last_became_peered":"2024-05-09T05:53:24.138835+0000","last_unstale":"2024-05-09T05:58:30.179473+0000","last_undegraded":"2024-05-09T05:58:30.179473+0000","last_fullsized":"2024-05-09T05:58:30.179473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:37:13.012588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"27'6","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:56:49.370370+0000","last_change":"2024-05-09T05:53:23.117121+0000","last_active":"2024-05-09T05:56:49.370370+0000","last_peered":"2024-05-09T05:56:49.370370+0000","last_clean":"2024-05-09T05:56:49.370370+0000","last_became_active":"2024-05-09T05:53:23.113294+0000","last_became_peered":"2024-05-09T05:53:23.113294+0000","last_unstale":"2024-05-09T05:56:49.370370+0000","last_undegraded":"2024-05-09T05:56:49.370370+0000","last_fullsized":"2024-05-09T05:56:49.370370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:53:41.591371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":127,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:56:44.385637+0000","last_change":"2024-05-09T05:53:12.484358+0000","last_active":"2024-05-09T05:56:44.385637+0000","last_peered":"2024-05-09T05:56:44.385637+0000","last_clean":"2024-05-09T05:56:44.385637+0000","last_became_active":"2024-05-09T05:53:12.481529+0000","last_became_peered":"2024-05-09T05:53:12.481529+0000","last_unstale":"2024-05-09T05:56:44.385637+0000","last_undegraded":"2024-05-09T05:56:44.385637+0000","last_fullsized":"2024-05-09T05:56:44.385637+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:10.902489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:10.902489+0000","last_clean_scrub_stamp":"2024-05-09T05:53:10.902489+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:28:50.650299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'276","reported_seq":300,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:32.994680+0000","last_change":"2024-05-09T05:53:28.190861+0000","last_active":"2024-05-09T05:58:32.994680+0000","last_peered":"2024-05-09T05:58:32.994680+0000","last_clean":"2024-05-09T05:58:32.994680+0000","last_became_active":"2024-05-09T05:53:28.190393+0000","last_became_peered":"2024-05-09T05:53:28.190393+0000","last_unstale":"2024-05-09T05:58:32.994680+0000","last_undegraded":"2024-05-09T05:58:32.994680+0000","last_fullsized":"2024-05-09T05:58:32.994680+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:05:37.653010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":276,"num_write_kb":753664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"29'7","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.163539+0000","last_change":"2024-05-09T05:53:24.143283+0000","last_active":"2024-05-09T05:58:30.163539+0000","last_peered":"2024-05-09T05:58:30.163539+0000","last_clean":"2024-05-09T05:58:30.163539+0000","last_became_active":"2024-05-09T05:53:24.139813+0000","last_became_peered":"2024-05-09T05:53:24.139813+0000","last_unstale":"2024-05-09T05:58:30.163539+0000","last_undegraded":"2024-05-09T05:58:30.163539+0000","last_fullsized":"2024-05-09T05:58:30.163539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:07:38.471778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"29'7","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:57:56.748839+0000","last_change":"2024-05-09T05:53:23.115534+0000","last_active":"2024-05-09T05:57:56.748839+0000","last_peered":"2024-05-09T05:57:56.748839+0000","last_clean":"2024-05-09T05:57:56.748839+0000","last_became_active":"2024-05-09T05:53:23.112260+0000","last_became_peered":"2024-05-09T05:53:23.112260+0000","last_unstale":"2024-05-09T05:57:56.748839+0000","last_undegraded":"2024-05-09T05:57:56.748839+0000","last_fullsized":"2024-05-09T05:57:56.748839+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:46:53.520691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"29'242","reported_seq":266,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.710353+0000","last_change":"2024-05-09T05:53:28.195687+0000","last_active":"2024-05-09T05:58:31.710353+0000","last_peered":"2024-05-09T05:58:31.710353+0000","last_clean":"2024-05-09T05:58:31.710353+0000","last_became_active":"2024-05-09T05:53:28.195082+0000","last_became_peered":"2024-05-09T05:53:28.195082+0000","last_unstale":"2024-05-09T05:58:31.710353+0000","last_undegraded":"2024-05-09T05:58:31.710353+0000","last_fullsized":"2024-05-09T05:58:31.710353+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:45:56.633547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155189248,"num_objects":37,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":242,"num_write_kb":761856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"29'6","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.185190+0000","last_change":"2024-05-09T05:53:24.130460+0000","last_active":"2024-05-09T05:58:30.185190+0000","last_peered":"2024-05-09T05:58:30.185190+0000","last_clean":"2024-05-09T05:58:30.185190+0000","last_became_active":"2024-05-09T05:53:24.129808+0000","last_became_peered":"2024-05-09T05:53:24.129808+0000","last_unstale":"2024-05-09T05:58:30.185190+0000","last_undegraded":"2024-05-09T05:58:30.185190+0000","last_fullsized":"2024-05-09T05:58:30.185190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:36:04.881676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:56:49.475046+0000","last_change":"2024-05-09T05:53:23.139063+0000","last_active":"2024-05-09T05:56:49.475046+0000","last_peered":"2024-05-09T05:56:49.475046+0000","last_clean":"2024-05-09T05:56:49.475046+0000","last_became_active":"2024-05-09T05:53:23.138303+0000","last_became_peered":"2024-05-09T05:53:23.138303+0000","last_unstale":"2024-05-09T05:56:49.475046+0000","last_undegraded":"2024-05-09T05:56:49.475046+0000","last_fullsized":"2024-05-09T05:56:49.475046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:18:20.172877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"29'261","reported_seq":285,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:33.010968+0000","last_change":"2024-05-09T05:53:28.214251+0000","last_active":"2024-05-09T05:58:33.010968+0000","last_peered":"2024-05-09T05:58:33.010968+0000","last_clean":"2024-05-09T05:58:33.010968+0000","last_became_active":"2024-05-09T05:53:28.206229+0000","last_became_peered":"2024-05-09T05:53:28.206229+0000","last_unstale":"2024-05-09T05:58:33.010968+0000","last_undegraded":"2024-05-09T05:58:33.010968+0000","last_fullsized":"2024-05-09T05:58:33.010968+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":261,"log_dups_size":0,"ondisk_log_size":261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:12:26.761543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":261,"num_write_kb":712704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"29'9","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.148788+0000","last_change":"2024-05-09T05:53:24.135578+0000","last_active":"2024-05-09T05:58:30.148788+0000","last_peered":"2024-05-09T05:58:30.148788+0000","last_clean":"2024-05-09T05:58:30.148788+0000","last_became_active":"2024-05-09T05:53:24.135253+0000","last_became_peered":"2024-05-09T05:53:24.135253+0000","last_unstale":"2024-05-09T05:58:30.148788+0000","last_undegraded":"2024-05-09T05:58:30.148788+0000","last_fullsized":"2024-05-09T05:58:30.148788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:20:23.093397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"27'5","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:57:10.701585+0000","last_change":"2024-05-09T05:53:23.140175+0000","last_active":"2024-05-09T05:57:10.701585+0000","last_peered":"2024-05-09T05:57:10.701585+0000","last_clean":"2024-05-09T05:57:10.701585+0000","last_became_active":"2024-05-09T05:53:23.139516+0000","last_became_peered":"2024-05-09T05:53:23.139516+0000","last_unstale":"2024-05-09T05:57:10.701585+0000","last_undegraded":"2024-05-09T05:57:10.701585+0000","last_fullsized":"2024-05-09T05:57:10.701585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:48:42.473155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"29'318","reported_seq":342,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:32.979280+0000","last_change":"2024-05-09T05:53:28.199385+0000","last_active":"2024-05-09T05:58:32.979280+0000","last_peered":"2024-05-09T05:58:32.979280+0000","last_clean":"2024-05-09T05:58:32.979280+0000","last_became_active":"2024-05-09T05:53:28.198825+0000","last_became_peered":"2024-05-09T05:53:28.198825+0000","last_unstale":"2024-05-09T05:58:32.979280+0000","last_undegraded":"2024-05-09T05:58:32.979280+0000","last_fullsized":"2024-05-09T05:58:32.979280+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:48:22.224140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":318,"num_write_kb":868352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"29'5","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.131274+0000","last_change":"2024-05-09T05:53:24.133293+0000","last_active":"2024-05-09T05:58:30.131274+0000","last_peered":"2024-05-09T05:58:30.131274+0000","last_clean":"2024-05-09T05:58:30.131274+0000","last_became_active":"2024-05-09T05:53:24.131741+0000","last_became_peered":"2024-05-09T05:53:24.131741+0000","last_unstale":"2024-05-09T05:58:30.131274+0000","last_undegraded":"2024-05-09T05:58:30.131274+0000","last_fullsized":"2024-05-09T05:58:30.131274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:01:33.701742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"26'2","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:56:44.378626+0000","last_change":"2024-05-09T05:53:23.112592+0000","last_active":"2024-05-09T05:56:44.378626+0000","last_peered":"2024-05-09T05:56:44.378626+0000","last_clean":"2024-05-09T05:56:44.378626+0000","last_became_active":"2024-05-09T05:53:23.111968+0000","last_became_peered":"2024-05-09T05:53:23.111968+0000","last_unstale":"2024-05-09T05:56:44.378626+0000","last_undegraded":"2024-05-09T05:56:44.378626+0000","last_fullsized":"2024-05-09T05:56:44.378626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:32:54.694588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"29'225","reported_seq":249,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.547246+0000","last_change":"2024-05-09T05:53:28.227755+0000","last_active":"2024-05-09T05:58:31.547246+0000","last_peered":"2024-05-09T05:58:31.547246+0000","last_clean":"2024-05-09T05:58:31.547246+0000","last_became_active":"2024-05-09T05:53:28.227272+0000","last_became_peered":"2024-05-09T05:53:28.227272+0000","last_unstale":"2024-05-09T05:58:31.547246+0000","last_undegraded":"2024-05-09T05:58:31.547246+0000","last_fullsized":"2024-05-09T05:58:31.547246+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":225,"log_dups_size":0,"ondisk_log_size":225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:13:32.020862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":225,"num_write_kb":704512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"29'6","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.158182+0000","last_change":"2024-05-09T05:53:24.144025+0000","last_active":"2024-05-09T05:58:30.158182+0000","last_peered":"2024-05-09T05:58:30.158182+0000","last_clean":"2024-05-09T05:58:30.158182+0000","last_became_active":"2024-05-09T05:53:24.143540+0000","last_became_peered":"2024-05-09T05:53:24.143540+0000","last_unstale":"2024-05-09T05:58:30.158182+0000","last_undegraded":"2024-05-09T05:58:30.158182+0000","last_fullsized":"2024-05-09T05:58:30.158182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:22:58.062541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"29'20","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:06.736201+0000","last_change":"2024-05-09T05:53:23.104452+0000","last_active":"2024-05-09T05:58:06.736201+0000","last_peered":"2024-05-09T05:58:06.736201+0000","last_clean":"2024-05-09T05:58:06.736201+0000","last_became_active":"2024-05-09T05:53:23.103471+0000","last_became_peered":"2024-05-09T05:53:23.103471+0000","last_unstale":"2024-05-09T05:58:06.736201+0000","last_undegraded":"2024-05-09T05:58:06.736201+0000","last_fullsized":"2024-05-09T05:58:06.736201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:33:30.508464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"29'360","reported_seq":384,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:33.029867+0000","last_change":"2024-05-09T05:53:28.241338+0000","last_active":"2024-05-09T05:58:33.029867+0000","last_peered":"2024-05-09T05:58:33.029867+0000","last_clean":"2024-05-09T05:58:33.029867+0000","last_became_active":"2024-05-09T05:53:28.239841+0000","last_became_peered":"2024-05-09T05:53:28.239841+0000","last_unstale":"2024-05-09T05:58:33.029867+0000","last_undegraded":"2024-05-09T05:58:33.029867+0000","last_fullsized":"2024-05-09T05:58:33.029867+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:44:47.854598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":360,"num_write_kb":983040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"29'6","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.181244+0000","last_change":"2024-05-09T05:53:24.149958+0000","last_active":"2024-05-09T05:58:30.181244+0000","last_peered":"2024-05-09T05:58:30.181244+0000","last_clean":"2024-05-09T05:58:30.181244+0000","last_became_active":"2024-05-09T05:53:24.149578+0000","last_became_peered":"2024-05-09T05:53:24.149578+0000","last_unstale":"2024-05-09T05:58:30.181244+0000","last_undegraded":"2024-05-09T05:58:30.181244+0000","last_fullsized":"2024-05-09T05:58:30.181244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:27:43.555218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"29'7","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:06.727523+0000","last_change":"2024-05-09T05:53:23.121266+0000","last_active":"2024-05-09T05:58:06.727523+0000","last_peered":"2024-05-09T05:58:06.727523+0000","last_clean":"2024-05-09T05:58:06.727523+0000","last_became_active":"2024-05-09T05:53:23.120857+0000","last_became_peered":"2024-05-09T05:53:23.120857+0000","last_unstale":"2024-05-09T05:58:06.727523+0000","last_undegraded":"2024-05-09T05:58:06.727523+0000","last_fullsized":"2024-05-09T05:58:06.727523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:03:30.185640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"29'273","reported_seq":297,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:33.018216+0000","last_change":"2024-05-09T05:53:28.240774+0000","last_active":"2024-05-09T05:58:33.018216+0000","last_peered":"2024-05-09T05:58:33.018216+0000","last_clean":"2024-05-09T05:58:33.018216+0000","last_became_active":"2024-05-09T05:53:28.240070+0000","last_became_peered":"2024-05-09T05:53:28.240070+0000","last_unstale":"2024-05-09T05:58:33.018216+0000","last_undegraded":"2024-05-09T05:58:33.018216+0000","last_fullsized":"2024-05-09T05:58:33.018216+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:25:24.019344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"29'15","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.166939+0000","last_change":"2024-05-09T05:54:06.645397+0000","last_active":"2024-05-09T05:58:30.166939+0000","last_peered":"2024-05-09T05:58:30.166939+0000","last_clean":"2024-05-09T05:58:30.166939+0000","last_became_active":"2024-05-09T05:54:06.644437+0000","last_became_peered":"2024-05-09T05:54:06.644437+0000","last_unstale":"2024-05-09T05:58:30.166939+0000","last_undegraded":"2024-05-09T05:58:30.166939+0000","last_fullsized":"2024-05-09T05:58:30.166939+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:41:52.843192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'5","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:56:49.370721+0000","last_change":"2024-05-09T05:53:23.120680+0000","last_active":"2024-05-09T05:56:49.370721+0000","last_peered":"2024-05-09T05:56:49.370721+0000","last_clean":"2024-05-09T05:56:49.370721+0000","last_became_active":"2024-05-09T05:53:23.118358+0000","last_became_peered":"2024-05-09T05:53:23.118358+0000","last_unstale":"2024-05-09T05:56:49.370721+0000","last_undegraded":"2024-05-09T05:56:49.370721+0000","last_fullsized":"2024-05-09T05:56:49.370721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:52:52.360128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"29'238","reported_seq":262,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.725696+0000","last_change":"2024-05-09T05:53:28.222341+0000","last_active":"2024-05-09T05:58:31.725696+0000","last_peered":"2024-05-09T05:58:31.725696+0000","last_clean":"2024-05-09T05:58:31.725696+0000","last_became_active":"2024-05-09T05:53:28.219636+0000","last_became_peered":"2024-05-09T05:53:28.219636+0000","last_unstale":"2024-05-09T05:58:31.725696+0000","last_undegraded":"2024-05-09T05:58:31.725696+0000","last_fullsized":"2024-05-09T05:58:31.725696+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:29:03.459851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":238,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"29'10","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.170796+0000","last_change":"2024-05-09T05:53:24.143495+0000","last_active":"2024-05-09T05:58:30.170796+0000","last_peered":"2024-05-09T05:58:30.170796+0000","last_clean":"2024-05-09T05:58:30.170796+0000","last_became_active":"2024-05-09T05:53:24.143181+0000","last_became_peered":"2024-05-09T05:53:24.143181+0000","last_unstale":"2024-05-09T05:58:30.170796+0000","last_undegraded":"2024-05-09T05:58:30.170796+0000","last_fullsized":"2024-05-09T05:58:30.170796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:40:20.997659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"27'9","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:57:10.706735+0000","last_change":"2024-05-09T05:53:23.114815+0000","last_active":"2024-05-09T05:57:10.706735+0000","last_peered":"2024-05-09T05:57:10.706735+0000","last_clean":"2024-05-09T05:57:10.706735+0000","last_became_active":"2024-05-09T05:53:23.113524+0000","last_became_peered":"2024-05-09T05:53:23.113524+0000","last_unstale":"2024-05-09T05:57:10.706735+0000","last_undegraded":"2024-05-09T05:57:10.706735+0000","last_fullsized":"2024-05-09T05:57:10.706735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:35:45.537715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"29'327","reported_seq":351,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:32.902431+0000","last_change":"2024-05-09T05:53:28.226682+0000","last_active":"2024-05-09T05:58:32.902431+0000","last_peered":"2024-05-09T05:58:32.902431+0000","last_clean":"2024-05-09T05:58:32.902431+0000","last_became_active":"2024-05-09T05:53:28.226279+0000","last_became_peered":"2024-05-09T05:53:28.226279+0000","last_unstale":"2024-05-09T05:58:32.902431+0000","last_undegraded":"2024-05-09T05:58:32.902431+0000","last_fullsized":"2024-05-09T05:58:32.902431+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:15:55.146695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":327,"num_write_kb":892928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"29'6","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.174448+0000","last_change":"2024-05-09T05:53:24.135119+0000","last_active":"2024-05-09T05:58:30.174448+0000","last_peered":"2024-05-09T05:58:30.174448+0000","last_clean":"2024-05-09T05:58:30.174448+0000","last_became_active":"2024-05-09T05:53:24.134690+0000","last_became_peered":"2024-05-09T05:53:24.134690+0000","last_unstale":"2024-05-09T05:58:30.174448+0000","last_undegraded":"2024-05-09T05:58:30.174448+0000","last_fullsized":"2024-05-09T05:58:30.174448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:15:36.608441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"29'101","reported_seq":137,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.487064+0000","last_change":"2024-05-09T05:53:23.119626+0000","last_active":"2024-05-09T05:58:30.487064+0000","last_peered":"2024-05-09T05:58:30.487064+0000","last_clean":"2024-05-09T05:58:30.487064+0000","last_became_active":"2024-05-09T05:53:23.119173+0000","last_became_peered":"2024-05-09T05:53:23.119173+0000","last_unstale":"2024-05-09T05:58:30.487064+0000","last_undegraded":"2024-05-09T05:58:30.487064+0000","last_fullsized":"2024-05-09T05:58:30.487064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:24:03.188897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":212943,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":102,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"29'250","reported_seq":274,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.724425+0000","last_change":"2024-05-09T05:53:28.223167+0000","last_active":"2024-05-09T05:58:31.724425+0000","last_peered":"2024-05-09T05:58:31.724425+0000","last_clean":"2024-05-09T05:58:31.724425+0000","last_became_active":"2024-05-09T05:53:28.221846+0000","last_became_peered":"2024-05-09T05:53:28.221846+0000","last_unstale":"2024-05-09T05:58:31.724425+0000","last_undegraded":"2024-05-09T05:58:31.724425+0000","last_fullsized":"2024-05-09T05:58:31.724425+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:47:12.366900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163577856,"num_objects":39,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":249,"num_write_kb":786432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"29'11","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.160480+0000","last_change":"2024-05-09T05:53:24.133007+0000","last_active":"2024-05-09T05:58:30.160480+0000","last_peered":"2024-05-09T05:58:30.160480+0000","last_clean":"2024-05-09T05:58:30.160480+0000","last_became_active":"2024-05-09T05:53:24.132545+0000","last_became_peered":"2024-05-09T05:53:24.132545+0000","last_unstale":"2024-05-09T05:58:30.160480+0000","last_undegraded":"2024-05-09T05:58:30.160480+0000","last_fullsized":"2024-05-09T05:58:30.160480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:10:26.299015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"29'9","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:16.732696+0000","last_change":"2024-05-09T05:53:23.121124+0000","last_active":"2024-05-09T05:58:16.732696+0000","last_peered":"2024-05-09T05:58:16.732696+0000","last_clean":"2024-05-09T05:58:16.732696+0000","last_became_active":"2024-05-09T05:53:23.120303+0000","last_became_peered":"2024-05-09T05:53:23.120303+0000","last_unstale":"2024-05-09T05:58:16.732696+0000","last_undegraded":"2024-05-09T05:58:16.732696+0000","last_fullsized":"2024-05-09T05:58:16.732696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:36:49.445673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"29'256","reported_seq":280,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.714538+0000","last_change":"2024-05-09T05:53:28.188712+0000","last_active":"2024-05-09T05:58:31.714538+0000","last_peered":"2024-05-09T05:58:31.714538+0000","last_clean":"2024-05-09T05:58:31.714538+0000","last_became_active":"2024-05-09T05:53:28.184259+0000","last_became_peered":"2024-05-09T05:53:28.184259+0000","last_unstale":"2024-05-09T05:58:31.714538+0000","last_undegraded":"2024-05-09T05:58:31.714538+0000","last_fullsized":"2024-05-09T05:58:31.714538+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:56:39.668106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171966464,"num_objects":41,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":256,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"29'9","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.183972+0000","last_change":"2024-05-09T05:53:24.146147+0000","last_active":"2024-05-09T05:58:30.183972+0000","last_peered":"2024-05-09T05:58:30.183972+0000","last_clean":"2024-05-09T05:58:30.183972+0000","last_became_active":"2024-05-09T05:53:24.145704+0000","last_became_peered":"2024-05-09T05:53:24.145704+0000","last_unstale":"2024-05-09T05:58:30.183972+0000","last_undegraded":"2024-05-09T05:58:30.183972+0000","last_fullsized":"2024-05-09T05:58:30.183972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:47:03.047479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"27'4","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:57:10.705335+0000","last_change":"2024-05-09T05:53:23.095689+0000","last_active":"2024-05-09T05:57:10.705335+0000","last_peered":"2024-05-09T05:57:10.705335+0000","last_clean":"2024-05-09T05:57:10.705335+0000","last_became_active":"2024-05-09T05:53:23.094889+0000","last_became_peered":"2024-05-09T05:53:23.094889+0000","last_unstale":"2024-05-09T05:57:10.705335+0000","last_undegraded":"2024-05-09T05:57:10.705335+0000","last_fullsized":"2024-05-09T05:57:10.705335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:25:35.069184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"29'270","reported_seq":294,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.697472+0000","last_change":"2024-05-09T05:53:28.223954+0000","last_active":"2024-05-09T05:58:31.697472+0000","last_peered":"2024-05-09T05:58:31.697472+0000","last_clean":"2024-05-09T05:58:31.697472+0000","last_became_active":"2024-05-09T05:53:28.222700+0000","last_became_peered":"2024-05-09T05:53:28.222700+0000","last_unstale":"2024-05-09T05:58:31.697472+0000","last_undegraded":"2024-05-09T05:58:31.697472+0000","last_fullsized":"2024-05-09T05:58:31.697472+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:17:17.864782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"29'10","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.161629+0000","last_change":"2024-05-09T05:53:24.140698+0000","last_active":"2024-05-09T05:58:30.161629+0000","last_peered":"2024-05-09T05:58:30.161629+0000","last_clean":"2024-05-09T05:58:30.161629+0000","last_became_active":"2024-05-09T05:53:24.139612+0000","last_became_peered":"2024-05-09T05:53:24.139612+0000","last_unstale":"2024-05-09T05:58:30.161629+0000","last_undegraded":"2024-05-09T05:58:30.161629+0000","last_fullsized":"2024-05-09T05:58:30.161629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:09:39.609750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"29'8","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.103000+0000","last_change":"2024-05-09T05:53:23.106167+0000","last_active":"2024-05-09T05:58:30.103000+0000","last_peered":"2024-05-09T05:58:30.103000+0000","last_clean":"2024-05-09T05:58:30.103000+0000","last_became_active":"2024-05-09T05:53:23.105346+0000","last_became_peered":"2024-05-09T05:53:23.105346+0000","last_unstale":"2024-05-09T05:58:30.103000+0000","last_undegraded":"2024-05-09T05:58:30.103000+0000","last_fullsized":"2024-05-09T05:58:30.103000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:06:46.109056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"29'283","reported_seq":307,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.714555+0000","last_change":"2024-05-09T05:53:28.194037+0000","last_active":"2024-05-09T05:58:31.714555+0000","last_peered":"2024-05-09T05:58:31.714555+0000","last_clean":"2024-05-09T05:58:31.714555+0000","last_became_active":"2024-05-09T05:53:28.192944+0000","last_became_peered":"2024-05-09T05:53:28.192944+0000","last_unstale":"2024-05-09T05:58:31.714555+0000","last_undegraded":"2024-05-09T05:58:31.714555+0000","last_fullsized":"2024-05-09T05:58:31.714555+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:28:47.664198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184549376,"num_objects":44,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":283,"num_write_kb":892928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"29'229","reported_seq":253,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.675312+0000","last_change":"2024-05-09T05:53:28.226664+0000","last_active":"2024-05-09T05:58:31.675312+0000","last_peered":"2024-05-09T05:58:31.675312+0000","last_clean":"2024-05-09T05:58:31.675312+0000","last_became_active":"2024-05-09T05:53:28.222225+0000","last_became_peered":"2024-05-09T05:53:28.222225+0000","last_unstale":"2024-05-09T05:58:31.675312+0000","last_undegraded":"2024-05-09T05:58:31.675312+0000","last_fullsized":"2024-05-09T05:58:31.675312+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:24:23.614210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184549376,"num_objects":44,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":229,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"29'11","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.193600+0000","last_change":"2024-05-09T05:53:24.128343+0000","last_active":"2024-05-09T05:58:30.193600+0000","last_peered":"2024-05-09T05:58:30.193600+0000","last_clean":"2024-05-09T05:58:30.193600+0000","last_became_active":"2024-05-09T05:53:24.127989+0000","last_became_peered":"2024-05-09T05:53:24.127989+0000","last_unstale":"2024-05-09T05:58:30.193600+0000","last_undegraded":"2024-05-09T05:58:30.193600+0000","last_fullsized":"2024-05-09T05:58:30.193600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:56:14.176175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:56:49.476291+0000","last_change":"2024-05-09T05:53:23.118882+0000","last_active":"2024-05-09T05:56:49.476291+0000","last_peered":"2024-05-09T05:56:49.476291+0000","last_clean":"2024-05-09T05:56:49.476291+0000","last_became_active":"2024-05-09T05:53:23.118119+0000","last_became_peered":"2024-05-09T05:53:23.118119+0000","last_unstale":"2024-05-09T05:56:49.476291+0000","last_undegraded":"2024-05-09T05:56:49.476291+0000","last_fullsized":"2024-05-09T05:56:49.476291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:06:48.203396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"29'267","reported_seq":291,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:33.001823+0000","last_change":"2024-05-09T05:53:28.235313+0000","last_active":"2024-05-09T05:58:33.001823+0000","last_peered":"2024-05-09T05:58:33.001823+0000","last_clean":"2024-05-09T05:58:33.001823+0000","last_became_active":"2024-05-09T05:53:28.234771+0000","last_became_peered":"2024-05-09T05:53:28.234771+0000","last_unstale":"2024-05-09T05:58:33.001823+0000","last_undegraded":"2024-05-09T05:58:33.001823+0000","last_fullsized":"2024-05-09T05:58:33.001823+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:38:46.942863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":267,"num_write_kb":729088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"29'8","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.179669+0000","last_change":"2024-05-09T05:53:24.141956+0000","last_active":"2024-05-09T05:58:30.179669+0000","last_peered":"2024-05-09T05:58:30.179669+0000","last_clean":"2024-05-09T05:58:30.179669+0000","last_became_active":"2024-05-09T05:53:24.139093+0000","last_became_peered":"2024-05-09T05:53:24.139093+0000","last_unstale":"2024-05-09T05:58:30.179669+0000","last_undegraded":"2024-05-09T05:58:30.179669+0000","last_fullsized":"2024-05-09T05:58:30.179669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:44:32.901168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"27'3","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:57:10.687185+0000","last_change":"2024-05-09T05:53:23.113865+0000","last_active":"2024-05-09T05:57:10.687185+0000","last_peered":"2024-05-09T05:57:10.687185+0000","last_clean":"2024-05-09T05:57:10.687185+0000","last_became_active":"2024-05-09T05:53:23.112020+0000","last_became_peered":"2024-05-09T05:53:23.112020+0000","last_unstale":"2024-05-09T05:57:10.687185+0000","last_undegraded":"2024-05-09T05:57:10.687185+0000","last_fullsized":"2024-05-09T05:57:10.687185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:37:04.425229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":14,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"26'7","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:56:44.375056+0000","last_change":"2024-05-09T05:53:23.127463+0000","last_active":"2024-05-09T05:56:44.375056+0000","last_peered":"2024-05-09T05:56:44.375056+0000","last_clean":"2024-05-09T05:56:44.375056+0000","last_became_active":"2024-05-09T05:53:23.126911+0000","last_became_peered":"2024-05-09T05:53:23.126911+0000","last_unstale":"2024-05-09T05:56:44.375056+0000","last_undegraded":"2024-05-09T05:56:44.375056+0000","last_fullsized":"2024-05-09T05:56:44.375056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:06:28.458926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"29'8","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.192543+0000","last_change":"2024-05-09T05:53:24.134391+0000","last_active":"2024-05-09T05:58:30.192543+0000","last_peered":"2024-05-09T05:58:30.192543+0000","last_clean":"2024-05-09T05:58:30.192543+0000","last_became_active":"2024-05-09T05:53:24.133994+0000","last_became_peered":"2024-05-09T05:53:24.133994+0000","last_unstale":"2024-05-09T05:58:30.192543+0000","last_undegraded":"2024-05-09T05:58:30.192543+0000","last_fullsized":"2024-05-09T05:58:30.192543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:30:32.872657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"29'248","reported_seq":272,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.603281+0000","last_change":"2024-05-09T05:53:28.223524+0000","last_active":"2024-05-09T05:58:31.603281+0000","last_peered":"2024-05-09T05:58:31.603281+0000","last_clean":"2024-05-09T05:58:31.603281+0000","last_became_active":"2024-05-09T05:53:28.222433+0000","last_became_peered":"2024-05-09T05:53:28.222433+0000","last_unstale":"2024-05-09T05:58:31.603281+0000","last_undegraded":"2024-05-09T05:58:31.603281+0000","last_fullsized":"2024-05-09T05:58:31.603281+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:52:35.361812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205520896,"num_objects":49,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"29'7","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:24.721349+0000","last_change":"2024-05-09T05:53:23.133700+0000","last_active":"2024-05-09T05:58:24.721349+0000","last_peered":"2024-05-09T05:58:24.721349+0000","last_clean":"2024-05-09T05:58:24.721349+0000","last_became_active":"2024-05-09T05:53:23.132946+0000","last_became_peered":"2024-05-09T05:53:23.132946+0000","last_unstale":"2024-05-09T05:58:24.721349+0000","last_undegraded":"2024-05-09T05:58:24.721349+0000","last_fullsized":"2024-05-09T05:58:24.721349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:39:49.829592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"29'7","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.163659+0000","last_change":"2024-05-09T05:53:24.138174+0000","last_active":"2024-05-09T05:58:30.163659+0000","last_peered":"2024-05-09T05:58:30.163659+0000","last_clean":"2024-05-09T05:58:30.163659+0000","last_became_active":"2024-05-09T05:53:24.137794+0000","last_became_peered":"2024-05-09T05:53:24.137794+0000","last_unstale":"2024-05-09T05:58:30.163659+0000","last_undegraded":"2024-05-09T05:58:30.163659+0000","last_fullsized":"2024-05-09T05:58:30.163659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:57:26.359258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"29'258","reported_seq":282,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:31.730396+0000","last_change":"2024-05-09T05:53:28.238375+0000","last_active":"2024-05-09T05:58:31.730396+0000","last_peered":"2024-05-09T05:58:31.730396+0000","last_clean":"2024-05-09T05:58:31.730396+0000","last_became_active":"2024-05-09T05:53:28.237414+0000","last_became_peered":"2024-05-09T05:53:28.237414+0000","last_unstale":"2024-05-09T05:58:31.730396+0000","last_undegraded":"2024-05-09T05:58:31.730396+0000","last_fullsized":"2024-05-09T05:58:31.730396+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:13:50.396951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":226492416,"num_objects":54,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":258,"num_write_kb":851968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"29'9","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.147744+0000","last_change":"2024-05-09T05:53:24.130839+0000","last_active":"2024-05-09T05:58:30.147744+0000","last_peered":"2024-05-09T05:58:30.147744+0000","last_clean":"2024-05-09T05:58:30.147744+0000","last_became_active":"2024-05-09T05:53:24.130201+0000","last_became_peered":"2024-05-09T05:53:24.130201+0000","last_unstale":"2024-05-09T05:58:30.147744+0000","last_undegraded":"2024-05-09T05:58:30.147744+0000","last_fullsized":"2024-05-09T05:58:30.147744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:26:03.973553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"29'12","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.179014+0000","last_change":"2024-05-09T05:53:24.138681+0000","last_active":"2024-05-09T05:58:30.179014+0000","last_peered":"2024-05-09T05:58:30.179014+0000","last_clean":"2024-05-09T05:58:30.179014+0000","last_became_active":"2024-05-09T05:53:24.138366+0000","last_became_peered":"2024-05-09T05:53:24.138366+0000","last_unstale":"2024-05-09T05:58:30.179014+0000","last_undegraded":"2024-05-09T05:58:30.179014+0000","last_fullsized":"2024-05-09T05:58:30.179014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:49.856205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"29'8","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.159685+0000","last_change":"2024-05-09T05:53:24.139915+0000","last_active":"2024-05-09T05:58:30.159685+0000","last_peered":"2024-05-09T05:58:30.159685+0000","last_clean":"2024-05-09T05:58:30.159685+0000","last_became_active":"2024-05-09T05:53:24.139058+0000","last_became_peered":"2024-05-09T05:53:24.139058+0000","last_unstale":"2024-05-09T05:58:30.159685+0000","last_undegraded":"2024-05-09T05:58:30.159685+0000","last_fullsized":"2024-05-09T05:58:30.159685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:06:00.768431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"29'7","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.189065+0000","last_change":"2024-05-09T05:53:24.149759+0000","last_active":"2024-05-09T05:58:30.189065+0000","last_peered":"2024-05-09T05:58:30.189065+0000","last_clean":"2024-05-09T05:58:30.189065+0000","last_became_active":"2024-05-09T05:53:24.142812+0000","last_became_peered":"2024-05-09T05:53:24.142812+0000","last_unstale":"2024-05-09T05:58:30.189065+0000","last_undegraded":"2024-05-09T05:58:30.189065+0000","last_fullsized":"2024-05-09T05:58:30.189065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:04.522514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"29'4","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.185763+0000","last_change":"2024-05-09T05:53:24.135373+0000","last_active":"2024-05-09T05:58:30.185763+0000","last_peered":"2024-05-09T05:58:30.185763+0000","last_clean":"2024-05-09T05:58:30.185763+0000","last_became_active":"2024-05-09T05:53:24.135043+0000","last_became_peered":"2024-05-09T05:53:24.135043+0000","last_unstale":"2024-05-09T05:58:30.185763+0000","last_undegraded":"2024-05-09T05:58:30.185763+0000","last_fullsized":"2024-05-09T05:58:30.185763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:20:03.245696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"29'6","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.185380+0000","last_change":"2024-05-09T05:53:24.134712+0000","last_active":"2024-05-09T05:58:30.185380+0000","last_peered":"2024-05-09T05:58:30.185380+0000","last_clean":"2024-05-09T05:58:30.185380+0000","last_became_active":"2024-05-09T05:53:24.132453+0000","last_became_peered":"2024-05-09T05:53:24.132453+0000","last_unstale":"2024-05-09T05:58:30.185380+0000","last_undegraded":"2024-05-09T05:58:30.185380+0000","last_fullsized":"2024-05-09T05:58:30.185380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:47:30.716995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"29'15","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.161321+0000","last_change":"2024-05-09T05:53:24.140714+0000","last_active":"2024-05-09T05:58:30.161321+0000","last_peered":"2024-05-09T05:58:30.161321+0000","last_clean":"2024-05-09T05:58:30.161321+0000","last_became_active":"2024-05-09T05:53:24.140045+0000","last_became_peered":"2024-05-09T05:53:24.140045+0000","last_unstale":"2024-05-09T05:58:30.161321+0000","last_undegraded":"2024-05-09T05:58:30.161321+0000","last_fullsized":"2024-05-09T05:58:30.161321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:36:06.166411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"29'2","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.183512+0000","last_change":"2024-05-09T05:53:24.151591+0000","last_active":"2024-05-09T05:58:30.183512+0000","last_peered":"2024-05-09T05:58:30.183512+0000","last_clean":"2024-05-09T05:58:30.183512+0000","last_became_active":"2024-05-09T05:53:24.151275+0000","last_became_peered":"2024-05-09T05:53:24.151275+0000","last_unstale":"2024-05-09T05:58:30.183512+0000","last_undegraded":"2024-05-09T05:58:30.183512+0000","last_fullsized":"2024-05-09T05:58:30.183512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:28:28.552732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"29'6","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.183409+0000","last_change":"2024-05-09T05:53:24.144315+0000","last_active":"2024-05-09T05:58:30.183409+0000","last_peered":"2024-05-09T05:58:30.183409+0000","last_clean":"2024-05-09T05:58:30.183409+0000","last_became_active":"2024-05-09T05:53:24.144005+0000","last_became_peered":"2024-05-09T05:53:24.144005+0000","last_unstale":"2024-05-09T05:58:30.183409+0000","last_undegraded":"2024-05-09T05:58:30.183409+0000","last_fullsized":"2024-05-09T05:58:30.183409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:06:37.312541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"29'8","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.180625+0000","last_change":"2024-05-09T05:53:24.149852+0000","last_active":"2024-05-09T05:58:30.180625+0000","last_peered":"2024-05-09T05:58:30.180625+0000","last_clean":"2024-05-09T05:58:30.180625+0000","last_became_active":"2024-05-09T05:53:24.146965+0000","last_became_peered":"2024-05-09T05:53:24.146965+0000","last_unstale":"2024-05-09T05:58:30.180625+0000","last_undegraded":"2024-05-09T05:58:30.180625+0000","last_fullsized":"2024-05-09T05:58:30.180625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:02:26.991425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"29'10","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.146017+0000","last_change":"2024-05-09T05:53:24.131735+0000","last_active":"2024-05-09T05:58:30.146017+0000","last_peered":"2024-05-09T05:58:30.146017+0000","last_clean":"2024-05-09T05:58:30.146017+0000","last_became_active":"2024-05-09T05:53:24.131417+0000","last_became_peered":"2024-05-09T05:53:24.131417+0000","last_unstale":"2024-05-09T05:58:30.146017+0000","last_undegraded":"2024-05-09T05:58:30.146017+0000","last_fullsized":"2024-05-09T05:58:30.146017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:01:59.750972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"29'11","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.192644+0000","last_change":"2024-05-09T05:53:24.140697+0000","last_active":"2024-05-09T05:58:30.192644+0000","last_peered":"2024-05-09T05:58:30.192644+0000","last_clean":"2024-05-09T05:58:30.192644+0000","last_became_active":"2024-05-09T05:53:24.140024+0000","last_became_peered":"2024-05-09T05:53:24.140024+0000","last_unstale":"2024-05-09T05:58:30.192644+0000","last_undegraded":"2024-05-09T05:58:30.192644+0000","last_fullsized":"2024-05-09T05:58:30.192644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:14:14.543827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"29'8","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.148226+0000","last_change":"2024-05-09T05:53:24.136878+0000","last_active":"2024-05-09T05:58:30.148226+0000","last_peered":"2024-05-09T05:58:30.148226+0000","last_clean":"2024-05-09T05:58:30.148226+0000","last_became_active":"2024-05-09T05:53:24.136572+0000","last_became_peered":"2024-05-09T05:53:24.136572+0000","last_unstale":"2024-05-09T05:58:30.148226+0000","last_undegraded":"2024-05-09T05:58:30.148226+0000","last_fullsized":"2024-05-09T05:58:30.148226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:46:47.509355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"29'7","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.163381+0000","last_change":"2024-05-09T05:53:24.147372+0000","last_active":"2024-05-09T05:58:30.163381+0000","last_peered":"2024-05-09T05:58:30.163381+0000","last_clean":"2024-05-09T05:58:30.163381+0000","last_became_active":"2024-05-09T05:53:24.144573+0000","last_became_peered":"2024-05-09T05:53:24.144573+0000","last_unstale":"2024-05-09T05:58:30.163381+0000","last_undegraded":"2024-05-09T05:58:30.163381+0000","last_fullsized":"2024-05-09T05:58:30.163381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:51:09.845748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"29'10","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.179342+0000","last_change":"2024-05-09T05:53:24.135964+0000","last_active":"2024-05-09T05:58:30.179342+0000","last_peered":"2024-05-09T05:58:30.179342+0000","last_clean":"2024-05-09T05:58:30.179342+0000","last_became_active":"2024-05-09T05:53:24.135625+0000","last_became_peered":"2024-05-09T05:53:24.135625+0000","last_unstale":"2024-05-09T05:58:30.179342+0000","last_undegraded":"2024-05-09T05:58:30.179342+0000","last_fullsized":"2024-05-09T05:58:30.179342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:52:02.026146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"29'8","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.157333+0000","last_change":"2024-05-09T05:53:24.133916+0000","last_active":"2024-05-09T05:58:30.157333+0000","last_peered":"2024-05-09T05:58:30.157333+0000","last_clean":"2024-05-09T05:58:30.157333+0000","last_became_active":"2024-05-09T05:53:24.133405+0000","last_became_peered":"2024-05-09T05:53:24.133405+0000","last_unstale":"2024-05-09T05:58:30.157333+0000","last_undegraded":"2024-05-09T05:58:30.157333+0000","last_fullsized":"2024-05-09T05:58:30.157333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:30:16.477715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"29'9","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.158011+0000","last_change":"2024-05-09T05:53:24.139697+0000","last_active":"2024-05-09T05:58:30.158011+0000","last_peered":"2024-05-09T05:58:30.158011+0000","last_clean":"2024-05-09T05:58:30.158011+0000","last_became_active":"2024-05-09T05:53:24.139374+0000","last_became_peered":"2024-05-09T05:53:24.139374+0000","last_unstale":"2024-05-09T05:58:30.158011+0000","last_undegraded":"2024-05-09T05:58:30.158011+0000","last_fullsized":"2024-05-09T05:58:30.158011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:26:28.502867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"29'7","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.180122+0000","last_change":"2024-05-09T05:53:24.147755+0000","last_active":"2024-05-09T05:58:30.180122+0000","last_peered":"2024-05-09T05:58:30.180122+0000","last_clean":"2024-05-09T05:58:30.180122+0000","last_became_active":"2024-05-09T05:53:24.145616+0000","last_became_peered":"2024-05-09T05:53:24.145616+0000","last_unstale":"2024-05-09T05:58:30.180122+0000","last_undegraded":"2024-05-09T05:58:30.180122+0000","last_fullsized":"2024-05-09T05:58:30.180122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:21:10.387393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"29'8","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.185016+0000","last_change":"2024-05-09T05:53:24.131741+0000","last_active":"2024-05-09T05:58:30.185016+0000","last_peered":"2024-05-09T05:58:30.185016+0000","last_clean":"2024-05-09T05:58:30.185016+0000","last_became_active":"2024-05-09T05:53:24.128870+0000","last_became_peered":"2024-05-09T05:53:24.128870+0000","last_unstale":"2024-05-09T05:58:30.185016+0000","last_undegraded":"2024-05-09T05:58:30.185016+0000","last_fullsized":"2024-05-09T05:58:30.185016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:28:25.103524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"29'10","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.189062+0000","last_change":"2024-05-09T05:53:24.133443+0000","last_active":"2024-05-09T05:58:30.189062+0000","last_peered":"2024-05-09T05:58:30.189062+0000","last_clean":"2024-05-09T05:58:30.189062+0000","last_became_active":"2024-05-09T05:53:24.132688+0000","last_became_peered":"2024-05-09T05:53:24.132688+0000","last_unstale":"2024-05-09T05:58:30.189062+0000","last_undegraded":"2024-05-09T05:58:30.189062+0000","last_fullsized":"2024-05-09T05:58:30.189062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:43:24.750805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"29'7","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.156337+0000","last_change":"2024-05-09T05:53:24.142600+0000","last_active":"2024-05-09T05:58:30.156337+0000","last_peered":"2024-05-09T05:58:30.156337+0000","last_clean":"2024-05-09T05:58:30.156337+0000","last_became_active":"2024-05-09T05:53:24.142280+0000","last_became_peered":"2024-05-09T05:53:24.142280+0000","last_unstale":"2024-05-09T05:58:30.156337+0000","last_undegraded":"2024-05-09T05:58:30.156337+0000","last_fullsized":"2024-05-09T05:58:30.156337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:20:58.962379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"29'6","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.151928+0000","last_change":"2024-05-09T05:53:24.144839+0000","last_active":"2024-05-09T05:58:30.151928+0000","last_peered":"2024-05-09T05:58:30.151928+0000","last_clean":"2024-05-09T05:58:30.151928+0000","last_became_active":"2024-05-09T05:53:24.144381+0000","last_became_peered":"2024-05-09T05:53:24.144381+0000","last_unstale":"2024-05-09T05:58:30.151928+0000","last_undegraded":"2024-05-09T05:58:30.151928+0000","last_fullsized":"2024-05-09T05:58:30.151928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:40:46.738053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"29'16","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.147352+0000","last_change":"2024-05-09T05:53:24.131521+0000","last_active":"2024-05-09T05:58:30.147352+0000","last_peered":"2024-05-09T05:58:30.147352+0000","last_clean":"2024-05-09T05:58:30.147352+0000","last_became_active":"2024-05-09T05:53:24.131218+0000","last_became_peered":"2024-05-09T05:53:24.131218+0000","last_unstale":"2024-05-09T05:58:30.147352+0000","last_undegraded":"2024-05-09T05:58:30.147352+0000","last_fullsized":"2024-05-09T05:58:30.147352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:25:59.410270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"29'11","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.160728+0000","last_change":"2024-05-09T05:53:24.139922+0000","last_active":"2024-05-09T05:58:30.160728+0000","last_peered":"2024-05-09T05:58:30.160728+0000","last_clean":"2024-05-09T05:58:30.160728+0000","last_became_active":"2024-05-09T05:53:24.139473+0000","last_became_peered":"2024-05-09T05:53:24.139473+0000","last_unstale":"2024-05-09T05:58:30.160728+0000","last_undegraded":"2024-05-09T05:58:30.160728+0000","last_fullsized":"2024-05-09T05:58:30.160728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:37:50.839899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"29'9","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.180793+0000","last_change":"2024-05-09T05:53:24.143338+0000","last_active":"2024-05-09T05:58:30.180793+0000","last_peered":"2024-05-09T05:58:30.180793+0000","last_clean":"2024-05-09T05:58:30.180793+0000","last_became_active":"2024-05-09T05:53:24.143053+0000","last_became_peered":"2024-05-09T05:53:24.143053+0000","last_unstale":"2024-05-09T05:58:30.180793+0000","last_undegraded":"2024-05-09T05:58:30.180793+0000","last_fullsized":"2024-05-09T05:58:30.180793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:22:16.337090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"29'5","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.182540+0000","last_change":"2024-05-09T05:53:24.145517+0000","last_active":"2024-05-09T05:58:30.182540+0000","last_peered":"2024-05-09T05:58:30.182540+0000","last_clean":"2024-05-09T05:58:30.182540+0000","last_became_active":"2024-05-09T05:53:24.145150+0000","last_became_peered":"2024-05-09T05:53:24.145150+0000","last_unstale":"2024-05-09T05:58:30.182540+0000","last_undegraded":"2024-05-09T05:58:30.182540+0000","last_fullsized":"2024-05-09T05:58:30.182540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:19:53.947349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"29'6","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.182235+0000","last_change":"2024-05-09T05:53:24.129669+0000","last_active":"2024-05-09T05:58:30.182235+0000","last_peered":"2024-05-09T05:58:30.182235+0000","last_clean":"2024-05-09T05:58:30.182235+0000","last_became_active":"2024-05-09T05:53:24.129339+0000","last_became_peered":"2024-05-09T05:53:24.129339+0000","last_unstale":"2024-05-09T05:58:30.182235+0000","last_undegraded":"2024-05-09T05:58:30.182235+0000","last_fullsized":"2024-05-09T05:58:30.182235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:05:51.845643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"29'4","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.177393+0000","last_change":"2024-05-09T05:53:24.138914+0000","last_active":"2024-05-09T05:58:30.177393+0000","last_peered":"2024-05-09T05:58:30.177393+0000","last_clean":"2024-05-09T05:58:30.177393+0000","last_became_active":"2024-05-09T05:53:24.138499+0000","last_became_peered":"2024-05-09T05:53:24.138499+0000","last_unstale":"2024-05-09T05:58:30.177393+0000","last_undegraded":"2024-05-09T05:58:30.177393+0000","last_fullsized":"2024-05-09T05:58:30.177393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:29:00.338046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"29'8","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.182277+0000","last_change":"2024-05-09T05:53:24.144296+0000","last_active":"2024-05-09T05:58:30.182277+0000","last_peered":"2024-05-09T05:58:30.182277+0000","last_clean":"2024-05-09T05:58:30.182277+0000","last_became_active":"2024-05-09T05:53:24.143890+0000","last_became_peered":"2024-05-09T05:53:24.143890+0000","last_unstale":"2024-05-09T05:58:30.182277+0000","last_undegraded":"2024-05-09T05:58:30.182277+0000","last_fullsized":"2024-05-09T05:58:30.182277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:34:56.860849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"29'7","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.178572+0000","last_change":"2024-05-09T05:53:24.152635+0000","last_active":"2024-05-09T05:58:30.178572+0000","last_peered":"2024-05-09T05:58:30.178572+0000","last_clean":"2024-05-09T05:58:30.178572+0000","last_became_active":"2024-05-09T05:53:24.151674+0000","last_became_peered":"2024-05-09T05:53:24.151674+0000","last_unstale":"2024-05-09T05:58:30.178572+0000","last_undegraded":"2024-05-09T05:58:30.178572+0000","last_fullsized":"2024-05-09T05:58:30.178572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:18:47.495857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"29'4","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.177792+0000","last_change":"2024-05-09T05:53:24.152746+0000","last_active":"2024-05-09T05:58:30.177792+0000","last_peered":"2024-05-09T05:58:30.177792+0000","last_clean":"2024-05-09T05:58:30.177792+0000","last_became_active":"2024-05-09T05:53:24.151418+0000","last_became_peered":"2024-05-09T05:53:24.151418+0000","last_unstale":"2024-05-09T05:58:30.177792+0000","last_undegraded":"2024-05-09T05:58:30.177792+0000","last_fullsized":"2024-05-09T05:58:30.177792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:27:19.121790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"29'8","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.161043+0000","last_change":"2024-05-09T05:53:24.140908+0000","last_active":"2024-05-09T05:58:30.161043+0000","last_peered":"2024-05-09T05:58:30.161043+0000","last_clean":"2024-05-09T05:58:30.161043+0000","last_became_active":"2024-05-09T05:53:24.140589+0000","last_became_peered":"2024-05-09T05:53:24.140589+0000","last_unstale":"2024-05-09T05:58:30.161043+0000","last_undegraded":"2024-05-09T05:58:30.161043+0000","last_fullsized":"2024-05-09T05:58:30.161043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:51:03.458547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3829399552,"num_objects":913,"num_object_clones":0,"num_object_copies":3652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":913,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8303,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":7973371904,"data_stored":7973371904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8304,"ondisk_log_size":8304,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":503,"ondisk_log_size":503,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":221640,"num_objects":99,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":153,"num_read_kb":159,"num_write":356,"num_write_kb":338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":688128,"data_stored":443280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":330,"ondisk_log_size":330,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509506,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1728924,"kb_used_data":1679700,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":92642916,"statfs":{"total":96636764160,"available":94866345984,"internally_reserved":0,"allocated":1720012800,"data_stored":1719795670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509509,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1517960,"kb_used_data":1464640,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":92853880,"statfs":{"total":96636764160,"available":95082373120,"internally_reserved":0,"allocated":1499791360,"data_stored":1499596671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509509,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1833528,"kb_used_data":1788464,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":92538312,"statfs":{"total":96636764160,"available":94759231488,"internally_reserved":0,"allocated":1831387136,"data_stored":1831157924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509506,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1268372,"kb_used_data":1212940,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":93103468,"statfs":{"total":96636764160,"available":95337951232,"internally_reserved":0,"allocated":1242050560,"data_stored":1241856442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509508,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2011596,"kb_used_data":1948548,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":92360244,"statfs":{"total":96636764160,"available":94576889856,"internally_reserved":0,"allocated":1995313152,"data_stored":1995112781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64551365},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509508,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1677720,"kb_used_data":1628496,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":92694120,"statfs":{"total":96636764160,"available":94918778880,"internally_reserved":0,"allocated":1667579904,"data_stored":1667368993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574915,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50132,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321708,"statfs":{"total":96636764160,"available":96585428992,"internally_reserved":0,"allocated":929792,"data_stored":721752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574916,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69600,"kb_used_data":2392,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94302240,"statfs":{"total":96636764160,"available":96565493760,"internally_reserved":0,"allocated":2449408,"data_stored":2229903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68811207},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":3706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":229376,"data_stored":213011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":266240,"data_stored":214781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1008730112,"data_stored":1008730112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1623195648,"data_stored":1623195648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1111490560,"data_stored":1111490560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2097152,"data_stored":2097152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1249902592,"data_stored":1249902592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1447034880,"data_stored":1447034880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1530920960,"data_stored":1530920960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T05:58:37.708 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T05:58:37.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.903+0000 7f1bd826f640 1 Processor -- start 2024-05-09T05:58:37.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.903+0000 7f1bd826f640 1 -- start start 2024-05-09T05:58:37.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.903+0000 7f1bd826f640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1bd015c190 0x7f1bd0159730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:37.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.903+0000 7f1bd826f640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1bd006fc00 0x7f1bd0070010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:37.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.903+0000 7f1bd826f640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bd00724b0 con 0x7f1bd0073160 2024-05-09T05:58:37.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.903+0000 7f1bd826f640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f1bd0072770 con 0x7f1bd015c190 2024-05-09T05:58:37.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.903+0000 7f1bd826f640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f1bd0072a50 con 0x7f1bd006fc00 2024-05-09T05:58:37.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.903+0000 7f1bd600b640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1bd015c190 0x7f1bd0159730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:37.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.903+0000 7f1bd600b640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1bd015c190 0x7f1bd0159730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54298/0 (socket says 172.21.15.72:54298) 2024-05-09T05:58:37.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.903+0000 7f1bd600b640 1 -- 172.21.15.72:0/3305372140 learned_addr learned my addr 172.21.15.72:0/3305372140 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:58:37.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.903+0000 7f1bd600b640 1 -- 172.21.15.72:0/3305372140 >> v2:172.21.15.110:3300/0 conn(0x7f1bd006fc00 msgr2=0x7f1bd0070010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:58:37.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.903+0000 7f1bd600b640 1 --2- 172.21.15.72:0/3305372140 >> v2:172.21.15.110:3300/0 conn(0x7f1bd006fc00 0x7f1bd0070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:37.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.903+0000 7f1bd600b640 1 -- 172.21.15.72:0/3305372140 >> v1:172.21.15.110:6789/0 conn(0x7f1bd0073160 legacy=0x7f1bd0152e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:58:37.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.903+0000 7f1bd600b640 1 -- 172.21.15.72:0/3305372140 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bd0158f30 con 0x7f1bd015c190 2024-05-09T05:58:37.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.907+0000 7f1bd600b640 1 --2- 172.21.15.72:0/3305372140 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bd015c190 0x7f1bd0159730 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0072150 tx=0x7f1bcc01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cfb0c8c57fff2ae server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:37.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.907+0000 7f1bd5009640 1 -- 172.21.15.72:0/3305372140 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc0b5070 con 0x7f1bd015c190 2024-05-09T05:58:37.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.907+0000 7f1bd5009640 1 -- 172.21.15.72:0/3305372140 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bcc0a89d0 con 0x7f1bd015c190 2024-05-09T05:58:37.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.907+0000 7f1bd5009640 1 -- 172.21.15.72:0/3305372140 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc0a8da0 con 0x7f1bd015c190 2024-05-09T05:58:37.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.907+0000 7f1bd826f640 1 -- 172.21.15.72:0/3305372140 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bd015c190 msgr2=0x7f1bd0159730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:37.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.907+0000 7f1bd826f640 1 --2- 172.21.15.72:0/3305372140 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bd015c190 0x7f1bd0159730 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0072150 tx=0x7f1bcc01ed10 comp rx=0 tx=0).stop 2024-05-09T05:58:37.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.907+0000 7f1bd826f640 1 -- 172.21.15.72:0/3305372140 shutdown_connections 2024-05-09T05:58:37.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.907+0000 7f1bd826f640 1 --2- 172.21.15.72:0/3305372140 >> v2:172.21.15.110:3300/0 conn(0x7f1bd006fc00 0x7f1bd0070010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:37.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.907+0000 7f1bd826f640 1 --2- 172.21.15.72:0/3305372140 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bd015c190 0x7f1bd0159730 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:37.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.907+0000 7f1bd826f640 1 -- 172.21.15.72:0/3305372140 >> 172.21.15.72:0/3305372140 conn(0x7f1bd00cde90 msgr2=0x7f1bd00ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:58:37.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.907+0000 7f1bd826f640 1 -- 172.21.15.72:0/3305372140 shutdown_connections 2024-05-09T05:58:37.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.907+0000 7f1bd826f640 1 -- 172.21.15.72:0/3305372140 wait complete. 2024-05-09T05:58:37.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.907+0000 7f1bd826f640 1 Processor -- start 2024-05-09T05:58:37.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.907+0000 7f1bd826f640 1 -- start start 2024-05-09T05:58:37.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.911+0000 7f1bd826f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1bd006fc00 0x7f1bd015bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:37.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.911+0000 7f1bd826f640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bd0073160 0x7f1bd015a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:37.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.911+0000 7f1bd826f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1bd015c190 0x7f1bd013e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:37.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.911+0000 7f1bd826f640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd0073570 con 0x7f1bd0073160 2024-05-09T05:58:37.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.911+0000 7f1bd826f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd0158c20 con 0x7f1bd015c190 2024-05-09T05:58:37.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.911+0000 7f1bd826f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f1bd00736f0 con 0x7f1bd006fc00 2024-05-09T05:58:37.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.911+0000 7f1bd580a640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bd0073160 0x7f1bd015a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:37.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.911+0000 7f1bd580a640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bd0073160 0x7f1bd015a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54314/0 (socket says 172.21.15.72:54314) 2024-05-09T05:58:37.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.911+0000 7f1bd580a640 1 -- 172.21.15.72:0/1711040212 learned_addr learned my addr 172.21.15.72:0/1711040212 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:58:37.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.911+0000 7f1bd600b640 1 --2- 172.21.15.72:0/1711040212 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1bd006fc00 0x7f1bd015bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:37.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.911+0000 7f1bd580a640 1 -- 172.21.15.72:0/1711040212 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1bd006fc00 msgr2=0x7f1bd015bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:37.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.911+0000 7f1bd580a640 1 --2- 172.21.15.72:0/1711040212 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1bd006fc00 0x7f1bd015bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:37.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.911+0000 7f1bd680c640 1 --2- 172.21.15.72:0/1711040212 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1bd015c190 0x7f1bd013e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:37.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.911+0000 7f1bd580a640 1 -- 172.21.15.72:0/1711040212 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1bd015c190 msgr2=0x7f1bd013e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:37.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.911+0000 7f1bd580a640 1 --2- 172.21.15.72:0/1711040212 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1bd015c190 0x7f1bd013e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:37.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.911+0000 7f1bd580a640 1 -- 172.21.15.72:0/1711040212 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bd0140cd0 con 0x7f1bd0073160 2024-05-09T05:58:37.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.911+0000 7f1bd600b640 1 --2- 172.21.15.72:0/1711040212 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1bd006fc00 0x7f1bd015bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:58:37.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.911+0000 7f1bd680c640 1 --2- 172.21.15.72:0/1711040212 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1bd015c190 0x7f1bd013e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:58:37.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.911+0000 7f1bd580a640 1 --2- 172.21.15.72:0/1711040212 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bd0073160 0x7f1bd015a900 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f1bc000b410 tx=0x7f1bc000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:37.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.911+0000 7f1bc6ffd640 1 -- 172.21.15.72:0/1711040212 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc0015020 con 0x7f1bd0073160 2024-05-09T05:58:37.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.911+0000 7f1bc6ffd640 1 -- 172.21.15.72:0/1711040212 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bc0011830 con 0x7f1bd0073160 2024-05-09T05:58:37.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.911+0000 7f1bc6ffd640 1 -- 172.21.15.72:0/1711040212 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc0011c20 con 0x7f1bd0073160 2024-05-09T05:58:37.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.911+0000 7f1bd826f640 1 -- 172.21.15.72:0/1711040212 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bd01409f0 con 0x7f1bd0073160 2024-05-09T05:58:37.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.911+0000 7f1bd826f640 1 -- 172.21.15.72:0/1711040212 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bd015a100 con 0x7f1bd0073160 2024-05-09T05:58:37.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.911+0000 7f1bd826f640 1 -- 172.21.15.72:0/1711040212 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bd006a520 con 0x7f1bd0073160 2024-05-09T05:58:37.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.911+0000 7f1bc6ffd640 1 -- 172.21.15.72:0/1711040212 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f1bc0018020 con 0x7f1bd0073160 2024-05-09T05:58:37.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.911+0000 7f1bc6ffd640 1 --2- 172.21.15.72:0/1711040212 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f1bb406f430 0x7f1bb4071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:37.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.911+0000 7f1bc6ffd640 1 -- 172.21.15.72:0/1711040212 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6762+0+0 (secure 0 0 0) 0x7f1bc008f000 con 0x7f1bd0073160 2024-05-09T05:58:37.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.911+0000 7f1bd600b640 1 --2- 172.21.15.72:0/1711040212 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f1bb406f430 0x7f1bb4071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:37.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.915+0000 7f1bd600b640 1 --2- 172.21.15.72:0/1711040212 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f1bb406f430 0x7f1bb4071940 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc0b2000 tx=0x7f1bcc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:37.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:37.919+0000 7f1bc6ffd640 1 -- 172.21.15.72:0/1711040212 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f1bc001f070 con 0x7f1bd0073160 2024-05-09T05:58:38.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:38.071+0000 7f1bd826f640 1 -- 172.21.15.72:0/1711040212 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1bd0140740 con 0x7f1bd0073160 2024-05-09T05:58:38.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:38.071+0000 7f1bc6ffd640 1 -- 172.21.15.72:0/1711040212 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18848 (secure 0 0 0) 0x7f1bc005bb60 con 0x7f1bd0073160 2024-05-09T05:58:38.061 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:58:38.061 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":29,"fsid":"44c88cb9-b39b-4787-a871-80ddf0ad6292","created":"2024-05-09T05:52:59.591187+0000","modified":"2024-05-09T05:56:44.361800+0000","last_up_change":"2024-05-09T05:53:10.902489+0000","last_in_change":"2024-05-09T05:53:02.200254+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T05:53:10.503537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T05:53:21.364958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T05:53:22.461477+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-09T05:53:26.171144+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e4af2aa1-ba5c-4411-a72a-a0e38e589a74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":331913921},{"type":"v1","addr":"172.21.15.72:6817","nonce":331913921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":331913921},{"type":"v1","addr":"172.21.15.72:6819","nonce":331913921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":331913921},{"type":"v1","addr":"172.21.15.72:6823","nonce":331913921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":331913921},{"type":"v1","addr":"172.21.15.72:6821","nonce":331913921}]},"public_addr":"172.21.15.72:6817/331913921","cluster_addr":"172.21.15.72:6819/331913921","heartbeat_back_addr":"172.21.15.72:6823/331913921","heartbeat_front_addr":"172.21.15.72:6821/331913921","state":["exists","up"]},{"osd":1,"uuid":"052504f5-a523-4922-bdc7-ce2890faa5ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2197151836},{"type":"v1","addr":"172.21.15.72:6801","nonce":2197151836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2197151836},{"type":"v1","addr":"172.21.15.72:6803","nonce":2197151836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2197151836},{"type":"v1","addr":"172.21.15.72:6811","nonce":2197151836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2197151836},{"type":"v1","addr":"172.21.15.72:6807","nonce":2197151836}]},"public_addr":"172.21.15.72:6801/2197151836","cluster_addr":"172.21.15.72:6803/2197151836","heartbeat_back_addr":"172.21.15.72:6811/2197151836","heartbeat_front_addr":"172.21.15.72:6807/2197151836","state":["exists","up"]},{"osd":2,"uuid":"28bc1c95-6d0d-4263-baad-314d86e6a670","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1273581990},{"type":"v1","addr":"172.21.15.72:6825","nonce":1273581990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":1273581990},{"type":"v1","addr":"172.21.15.72:6827","nonce":1273581990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1273581990},{"type":"v1","addr":"172.21.15.72:6831","nonce":1273581990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1273581990},{"type":"v1","addr":"172.21.15.72:6829","nonce":1273581990}]},"public_addr":"172.21.15.72:6825/1273581990","cluster_addr":"172.21.15.72:6827/1273581990","heartbeat_back_addr":"172.21.15.72:6831/1273581990","heartbeat_front_addr":"172.21.15.72:6829/1273581990","state":["exists","up"]},{"osd":3,"uuid":"edcc86cb-f178-4533-8069-de9d781531ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2180866263},{"type":"v1","addr":"172.21.15.72:6806","nonce":2180866263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2180866263},{"type":"v1","addr":"172.21.15.72:6810","nonce":2180866263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2180866263},{"type":"v1","addr":"172.21.15.72:6815","nonce":2180866263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2180866263},{"type":"v1","addr":"172.21.15.72:6813","nonce":2180866263}]},"public_addr":"172.21.15.72:6806/2180866263","cluster_addr":"172.21.15.72:6810/2180866263","heartbeat_back_addr":"172.21.15.72:6815/2180866263","heartbeat_front_addr":"172.21.15.72:6813/2180866263","state":["exists","up"]},{"osd":4,"uuid":"8d138128-4829-4109-87a1-25f339f3e953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3437318248},{"type":"v1","addr":"172.21.15.110:6817","nonce":3437318248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3437318248},{"type":"v1","addr":"172.21.15.110:6819","nonce":3437318248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3437318248},{"type":"v1","addr":"172.21.15.110:6823","nonce":3437318248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3437318248},{"type":"v1","addr":"172.21.15.110:6821","nonce":3437318248}]},"public_addr":"172.21.15.110:6817/3437318248","cluster_addr":"172.21.15.110:6819/3437318248","heartbeat_back_addr":"172.21.15.110:6823/3437318248","heartbeat_front_addr":"172.21.15.110:6821/3437318248","state":["exists","up"]},{"osd":5,"uuid":"99a4a914-0a0e-4d25-94ae-3e86b8b1aa4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":977576181},{"type":"v1","addr":"172.21.15.110:6825","nonce":977576181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":977576181},{"type":"v1","addr":"172.21.15.110:6827","nonce":977576181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":977576181},{"type":"v1","addr":"172.21.15.110:6831","nonce":977576181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":977576181},{"type":"v1","addr":"172.21.15.110:6829","nonce":977576181}]},"public_addr":"172.21.15.110:6825/977576181","cluster_addr":"172.21.15.110:6827/977576181","heartbeat_back_addr":"172.21.15.110:6831/977576181","heartbeat_front_addr":"172.21.15.110:6829/977576181","state":["exists","up"]},{"osd":6,"uuid":"6e04b295-afc9-4f80-80f7-3df1f5168608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":1817638786},{"type":"v1","addr":"172.21.15.110:6809","nonce":1817638786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":1817638786},{"type":"v1","addr":"172.21.15.110:6811","nonce":1817638786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":1817638786},{"type":"v1","addr":"172.21.15.110:6815","nonce":1817638786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":1817638786},{"type":"v1","addr":"172.21.15.110:6813","nonce":1817638786}]},"public_addr":"172.21.15.110:6809/1817638786","cluster_addr":"172.21.15.110:6811/1817638786","heartbeat_back_addr":"172.21.15.110:6815/1817638786","heartbeat_front_addr":"172.21.15.110:6813/1817638786","state":["exists","up"]},{"osd":7,"uuid":"835de5c9-1e2c-41d8-bd28-d7ffe5ad8fdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":214675920},{"type":"v1","addr":"172.21.15.110:6801","nonce":214675920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":214675920},{"type":"v1","addr":"172.21.15.110:6803","nonce":214675920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":214675920},{"type":"v1","addr":"172.21.15.110:6807","nonce":214675920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":214675920},{"type":"v1","addr":"172.21.15.110:6805","nonce":214675920}]},"public_addr":"172.21.15.110:6801/214675920","cluster_addr":"172.21.15.110:6803/214675920","heartbeat_back_addr":"172.21.15.110:6807/214675920","heartbeat_front_addr":"172.21.15.110:6805/214675920","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.849761+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.670554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.743789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:08.516367+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.665550+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.518775+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.786468+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.794984+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":0,"to":7}]},{"pgid":"4.6","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:6834/1142956298":"2024-05-10T05:56:44.361730+0000","172.21.15.72:6832/1142956298":"2024-05-10T05:56:44.361730+0000","172.21.15.72:6835/3946563056":"2024-05-10T05:55:14.344999+0000","172.21.15.72:6833/3946563056":"2024-05-10T05:55:14.344999+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T05:58:38.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:38.075+0000 7f1bd826f640 1 -- 172.21.15.72:0/1711040212 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f1bb406f430 msgr2=0x7f1bb4071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:38.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:38.075+0000 7f1bd826f640 1 --2- 172.21.15.72:0/1711040212 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f1bb406f430 0x7f1bb4071940 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc0b2000 tx=0x7f1bcc008040 comp rx=0 tx=0).stop 2024-05-09T05:58:38.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:38.075+0000 7f1bd826f640 1 -- 172.21.15.72:0/1711040212 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bd0073160 msgr2=0x7f1bd015a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:38.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:38.075+0000 7f1bd826f640 1 --2- 172.21.15.72:0/1711040212 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bd0073160 0x7f1bd015a900 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f1bc000b410 tx=0x7f1bc000b8d0 comp rx=0 tx=0).stop 2024-05-09T05:58:38.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:38.075+0000 7f1bd826f640 1 -- 172.21.15.72:0/1711040212 shutdown_connections 2024-05-09T05:58:38.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:38.075+0000 7f1bd826f640 1 --2- 172.21.15.72:0/1711040212 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f1bb406f430 0x7f1bb4071940 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:38.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:38.075+0000 7f1bd826f640 1 --2- 172.21.15.72:0/1711040212 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1bd015c190 0x7f1bd013e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:38.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:38.075+0000 7f1bd826f640 1 --2- 172.21.15.72:0/1711040212 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bd0073160 0x7f1bd015a900 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:38.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:38.075+0000 7f1bd826f640 1 --2- 172.21.15.72:0/1711040212 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1bd006fc00 0x7f1bd015bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:38.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:38.075+0000 7f1bd826f640 1 -- 172.21.15.72:0/1711040212 >> 172.21.15.72:0/1711040212 conn(0x7f1bd00cde90 msgr2=0x7f1bd01437a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:58:38.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:38.075+0000 7f1bd826f640 1 -- 172.21.15.72:0/1711040212 shutdown_connections 2024-05-09T05:58:38.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:38.075+0000 7f1bd826f640 1 -- 172.21.15.72:0/1711040212 wait complete. 2024-05-09T05:58:39.083 INFO:tasks.ceph:Scrubbing osd.0 2024-05-09T05:58:39.083 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-05-09T05:58:39.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.263+0000 7f6cc0eff640 1 Processor -- start 2024-05-09T05:58:39.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.263+0000 7f6cc0eff640 1 -- start start 2024-05-09T05:58:39.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.263+0000 7f6cc0eff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6cbc159ed0 0x7f6cbc153860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:39.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.263+0000 7f6cc0eff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6cbc072f40 0x7f6cbc073350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:39.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.263+0000 7f6cc0eff640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cbc072b00 con 0x7f6cbc0c6cd0 2024-05-09T05:58:39.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.263+0000 7f6cc0eff640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f6cbc072540 con 0x7f6cbc159ed0 2024-05-09T05:58:39.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.263+0000 7f6cc0eff640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f6cbc072820 con 0x7f6cbc072f40 2024-05-09T05:58:39.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.267+0000 7f6cba59c640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6cbc159ed0 0x7f6cbc153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:39.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.267+0000 7f6cba59c640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6cbc159ed0 0x7f6cbc153860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54324/0 (socket says 172.21.15.72:54324) 2024-05-09T05:58:39.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.267+0000 7f6cba59c640 1 -- 172.21.15.72:0/3834254233 learned_addr learned my addr 172.21.15.72:0/3834254233 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:58:39.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.267+0000 7f6cb1d9b640 1 --2- 172.21.15.72:0/3834254233 >> v2:172.21.15.110:3300/0 conn(0x7f6cbc072f40 0x7f6cbc073350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:39.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.267+0000 7f6cba59c640 1 -- 172.21.15.72:0/3834254233 >> v2:172.21.15.110:3300/0 conn(0x7f6cbc072f40 msgr2=0x7f6cbc073350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:58:39.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.267+0000 7f6cba59c640 1 --2- 172.21.15.72:0/3834254233 >> v2:172.21.15.110:3300/0 conn(0x7f6cbc072f40 0x7f6cbc073350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:39.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.267+0000 7f6cba59c640 1 -- 172.21.15.72:0/3834254233 >> v1:172.21.15.110:6789/0 conn(0x7f6cbc0c6cd0 legacy=0x7f6cbc0c70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:39.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.267+0000 7f6cba59c640 1 -- 172.21.15.72:0/3834254233 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cbc0c64d0 con 0x7f6cbc159ed0 2024-05-09T05:58:39.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.267+0000 7f6cba59c640 1 --2- 172.21.15.72:0/3834254233 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6cbc159ed0 0x7f6cbc153860 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc071e50 tx=0x7f6cac01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bda6ef4b3ec8494 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:39.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.267+0000 7f6cb9d9b640 1 -- 172.21.15.72:0/3834254233 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cac0b5070 con 0x7f6cbc159ed0 2024-05-09T05:58:39.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.267+0000 7f6cb9d9b640 1 -- 172.21.15.72:0/3834254233 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cac0a8a10 con 0x7f6cbc159ed0 2024-05-09T05:58:39.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.267+0000 7f6cb9d9b640 1 -- 172.21.15.72:0/3834254233 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cac0a8de0 con 0x7f6cbc159ed0 2024-05-09T05:58:39.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.271+0000 7f6cc0eff640 1 -- 172.21.15.72:0/3834254233 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6cbc159ed0 msgr2=0x7f6cbc153860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:39.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.271+0000 7f6cc0eff640 1 --2- 172.21.15.72:0/3834254233 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6cbc159ed0 0x7f6cbc153860 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc071e50 tx=0x7f6cac01ed10 comp rx=0 tx=0).stop 2024-05-09T05:58:39.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.271+0000 7f6cc0eff640 1 -- 172.21.15.72:0/3834254233 shutdown_connections 2024-05-09T05:58:39.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.271+0000 7f6cc0eff640 1 --2- 172.21.15.72:0/3834254233 >> v2:172.21.15.110:3300/0 conn(0x7f6cbc072f40 0x7f6cbc073350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:39.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.271+0000 7f6cc0eff640 1 --2- 172.21.15.72:0/3834254233 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6cbc159ed0 0x7f6cbc153860 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:39.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.271+0000 7f6cc0eff640 1 -- 172.21.15.72:0/3834254233 >> 172.21.15.72:0/3834254233 conn(0x7f6cbc0cde90 msgr2=0x7f6cbc0ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:58:39.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.271+0000 7f6cc0eff640 1 -- 172.21.15.72:0/3834254233 shutdown_connections 2024-05-09T05:58:39.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.271+0000 7f6cc0eff640 1 -- 172.21.15.72:0/3834254233 wait complete. 2024-05-09T05:58:39.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.271+0000 7f6cc0eff640 1 Processor -- start 2024-05-09T05:58:39.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.271+0000 7f6cc0eff640 1 -- start start 2024-05-09T05:58:39.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.275+0000 7f6cc0eff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6cbc072f40 0x7f6cbc15bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:39.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.275+0000 7f6cc0eff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6cbc0c6cd0 0x7f6cbc1f1160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:39.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.275+0000 7f6cc0eff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6cbc159ed0 0x7f6cbc15cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:39.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.275+0000 7f6cc0eff640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f6cbc0c4e30 con 0x7f6cbc072f40 2024-05-09T05:58:39.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.275+0000 7f6cc0eff640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f6cbc0c4cb0 con 0x7f6cbc0c6cd0 2024-05-09T05:58:39.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.275+0000 7f6cc0eff640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f6cbc163d80 con 0x7f6cbc159ed0 2024-05-09T05:58:39.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.275+0000 7f6cba59c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6cbc072f40 0x7f6cbc15bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:39.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.275+0000 7f6cba59c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6cbc072f40 0x7f6cbc15bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54332/0 (socket says 172.21.15.72:54332) 2024-05-09T05:58:39.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.275+0000 7f6cba59c640 1 -- 172.21.15.72:0/3944538847 learned_addr learned my addr 172.21.15.72:0/3944538847 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:58:39.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.275+0000 7f6cb1d9b640 1 --2- 172.21.15.72:0/3944538847 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6cbc0c6cd0 0x7f6cbc1f1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:39.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.275+0000 7f6cba59c640 1 -- 172.21.15.72:0/3944538847 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6cbc159ed0 msgr2=0x7f6cbc15cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:39.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.275+0000 7f6cba59c640 1 --2- 172.21.15.72:0/3944538847 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6cbc159ed0 0x7f6cbc15cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:39.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.275+0000 7f6cba59c640 1 -- 172.21.15.72:0/3944538847 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6cbc0c6cd0 msgr2=0x7f6cbc1f1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:39.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.275+0000 7f6cba59c640 1 --2- 172.21.15.72:0/3944538847 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6cbc0c6cd0 0x7f6cbc1f1160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:39.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.275+0000 7f6cba59c640 1 -- 172.21.15.72:0/3944538847 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cbc0caa50 con 0x7f6cbc072f40 2024-05-09T05:58:39.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.275+0000 7f6cba59c640 1 --2- 172.21.15.72:0/3944538847 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6cbc072f40 0x7f6cbc15bee0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f6cac000c10 tx=0x7f6cac01bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:39.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.275+0000 7f6cb37fe640 1 -- 172.21.15.72:0/3944538847 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cac0b5070 con 0x7f6cbc072f40 2024-05-09T05:58:39.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.275+0000 7f6cb37fe640 1 -- 172.21.15.72:0/3944538847 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cac0b09d0 con 0x7f6cbc072f40 2024-05-09T05:58:39.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.275+0000 7f6cc0eff640 1 -- 172.21.15.72:0/3944538847 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cbc0c7180 con 0x7f6cbc072f40 2024-05-09T05:58:39.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.275+0000 7f6cb37fe640 1 -- 172.21.15.72:0/3944538847 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cac0b0da0 con 0x7f6cbc072f40 2024-05-09T05:58:39.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.275+0000 7f6cc0eff640 1 -- 172.21.15.72:0/3944538847 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cbc15ae40 con 0x7f6cbc072f40 2024-05-09T05:58:39.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.275+0000 7f6cc0eff640 1 -- 172.21.15.72:0/3944538847 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6cbc06a520 con 0x7f6cbc072f40 2024-05-09T05:58:39.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.275+0000 7f6cb37fe640 1 -- 172.21.15.72:0/3944538847 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f6cac0c2060 con 0x7f6cbc072f40 2024-05-09T05:58:39.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.275+0000 7f6cb37fe640 1 --2- 172.21.15.72:0/3944538847 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f6c9c06f400 0x7f6c9c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:39.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.275+0000 7f6cb37fe640 1 -- 172.21.15.72:0/3944538847 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6762+0+0 (secure 0 0 0) 0x7f6cac12cdb0 con 0x7f6cbc072f40 2024-05-09T05:58:39.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.275+0000 7f6cb37fe640 1 --2- 172.21.15.72:0/3944538847 >> [v2:172.21.15.72:6816/331913921,v1:172.21.15.72:6817/331913921] conn(0x7f6c9c078db0 0x7f6c9c07b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:39.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.275+0000 7f6cb37fe640 1 -- 172.21.15.72:0/3944538847 --> [v2:172.21.15.72:6816/331913921,v1:172.21.15.72:6817/331913921] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6cac0abec0 con 0x7f6c9c078db0 2024-05-09T05:58:39.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.275+0000 7f6cb37fe640 1 -- 172.21.15.72:0/3944538847 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6cac12d240 con 0x7f6cbc072f40 2024-05-09T05:58:39.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.275+0000 7f6cb1d9b640 1 --2- 172.21.15.72:0/3944538847 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f6c9c06f400 0x7f6c9c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:39.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.279+0000 7f6cbad9d640 1 --2- 172.21.15.72:0/3944538847 >> [v2:172.21.15.72:6816/331913921,v1:172.21.15.72:6817/331913921] conn(0x7f6c9c078db0 0x7f6c9c07b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:39.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.279+0000 7f6cbad9d640 1 --2- 172.21.15.72:0/3944538847 >> [v2:172.21.15.72:6816/331913921,v1:172.21.15.72:6817/331913921] conn(0x7f6c9c078db0 0x7f6c9c07b280 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:39.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.279+0000 7f6cb1d9b640 1 --2- 172.21.15.72:0/3944538847 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f6c9c06f400 0x7f6c9c071910 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc0c41d0 tx=0x7f6ca4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:39.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.279+0000 7f6cb37fe640 1 -- 172.21.15.72:0/3944538847 <== osd.0 v2:172.21.15.72:6816/331913921 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6cac0abec0 con 0x7f6c9c078db0 2024-05-09T05:58:39.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.291+0000 7f6cc0eff640 1 -- 172.21.15.72:0/3944538847 --> [v2:172.21.15.72:6816/331913921,v1:172.21.15.72:6817/331913921] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6cbc150cd0 con 0x7f6c9c078db0 2024-05-09T05:58:39.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.291+0000 7f6cb37fe640 1 -- 172.21.15.72:0/3944538847 <== osd.0 v2:172.21.15.72:6816/331913921 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f6cbc150cd0 con 0x7f6c9c078db0 2024-05-09T05:58:39.280 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-05-09T05:58:39.280 INFO:teuthology.orchestra.run.smithi072.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-09T05:58:39.280 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-05-09T05:58:39.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.291+0000 7f6cc0eff640 1 -- 172.21.15.72:0/3944538847 >> [v2:172.21.15.72:6816/331913921,v1:172.21.15.72:6817/331913921] conn(0x7f6c9c078db0 msgr2=0x7f6c9c07b280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:39.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.291+0000 7f6cc0eff640 1 --2- 172.21.15.72:0/3944538847 >> [v2:172.21.15.72:6816/331913921,v1:172.21.15.72:6817/331913921] conn(0x7f6c9c078db0 0x7f6c9c07b280 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:39.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.291+0000 7f6cc0eff640 1 -- 172.21.15.72:0/3944538847 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f6c9c06f400 msgr2=0x7f6c9c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:39.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.291+0000 7f6cc0eff640 1 --2- 172.21.15.72:0/3944538847 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f6c9c06f400 0x7f6c9c071910 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc0c41d0 tx=0x7f6ca4008040 comp rx=0 tx=0).stop 2024-05-09T05:58:39.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.291+0000 7f6cc0eff640 1 -- 172.21.15.72:0/3944538847 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6cbc072f40 msgr2=0x7f6cbc15bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:39.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.291+0000 7f6cc0eff640 1 --2- 172.21.15.72:0/3944538847 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6cbc072f40 0x7f6cbc15bee0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f6cac000c10 tx=0x7f6cac01bab0 comp rx=0 tx=0).stop 2024-05-09T05:58:39.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.291+0000 7f6cbad9d640 1 -- 172.21.15.72:0/3944538847 reap_dead start 2024-05-09T05:58:39.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.291+0000 7f6cc0eff640 1 -- 172.21.15.72:0/3944538847 shutdown_connections 2024-05-09T05:58:39.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.291+0000 7f6cc0eff640 1 -- 172.21.15.72:0/3944538847 >> 172.21.15.72:0/3944538847 conn(0x7f6cbc0cde90 msgr2=0x7f6cbc151a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:58:39.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.291+0000 7f6cc0eff640 1 -- 172.21.15.72:0/3944538847 shutdown_connections 2024-05-09T05:58:39.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.291+0000 7f6cc0eff640 1 -- 172.21.15.72:0/3944538847 wait complete. 2024-05-09T05:58:39.301 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-05-09T05:58:39.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.463+0000 7f5cb5546640 1 Processor -- start 2024-05-09T05:58:39.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.463+0000 7f5cb5546640 1 -- start start 2024-05-09T05:58:39.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.467+0000 7f5cb5546640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5cb015e4a0 0x7f5cb00ca620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:39.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.467+0000 7f5cb5546640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cb00c9a30 con 0x7f5cb00cc6b0 2024-05-09T05:58:39.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.467+0000 7f5cb5546640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cb00c9d10 con 0x7f5cb0074d30 2024-05-09T05:58:39.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.467+0000 7f5cb5546640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f5cb00cc200 con 0x7f5cb015e4a0 2024-05-09T05:58:39.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.467+0000 7f5cae7fc640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f5cb00cc6b0 0x7f5cb0074620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:38474/0 (socket says 172.21.15.72:38474) 2024-05-09T05:58:39.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.467+0000 7f5cae7fc640 1 -- 172.21.15.72:0/2285685870 learned_addr learned my addr 172.21.15.72:0/2285685870 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:58:39.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.467+0000 7f5caeffd640 1 --2- 172.21.15.72:0/2285685870 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5cb015e4a0 0x7f5cb00ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:39.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.467+0000 7f5cadffb640 1 -- 172.21.15.72:0/2285685870 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1886432729 0 0) 0x7f5cb00c9a30 con 0x7f5cb00cc6b0 2024-05-09T05:58:39.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.467+0000 7f5cadffb640 1 -- 172.21.15.72:0/2285685870 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c98003530 con 0x7f5cb00cc6b0 2024-05-09T05:58:39.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.467+0000 7f5cadffb640 1 -- 172.21.15.72:0/2285685870 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2475469378 0 0) 0x7f5c98003530 con 0x7f5cb00cc6b0 2024-05-09T05:58:39.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.467+0000 7f5cadffb640 1 -- 172.21.15.72:0/2285685870 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5cb015e4a0 msgr2=0x7f5cb00ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:58:39.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.467+0000 7f5cadffb640 1 --2- 172.21.15.72:0/2285685870 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5cb015e4a0 0x7f5cb00ca620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:39.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.467+0000 7f5cadffb640 1 -- 172.21.15.72:0/2285685870 >> v1:172.21.15.110:6789/0 conn(0x7f5cb0074d30 legacy=0x7f5cb0164e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:39.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.467+0000 7f5cadffb640 1 -- 172.21.15.72:0/2285685870 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cb00c9ff0 con 0x7f5cb00cc6b0 2024-05-09T05:58:39.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.467+0000 7f5cadffb640 1 -- 172.21.15.72:0/2285685870 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2749052815 0 0) 0x7f5ca4001700 con 0x7f5cb00cc6b0 2024-05-09T05:58:39.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.467+0000 7f5cadffb640 1 -- 172.21.15.72:0/2285685870 >> v1:172.21.15.72:6789/0 conn(0x7f5cb00cc6b0 legacy=0x7f5cb0074620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:39.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.467+0000 7f5cadffb640 1 --2- 172.21.15.72:0/2285685870 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5cb015e4a0 0x7f5c98003a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:39.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.467+0000 7f5cadffb640 1 --2- 172.21.15.72:0/2285685870 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c98004010 0x7f5c98004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:39.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.467+0000 7f5cadffb640 1 --2- 172.21.15.72:0/2285685870 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5c98004d50 0x7f5c98005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:39.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.467+0000 7f5cadffb640 1 -- 172.21.15.72:0/2285685870 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f5cb00cc200 con 0x7f5c98004010 2024-05-09T05:58:39.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.467+0000 7f5cadffb640 1 -- 172.21.15.72:0/2285685870 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f5c9800bc90 con 0x7f5c98004d50 2024-05-09T05:58:39.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.467+0000 7f5cadffb640 1 -- 172.21.15.72:0/2285685870 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f5c9800be90 con 0x7f5cb015e4a0 2024-05-09T05:58:39.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.467+0000 7f5cae7fc640 1 --2- 172.21.15.72:0/2285685870 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c98004010 0x7f5c98004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:39.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.467+0000 7f5caeffd640 1 --2- 172.21.15.72:0/2285685870 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5cb015e4a0 0x7f5c98003a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:39.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.467+0000 7f5caf7fe640 1 --2- 172.21.15.72:0/2285685870 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5c98004d50 0x7f5c98005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:39.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.467+0000 7f5cae7fc640 1 -- 172.21.15.72:0/2285685870 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5cb015e4a0 msgr2=0x7f5c98003a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:58:39.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.467+0000 7f5cae7fc640 1 --2- 172.21.15.72:0/2285685870 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5cb015e4a0 0x7f5c98003a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:39.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.467+0000 7f5cae7fc640 1 -- 172.21.15.72:0/2285685870 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5c98004d50 msgr2=0x7f5c98005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:58:39.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.467+0000 7f5cae7fc640 1 --2- 172.21.15.72:0/2285685870 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5c98004d50 0x7f5c98005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:39.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.467+0000 7f5cae7fc640 1 -- 172.21.15.72:0/2285685870 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c98003530 con 0x7f5c98004010 2024-05-09T05:58:39.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.471+0000 7f5cae7fc640 1 --2- 172.21.15.72:0/2285685870 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c98004010 0x7f5c98004810 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f5ca4001060 tx=0x7f5ca401cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed2191713924a309 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:39.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.471+0000 7f5cadffb640 1 -- 172.21.15.72:0/2285685870 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ca4007d20 con 0x7f5c98004010 2024-05-09T05:58:39.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.471+0000 7f5cadffb640 1 -- 172.21.15.72:0/2285685870 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ca40a9020 con 0x7f5c98004010 2024-05-09T05:58:39.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.471+0000 7f5cadffb640 1 -- 172.21.15.72:0/2285685870 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ca4005b20 con 0x7f5c98004010 2024-05-09T05:58:39.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.471+0000 7f5cb5546640 1 -- 172.21.15.72:0/2285685870 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c98004010 msgr2=0x7f5c98004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:39.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.471+0000 7f5cb5546640 1 --2- 172.21.15.72:0/2285685870 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c98004010 0x7f5c98004810 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f5ca4001060 tx=0x7f5ca401cba0 comp rx=0 tx=0).stop 2024-05-09T05:58:39.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.471+0000 7f5caf7fe640 1 -- 172.21.15.72:0/2285685870 reap_dead start 2024-05-09T05:58:39.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.471+0000 7f5cb5546640 1 -- 172.21.15.72:0/2285685870 shutdown_connections 2024-05-09T05:58:39.459 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.471+0000 7f5cb5546640 1 -- 172.21.15.72:0/2285685870 >> 172.21.15.72:0/2285685870 conn(0x7f5cb00cfc20 msgr2=0x7f5cb00d0030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:58:39.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.471+0000 7f5cb5546640 1 -- 172.21.15.72:0/2285685870 shutdown_connections 2024-05-09T05:58:39.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.471+0000 7f5cb5546640 1 -- 172.21.15.72:0/2285685870 wait complete. 2024-05-09T05:58:39.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.471+0000 7f5cb5546640 1 Processor -- start 2024-05-09T05:58:39.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.471+0000 7f5cb5546640 1 -- start start 2024-05-09T05:58:39.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.475+0000 7f5cb5546640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c98004010 0x7f5cb015d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:39.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.475+0000 7f5cb5546640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5cb006da40 0x7f5cb01f94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:39.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.475+0000 7f5cb5546640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5cb015da00 0x7f5cb0157250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:39.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.475+0000 7f5cb5546640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f5cb01666c0 con 0x7f5c98004010 2024-05-09T05:58:39.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.475+0000 7f5cb5546640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f5cb0166540 con 0x7f5cb006da40 2024-05-09T05:58:39.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.475+0000 7f5cb5546640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f5cb0166840 con 0x7f5cb015da00 2024-05-09T05:58:39.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.475+0000 7f5caeffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c98004010 0x7f5cb015d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:39.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.475+0000 7f5caeffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c98004010 0x7f5cb015d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54344/0 (socket says 172.21.15.72:54344) 2024-05-09T05:58:39.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.475+0000 7f5caeffd640 1 -- 172.21.15.72:0/2629074427 learned_addr learned my addr 172.21.15.72:0/2629074427 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:58:39.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.475+0000 7f5caf7fe640 1 --2- 172.21.15.72:0/2629074427 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5cb015da00 0x7f5cb0157250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:39.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.475+0000 7f5cae7fc640 1 --2- 172.21.15.72:0/2629074427 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5cb006da40 0x7f5cb01f94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:39.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.475+0000 7f5caeffd640 1 -- 172.21.15.72:0/2629074427 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5cb015da00 msgr2=0x7f5cb0157250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:39.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.475+0000 7f5caeffd640 1 --2- 172.21.15.72:0/2629074427 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5cb015da00 0x7f5cb0157250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:39.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.475+0000 7f5caeffd640 1 -- 172.21.15.72:0/2629074427 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5cb006da40 msgr2=0x7f5cb01f94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:39.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.475+0000 7f5caeffd640 1 --2- 172.21.15.72:0/2629074427 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5cb006da40 0x7f5cb01f94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:39.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.475+0000 7f5caeffd640 1 -- 172.21.15.72:0/2629074427 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cb01f9a00 con 0x7f5c98004010 2024-05-09T05:58:39.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.475+0000 7f5caf7fe640 1 --2- 172.21.15.72:0/2629074427 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5cb015da00 0x7f5cb0157250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:58:39.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.475+0000 7f5caeffd640 1 --2- 172.21.15.72:0/2629074427 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c98004010 0x7f5cb015d290 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f5ca0007f60 tx=0x7f5ca0007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:39.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.475+0000 7f5c977fe640 1 -- 172.21.15.72:0/2629074427 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ca001a020 con 0x7f5c98004010 2024-05-09T05:58:39.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.475+0000 7f5c977fe640 1 -- 172.21.15.72:0/2629074427 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ca0016470 con 0x7f5c98004010 2024-05-09T05:58:39.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.475+0000 7f5cb5546640 1 -- 172.21.15.72:0/2629074427 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cb015c1f0 con 0x7f5c98004010 2024-05-09T05:58:39.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.475+0000 7f5c977fe640 1 -- 172.21.15.72:0/2629074427 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ca0016860 con 0x7f5c98004010 2024-05-09T05:58:39.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.475+0000 7f5cb5546640 1 -- 172.21.15.72:0/2629074427 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cb01f9c10 con 0x7f5c98004010 2024-05-09T05:58:39.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.475+0000 7f5cb5546640 1 -- 172.21.15.72:0/2629074427 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cb006a520 con 0x7f5c98004010 2024-05-09T05:58:39.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.475+0000 7f5c977fe640 1 -- 172.21.15.72:0/2629074427 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f5ca001d020 con 0x7f5c98004010 2024-05-09T05:58:39.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.475+0000 7f5c977fe640 1 --2- 172.21.15.72:0/2629074427 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f5c9c06f400 0x7f5c9c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:39.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.475+0000 7f5c977fe640 1 -- 172.21.15.72:0/2629074427 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6762+0+0 (secure 0 0 0) 0x7f5ca0090490 con 0x7f5c98004010 2024-05-09T05:58:39.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.479+0000 7f5cae7fc640 1 --2- 172.21.15.72:0/2629074427 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f5c9c06f400 0x7f5c9c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:39.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.479+0000 7f5cae7fc640 1 --2- 172.21.15.72:0/2629074427 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f5c9c06f400 0x7f5c9c071910 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5ca40aa000 tx=0x7f5ca4000ff0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:39.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.483+0000 7f5c977fe640 1 -- 172.21.15.72:0/2629074427 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f5ca0024030 con 0x7f5c98004010 2024-05-09T05:58:39.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.647+0000 7f5cb5546640 1 -- 172.21.15.72:0/2629074427 --> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f5cb01f9eb0 con 0x7f5c9c06f400 2024-05-09T05:58:39.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.647+0000 7f5c977fe640 1 -- 172.21.15.72:0/2629074427 <== mgr.4102 v2:172.21.15.110:6832/1113420672 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f5cb01f9eb0 con 0x7f5c9c06f400 2024-05-09T05:58:39.636 INFO:teuthology.orchestra.run.smithi072.stderr:instructed osd(s) 0 to deep-scrub 2024-05-09T05:58:39.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.651+0000 7f5cb5546640 1 -- 172.21.15.72:0/2629074427 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f5c9c06f400 msgr2=0x7f5c9c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:39.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.651+0000 7f5cb5546640 1 --2- 172.21.15.72:0/2629074427 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f5c9c06f400 0x7f5c9c071910 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5ca40aa000 tx=0x7f5ca4000ff0 comp rx=0 tx=0).stop 2024-05-09T05:58:39.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.651+0000 7f5cb5546640 1 -- 172.21.15.72:0/2629074427 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c98004010 msgr2=0x7f5cb015d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:39.639 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.651+0000 7f5cb5546640 1 --2- 172.21.15.72:0/2629074427 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c98004010 0x7f5cb015d290 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f5ca0007f60 tx=0x7f5ca0007f90 comp rx=0 tx=0).stop 2024-05-09T05:58:39.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.651+0000 7f5cb5546640 1 -- 172.21.15.72:0/2629074427 shutdown_connections 2024-05-09T05:58:39.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.651+0000 7f5cb5546640 1 --2- 172.21.15.72:0/2629074427 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f5c9c06f400 0x7f5c9c071910 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:39.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.651+0000 7f5cb5546640 1 --2- 172.21.15.72:0/2629074427 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5cb015da00 0x7f5cb0157250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:39.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.651+0000 7f5cb5546640 1 --2- 172.21.15.72:0/2629074427 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5cb006da40 0x7f5cb01f94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:39.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.651+0000 7f5cb5546640 1 --2- 172.21.15.72:0/2629074427 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c98004010 0x7f5cb015d290 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:39.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.651+0000 7f5cb5546640 1 -- 172.21.15.72:0/2629074427 >> 172.21.15.72:0/2629074427 conn(0x7f5cb00cfc20 msgr2=0x7f5cb0153d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:58:39.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.651+0000 7f5cb5546640 1 -- 172.21.15.72:0/2629074427 shutdown_connections 2024-05-09T05:58:39.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.651+0000 7f5cb5546640 1 -- 172.21.15.72:0/2629074427 wait complete. 2024-05-09T05:58:39.659 INFO:tasks.ceph:Scrubbing osd.1 2024-05-09T05:58:39.659 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-05-09T05:58:39.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.823+0000 7f491f468640 1 Processor -- start 2024-05-09T05:58:39.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.823+0000 7f491f468640 1 -- start start 2024-05-09T05:58:39.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.823+0000 7f491f468640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f49181537d0 0x7f4918074740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:39.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.823+0000 7f491f468640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4918161d70 0x7f4918164190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:39.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.823+0000 7f491f468640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49180c72c0 con 0x7f49180c77a0 2024-05-09T05:58:39.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.823+0000 7f491f468640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f4918074c80 con 0x7f49181537d0 2024-05-09T05:58:39.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.823+0000 7f491f468640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f49180c7bb0 con 0x7f4918161d70 2024-05-09T05:58:39.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.823+0000 7f491ca03640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f49181537d0 0x7f4918074740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:39.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.823+0000 7f491ca03640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f49181537d0 0x7f4918074740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54348/0 (socket says 172.21.15.72:54348) 2024-05-09T05:58:39.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.823+0000 7f491ca03640 1 -- 172.21.15.72:0/2477049146 learned_addr learned my addr 172.21.15.72:0/2477049146 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:58:39.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.823+0000 7f491da05640 1 --2- 172.21.15.72:0/2477049146 >> v2:172.21.15.110:3300/0 conn(0x7f4918161d70 0x7f4918164190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:39.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.823+0000 7f491ca03640 1 -- 172.21.15.72:0/2477049146 >> v2:172.21.15.110:3300/0 conn(0x7f4918161d70 msgr2=0x7f4918164190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:58:39.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.823+0000 7f491ca03640 1 --2- 172.21.15.72:0/2477049146 >> v2:172.21.15.110:3300/0 conn(0x7f4918161d70 0x7f4918164190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:39.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.823+0000 7f491ca03640 1 -- 172.21.15.72:0/2477049146 >> v1:172.21.15.110:6789/0 conn(0x7f49180c77a0 legacy=0x7f4918072e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:58:39.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.823+0000 7f491ca03640 1 -- 172.21.15.72:0/2477049146 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4918153be0 con 0x7f49181537d0 2024-05-09T05:58:39.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.827+0000 7f491ca03640 1 --2- 172.21.15.72:0/2477049146 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49181537d0 0x7f4918074740 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f49180ce620 tx=0x7f490801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c44b260fb23648d1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:39.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.827+0000 7f490ffff640 1 -- 172.21.15.72:0/2477049146 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49080b0070 con 0x7f49181537d0 2024-05-09T05:58:39.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.827+0000 7f490ffff640 1 -- 172.21.15.72:0/2477049146 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49080ab600 con 0x7f49181537d0 2024-05-09T05:58:39.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.827+0000 7f490ffff640 1 -- 172.21.15.72:0/2477049146 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49080ab9d0 con 0x7f49181537d0 2024-05-09T05:58:39.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.827+0000 7f491f468640 1 -- 172.21.15.72:0/2477049146 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49181537d0 msgr2=0x7f4918074740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:39.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.827+0000 7f491f468640 1 --2- 172.21.15.72:0/2477049146 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49181537d0 0x7f4918074740 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f49180ce620 tx=0x7f490801c4f0 comp rx=0 tx=0).stop 2024-05-09T05:58:39.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.827+0000 7f491f468640 1 -- 172.21.15.72:0/2477049146 shutdown_connections 2024-05-09T05:58:39.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.827+0000 7f491f468640 1 --2- 172.21.15.72:0/2477049146 >> v2:172.21.15.110:3300/0 conn(0x7f4918161d70 0x7f4918164190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:39.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.827+0000 7f491f468640 1 --2- 172.21.15.72:0/2477049146 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49181537d0 0x7f4918074740 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:39.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.827+0000 7f491f468640 1 -- 172.21.15.72:0/2477049146 >> 172.21.15.72:0/2477049146 conn(0x7f49180cde90 msgr2=0x7f49180ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:58:39.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.827+0000 7f491f468640 1 -- 172.21.15.72:0/2477049146 shutdown_connections 2024-05-09T05:58:39.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.827+0000 7f491f468640 1 -- 172.21.15.72:0/2477049146 wait complete. 2024-05-09T05:58:39.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.831+0000 7f491f468640 1 Processor -- start 2024-05-09T05:58:39.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.831+0000 7f491f468640 1 -- start start 2024-05-09T05:58:39.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.831+0000 7f491f468640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49180c77a0 0x7f49181f60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:39.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.831+0000 7f491f468640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f49181537d0 0x7f4918144550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:39.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.831+0000 7f491f468640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4918161d70 0x7f4918141fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:39.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.831+0000 7f491f468640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f4918072940 con 0x7f49180c77a0 2024-05-09T05:58:39.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.831+0000 7f491f468640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f49180740b0 con 0x7f49181537d0 2024-05-09T05:58:39.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.831+0000 7f491f468640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f49180c4cb0 con 0x7f4918161d70 2024-05-09T05:58:39.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.831+0000 7f491d204640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49180c77a0 0x7f49181f60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:39.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.831+0000 7f491d204640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49180c77a0 0x7f49181f60c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54360/0 (socket says 172.21.15.72:54360) 2024-05-09T05:58:39.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.831+0000 7f491d204640 1 -- 172.21.15.72:0/1550874195 learned_addr learned my addr 172.21.15.72:0/1550874195 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:58:39.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.831+0000 7f491d204640 1 -- 172.21.15.72:0/1550874195 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4918161d70 msgr2=0x7f4918141fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:39.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.831+0000 7f491d204640 1 --2- 172.21.15.72:0/1550874195 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4918161d70 0x7f4918141fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:39.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.831+0000 7f491ca03640 1 --2- 172.21.15.72:0/1550874195 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f49181537d0 0x7f4918144550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:39.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.831+0000 7f491d204640 1 -- 172.21.15.72:0/1550874195 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f49181537d0 msgr2=0x7f4918144550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:39.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.831+0000 7f491d204640 1 --2- 172.21.15.72:0/1550874195 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f49181537d0 0x7f4918144550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:39.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.831+0000 7f491d204640 1 -- 172.21.15.72:0/1550874195 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49181f6600 con 0x7f49180c77a0 2024-05-09T05:58:39.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.831+0000 7f491d204640 1 --2- 172.21.15.72:0/1550874195 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49180c77a0 0x7f49181f60c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f491400b3e0 tx=0x7f491400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:39.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.831+0000 7f490dffb640 1 -- 172.21.15.72:0/1550874195 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4914015020 con 0x7f49180c77a0 2024-05-09T05:58:39.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.831+0000 7f490dffb640 1 -- 172.21.15.72:0/1550874195 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4914011830 con 0x7f49180c77a0 2024-05-09T05:58:39.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.831+0000 7f490dffb640 1 -- 172.21.15.72:0/1550874195 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4914011c60 con 0x7f49180c77a0 2024-05-09T05:58:39.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.835+0000 7f491f468640 1 -- 172.21.15.72:0/1550874195 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4918142c80 con 0x7f49180c77a0 2024-05-09T05:58:39.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.835+0000 7f491f468640 1 -- 172.21.15.72:0/1550874195 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49181f9920 con 0x7f49180c77a0 2024-05-09T05:58:39.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.835+0000 7f491f468640 1 -- 172.21.15.72:0/1550874195 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f49181f5c70 con 0x7f49180c77a0 2024-05-09T05:58:39.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.835+0000 7f490dffb640 1 -- 172.21.15.72:0/1550874195 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f4914018020 con 0x7f49180c77a0 2024-05-09T05:58:39.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.835+0000 7f490dffb640 1 --2- 172.21.15.72:0/1550874195 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f48fc06f400 0x7f48fc071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:39.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.835+0000 7f490dffb640 1 -- 172.21.15.72:0/1550874195 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6762+0+0 (secure 0 0 0) 0x7f491408f920 con 0x7f49180c77a0 2024-05-09T05:58:39.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.835+0000 7f490dffb640 1 --2- 172.21.15.72:0/1550874195 >> [v2:172.21.15.72:6800/2197151836,v1:172.21.15.72:6801/2197151836] conn(0x7f48fc078db0 0x7f48fc07b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:39.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.835+0000 7f490dffb640 1 -- 172.21.15.72:0/1550874195 --> [v2:172.21.15.72:6800/2197151836,v1:172.21.15.72:6801/2197151836] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f48fc07b950 con 0x7f48fc078db0 2024-05-09T05:58:39.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.835+0000 7f490dffb640 1 -- 172.21.15.72:0/1550874195 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f491408fdb0 con 0x7f49180c77a0 2024-05-09T05:58:39.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.835+0000 7f491ca03640 1 --2- 172.21.15.72:0/1550874195 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f48fc06f400 0x7f48fc071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:39.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.835+0000 7f491da05640 1 --2- 172.21.15.72:0/1550874195 >> [v2:172.21.15.72:6800/2197151836,v1:172.21.15.72:6801/2197151836] conn(0x7f48fc078db0 0x7f48fc07b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:39.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.835+0000 7f491da05640 1 --2- 172.21.15.72:0/1550874195 >> [v2:172.21.15.72:6800/2197151836,v1:172.21.15.72:6801/2197151836] conn(0x7f48fc078db0 0x7f48fc07b280 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:39.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.835+0000 7f491ca03640 1 --2- 172.21.15.72:0/1550874195 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f48fc06f400 0x7f48fc071910 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f49080ad000 tx=0x7f4908008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:39.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.835+0000 7f490dffb640 1 -- 172.21.15.72:0/1550874195 <== osd.1 v2:172.21.15.72:6800/2197151836 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f48fc07b950 con 0x7f48fc078db0 2024-05-09T05:58:39.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.851+0000 7f491f468640 1 -- 172.21.15.72:0/1550874195 --> [v2:172.21.15.72:6800/2197151836,v1:172.21.15.72:6801/2197151836] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f491806a520 con 0x7f48fc078db0 2024-05-09T05:58:39.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.851+0000 7f490dffb640 1 -- 172.21.15.72:0/1550874195 <== osd.1 v2:172.21.15.72:6800/2197151836 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f491806a520 con 0x7f48fc078db0 2024-05-09T05:58:39.839 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-05-09T05:58:39.839 INFO:teuthology.orchestra.run.smithi072.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-09T05:58:39.839 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-05-09T05:58:39.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.851+0000 7f491f468640 1 -- 172.21.15.72:0/1550874195 >> [v2:172.21.15.72:6800/2197151836,v1:172.21.15.72:6801/2197151836] conn(0x7f48fc078db0 msgr2=0x7f48fc07b280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:39.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.851+0000 7f491f468640 1 --2- 172.21.15.72:0/1550874195 >> [v2:172.21.15.72:6800/2197151836,v1:172.21.15.72:6801/2197151836] conn(0x7f48fc078db0 0x7f48fc07b280 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:39.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.851+0000 7f491f468640 1 -- 172.21.15.72:0/1550874195 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f48fc06f400 msgr2=0x7f48fc071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:39.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.851+0000 7f491f468640 1 --2- 172.21.15.72:0/1550874195 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f48fc06f400 0x7f48fc071910 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f49080ad000 tx=0x7f4908008040 comp rx=0 tx=0).stop 2024-05-09T05:58:39.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.851+0000 7f491f468640 1 -- 172.21.15.72:0/1550874195 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49180c77a0 msgr2=0x7f49181f60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:39.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.851+0000 7f491f468640 1 --2- 172.21.15.72:0/1550874195 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49180c77a0 0x7f49181f60c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f491400b3e0 tx=0x7f491400b8a0 comp rx=0 tx=0).stop 2024-05-09T05:58:39.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.851+0000 7f491da05640 1 -- 172.21.15.72:0/1550874195 reap_dead start 2024-05-09T05:58:39.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.851+0000 7f491f468640 1 -- 172.21.15.72:0/1550874195 shutdown_connections 2024-05-09T05:58:39.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.851+0000 7f491f468640 1 -- 172.21.15.72:0/1550874195 >> 172.21.15.72:0/1550874195 conn(0x7f49180cde90 msgr2=0x7f49180ca060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:58:39.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.851+0000 7f491f468640 1 -- 172.21.15.72:0/1550874195 shutdown_connections 2024-05-09T05:58:39.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:39.851+0000 7f491f468640 1 -- 172.21.15.72:0/1550874195 wait complete. 2024-05-09T05:58:39.860 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-05-09T05:58:40.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.019+0000 7fcc8790a640 1 Processor -- start 2024-05-09T05:58:40.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.019+0000 7fcc8790a640 1 -- start start 2024-05-09T05:58:40.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.019+0000 7fcc8790a640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcc8015e470 0x7fcc8015e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:40.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.019+0000 7fcc8790a640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcc8015edc0 0x7fcc8015f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:40.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.019+0000 7fcc8790a640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc800cda30 con 0x7fcc80156b50 2024-05-09T05:58:40.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.019+0000 7fcc8790a640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fcc800cc020 con 0x7fcc8015edc0 2024-05-09T05:58:40.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.019+0000 7fcc8790a640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fcc8015dfe0 con 0x7fcc8015e470 2024-05-09T05:58:40.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.019+0000 7fcc85ea7640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcc8015edc0 0x7fcc8015f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:40.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.019+0000 7fcc85ea7640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcc8015edc0 0x7fcc8015f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54376/0 (socket says 172.21.15.72:54376) 2024-05-09T05:58:40.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.019+0000 7fcc85ea7640 1 -- 172.21.15.72:0/3753178043 learned_addr learned my addr 172.21.15.72:0/3753178043 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:58:40.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.019+0000 7fcc84ea5640 1 --2- 172.21.15.72:0/3753178043 >> v2:172.21.15.110:3300/0 conn(0x7fcc8015e470 0x7fcc8015e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:40.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.019+0000 7fcc85ea7640 1 -- 172.21.15.72:0/3753178043 >> v2:172.21.15.110:3300/0 conn(0x7fcc8015e470 msgr2=0x7fcc8015e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:58:40.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.019+0000 7fcc85ea7640 1 --2- 172.21.15.72:0/3753178043 >> v2:172.21.15.110:3300/0 conn(0x7fcc8015e470 0x7fcc8015e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:40.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.019+0000 7fcc85ea7640 1 -- 172.21.15.72:0/3753178043 >> v1:172.21.15.110:6789/0 conn(0x7fcc80156b50 legacy=0x7fcc80073ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:58:40.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.019+0000 7fcc85ea7640 1 -- 172.21.15.72:0/3753178043 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc8015cdd0 con 0x7fcc8015edc0 2024-05-09T05:58:40.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.023+0000 7fcc85ea7640 1 --2- 172.21.15.72:0/3753178043 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc8015edc0 0x7fcc8015f1d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fcc8008f980 tx=0x7fcc7801c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ab1a4911e906398 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:40.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.023+0000 7fcc77fff640 1 -- 172.21.15.72:0/3753178043 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc780ac020 con 0x7fcc8015edc0 2024-05-09T05:58:40.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.023+0000 7fcc77fff640 1 -- 172.21.15.72:0/3753178043 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc780a64a0 con 0x7fcc8015edc0 2024-05-09T05:58:40.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.023+0000 7fcc77fff640 1 -- 172.21.15.72:0/3753178043 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc780a6870 con 0x7fcc8015edc0 2024-05-09T05:58:40.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.023+0000 7fcc8790a640 1 -- 172.21.15.72:0/3753178043 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc8015edc0 msgr2=0x7fcc8015f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:40.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.023+0000 7fcc8790a640 1 --2- 172.21.15.72:0/3753178043 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc8015edc0 0x7fcc8015f1d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fcc8008f980 tx=0x7fcc7801c810 comp rx=0 tx=0).stop 2024-05-09T05:58:40.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.023+0000 7fcc8790a640 1 -- 172.21.15.72:0/3753178043 shutdown_connections 2024-05-09T05:58:40.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.023+0000 7fcc8790a640 1 --2- 172.21.15.72:0/3753178043 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc8015edc0 0x7fcc8015f1d0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:40.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.023+0000 7fcc8790a640 1 --2- 172.21.15.72:0/3753178043 >> v2:172.21.15.110:3300/0 conn(0x7fcc8015e470 0x7fcc8015e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:40.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.023+0000 7fcc8790a640 1 -- 172.21.15.72:0/3753178043 >> 172.21.15.72:0/3753178043 conn(0x7fcc800d1b70 msgr2=0x7fcc800d1f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:58:40.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.023+0000 7fcc8790a640 1 -- 172.21.15.72:0/3753178043 shutdown_connections 2024-05-09T05:58:40.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.023+0000 7fcc8790a640 1 -- 172.21.15.72:0/3753178043 wait complete. 2024-05-09T05:58:40.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.027+0000 7fcc8790a640 1 Processor -- start 2024-05-09T05:58:40.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.027+0000 7fcc8790a640 1 -- start start 2024-05-09T05:58:40.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.027+0000 7fcc8790a640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc80156b50 0x7fcc80155010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:40.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.027+0000 7fcc8790a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc8015e470 0x7fcc80157410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:40.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.027+0000 7fcc8790a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc8015edc0 0x7fcc801f9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:40.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.027+0000 7fcc8790a640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fcc8015c9b0 con 0x7fcc80156b50 2024-05-09T05:58:40.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.027+0000 7fcc8790a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fcc80074cf0 con 0x7fcc8015e470 2024-05-09T05:58:40.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.027+0000 7fcc8790a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fcc8015cb30 con 0x7fcc8015edc0 2024-05-09T05:58:40.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.027+0000 7fcc856a6640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc80156b50 0x7fcc80155010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:40.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.027+0000 7fcc856a6640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc80156b50 0x7fcc80155010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54392/0 (socket says 172.21.15.72:54392) 2024-05-09T05:58:40.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.027+0000 7fcc856a6640 1 -- 172.21.15.72:0/364048536 learned_addr learned my addr 172.21.15.72:0/364048536 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:58:40.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.027+0000 7fcc84ea5640 1 --2- 172.21.15.72:0/364048536 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc8015e470 0x7fcc80157410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:40.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.027+0000 7fcc85ea7640 1 --2- 172.21.15.72:0/364048536 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc8015edc0 0x7fcc801f9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:40.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.027+0000 7fcc856a6640 1 -- 172.21.15.72:0/364048536 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc8015edc0 msgr2=0x7fcc801f9bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:40.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.027+0000 7fcc856a6640 1 --2- 172.21.15.72:0/364048536 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc8015edc0 0x7fcc801f9bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:40.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.027+0000 7fcc856a6640 1 -- 172.21.15.72:0/364048536 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc8015e470 msgr2=0x7fcc80157410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:40.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.027+0000 7fcc856a6640 1 --2- 172.21.15.72:0/364048536 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc8015e470 0x7fcc80157410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:40.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.027+0000 7fcc856a6640 1 -- 172.21.15.72:0/364048536 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc801fa110 con 0x7fcc80156b50 2024-05-09T05:58:40.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.027+0000 7fcc85ea7640 1 --2- 172.21.15.72:0/364048536 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc8015edc0 0x7fcc801f9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:58:40.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.027+0000 7fcc856a6640 1 --2- 172.21.15.72:0/364048536 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc80156b50 0x7fcc80155010 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c00b410 tx=0x7fcc7c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:40.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.027+0000 7fcc75ffb640 1 -- 172.21.15.72:0/364048536 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc7c015030 con 0x7fcc80156b50 2024-05-09T05:58:40.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.027+0000 7fcc75ffb640 1 -- 172.21.15.72:0/364048536 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc7c004020 con 0x7fcc80156b50 2024-05-09T05:58:40.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.027+0000 7fcc8790a640 1 -- 172.21.15.72:0/364048536 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc80156730 con 0x7fcc80156b50 2024-05-09T05:58:40.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.027+0000 7fcc75ffb640 1 -- 172.21.15.72:0/364048536 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc7c004450 con 0x7fcc80156b50 2024-05-09T05:58:40.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.027+0000 7fcc8790a640 1 -- 172.21.15.72:0/364048536 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc80156450 con 0x7fcc80156b50 2024-05-09T05:58:40.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.027+0000 7fcc8790a640 1 -- 172.21.15.72:0/364048536 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc8006a520 con 0x7fcc80156b50 2024-05-09T05:58:40.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.031+0000 7fcc75ffb640 1 -- 172.21.15.72:0/364048536 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fcc7c018070 con 0x7fcc80156b50 2024-05-09T05:58:40.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.031+0000 7fcc75ffb640 1 --2- 172.21.15.72:0/364048536 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fcc6406f400 0x7fcc64071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:40.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.031+0000 7fcc75ffb640 1 -- 172.21.15.72:0/364048536 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6762+0+0 (secure 0 0 0) 0x7fcc7c08fab0 con 0x7fcc80156b50 2024-05-09T05:58:40.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.031+0000 7fcc84ea5640 1 --2- 172.21.15.72:0/364048536 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fcc6406f400 0x7fcc64071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:40.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.031+0000 7fcc84ea5640 1 --2- 172.21.15.72:0/364048536 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fcc6406f400 0x7fcc64071910 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fcc8015c940 tx=0x7fcc70008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:40.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.035+0000 7fcc75ffb640 1 -- 172.21.15.72:0/364048536 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fcc7c05c580 con 0x7fcc80156b50 2024-05-09T05:58:40.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.199+0000 7fcc8790a640 1 -- 172.21.15.72:0/364048536 --> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fcc800cdcb0 con 0x7fcc6406f400 2024-05-09T05:58:40.186 INFO:teuthology.orchestra.run.smithi072.stderr:instructed osd(s) 1 to deep-scrub 2024-05-09T05:58:40.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.199+0000 7fcc75ffb640 1 -- 172.21.15.72:0/364048536 <== mgr.4102 v2:172.21.15.110:6832/1113420672 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fcc800cdcb0 con 0x7fcc6406f400 2024-05-09T05:58:40.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.199+0000 7fcc8790a640 1 -- 172.21.15.72:0/364048536 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fcc6406f400 msgr2=0x7fcc64071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:40.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.199+0000 7fcc8790a640 1 --2- 172.21.15.72:0/364048536 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fcc6406f400 0x7fcc64071910 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fcc8015c940 tx=0x7fcc70008040 comp rx=0 tx=0).stop 2024-05-09T05:58:40.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.199+0000 7fcc8790a640 1 -- 172.21.15.72:0/364048536 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc80156b50 msgr2=0x7fcc80155010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:40.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.199+0000 7fcc8790a640 1 --2- 172.21.15.72:0/364048536 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc80156b50 0x7fcc80155010 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c00b410 tx=0x7fcc7c00b8d0 comp rx=0 tx=0).stop 2024-05-09T05:58:40.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.199+0000 7fcc8790a640 1 -- 172.21.15.72:0/364048536 shutdown_connections 2024-05-09T05:58:40.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.199+0000 7fcc8790a640 1 --2- 172.21.15.72:0/364048536 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fcc6406f400 0x7fcc64071910 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:40.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.199+0000 7fcc8790a640 1 --2- 172.21.15.72:0/364048536 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc8015edc0 0x7fcc801f9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:40.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.199+0000 7fcc8790a640 1 --2- 172.21.15.72:0/364048536 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc8015e470 0x7fcc80157410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:40.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.199+0000 7fcc8790a640 1 --2- 172.21.15.72:0/364048536 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc80156b50 0x7fcc80155010 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:40.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.199+0000 7fcc8790a640 1 -- 172.21.15.72:0/364048536 >> 172.21.15.72:0/364048536 conn(0x7fcc800d1b70 msgr2=0x7fcc800b64a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:58:40.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.199+0000 7fcc8790a640 1 -- 172.21.15.72:0/364048536 shutdown_connections 2024-05-09T05:58:40.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.199+0000 7fcc8790a640 1 -- 172.21.15.72:0/364048536 wait complete. 2024-05-09T05:58:40.230 INFO:tasks.ceph:Scrubbing osd.2 2024-05-09T05:58:40.230 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-05-09T05:58:40.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.391+0000 7f647b9ad640 1 Processor -- start 2024-05-09T05:58:40.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.391+0000 7f647b9ad640 1 -- start start 2024-05-09T05:58:40.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.395+0000 7f647b9ad640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64741537d0 0x7f6474074740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:40.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.395+0000 7f647b9ad640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64740c72c0 con 0x7f64740c77a0 2024-05-09T05:58:40.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.395+0000 7f647b9ad640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64740c7bb0 con 0x7f6474161d70 2024-05-09T05:58:40.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.395+0000 7f647b9ad640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f6474074c80 con 0x7f64741537d0 2024-05-09T05:58:40.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.395+0000 7f6479749640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f64740c77a0 0x7f6474072e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:38486/0 (socket says 172.21.15.72:38486) 2024-05-09T05:58:40.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.395+0000 7f6479749640 1 -- 172.21.15.72:0/4069074440 learned_addr learned my addr 172.21.15.72:0/4069074440 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:58:40.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.395+0000 7f6478f48640 1 --2- 172.21.15.72:0/4069074440 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64741537d0 0x7f6474074740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:40.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.395+0000 7f646bfff640 1 -- 172.21.15.72:0/4069074440 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2154298943 0 0) 0x7f64740c72c0 con 0x7f64740c77a0 2024-05-09T05:58:40.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.395+0000 7f646bfff640 1 -- 172.21.15.72:0/4069074440 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6460003530 con 0x7f64740c77a0 2024-05-09T05:58:40.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.395+0000 7f646bfff640 1 -- 172.21.15.72:0/4069074440 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2830434241 0 0) 0x7f6460003530 con 0x7f64740c77a0 2024-05-09T05:58:40.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.395+0000 7f646bfff640 1 -- 172.21.15.72:0/4069074440 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64741537d0 msgr2=0x7f6474074740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:58:40.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.395+0000 7f646bfff640 1 --2- 172.21.15.72:0/4069074440 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64741537d0 0x7f6474074740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:40.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.395+0000 7f646bfff640 1 -- 172.21.15.72:0/4069074440 >> v1:172.21.15.110:6789/0 conn(0x7f6474161d70 legacy=0x7f6474164190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:40.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.395+0000 7f646bfff640 1 -- 172.21.15.72:0/4069074440 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6474153be0 con 0x7f64740c77a0 2024-05-09T05:58:40.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.395+0000 7f646bfff640 1 -- 172.21.15.72:0/4069074440 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2749052815 0 0) 0x7f6470001720 con 0x7f64740c77a0 2024-05-09T05:58:40.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.395+0000 7f646bfff640 1 -- 172.21.15.72:0/4069074440 >> v1:172.21.15.72:6789/0 conn(0x7f64740c77a0 legacy=0x7f6474072e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:40.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.395+0000 7f646bfff640 1 --2- 172.21.15.72:0/4069074440 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64741537d0 0x7f6460003a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:40.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.395+0000 7f646bfff640 1 --2- 172.21.15.72:0/4069074440 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6460004010 0x7f6460004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:40.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.395+0000 7f646bfff640 1 --2- 172.21.15.72:0/4069074440 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6460004d50 0x7f6460005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:40.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.395+0000 7f646bfff640 1 -- 172.21.15.72:0/4069074440 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f6474074c80 con 0x7f6460004010 2024-05-09T05:58:40.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.395+0000 7f646bfff640 1 -- 172.21.15.72:0/4069074440 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f646000bc10 con 0x7f6460004d50 2024-05-09T05:58:40.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.395+0000 7f646bfff640 1 -- 172.21.15.72:0/4069074440 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f646000be10 con 0x7f64741537d0 2024-05-09T05:58:40.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.395+0000 7f6478f48640 1 --2- 172.21.15.72:0/4069074440 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6460004010 0x7f6460004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:40.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.395+0000 7f6479749640 1 --2- 172.21.15.72:0/4069074440 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64741537d0 0x7f6460003a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:40.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.395+0000 7f6479f4a640 1 --2- 172.21.15.72:0/4069074440 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6460004d50 0x7f6460005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:40.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.395+0000 7f6478f48640 1 -- 172.21.15.72:0/4069074440 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64741537d0 msgr2=0x7f6460003a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:58:40.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.395+0000 7f6478f48640 1 --2- 172.21.15.72:0/4069074440 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64741537d0 0x7f6460003a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:40.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.395+0000 7f6478f48640 1 -- 172.21.15.72:0/4069074440 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6460004d50 msgr2=0x7f6460005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:58:40.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.395+0000 7f6478f48640 1 --2- 172.21.15.72:0/4069074440 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6460004d50 0x7f6460005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:40.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.395+0000 7f6478f48640 1 -- 172.21.15.72:0/4069074440 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6460003530 con 0x7f6460004010 2024-05-09T05:58:40.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.395+0000 7f6479f4a640 1 --2- 172.21.15.72:0/4069074440 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6460004d50 0x7f6460005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:58:40.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.399+0000 7f6478f48640 1 --2- 172.21.15.72:0/4069074440 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6460004010 0x7f6460004810 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f647406f780 tx=0x7f646401ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50c1c7e4814f0efc server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:40.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.399+0000 7f646bfff640 1 -- 172.21.15.72:0/4069074440 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64640b2070 con 0x7f6460004010 2024-05-09T05:58:40.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.399+0000 7f646bfff640 1 -- 172.21.15.72:0/4069074440 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64640a5600 con 0x7f6460004010 2024-05-09T05:58:40.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.399+0000 7f646bfff640 1 -- 172.21.15.72:0/4069074440 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64640096b0 con 0x7f6460004010 2024-05-09T05:58:40.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.399+0000 7f647b9ad640 1 -- 172.21.15.72:0/4069074440 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6460004010 msgr2=0x7f6460004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:40.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.399+0000 7f647b9ad640 1 --2- 172.21.15.72:0/4069074440 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6460004010 0x7f6460004810 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f647406f780 tx=0x7f646401ca10 comp rx=0 tx=0).stop 2024-05-09T05:58:40.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.399+0000 7f6479f4a640 1 -- 172.21.15.72:0/4069074440 reap_dead start 2024-05-09T05:58:40.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.399+0000 7f647b9ad640 1 -- 172.21.15.72:0/4069074440 shutdown_connections 2024-05-09T05:58:40.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.399+0000 7f647b9ad640 1 -- 172.21.15.72:0/4069074440 >> 172.21.15.72:0/4069074440 conn(0x7f64740cde90 msgr2=0x7f64740ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:58:40.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.399+0000 7f647b9ad640 1 -- 172.21.15.72:0/4069074440 shutdown_connections 2024-05-09T05:58:40.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.399+0000 7f647b9ad640 1 -- 172.21.15.72:0/4069074440 wait complete. 2024-05-09T05:58:40.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.399+0000 7f647b9ad640 1 Processor -- start 2024-05-09T05:58:40.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.399+0000 7f647b9ad640 1 -- start start 2024-05-09T05:58:40.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.403+0000 7f647b9ad640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6474143a50 0x7f64741f1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:40.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.403+0000 7f647b9ad640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f647414bb90 0x7f64741ef2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:40.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.403+0000 7f647b9ad640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64740ca480 0x7f6474145400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:40.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.403+0000 7f647b9ad640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f6474073dd0 con 0x7f6474143a50 2024-05-09T05:58:40.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.403+0000 7f647b9ad640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f6474073af0 con 0x7f64740ca480 2024-05-09T05:58:40.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.403+0000 7f647b9ad640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f64740740b0 con 0x7f647414bb90 2024-05-09T05:58:40.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.403+0000 7f6479749640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6474143a50 0x7f64741f1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:40.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.403+0000 7f6479749640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6474143a50 0x7f64741f1d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54420/0 (socket says 172.21.15.72:54420) 2024-05-09T05:58:40.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.403+0000 7f6479749640 1 -- 172.21.15.72:0/2634816028 learned_addr learned my addr 172.21.15.72:0/2634816028 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:58:40.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.403+0000 7f6478f48640 1 --2- 172.21.15.72:0/2634816028 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f647414bb90 0x7f64741ef2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:40.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.403+0000 7f6479f4a640 1 --2- 172.21.15.72:0/2634816028 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64740ca480 0x7f6474145400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:40.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.403+0000 7f6479749640 1 -- 172.21.15.72:0/2634816028 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f647414bb90 msgr2=0x7f64741ef2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:40.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.403+0000 7f6479749640 1 --2- 172.21.15.72:0/2634816028 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f647414bb90 0x7f64741ef2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:40.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.403+0000 7f6479749640 1 -- 172.21.15.72:0/2634816028 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64740ca480 msgr2=0x7f6474145400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:40.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.403+0000 7f6479749640 1 --2- 172.21.15.72:0/2634816028 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64740ca480 0x7f6474145400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:40.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.403+0000 7f6479749640 1 -- 172.21.15.72:0/2634816028 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f647414b590 con 0x7f6474143a50 2024-05-09T05:58:40.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.403+0000 7f6479f4a640 1 --2- 172.21.15.72:0/2634816028 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64740ca480 0x7f6474145400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:58:40.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.403+0000 7f6479749640 1 --2- 172.21.15.72:0/2634816028 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6474143a50 0x7f64741f1d90 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f6470012600 tx=0x7f6470012ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:40.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.403+0000 7f6469ffb640 1 -- 172.21.15.72:0/2634816028 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f647000f820 con 0x7f6474143a50 2024-05-09T05:58:40.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.403+0000 7f6469ffb640 1 -- 172.21.15.72:0/2634816028 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f647000f9e0 con 0x7f6474143a50 2024-05-09T05:58:40.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.403+0000 7f647b9ad640 1 -- 172.21.15.72:0/2634816028 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f647414b870 con 0x7f6474143a50 2024-05-09T05:58:40.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.403+0000 7f6469ffb640 1 -- 172.21.15.72:0/2634816028 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f647000fdd0 con 0x7f6474143a50 2024-05-09T05:58:40.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.403+0000 7f647b9ad640 1 -- 172.21.15.72:0/2634816028 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64741eedd0 con 0x7f6474143a50 2024-05-09T05:58:40.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.403+0000 7f647b9ad640 1 -- 172.21.15.72:0/2634816028 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6474153100 con 0x7f6474143a50 2024-05-09T05:58:40.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.403+0000 7f6469ffb640 1 -- 172.21.15.72:0/2634816028 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f64700263f0 con 0x7f6474143a50 2024-05-09T05:58:40.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.403+0000 7f6469ffb640 1 --2- 172.21.15.72:0/2634816028 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f645806f400 0x7f6458071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:40.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.403+0000 7f6469ffb640 1 -- 172.21.15.72:0/2634816028 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6762+0+0 (secure 0 0 0) 0x7f6470095980 con 0x7f6474143a50 2024-05-09T05:58:40.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.403+0000 7f6469ffb640 1 --2- 172.21.15.72:0/2634816028 >> [v2:172.21.15.72:6824/1273581990,v1:172.21.15.72:6825/1273581990] conn(0x7f6458078db0 0x7f645807b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:40.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.403+0000 7f6469ffb640 1 -- 172.21.15.72:0/2634816028 --> [v2:172.21.15.72:6824/1273581990,v1:172.21.15.72:6825/1273581990] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6470024e80 con 0x7f6458078db0 2024-05-09T05:58:40.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.403+0000 7f6469ffb640 1 -- 172.21.15.72:0/2634816028 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6470095e10 con 0x7f6474143a50 2024-05-09T05:58:40.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.403+0000 7f6479f4a640 1 --2- 172.21.15.72:0/2634816028 >> [v2:172.21.15.72:6824/1273581990,v1:172.21.15.72:6825/1273581990] conn(0x7f6458078db0 0x7f645807b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:40.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.403+0000 7f6478f48640 1 --2- 172.21.15.72:0/2634816028 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f645806f400 0x7f6458071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:40.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.407+0000 7f6479f4a640 1 --2- 172.21.15.72:0/2634816028 >> [v2:172.21.15.72:6824/1273581990,v1:172.21.15.72:6825/1273581990] conn(0x7f6458078db0 0x7f645807b280 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:40.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.407+0000 7f6478f48640 1 --2- 172.21.15.72:0/2634816028 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f645806f400 0x7f6458071910 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f64640af000 tx=0x7f6464008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:40.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.407+0000 7f6469ffb640 1 -- 172.21.15.72:0/2634816028 <== osd.2 v2:172.21.15.72:6824/1273581990 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6470024e80 con 0x7f6458078db0 2024-05-09T05:58:40.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.419+0000 7f647b9ad640 1 -- 172.21.15.72:0/2634816028 --> [v2:172.21.15.72:6824/1273581990,v1:172.21.15.72:6825/1273581990] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f647406a520 con 0x7f6458078db0 2024-05-09T05:58:40.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.419+0000 7f6469ffb640 1 -- 172.21.15.72:0/2634816028 <== osd.2 v2:172.21.15.72:6824/1273581990 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f647406a520 con 0x7f6458078db0 2024-05-09T05:58:40.408 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-05-09T05:58:40.408 INFO:teuthology.orchestra.run.smithi072.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-09T05:58:40.408 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-05-09T05:58:40.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.419+0000 7f647b9ad640 1 -- 172.21.15.72:0/2634816028 >> [v2:172.21.15.72:6824/1273581990,v1:172.21.15.72:6825/1273581990] conn(0x7f6458078db0 msgr2=0x7f645807b280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:40.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.419+0000 7f647b9ad640 1 --2- 172.21.15.72:0/2634816028 >> [v2:172.21.15.72:6824/1273581990,v1:172.21.15.72:6825/1273581990] conn(0x7f6458078db0 0x7f645807b280 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:40.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.419+0000 7f647b9ad640 1 -- 172.21.15.72:0/2634816028 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f645806f400 msgr2=0x7f6458071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:40.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.419+0000 7f647b9ad640 1 --2- 172.21.15.72:0/2634816028 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f645806f400 0x7f6458071910 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f64640af000 tx=0x7f6464008040 comp rx=0 tx=0).stop 2024-05-09T05:58:40.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.419+0000 7f647b9ad640 1 -- 172.21.15.72:0/2634816028 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6474143a50 msgr2=0x7f64741f1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:40.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.419+0000 7f647b9ad640 1 --2- 172.21.15.72:0/2634816028 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6474143a50 0x7f64741f1d90 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f6470012600 tx=0x7f6470012ac0 comp rx=0 tx=0).stop 2024-05-09T05:58:40.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.419+0000 7f6479f4a640 1 -- 172.21.15.72:0/2634816028 reap_dead start 2024-05-09T05:58:40.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.419+0000 7f647b9ad640 1 -- 172.21.15.72:0/2634816028 shutdown_connections 2024-05-09T05:58:40.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.419+0000 7f647b9ad640 1 -- 172.21.15.72:0/2634816028 >> 172.21.15.72:0/2634816028 conn(0x7f64740cde90 msgr2=0x7f64740c63c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:58:40.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.419+0000 7f647b9ad640 1 -- 172.21.15.72:0/2634816028 shutdown_connections 2024-05-09T05:58:40.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.419+0000 7f647b9ad640 1 -- 172.21.15.72:0/2634816028 wait complete. 2024-05-09T05:58:40.427 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-05-09T05:58:40.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.575+0000 7fe262c34640 1 Processor -- start 2024-05-09T05:58:40.562 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.575+0000 7fe262c34640 1 -- start start 2024-05-09T05:58:40.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.575+0000 7fe262c34640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe25c15da90 0x7fe25c0c7570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:40.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.575+0000 7fe262c34640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe25c15dea0 0x7fe25c0745b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:40.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.575+0000 7fe262c34640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe25c074af0 0x7fe25c06fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:40.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.575+0000 7fe262c34640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fe25c1513f0 con 0x7fe25c15dea0 2024-05-09T05:58:40.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.575+0000 7fe262c34640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fe25c15a4f0 con 0x7fe25c15da90 2024-05-09T05:58:40.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.575+0000 7fe262c34640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fe25c0c84f0 con 0x7fe25c074af0 2024-05-09T05:58:40.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.575+0000 7fe25bfff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe25c15dea0 0x7fe25c0745b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:40.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.575+0000 7fe25bfff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe25c15dea0 0x7fe25c0745b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54432/0 (socket says 172.21.15.72:54432) 2024-05-09T05:58:40.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.575+0000 7fe25bfff640 1 -- 172.21.15.72:0/2180983572 learned_addr learned my addr 172.21.15.72:0/2180983572 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:58:40.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.575+0000 7fe2611d1640 1 --2- 172.21.15.72:0/2180983572 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe25c074af0 0x7fe25c06fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:40.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.575+0000 7fe2609d0640 1 --2- 172.21.15.72:0/2180983572 >> v2:172.21.15.110:3300/0 conn(0x7fe25c15da90 0x7fe25c0c7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:40.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.575+0000 7fe25bfff640 1 -- 172.21.15.72:0/2180983572 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe25c074af0 msgr2=0x7fe25c06fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:58:40.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.575+0000 7fe25bfff640 1 --2- 172.21.15.72:0/2180983572 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe25c074af0 0x7fe25c06fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:40.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.575+0000 7fe25bfff640 1 -- 172.21.15.72:0/2180983572 >> v2:172.21.15.110:3300/0 conn(0x7fe25c15da90 msgr2=0x7fe25c0c7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:58:40.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.575+0000 7fe25bfff640 1 --2- 172.21.15.72:0/2180983572 >> v2:172.21.15.110:3300/0 conn(0x7fe25c15da90 0x7fe25c0c7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:40.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.575+0000 7fe25bfff640 1 -- 172.21.15.72:0/2180983572 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe25c0c87d0 con 0x7fe25c15dea0 2024-05-09T05:58:40.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.579+0000 7fe25bfff640 1 --2- 172.21.15.72:0/2180983572 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe25c15dea0 0x7fe25c0745b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fe25c071b70 tx=0x7fe25001c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=815f191e0f59eceb server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:40.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.579+0000 7fe25b7fe640 1 -- 172.21.15.72:0/2180983572 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2500b0070 con 0x7fe25c15dea0 2024-05-09T05:58:40.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.579+0000 7fe25b7fe640 1 -- 172.21.15.72:0/2180983572 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2500ab600 con 0x7fe25c15dea0 2024-05-09T05:58:40.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.579+0000 7fe25b7fe640 1 -- 172.21.15.72:0/2180983572 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2500ab9d0 con 0x7fe25c15dea0 2024-05-09T05:58:40.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.579+0000 7fe262c34640 1 -- 172.21.15.72:0/2180983572 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe25c15dea0 msgr2=0x7fe25c0745b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:40.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.579+0000 7fe262c34640 1 --2- 172.21.15.72:0/2180983572 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe25c15dea0 0x7fe25c0745b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fe25c071b70 tx=0x7fe25001c260 comp rx=0 tx=0).stop 2024-05-09T05:58:40.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.579+0000 7fe262c34640 1 -- 172.21.15.72:0/2180983572 shutdown_connections 2024-05-09T05:58:40.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.579+0000 7fe262c34640 1 --2- 172.21.15.72:0/2180983572 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe25c074af0 0x7fe25c06fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:40.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.579+0000 7fe262c34640 1 --2- 172.21.15.72:0/2180983572 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe25c15dea0 0x7fe25c0745b0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:40.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.579+0000 7fe262c34640 1 --2- 172.21.15.72:0/2180983572 >> v2:172.21.15.110:3300/0 conn(0x7fe25c15da90 0x7fe25c0c7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:40.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.579+0000 7fe262c34640 1 -- 172.21.15.72:0/2180983572 >> 172.21.15.72:0/2180983572 conn(0x7fe25c0cde90 msgr2=0x7fe25c0ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:58:40.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.579+0000 7fe262c34640 1 -- 172.21.15.72:0/2180983572 shutdown_connections 2024-05-09T05:58:40.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.579+0000 7fe262c34640 1 -- 172.21.15.72:0/2180983572 wait complete. 2024-05-09T05:58:40.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.583+0000 7fe262c34640 1 Processor -- start 2024-05-09T05:58:40.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.583+0000 7fe262c34640 1 -- start start 2024-05-09T05:58:40.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.583+0000 7fe262c34640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe25c074af0 0x7fe25c14b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:40.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.583+0000 7fe262c34640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe25c15da90 0x7fe25c1f9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:40.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.583+0000 7fe262c34640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe25c15dea0 0x7fe25c143b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:40.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.583+0000 7fe262c34640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe25c0c81b0 con 0x7fe25c074af0 2024-05-09T05:58:40.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.583+0000 7fe262c34640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fe25c0c70e0 con 0x7fe25c15da90 2024-05-09T05:58:40.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.583+0000 7fe262c34640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fe25c154ab0 con 0x7fe25c15dea0 2024-05-09T05:58:40.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.583+0000 7fe2609d0640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe25c074af0 0x7fe25c14b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:40.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.583+0000 7fe2609d0640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe25c074af0 0x7fe25c14b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54446/0 (socket says 172.21.15.72:54446) 2024-05-09T05:58:40.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.583+0000 7fe2609d0640 1 -- 172.21.15.72:0/2291539490 learned_addr learned my addr 172.21.15.72:0/2291539490 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:58:40.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.583+0000 7fe25bfff640 1 --2- 172.21.15.72:0/2291539490 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe25c15da90 0x7fe25c1f9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:40.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.583+0000 7fe2611d1640 1 --2- 172.21.15.72:0/2291539490 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe25c15dea0 0x7fe25c143b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:40.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.583+0000 7fe2609d0640 1 -- 172.21.15.72:0/2291539490 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe25c15dea0 msgr2=0x7fe25c143b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:40.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.583+0000 7fe2609d0640 1 --2- 172.21.15.72:0/2291539490 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe25c15dea0 0x7fe25c143b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:40.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.583+0000 7fe2609d0640 1 -- 172.21.15.72:0/2291539490 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe25c15da90 msgr2=0x7fe25c1f9cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:40.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.583+0000 7fe2609d0640 1 --2- 172.21.15.72:0/2291539490 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe25c15da90 0x7fe25c1f9cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:40.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.583+0000 7fe2609d0640 1 -- 172.21.15.72:0/2291539490 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe25c1fa230 con 0x7fe25c074af0 2024-05-09T05:58:40.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.583+0000 7fe2609d0640 1 --2- 172.21.15.72:0/2291539490 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe25c074af0 0x7fe25c14b5f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fe24c00d630 tx=0x7fe24c00daf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:40.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.583+0000 7fe2597fa640 1 -- 172.21.15.72:0/2291539490 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe24c004240 con 0x7fe25c074af0 2024-05-09T05:58:40.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.583+0000 7fe2597fa640 1 -- 172.21.15.72:0/2291539490 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe24c0043e0 con 0x7fe25c074af0 2024-05-09T05:58:40.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.583+0000 7fe262c34640 1 -- 172.21.15.72:0/2291539490 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe25c14d200 con 0x7fe25c074af0 2024-05-09T05:58:40.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.583+0000 7fe2597fa640 1 -- 172.21.15.72:0/2291539490 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe24c003840 con 0x7fe25c074af0 2024-05-09T05:58:40.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.583+0000 7fe262c34640 1 -- 172.21.15.72:0/2291539490 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe25c149fe0 con 0x7fe25c074af0 2024-05-09T05:58:40.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.587+0000 7fe262c34640 1 -- 172.21.15.72:0/2291539490 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe25c06a520 con 0x7fe25c074af0 2024-05-09T05:58:40.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.587+0000 7fe2597fa640 1 -- 172.21.15.72:0/2291539490 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe24c0039e0 con 0x7fe25c074af0 2024-05-09T05:58:40.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.587+0000 7fe2597fa640 1 --2- 172.21.15.72:0/2291539490 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fe24806f430 0x7fe248071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:40.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.587+0000 7fe2597fa640 1 -- 172.21.15.72:0/2291539490 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6762+0+0 (secure 0 0 0) 0x7fe24c08f790 con 0x7fe25c074af0 2024-05-09T05:58:40.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.587+0000 7fe25bfff640 1 --2- 172.21.15.72:0/2291539490 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fe24806f430 0x7fe248071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:40.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.587+0000 7fe25bfff640 1 --2- 172.21.15.72:0/2291539490 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fe24806f430 0x7fe248071940 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe2500ad000 tx=0x7fe250008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:40.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.591+0000 7fe2597fa640 1 -- 172.21.15.72:0/2291539490 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fe24c05c380 con 0x7fe25c074af0 2024-05-09T05:58:40.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.743+0000 7fe262c34640 1 -- 172.21.15.72:0/2291539490 --> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fe25c164c50 con 0x7fe24806f430 2024-05-09T05:58:40.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.743+0000 7fe2597fa640 1 -- 172.21.15.72:0/2291539490 <== mgr.4102 v2:172.21.15.110:6832/1113420672 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe25c164c50 con 0x7fe24806f430 2024-05-09T05:58:40.731 INFO:teuthology.orchestra.run.smithi072.stderr:instructed osd(s) 2 to deep-scrub 2024-05-09T05:58:40.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.747+0000 7fe262c34640 1 -- 172.21.15.72:0/2291539490 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fe24806f430 msgr2=0x7fe248071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:40.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.747+0000 7fe262c34640 1 --2- 172.21.15.72:0/2291539490 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fe24806f430 0x7fe248071940 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe2500ad000 tx=0x7fe250008040 comp rx=0 tx=0).stop 2024-05-09T05:58:40.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.747+0000 7fe262c34640 1 -- 172.21.15.72:0/2291539490 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe25c074af0 msgr2=0x7fe25c14b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:40.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.747+0000 7fe262c34640 1 --2- 172.21.15.72:0/2291539490 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe25c074af0 0x7fe25c14b5f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fe24c00d630 tx=0x7fe24c00daf0 comp rx=0 tx=0).stop 2024-05-09T05:58:40.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.747+0000 7fe262c34640 1 -- 172.21.15.72:0/2291539490 shutdown_connections 2024-05-09T05:58:40.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.747+0000 7fe262c34640 1 --2- 172.21.15.72:0/2291539490 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fe24806f430 0x7fe248071940 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:40.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.747+0000 7fe262c34640 1 --2- 172.21.15.72:0/2291539490 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe25c15dea0 0x7fe25c143b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:40.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.747+0000 7fe262c34640 1 --2- 172.21.15.72:0/2291539490 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe25c15da90 0x7fe25c1f9cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:40.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.747+0000 7fe262c34640 1 --2- 172.21.15.72:0/2291539490 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe25c074af0 0x7fe25c14b5f0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:40.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.747+0000 7fe262c34640 1 -- 172.21.15.72:0/2291539490 >> 172.21.15.72:0/2291539490 conn(0x7fe25c0cde90 msgr2=0x7fe25c0ca050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:58:40.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.747+0000 7fe262c34640 1 -- 172.21.15.72:0/2291539490 shutdown_connections 2024-05-09T05:58:40.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.747+0000 7fe262c34640 1 -- 172.21.15.72:0/2291539490 wait complete. 2024-05-09T05:58:40.755 INFO:tasks.ceph:Scrubbing osd.3 2024-05-09T05:58:40.755 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-05-09T05:58:40.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.907+0000 7f8cbb400640 1 Processor -- start 2024-05-09T05:58:40.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.907+0000 7f8cbb400640 1 -- start start 2024-05-09T05:58:40.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.907+0000 7f8cbb400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8cb4156b50 0x7f8cb4073ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:40.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.907+0000 7f8cbb400640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8cb4074410 0x7f8cb40cc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:40.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.907+0000 7f8cbb400640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cb40cda30 con 0x7f8cb40cca30 2024-05-09T05:58:40.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.907+0000 7f8cbb400640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f8cb40cc020 con 0x7f8cb4074410 2024-05-09T05:58:40.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.907+0000 7f8cbb400640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f8cb415dfe0 con 0x7f8cb4156b50 2024-05-09T05:58:40.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.907+0000 7f8cb899b640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8cb4074410 0x7f8cb40cc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:40.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.907+0000 7f8cb999d640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f8cb40cca30 0x7f8cb40cce40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:38494/0 (socket says 172.21.15.72:38494) 2024-05-09T05:58:40.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.907+0000 7f8cb899b640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8cb4074410 0x7f8cb40cc4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54458/0 (socket says 172.21.15.72:54458) 2024-05-09T05:58:40.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.907+0000 7f8cb999d640 1 -- 172.21.15.72:0/170749418 learned_addr learned my addr 172.21.15.72:0/170749418 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:58:40.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.907+0000 7f8cb919c640 1 --2- 172.21.15.72:0/170749418 >> v2:172.21.15.110:3300/0 conn(0x7f8cb4156b50 0x7f8cb4073ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:40.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.907+0000 7f8cb899b640 1 -- 172.21.15.72:0/170749418 >> v2:172.21.15.110:3300/0 conn(0x7f8cb4156b50 msgr2=0x7f8cb4073ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:58:40.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.907+0000 7f8cb899b640 1 --2- 172.21.15.72:0/170749418 >> v2:172.21.15.110:3300/0 conn(0x7f8cb4156b50 0x7f8cb4073ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:40.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.907+0000 7f8cb899b640 1 -- 172.21.15.72:0/170749418 >> v1:172.21.15.72:6789/0 conn(0x7f8cb40cca30 legacy=0x7f8cb40cce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:40.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.907+0000 7f8cb899b640 1 -- 172.21.15.72:0/170749418 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cb415cdd0 con 0x7f8cb4074410 2024-05-09T05:58:40.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.911+0000 7f8cb899b640 1 --2- 172.21.15.72:0/170749418 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8cb4074410 0x7f8cb40cc4f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8cb406f9a0 tx=0x7f8ca401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3821c90983a4b61f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:40.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.911+0000 7f8cabfff640 1 -- 172.21.15.72:0/170749418 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca40b0070 con 0x7f8cb4074410 2024-05-09T05:58:40.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.911+0000 7f8cabfff640 1 -- 172.21.15.72:0/170749418 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ca40ab600 con 0x7f8cb4074410 2024-05-09T05:58:40.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.911+0000 7f8cabfff640 1 -- 172.21.15.72:0/170749418 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca40ab9d0 con 0x7f8cb4074410 2024-05-09T05:58:40.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.911+0000 7f8cbb400640 1 -- 172.21.15.72:0/170749418 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8cb4074410 msgr2=0x7f8cb40cc4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:40.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.911+0000 7f8cbb400640 1 --2- 172.21.15.72:0/170749418 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8cb4074410 0x7f8cb40cc4f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8cb406f9a0 tx=0x7f8ca401c480 comp rx=0 tx=0).stop 2024-05-09T05:58:40.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.911+0000 7f8cbb400640 1 -- 172.21.15.72:0/170749418 shutdown_connections 2024-05-09T05:58:40.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.911+0000 7f8cbb400640 1 --2- 172.21.15.72:0/170749418 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8cb4074410 0x7f8cb40cc4f0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:40.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.911+0000 7f8cbb400640 1 --2- 172.21.15.72:0/170749418 >> v2:172.21.15.110:3300/0 conn(0x7f8cb4156b50 0x7f8cb4073ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:40.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.911+0000 7f8cbb400640 1 -- 172.21.15.72:0/170749418 >> 172.21.15.72:0/170749418 conn(0x7f8cb40d1b70 msgr2=0x7f8cb40d1f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:58:40.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.911+0000 7f8cbb400640 1 -- 172.21.15.72:0/170749418 shutdown_connections 2024-05-09T05:58:40.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.911+0000 7f8cbb400640 1 -- 172.21.15.72:0/170749418 wait complete. 2024-05-09T05:58:40.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.911+0000 7f8cbb400640 1 Processor -- start 2024-05-09T05:58:40.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.911+0000 7f8cbb400640 1 -- start start 2024-05-09T05:58:40.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.915+0000 7f8cbb400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8cb4074410 0x7f8cb41f6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:40.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.915+0000 7f8cbb400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8cb40cca30 0x7f8cb4167370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:40.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.915+0000 7f8cbb400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8cb4156b50 0x7f8cb4155ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:40.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.915+0000 7f8cbb400640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb4074cf0 con 0x7f8cb4074410 2024-05-09T05:58:40.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.915+0000 7f8cbb400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb415d950 con 0x7f8cb40cca30 2024-05-09T05:58:40.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.915+0000 7f8cbb400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f8cb40cd550 con 0x7f8cb4156b50 2024-05-09T05:58:40.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.915+0000 7f8cb919c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8cb4074410 0x7f8cb41f6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:40.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.915+0000 7f8cb919c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8cb4074410 0x7f8cb41f6bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54474/0 (socket says 172.21.15.72:54474) 2024-05-09T05:58:40.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.915+0000 7f8cb919c640 1 -- 172.21.15.72:0/2581396701 learned_addr learned my addr 172.21.15.72:0/2581396701 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:58:40.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.915+0000 7f8cb999d640 1 --2- 172.21.15.72:0/2581396701 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8cb4156b50 0x7f8cb4155ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:40.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.915+0000 7f8cb899b640 1 --2- 172.21.15.72:0/2581396701 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8cb40cca30 0x7f8cb4167370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:40.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.915+0000 7f8cb919c640 1 -- 172.21.15.72:0/2581396701 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8cb4156b50 msgr2=0x7f8cb4155ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:40.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.915+0000 7f8cb919c640 1 --2- 172.21.15.72:0/2581396701 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8cb4156b50 0x7f8cb4155ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:40.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.915+0000 7f8cb919c640 1 -- 172.21.15.72:0/2581396701 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8cb40cca30 msgr2=0x7f8cb4167370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:40.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.915+0000 7f8cb919c640 1 --2- 172.21.15.72:0/2581396701 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8cb40cca30 0x7f8cb4167370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:40.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.915+0000 7f8cb919c640 1 -- 172.21.15.72:0/2581396701 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cb41613b0 con 0x7f8cb4074410 2024-05-09T05:58:40.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.915+0000 7f8cb919c640 1 --2- 172.21.15.72:0/2581396701 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8cb4074410 0x7f8cb41f6bb0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f8cb000d620 tx=0x7f8cb000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:40.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.915+0000 7f8ca9ffb640 1 -- 172.21.15.72:0/2581396701 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cb000b620 con 0x7f8cb4074410 2024-05-09T05:58:40.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.915+0000 7f8ca9ffb640 1 -- 172.21.15.72:0/2581396701 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cb0019070 con 0x7f8cb4074410 2024-05-09T05:58:40.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.915+0000 7f8ca9ffb640 1 -- 172.21.15.72:0/2581396701 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cb000b9e0 con 0x7f8cb4074410 2024-05-09T05:58:40.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.915+0000 7f8cbb400640 1 -- 172.21.15.72:0/2581396701 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cb4161690 con 0x7f8cb4074410 2024-05-09T05:58:40.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.915+0000 7f8cbb400640 1 -- 172.21.15.72:0/2581396701 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cb41f6690 con 0x7f8cb4074410 2024-05-09T05:58:40.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.915+0000 7f8cbb400640 1 -- 172.21.15.72:0/2581396701 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8cb4150eb0 con 0x7f8cb4074410 2024-05-09T05:58:40.906 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.915+0000 7f8ca9ffb640 1 -- 172.21.15.72:0/2581396701 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f8cb000bb80 con 0x7f8cb4074410 2024-05-09T05:58:40.906 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.915+0000 7f8ca9ffb640 1 --2- 172.21.15.72:0/2581396701 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f8c9806f400 0x7f8c98071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:40.906 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.915+0000 7f8ca9ffb640 1 -- 172.21.15.72:0/2581396701 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6762+0+0 (secure 0 0 0) 0x7f8cb00905d0 con 0x7f8cb4074410 2024-05-09T05:58:40.906 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.915+0000 7f8ca9ffb640 1 --2- 172.21.15.72:0/2581396701 >> [v2:172.21.15.72:6804/2180866263,v1:172.21.15.72:6806/2180866263] conn(0x7f8c98078db0 0x7f8c9807b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:40.906 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.915+0000 7f8ca9ffb640 1 -- 172.21.15.72:0/2581396701 --> [v2:172.21.15.72:6804/2180866263,v1:172.21.15.72:6806/2180866263] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8cb0013e50 con 0x7f8c98078db0 2024-05-09T05:58:40.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.915+0000 7f8ca9ffb640 1 -- 172.21.15.72:0/2581396701 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8cb0090a60 con 0x7f8cb4074410 2024-05-09T05:58:40.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.915+0000 7f8cb899b640 1 --2- 172.21.15.72:0/2581396701 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f8c9806f400 0x7f8c98071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:40.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.919+0000 7f8cb999d640 1 --2- 172.21.15.72:0/2581396701 >> [v2:172.21.15.72:6804/2180866263,v1:172.21.15.72:6806/2180866263] conn(0x7f8c98078db0 0x7f8c9807b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:40.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.919+0000 7f8cb999d640 1 --2- 172.21.15.72:0/2581396701 >> [v2:172.21.15.72:6804/2180866263,v1:172.21.15.72:6806/2180866263] conn(0x7f8c98078db0 0x7f8c9807b280 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:40.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.919+0000 7f8cb899b640 1 --2- 172.21.15.72:0/2581396701 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f8c9806f400 0x7f8c98071910 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8ca40ad000 tx=0x7f8ca4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:40.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.919+0000 7f8ca9ffb640 1 -- 172.21.15.72:0/2581396701 <== osd.3 v2:172.21.15.72:6804/2180866263 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8cb0013e50 con 0x7f8c98078db0 2024-05-09T05:58:40.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.931+0000 7f8cbb400640 1 -- 172.21.15.72:0/2581396701 --> [v2:172.21.15.72:6804/2180866263,v1:172.21.15.72:6806/2180866263] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f8cb406a520 con 0x7f8c98078db0 2024-05-09T05:58:40.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.931+0000 7f8ca9ffb640 1 -- 172.21.15.72:0/2581396701 <== osd.3 v2:172.21.15.72:6804/2180866263 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f8cb406a520 con 0x7f8c98078db0 2024-05-09T05:58:40.919 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-05-09T05:58:40.919 INFO:teuthology.orchestra.run.smithi072.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-09T05:58:40.919 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-05-09T05:58:40.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.931+0000 7f8cbb400640 1 -- 172.21.15.72:0/2581396701 >> [v2:172.21.15.72:6804/2180866263,v1:172.21.15.72:6806/2180866263] conn(0x7f8c98078db0 msgr2=0x7f8c9807b280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:40.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.931+0000 7f8cbb400640 1 --2- 172.21.15.72:0/2581396701 >> [v2:172.21.15.72:6804/2180866263,v1:172.21.15.72:6806/2180866263] conn(0x7f8c98078db0 0x7f8c9807b280 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:40.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.931+0000 7f8cbb400640 1 -- 172.21.15.72:0/2581396701 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f8c9806f400 msgr2=0x7f8c98071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:40.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.931+0000 7f8cbb400640 1 --2- 172.21.15.72:0/2581396701 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f8c9806f400 0x7f8c98071910 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8ca40ad000 tx=0x7f8ca4008040 comp rx=0 tx=0).stop 2024-05-09T05:58:40.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.931+0000 7f8cbb400640 1 -- 172.21.15.72:0/2581396701 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8cb4074410 msgr2=0x7f8cb41f6bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:40.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.931+0000 7f8cbb400640 1 --2- 172.21.15.72:0/2581396701 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8cb4074410 0x7f8cb41f6bb0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f8cb000d620 tx=0x7f8cb000dae0 comp rx=0 tx=0).stop 2024-05-09T05:58:40.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.931+0000 7f8cb999d640 1 -- 172.21.15.72:0/2581396701 reap_dead start 2024-05-09T05:58:40.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.931+0000 7f8cbb400640 1 -- 172.21.15.72:0/2581396701 shutdown_connections 2024-05-09T05:58:40.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.931+0000 7f8cbb400640 1 -- 172.21.15.72:0/2581396701 >> 172.21.15.72:0/2581396701 conn(0x7f8cb40d1b70 msgr2=0x7f8cb40cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:58:40.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.931+0000 7f8cbb400640 1 -- 172.21.15.72:0/2581396701 shutdown_connections 2024-05-09T05:58:40.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:40.931+0000 7f8cbb400640 1 -- 172.21.15.72:0/2581396701 wait complete. 2024-05-09T05:58:40.938 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-05-09T05:58:41.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.091+0000 7fe006137640 1 Processor -- start 2024-05-09T05:58:41.079 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.091+0000 7fe006137640 1 -- start start 2024-05-09T05:58:41.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.091+0000 7fe006137640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe000159ed0 0x7fe000153860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:41.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.091+0000 7fe006137640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe0000c73e0 0x7fe000073350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:41.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.091+0000 7fe006137640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe000072b00 con 0x7fe000072f40 2024-05-09T05:58:41.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.091+0000 7fe006137640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fe000072540 con 0x7fe000159ed0 2024-05-09T05:58:41.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.091+0000 7fe006137640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fe000072820 con 0x7fe0000c73e0 2024-05-09T05:58:41.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.091+0000 7fdfff7fe640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe000159ed0 0x7fe000153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:41.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.091+0000 7fdfff7fe640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe000159ed0 0x7fe000153860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54482/0 (socket says 172.21.15.72:54482) 2024-05-09T05:58:41.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.091+0000 7fdfff7fe640 1 -- 172.21.15.72:0/3440234770 learned_addr learned my addr 172.21.15.72:0/3440234770 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:58:41.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.091+0000 7fdfff7fe640 1 -- 172.21.15.72:0/3440234770 >> v2:172.21.15.110:3300/0 conn(0x7fe0000c73e0 msgr2=0x7fe000073350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:58:41.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.091+0000 7fdffffff640 1 --2- 172.21.15.72:0/3440234770 >> v2:172.21.15.110:3300/0 conn(0x7fe0000c73e0 0x7fe000073350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:41.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.091+0000 7fdfff7fe640 1 --2- 172.21.15.72:0/3440234770 >> v2:172.21.15.110:3300/0 conn(0x7fe0000c73e0 0x7fe000073350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:41.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.091+0000 7fdfff7fe640 1 -- 172.21.15.72:0/3440234770 >> v1:172.21.15.110:6789/0 conn(0x7fe000072f40 legacy=0x7fe0000c6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:41.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.091+0000 7fdfff7fe640 1 -- 172.21.15.72:0/3440234770 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0000c64d0 con 0x7fe000159ed0 2024-05-09T05:58:41.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.095+0000 7fdfff7fe640 1 --2- 172.21.15.72:0/3440234770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe000159ed0 0x7fe000153860 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fe000075490 tx=0x7fdff80213e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d8672d0d59e835a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:41.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.095+0000 7fdffe7fc640 1 -- 172.21.15.72:0/3440234770 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdff80b6070 con 0x7fe000159ed0 2024-05-09T05:58:41.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.095+0000 7fdffe7fc640 1 -- 172.21.15.72:0/3440234770 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdff80b1600 con 0x7fe000159ed0 2024-05-09T05:58:41.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.095+0000 7fdffe7fc640 1 -- 172.21.15.72:0/3440234770 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdff80b19d0 con 0x7fe000159ed0 2024-05-09T05:58:41.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.095+0000 7fe006137640 1 -- 172.21.15.72:0/3440234770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe000159ed0 msgr2=0x7fe000153860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:41.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.095+0000 7fe006137640 1 --2- 172.21.15.72:0/3440234770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe000159ed0 0x7fe000153860 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fe000075490 tx=0x7fdff80213e0 comp rx=0 tx=0).stop 2024-05-09T05:58:41.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.095+0000 7fe006137640 1 -- 172.21.15.72:0/3440234770 shutdown_connections 2024-05-09T05:58:41.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.095+0000 7fe006137640 1 --2- 172.21.15.72:0/3440234770 >> v2:172.21.15.110:3300/0 conn(0x7fe0000c73e0 0x7fe000073350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:41.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.095+0000 7fe006137640 1 --2- 172.21.15.72:0/3440234770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe000159ed0 0x7fe000153860 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:41.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.095+0000 7fe006137640 1 -- 172.21.15.72:0/3440234770 >> 172.21.15.72:0/3440234770 conn(0x7fe0000cde90 msgr2=0x7fe0000ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:58:41.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.095+0000 7fe006137640 1 -- 172.21.15.72:0/3440234770 shutdown_connections 2024-05-09T05:58:41.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.095+0000 7fe006137640 1 -- 172.21.15.72:0/3440234770 wait complete. 2024-05-09T05:58:41.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.099+0000 7fe006137640 1 Processor -- start 2024-05-09T05:58:41.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.099+0000 7fe006137640 1 -- start start 2024-05-09T05:58:41.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.099+0000 7fe006137640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe000072f40 0x7fe00015a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:41.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.099+0000 7fe006137640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0000c73e0 0x7fe0001520f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:41.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.099+0000 7fe006137640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe000159ed0 0x7fe000156070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:41.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.099+0000 7fe006137640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe0000c4e30 con 0x7fe0000c73e0 2024-05-09T05:58:41.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.099+0000 7fe006137640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fe0000c4cb0 con 0x7fe000159ed0 2024-05-09T05:58:41.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.099+0000 7fe006137640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fe00006fc00 con 0x7fe000072f40 2024-05-09T05:58:41.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.099+0000 7fdffeffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0000c73e0 0x7fe0001520f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:41.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.099+0000 7fdffeffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0000c73e0 0x7fe0001520f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54488/0 (socket says 172.21.15.72:54488) 2024-05-09T05:58:41.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.099+0000 7fdffeffd640 1 -- 172.21.15.72:0/1123496402 learned_addr learned my addr 172.21.15.72:0/1123496402 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:58:41.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.099+0000 7fdffffff640 1 --2- 172.21.15.72:0/1123496402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe000159ed0 0x7fe000156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:41.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.099+0000 7fdfff7fe640 1 --2- 172.21.15.72:0/1123496402 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe000072f40 0x7fe00015a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:41.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.099+0000 7fdffeffd640 1 -- 172.21.15.72:0/1123496402 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe000072f40 msgr2=0x7fe00015a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:41.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.099+0000 7fdffeffd640 1 --2- 172.21.15.72:0/1123496402 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe000072f40 0x7fe00015a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:41.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.099+0000 7fdffeffd640 1 -- 172.21.15.72:0/1123496402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe000159ed0 msgr2=0x7fe000156070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:41.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.099+0000 7fdffeffd640 1 --2- 172.21.15.72:0/1123496402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe000159ed0 0x7fe000156070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:41.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.099+0000 7fdffeffd640 1 -- 172.21.15.72:0/1123496402 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe00015ab40 con 0x7fe0000c73e0 2024-05-09T05:58:41.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.099+0000 7fdffffff640 1 --2- 172.21.15.72:0/1123496402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe000159ed0 0x7fe000156070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:58:41.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.099+0000 7fdffeffd640 1 --2- 172.21.15.72:0/1123496402 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0000c73e0 0x7fe0001520f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fdfe800c3f0 tx=0x7fdfe800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:41.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.099+0000 7fdff7fff640 1 -- 172.21.15.72:0/1123496402 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe8017070 con 0x7fe0000c73e0 2024-05-09T05:58:41.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.099+0000 7fdff7fff640 1 -- 172.21.15.72:0/1123496402 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfe80052d0 con 0x7fe0000c73e0 2024-05-09T05:58:41.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.099+0000 7fe006137640 1 -- 172.21.15.72:0/1123496402 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe00015cb00 con 0x7fe0000c73e0 2024-05-09T05:58:41.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.099+0000 7fdff7fff640 1 -- 172.21.15.72:0/1123496402 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe8003840 con 0x7fe0000c73e0 2024-05-09T05:58:41.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.099+0000 7fe006137640 1 -- 172.21.15.72:0/1123496402 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0001f38f0 con 0x7fe0000c73e0 2024-05-09T05:58:41.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.099+0000 7fe006137640 1 -- 172.21.15.72:0/1123496402 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe00006a520 con 0x7fe0000c73e0 2024-05-09T05:58:41.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.103+0000 7fdff7fff640 1 -- 172.21.15.72:0/1123496402 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fdfe801a070 con 0x7fe0000c73e0 2024-05-09T05:58:41.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.103+0000 7fdff7fff640 1 --2- 172.21.15.72:0/1123496402 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fdfe006f430 0x7fdfe0071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:41.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.103+0000 7fdff7fff640 1 -- 172.21.15.72:0/1123496402 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6762+0+0 (secure 0 0 0) 0x7fdfe808e980 con 0x7fe0000c73e0 2024-05-09T05:58:41.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.103+0000 7fdfff7fe640 1 --2- 172.21.15.72:0/1123496402 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fdfe006f430 0x7fdfe0071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:41.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.103+0000 7fdfff7fe640 1 --2- 172.21.15.72:0/1123496402 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fdfe006f430 0x7fdfe0071940 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fdff80b3000 tx=0x7fdff80ac000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:41.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.107+0000 7fdff7fff640 1 -- 172.21.15.72:0/1123496402 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fdfe8001090 con 0x7fe0000c73e0 2024-05-09T05:58:41.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.271+0000 7fe006137640 1 -- 172.21.15.72:0/1123496402 --> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fe000159cb0 con 0x7fdfe006f430 2024-05-09T05:58:41.258 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.271+0000 7fdff7fff640 1 -- 172.21.15.72:0/1123496402 <== mgr.4102 v2:172.21.15.110:6832/1113420672 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe000159cb0 con 0x7fdfe006f430 2024-05-09T05:58:41.258 INFO:teuthology.orchestra.run.smithi072.stderr:instructed osd(s) 3 to deep-scrub 2024-05-09T05:58:41.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.271+0000 7fe006137640 1 -- 172.21.15.72:0/1123496402 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fdfe006f430 msgr2=0x7fdfe0071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:41.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.271+0000 7fe006137640 1 --2- 172.21.15.72:0/1123496402 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fdfe006f430 0x7fdfe0071940 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fdff80b3000 tx=0x7fdff80ac000 comp rx=0 tx=0).stop 2024-05-09T05:58:41.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.271+0000 7fe006137640 1 -- 172.21.15.72:0/1123496402 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0000c73e0 msgr2=0x7fe0001520f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:41.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.271+0000 7fe006137640 1 --2- 172.21.15.72:0/1123496402 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0000c73e0 0x7fe0001520f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fdfe800c3f0 tx=0x7fdfe800c8b0 comp rx=0 tx=0).stop 2024-05-09T05:58:41.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.271+0000 7fe006137640 1 -- 172.21.15.72:0/1123496402 shutdown_connections 2024-05-09T05:58:41.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.271+0000 7fe006137640 1 --2- 172.21.15.72:0/1123496402 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fdfe006f430 0x7fdfe0071940 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:41.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.271+0000 7fe006137640 1 --2- 172.21.15.72:0/1123496402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe000159ed0 0x7fe000156070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:41.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.271+0000 7fe006137640 1 --2- 172.21.15.72:0/1123496402 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0000c73e0 0x7fe0001520f0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:41.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.271+0000 7fe006137640 1 --2- 172.21.15.72:0/1123496402 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe000072f40 0x7fe00015a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:41.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.271+0000 7fe006137640 1 -- 172.21.15.72:0/1123496402 >> 172.21.15.72:0/1123496402 conn(0x7fe0000cde90 msgr2=0x7fe00006ffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:58:41.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.271+0000 7fe006137640 1 -- 172.21.15.72:0/1123496402 shutdown_connections 2024-05-09T05:58:41.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.271+0000 7fe006137640 1 -- 172.21.15.72:0/1123496402 wait complete. 2024-05-09T05:58:41.282 INFO:tasks.ceph:Scrubbing osd.4 2024-05-09T05:58:41.282 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-05-09T05:58:41.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.447+0000 7f2508693640 1 Processor -- start 2024-05-09T05:58:41.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.447+0000 7f2508693640 1 -- start start 2024-05-09T05:58:41.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.451+0000 7f2508693640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2500156b50 0x7f2500073ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:41.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.451+0000 7f2508693640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2500074410 0x7f25000cc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:41.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.451+0000 7f2508693640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25000cca30 0x7f25000cce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:41.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.451+0000 7f2508693640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f25000cc020 con 0x7f2500074410 2024-05-09T05:58:41.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.451+0000 7f2508693640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f250015dfe0 con 0x7f2500156b50 2024-05-09T05:58:41.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.451+0000 7f2508693640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f250015d950 con 0x7f25000cca30 2024-05-09T05:58:41.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.451+0000 7f2505c2e640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2500074410 0x7f25000cc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:41.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.451+0000 7f2505c2e640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2500074410 0x7f25000cc4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54498/0 (socket says 172.21.15.72:54498) 2024-05-09T05:58:41.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.451+0000 7f2505c2e640 1 -- 172.21.15.72:0/166983322 learned_addr learned my addr 172.21.15.72:0/166983322 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:58:41.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.451+0000 7f2506c30640 1 --2- 172.21.15.72:0/166983322 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25000cca30 0x7f25000cce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:41.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.451+0000 7f250642f640 1 --2- 172.21.15.72:0/166983322 >> v2:172.21.15.110:3300/0 conn(0x7f2500156b50 0x7f2500073ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:41.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.451+0000 7f2505c2e640 1 -- 172.21.15.72:0/166983322 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25000cca30 msgr2=0x7f25000cce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:58:41.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.451+0000 7f2505c2e640 1 --2- 172.21.15.72:0/166983322 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25000cca30 0x7f25000cce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:41.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.451+0000 7f2505c2e640 1 -- 172.21.15.72:0/166983322 >> v2:172.21.15.110:3300/0 conn(0x7f2500156b50 msgr2=0x7f2500073ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:58:41.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.451+0000 7f2505c2e640 1 --2- 172.21.15.72:0/166983322 >> v2:172.21.15.110:3300/0 conn(0x7f2500156b50 0x7f2500073ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:41.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.451+0000 7f2505c2e640 1 -- 172.21.15.72:0/166983322 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25000cda30 con 0x7f2500074410 2024-05-09T05:58:41.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.451+0000 7f250642f640 1 --2- 172.21.15.72:0/166983322 >> v2:172.21.15.110:3300/0 conn(0x7f2500156b50 0x7f2500073ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:58:41.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.451+0000 7f2505c2e640 1 --2- 172.21.15.72:0/166983322 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2500074410 0x7f25000cc4f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f250006f9a0 tx=0x7f24fc01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c286c421b1552e35 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:41.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.451+0000 7f250542d640 1 -- 172.21.15.72:0/166983322 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24fc0ab5f0 con 0x7f2500074410 2024-05-09T05:58:41.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.451+0000 7f250542d640 1 -- 172.21.15.72:0/166983322 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24fc0b0070 con 0x7f2500074410 2024-05-09T05:58:41.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.451+0000 7f250542d640 1 -- 172.21.15.72:0/166983322 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24fc0ab9b0 con 0x7f2500074410 2024-05-09T05:58:41.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.455+0000 7f2508693640 1 -- 172.21.15.72:0/166983322 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2500074410 msgr2=0x7f25000cc4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:41.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.455+0000 7f2508693640 1 --2- 172.21.15.72:0/166983322 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2500074410 0x7f25000cc4f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f250006f9a0 tx=0x7f24fc01c520 comp rx=0 tx=0).stop 2024-05-09T05:58:41.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.455+0000 7f2508693640 1 -- 172.21.15.72:0/166983322 shutdown_connections 2024-05-09T05:58:41.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.455+0000 7f2508693640 1 --2- 172.21.15.72:0/166983322 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25000cca30 0x7f25000cce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:41.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.455+0000 7f2508693640 1 --2- 172.21.15.72:0/166983322 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2500074410 0x7f25000cc4f0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:41.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.455+0000 7f2508693640 1 --2- 172.21.15.72:0/166983322 >> v2:172.21.15.110:3300/0 conn(0x7f2500156b50 0x7f2500073ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:41.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.455+0000 7f2508693640 1 -- 172.21.15.72:0/166983322 >> 172.21.15.72:0/166983322 conn(0x7f25000d1b70 msgr2=0x7f25000d1f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:58:41.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.455+0000 7f2508693640 1 -- 172.21.15.72:0/166983322 shutdown_connections 2024-05-09T05:58:41.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.455+0000 7f2508693640 1 -- 172.21.15.72:0/166983322 wait complete. 2024-05-09T05:58:41.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.455+0000 7f2508693640 1 Processor -- start 2024-05-09T05:58:41.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.455+0000 7f2508693640 1 -- start start 2024-05-09T05:58:41.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.455+0000 7f2508693640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2500074410 0x7f2500157840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:41.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.455+0000 7f2508693640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25000cca30 0x7f2500162220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:41.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.455+0000 7f2508693640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2500156b50 0x7f2500150d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:41.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.455+0000 7f2508693640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f2500074cf0 con 0x7f2500156b50 2024-05-09T05:58:41.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.455+0000 7f2508693640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f250015d670 con 0x7f25000cca30 2024-05-09T05:58:41.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.455+0000 7f2508693640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f250015c9b0 con 0x7f2500074410 2024-05-09T05:58:41.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.459+0000 7f2506c30640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2500156b50 0x7f2500150d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:41.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.459+0000 7f2506c30640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2500156b50 0x7f2500150d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54500/0 (socket says 172.21.15.72:54500) 2024-05-09T05:58:41.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.459+0000 7f2506c30640 1 -- 172.21.15.72:0/1056584535 learned_addr learned my addr 172.21.15.72:0/1056584535 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:58:41.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.459+0000 7f2505c2e640 1 --2- 172.21.15.72:0/1056584535 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25000cca30 0x7f2500162220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:41.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.459+0000 7f250642f640 1 --2- 172.21.15.72:0/1056584535 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2500074410 0x7f2500157840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:41.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.459+0000 7f2506c30640 1 -- 172.21.15.72:0/1056584535 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2500074410 msgr2=0x7f2500157840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:41.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.459+0000 7f2506c30640 1 --2- 172.21.15.72:0/1056584535 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2500074410 0x7f2500157840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:41.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.459+0000 7f2506c30640 1 -- 172.21.15.72:0/1056584535 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25000cca30 msgr2=0x7f2500162220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:41.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.459+0000 7f2506c30640 1 --2- 172.21.15.72:0/1056584535 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25000cca30 0x7f2500162220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:41.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.459+0000 7f2506c30640 1 -- 172.21.15.72:0/1056584535 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2500157d80 con 0x7f2500156b50 2024-05-09T05:58:41.448 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.459+0000 7f2506c30640 1 --2- 172.21.15.72:0/1056584535 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2500156b50 0x7f2500150d20 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f24f800ef30 tx=0x7f24f800b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:41.448 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.459+0000 7f24f6ffd640 1 -- 172.21.15.72:0/1056584535 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f8018020 con 0x7f2500156b50 2024-05-09T05:58:41.448 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.459+0000 7f24f6ffd640 1 -- 172.21.15.72:0/1056584535 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24f800bcc0 con 0x7f2500156b50 2024-05-09T05:58:41.448 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.459+0000 7f2508693640 1 -- 172.21.15.72:0/1056584535 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25001f6200 con 0x7f2500156b50 2024-05-09T05:58:41.448 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.459+0000 7f24f6ffd640 1 -- 172.21.15.72:0/1056584535 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f8014620 con 0x7f2500156b50 2024-05-09T05:58:41.448 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.459+0000 7f2508693640 1 -- 172.21.15.72:0/1056584535 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25001f6ab0 con 0x7f2500156b50 2024-05-09T05:58:41.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.459+0000 7f2508693640 1 -- 172.21.15.72:0/1056584535 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f250006a520 con 0x7f2500156b50 2024-05-09T05:58:41.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.459+0000 7f24f6ffd640 1 -- 172.21.15.72:0/1056584535 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f24f801b020 con 0x7f2500156b50 2024-05-09T05:58:41.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.459+0000 7f24f6ffd640 1 --2- 172.21.15.72:0/1056584535 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f24e406f430 0x7f24e4071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:41.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.459+0000 7f24f6ffd640 1 -- 172.21.15.72:0/1056584535 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6762+0+0 (secure 0 0 0) 0x7f24f8090700 con 0x7f2500156b50 2024-05-09T05:58:41.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.459+0000 7f24f6ffd640 1 --2- 172.21.15.72:0/1056584535 >> [v2:172.21.15.110:6816/3437318248,v1:172.21.15.110:6817/3437318248] conn(0x7f24e4078df0 0x7f24e407b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:41.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.459+0000 7f24f6ffd640 1 -- 172.21.15.72:0/1056584535 --> [v2:172.21.15.110:6816/3437318248,v1:172.21.15.110:6817/3437318248] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f24f8021e80 con 0x7f24e4078df0 2024-05-09T05:58:41.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.459+0000 7f24f6ffd640 1 -- 172.21.15.72:0/1056584535 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f24f8090b90 con 0x7f2500156b50 2024-05-09T05:58:41.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.459+0000 7f250642f640 1 --2- 172.21.15.72:0/1056584535 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f24e406f430 0x7f24e4071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:41.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.459+0000 7f2505c2e640 1 --2- 172.21.15.72:0/1056584535 >> [v2:172.21.15.110:6816/3437318248,v1:172.21.15.110:6817/3437318248] conn(0x7f24e4078df0 0x7f24e407b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:41.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.463+0000 7f250642f640 1 --2- 172.21.15.72:0/1056584535 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f24e406f430 0x7f24e4071940 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f24f000ba10 tx=0x7f24f0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:41.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.463+0000 7f2505c2e640 1 --2- 172.21.15.72:0/1056584535 >> [v2:172.21.15.110:6816/3437318248,v1:172.21.15.110:6817/3437318248] conn(0x7f24e4078df0 0x7f24e407b2c0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:41.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.463+0000 7f24f6ffd640 1 -- 172.21.15.72:0/1056584535 <== osd.4 v2:172.21.15.110:6816/3437318248 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f24f8021e80 con 0x7f24e4078df0 2024-05-09T05:58:41.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.479+0000 7f2508693640 1 -- 172.21.15.72:0/1056584535 --> [v2:172.21.15.110:6816/3437318248,v1:172.21.15.110:6817/3437318248] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f25001f6580 con 0x7f24e4078df0 2024-05-09T05:58:41.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.479+0000 7f24f6ffd640 1 -- 172.21.15.72:0/1056584535 <== osd.4 v2:172.21.15.110:6816/3437318248 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f25001f6580 con 0x7f24e4078df0 2024-05-09T05:58:41.466 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-05-09T05:58:41.466 INFO:teuthology.orchestra.run.smithi072.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-09T05:58:41.466 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-05-09T05:58:41.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.479+0000 7f2508693640 1 -- 172.21.15.72:0/1056584535 >> [v2:172.21.15.110:6816/3437318248,v1:172.21.15.110:6817/3437318248] conn(0x7f24e4078df0 msgr2=0x7f24e407b2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:41.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.479+0000 7f2508693640 1 --2- 172.21.15.72:0/1056584535 >> [v2:172.21.15.110:6816/3437318248,v1:172.21.15.110:6817/3437318248] conn(0x7f24e4078df0 0x7f24e407b2c0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:41.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.479+0000 7f2508693640 1 -- 172.21.15.72:0/1056584535 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f24e406f430 msgr2=0x7f24e4071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:41.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.479+0000 7f2508693640 1 --2- 172.21.15.72:0/1056584535 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f24e406f430 0x7f24e4071940 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f24f000ba10 tx=0x7f24f0008040 comp rx=0 tx=0).stop 2024-05-09T05:58:41.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.479+0000 7f2508693640 1 -- 172.21.15.72:0/1056584535 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2500156b50 msgr2=0x7f2500150d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:41.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.479+0000 7f2508693640 1 --2- 172.21.15.72:0/1056584535 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2500156b50 0x7f2500150d20 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f24f800ef30 tx=0x7f24f800b480 comp rx=0 tx=0).stop 2024-05-09T05:58:41.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.479+0000 7f2506c30640 1 -- 172.21.15.72:0/1056584535 reap_dead start 2024-05-09T05:58:41.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.479+0000 7f2508693640 1 -- 172.21.15.72:0/1056584535 shutdown_connections 2024-05-09T05:58:41.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.479+0000 7f2508693640 1 -- 172.21.15.72:0/1056584535 >> 172.21.15.72:0/1056584535 conn(0x7f25000d1b70 msgr2=0x7f25000d1180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:58:41.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.479+0000 7f2508693640 1 -- 172.21.15.72:0/1056584535 shutdown_connections 2024-05-09T05:58:41.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.479+0000 7f2508693640 1 -- 172.21.15.72:0/1056584535 wait complete. 2024-05-09T05:58:41.487 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-05-09T05:58:41.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.631+0000 7fe2d74eb640 1 Processor -- start 2024-05-09T05:58:41.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.631+0000 7fe2d74eb640 1 -- start start 2024-05-09T05:58:41.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.631+0000 7fe2d74eb640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe2d00c9c00 0x7fe2d0160620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:41.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.631+0000 7fe2d74eb640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe2d006fc00 0x7fe2d0070010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:41.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.631+0000 7fe2d74eb640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2d0072520 con 0x7fe2d00c8ee0 2024-05-09T05:58:41.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.631+0000 7fe2d74eb640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fe2d00c81b0 con 0x7fe2d006fc00 2024-05-09T05:58:41.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.631+0000 7fe2d74eb640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fe2d0072800 con 0x7fe2d00c9c00 2024-05-09T05:58:41.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.631+0000 7fe2d4a86640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe2d006fc00 0x7fe2d0070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:41.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.631+0000 7fe2d4a86640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe2d006fc00 0x7fe2d0070010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54514/0 (socket says 172.21.15.72:54514) 2024-05-09T05:58:41.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.631+0000 7fe2d4a86640 1 -- 172.21.15.72:0/32386239 learned_addr learned my addr 172.21.15.72:0/32386239 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:58:41.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.631+0000 7fe2d5287640 1 --2- 172.21.15.72:0/32386239 >> v2:172.21.15.110:3300/0 conn(0x7fe2d00c9c00 0x7fe2d0160620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:41.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.635+0000 7fe2d4a86640 1 -- 172.21.15.72:0/32386239 >> v2:172.21.15.110:3300/0 conn(0x7fe2d00c9c00 msgr2=0x7fe2d0160620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:58:41.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.635+0000 7fe2d4a86640 1 --2- 172.21.15.72:0/32386239 >> v2:172.21.15.110:3300/0 conn(0x7fe2d00c9c00 0x7fe2d0160620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:41.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.635+0000 7fe2d4a86640 1 -- 172.21.15.72:0/32386239 >> v1:172.21.15.72:6789/0 conn(0x7fe2d00c8ee0 legacy=0x7fe2d015c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:41.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.635+0000 7fe2d4a86640 1 -- 172.21.15.72:0/32386239 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2d00c8400 con 0x7fe2d006fc00 2024-05-09T05:58:41.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.635+0000 7fe2d4a86640 1 --2- 172.21.15.72:0/32386239 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2d006fc00 0x7fe2d0070010 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fe2d0070e60 tx=0x7fe2cc01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41b81cbcb5ee0dff server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:41.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.635+0000 7fe2c7fff640 1 -- 172.21.15.72:0/32386239 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc0b0070 con 0x7fe2d006fc00 2024-05-09T05:58:41.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.635+0000 7fe2c7fff640 1 -- 172.21.15.72:0/32386239 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2cc0ab600 con 0x7fe2d006fc00 2024-05-09T05:58:41.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.635+0000 7fe2c7fff640 1 -- 172.21.15.72:0/32386239 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc0ab9d0 con 0x7fe2d006fc00 2024-05-09T05:58:41.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.635+0000 7fe2d74eb640 1 -- 172.21.15.72:0/32386239 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2d006fc00 msgr2=0x7fe2d0070010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:41.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.635+0000 7fe2d74eb640 1 --2- 172.21.15.72:0/32386239 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2d006fc00 0x7fe2d0070010 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fe2d0070e60 tx=0x7fe2cc01c520 comp rx=0 tx=0).stop 2024-05-09T05:58:41.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.635+0000 7fe2d74eb640 1 -- 172.21.15.72:0/32386239 shutdown_connections 2024-05-09T05:58:41.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.635+0000 7fe2d74eb640 1 --2- 172.21.15.72:0/32386239 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2d006fc00 0x7fe2d0070010 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:41.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.635+0000 7fe2d74eb640 1 --2- 172.21.15.72:0/32386239 >> v2:172.21.15.110:3300/0 conn(0x7fe2d00c9c00 0x7fe2d0160620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:41.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.635+0000 7fe2d74eb640 1 -- 172.21.15.72:0/32386239 >> 172.21.15.72:0/32386239 conn(0x7fe2d00cde90 msgr2=0x7fe2d00ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:58:41.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.635+0000 7fe2d74eb640 1 -- 172.21.15.72:0/32386239 shutdown_connections 2024-05-09T05:58:41.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.635+0000 7fe2d74eb640 1 -- 172.21.15.72:0/32386239 wait complete. 2024-05-09T05:58:41.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.639+0000 7fe2d74eb640 1 Processor -- start 2024-05-09T05:58:41.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.639+0000 7fe2d74eb640 1 -- start start 2024-05-09T05:58:41.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.639+0000 7fe2d74eb640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2d006fc00 0x7fe2d015a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:41.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.639+0000 7fe2d74eb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2d00c8ee0 0x7fe2d0159920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:41.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.639+0000 7fe2d74eb640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2d00c9c00 0x7fe2d00c69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:41.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.639+0000 7fe2d74eb640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d00cab40 con 0x7fe2d006fc00 2024-05-09T05:58:41.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.639+0000 7fe2d74eb640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d00ca9c0 con 0x7fe2d00c8ee0 2024-05-09T05:58:41.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.639+0000 7fe2d74eb640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fe2d016a010 con 0x7fe2d00c9c00 2024-05-09T05:58:41.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.639+0000 7fe2d5287640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2d006fc00 0x7fe2d015a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:41.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.639+0000 7fe2d5287640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2d006fc00 0x7fe2d015a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54516/0 (socket says 172.21.15.72:54516) 2024-05-09T05:58:41.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.639+0000 7fe2d5287640 1 -- 172.21.15.72:0/616961571 learned_addr learned my addr 172.21.15.72:0/616961571 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:58:41.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.639+0000 7fe2d4a86640 1 --2- 172.21.15.72:0/616961571 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2d00c8ee0 0x7fe2d0159920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:41.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.639+0000 7fe2d5287640 1 -- 172.21.15.72:0/616961571 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2d00c9c00 msgr2=0x7fe2d00c69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:41.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.639+0000 7fe2d5287640 1 --2- 172.21.15.72:0/616961571 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2d00c9c00 0x7fe2d00c69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:41.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.639+0000 7fe2d5287640 1 -- 172.21.15.72:0/616961571 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2d00c8ee0 msgr2=0x7fe2d0159920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:41.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.639+0000 7fe2d5287640 1 --2- 172.21.15.72:0/616961571 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2d00c8ee0 0x7fe2d0159920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:41.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.639+0000 7fe2d5287640 1 -- 172.21.15.72:0/616961571 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2d015adb0 con 0x7fe2d006fc00 2024-05-09T05:58:41.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.639+0000 7fe2d5287640 1 --2- 172.21.15.72:0/616961571 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2d006fc00 0x7fe2d015a870 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fe2c000d620 tx=0x7fe2c000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:41.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.639+0000 7fe2c5ffb640 1 -- 172.21.15.72:0/616961571 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c000b620 con 0x7fe2d006fc00 2024-05-09T05:58:41.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.639+0000 7fe2c5ffb640 1 -- 172.21.15.72:0/616961571 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2c0019070 con 0x7fe2d006fc00 2024-05-09T05:58:41.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.639+0000 7fe2d74eb640 1 -- 172.21.15.72:0/616961571 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2d0158d30 con 0x7fe2d006fc00 2024-05-09T05:58:41.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.643+0000 7fe2c5ffb640 1 -- 172.21.15.72:0/616961571 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c000b9e0 con 0x7fe2d006fc00 2024-05-09T05:58:41.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.643+0000 7fe2d74eb640 1 -- 172.21.15.72:0/616961571 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2d015b910 con 0x7fe2d006fc00 2024-05-09T05:58:41.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.643+0000 7fe2d74eb640 1 -- 172.21.15.72:0/616961571 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2d006a520 con 0x7fe2d006fc00 2024-05-09T05:58:41.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.643+0000 7fe2c5ffb640 1 -- 172.21.15.72:0/616961571 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe2c000bb80 con 0x7fe2d006fc00 2024-05-09T05:58:41.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.643+0000 7fe2c5ffb640 1 --2- 172.21.15.72:0/616961571 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fe2b406f430 0x7fe2b4071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:41.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.643+0000 7fe2c5ffb640 1 -- 172.21.15.72:0/616961571 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6762+0+0 (secure 0 0 0) 0x7fe2c008fa20 con 0x7fe2d006fc00 2024-05-09T05:58:41.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.643+0000 7fe2d4a86640 1 --2- 172.21.15.72:0/616961571 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fe2b406f430 0x7fe2b4071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:41.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.643+0000 7fe2d4a86640 1 --2- 172.21.15.72:0/616961571 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fe2b406f430 0x7fe2b4071940 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc0ad000 tx=0x7fe2cc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:41.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.647+0000 7fe2c5ffb640 1 -- 172.21.15.72:0/616961571 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fe2c005c610 con 0x7fe2d006fc00 2024-05-09T05:58:41.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.811+0000 7fe2d74eb640 1 -- 172.21.15.72:0/616961571 --> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fe2d00c4390 con 0x7fe2b406f430 2024-05-09T05:58:41.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.811+0000 7fe2c5ffb640 1 -- 172.21.15.72:0/616961571 <== mgr.4102 v2:172.21.15.110:6832/1113420672 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe2d00c4390 con 0x7fe2b406f430 2024-05-09T05:58:41.801 INFO:teuthology.orchestra.run.smithi072.stderr:instructed osd(s) 4 to deep-scrub 2024-05-09T05:58:41.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.815+0000 7fe2d74eb640 1 -- 172.21.15.72:0/616961571 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fe2b406f430 msgr2=0x7fe2b4071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:41.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.815+0000 7fe2d74eb640 1 --2- 172.21.15.72:0/616961571 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fe2b406f430 0x7fe2b4071940 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc0ad000 tx=0x7fe2cc008040 comp rx=0 tx=0).stop 2024-05-09T05:58:41.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.815+0000 7fe2d74eb640 1 -- 172.21.15.72:0/616961571 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2d006fc00 msgr2=0x7fe2d015a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:41.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.815+0000 7fe2d74eb640 1 --2- 172.21.15.72:0/616961571 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2d006fc00 0x7fe2d015a870 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fe2c000d620 tx=0x7fe2c000dae0 comp rx=0 tx=0).stop 2024-05-09T05:58:41.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.815+0000 7fe2d74eb640 1 -- 172.21.15.72:0/616961571 shutdown_connections 2024-05-09T05:58:41.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.815+0000 7fe2d74eb640 1 --2- 172.21.15.72:0/616961571 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fe2b406f430 0x7fe2b4071940 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:41.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.815+0000 7fe2d74eb640 1 --2- 172.21.15.72:0/616961571 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2d00c9c00 0x7fe2d00c69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:41.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.815+0000 7fe2d74eb640 1 --2- 172.21.15.72:0/616961571 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2d00c8ee0 0x7fe2d0159920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:41.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.815+0000 7fe2d74eb640 1 --2- 172.21.15.72:0/616961571 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2d006fc00 0x7fe2d015a870 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:41.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.815+0000 7fe2d74eb640 1 -- 172.21.15.72:0/616961571 >> 172.21.15.72:0/616961571 conn(0x7fe2d00cde90 msgr2=0x7fe2d0150430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:58:41.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.815+0000 7fe2d74eb640 1 -- 172.21.15.72:0/616961571 shutdown_connections 2024-05-09T05:58:41.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.815+0000 7fe2d74eb640 1 -- 172.21.15.72:0/616961571 wait complete. 2024-05-09T05:58:41.827 INFO:tasks.ceph:Scrubbing osd.5 2024-05-09T05:58:41.828 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-05-09T05:58:41.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.995+0000 7f5baccdd640 1 Processor -- start 2024-05-09T05:58:41.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.995+0000 7f5baccdd640 1 -- start start 2024-05-09T05:58:41.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.995+0000 7f5baccdd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ba8163e70 0x7f5ba8166290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:41.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.995+0000 7f5baccdd640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ba80c7c80 con 0x7f5ba815dea0 2024-05-09T05:58:41.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.995+0000 7f5baccdd640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ba815a4f0 con 0x7f5ba815da90 2024-05-09T05:58:41.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.995+0000 7f5baccdd640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f5ba81513f0 con 0x7f5ba8163e70 2024-05-09T05:58:41.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.995+0000 7f5b9dd9b640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f5ba815dea0 0x7f5ba80745b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48486/0 (socket says 172.21.15.72:48486) 2024-05-09T05:58:41.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.995+0000 7f5b9dd9b640 1 -- 172.21.15.72:0/3647248692 learned_addr learned my addr 172.21.15.72:0/3647248692 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:58:41.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.995+0000 7f5ba6d9d640 1 --2- 172.21.15.72:0/3647248692 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ba8163e70 0x7f5ba8166290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:41.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.995+0000 7f5ba5d9b640 1 -- 172.21.15.72:0/3647248692 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2683930437 0 0) 0x7f5ba80c7c80 con 0x7f5ba815dea0 2024-05-09T05:58:41.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.995+0000 7f5ba5d9b640 1 -- 172.21.15.72:0/3647248692 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b94003530 con 0x7f5ba815dea0 2024-05-09T05:58:41.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.999+0000 7f5ba5d9b640 1 -- 172.21.15.72:0/3647248692 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1474899352 0 0) 0x7f5b94003530 con 0x7f5ba815dea0 2024-05-09T05:58:41.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.999+0000 7f5ba5d9b640 1 -- 172.21.15.72:0/3647248692 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ba8163e70 msgr2=0x7f5ba8166290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:58:41.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.999+0000 7f5ba5d9b640 1 --2- 172.21.15.72:0/3647248692 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ba8163e70 0x7f5ba8166290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:41.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.999+0000 7f5ba5d9b640 1 -- 172.21.15.72:0/3647248692 >> v1:172.21.15.110:6789/0 conn(0x7f5ba815da90 legacy=0x7f5ba80c7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:41.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.999+0000 7f5ba5d9b640 1 -- 172.21.15.72:0/3647248692 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ba80c84f0 con 0x7f5ba815dea0 2024-05-09T05:58:41.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.999+0000 7f5ba5d9b640 1 -- 172.21.15.72:0/3647248692 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2749052815 0 0) 0x7f5b90001700 con 0x7f5ba815dea0 2024-05-09T05:58:41.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.999+0000 7f5ba5d9b640 1 -- 172.21.15.72:0/3647248692 >> v1:172.21.15.72:6789/0 conn(0x7f5ba815dea0 legacy=0x7f5ba80745b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:41.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.999+0000 7f5ba5d9b640 1 --2- 172.21.15.72:0/3647248692 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ba8163e70 0x7f5b94003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:41.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.999+0000 7f5ba5d9b640 1 --2- 172.21.15.72:0/3647248692 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5b94004030 0x7f5b94004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:41.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.999+0000 7f5ba5d9b640 1 --2- 172.21.15.72:0/3647248692 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b94004d50 0x7f5b94005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:41.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.999+0000 7f5ba5d9b640 1 -- 172.21.15.72:0/3647248692 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f5b9400bbe0 con 0x7f5b94004d50 2024-05-09T05:58:41.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.999+0000 7f5ba5d9b640 1 -- 172.21.15.72:0/3647248692 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f5b9400bd90 con 0x7f5b94004030 2024-05-09T05:58:41.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.999+0000 7f5ba5d9b640 1 -- 172.21.15.72:0/3647248692 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f5b9400bf90 con 0x7f5ba8163e70 2024-05-09T05:58:41.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.999+0000 7f5ba6d9d640 1 --2- 172.21.15.72:0/3647248692 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b94004d50 0x7f5b94005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:41.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.999+0000 7f5b9dd9b640 1 --2- 172.21.15.72:0/3647248692 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5b94004030 0x7f5b94004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:41.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.999+0000 7f5ba659c640 1 --2- 172.21.15.72:0/3647248692 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ba8163e70 0x7f5b94003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:41.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.999+0000 7f5ba6d9d640 1 -- 172.21.15.72:0/3647248692 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ba8163e70 msgr2=0x7f5b94003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:58:41.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.999+0000 7f5ba6d9d640 1 --2- 172.21.15.72:0/3647248692 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ba8163e70 0x7f5b94003a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:41.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.999+0000 7f5ba6d9d640 1 -- 172.21.15.72:0/3647248692 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5b94004030 msgr2=0x7f5b94004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:58:41.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.999+0000 7f5ba6d9d640 1 --2- 172.21.15.72:0/3647248692 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5b94004030 0x7f5b94004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:41.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.999+0000 7f5ba6d9d640 1 -- 172.21.15.72:0/3647248692 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b94003530 con 0x7f5b94004d50 2024-05-09T05:58:41.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.999+0000 7f5ba6d9d640 1 --2- 172.21.15.72:0/3647248692 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b94004d50 0x7f5b94005220 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5ba0009f90 tx=0x7f5ba001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c256c8d115dc573f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:41.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.999+0000 7f5ba5d9b640 1 -- 172.21.15.72:0/3647248692 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba00b2070 con 0x7f5b94004d50 2024-05-09T05:58:41.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.999+0000 7f5ba5d9b640 1 -- 172.21.15.72:0/3647248692 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ba00a5c70 con 0x7f5b94004d50 2024-05-09T05:58:41.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.999+0000 7f5ba5d9b640 1 -- 172.21.15.72:0/3647248692 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba0009c10 con 0x7f5b94004d50 2024-05-09T05:58:41.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.999+0000 7f5baccdd640 1 -- 172.21.15.72:0/3647248692 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b94004d50 msgr2=0x7f5b94005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:41.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.999+0000 7f5baccdd640 1 --2- 172.21.15.72:0/3647248692 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b94004d50 0x7f5b94005220 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5ba0009f90 tx=0x7f5ba001cc60 comp rx=0 tx=0).stop 2024-05-09T05:58:41.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.999+0000 7f5ba6d9d640 1 -- 172.21.15.72:0/3647248692 reap_dead start 2024-05-09T05:58:41.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.999+0000 7f5baccdd640 1 -- 172.21.15.72:0/3647248692 shutdown_connections 2024-05-09T05:58:41.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.999+0000 7f5baccdd640 1 -- 172.21.15.72:0/3647248692 >> 172.21.15.72:0/3647248692 conn(0x7f5ba80cde90 msgr2=0x7f5ba80ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:58:41.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.999+0000 7f5baccdd640 1 -- 172.21.15.72:0/3647248692 shutdown_connections 2024-05-09T05:58:41.991 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:41.999+0000 7f5baccdd640 1 -- 172.21.15.72:0/3647248692 wait complete. 2024-05-09T05:58:41.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.003+0000 7f5baccdd640 1 Processor -- start 2024-05-09T05:58:41.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.003+0000 7f5baccdd640 1 -- start start 2024-05-09T05:58:41.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.003+0000 7f5baccdd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ba81f4c30 0x7f5ba80cc900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:41.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.003+0000 7f5baccdd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ba8149050 0x7f5ba8149460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:41.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.003+0000 7f5baccdd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ba814a250 0x7f5ba814a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:41.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.003+0000 7f5baccdd640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f5ba815aa90 con 0x7f5ba814a250 2024-05-09T05:58:41.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.003+0000 7f5baccdd640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f5ba815a7b0 con 0x7f5ba81f4c30 2024-05-09T05:58:41.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.003+0000 7f5baccdd640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f5ba815ad70 con 0x7f5ba8149050 2024-05-09T05:58:41.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.003+0000 7f5ba6d9d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ba814a250 0x7f5ba814a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:41.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.003+0000 7f5ba6d9d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ba814a250 0x7f5ba814a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41016/0 (socket says 172.21.15.72:41016) 2024-05-09T05:58:41.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.003+0000 7f5ba6d9d640 1 -- 172.21.15.72:0/1669147859 learned_addr learned my addr 172.21.15.72:0/1669147859 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:58:41.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.003+0000 7f5ba659c640 1 --2- 172.21.15.72:0/1669147859 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ba81f4c30 0x7f5ba80cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:41.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.003+0000 7f5b9dd9b640 1 --2- 172.21.15.72:0/1669147859 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ba8149050 0x7f5ba8149460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:41.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.003+0000 7f5ba6d9d640 1 -- 172.21.15.72:0/1669147859 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ba8149050 msgr2=0x7f5ba8149460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:41.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.003+0000 7f5ba6d9d640 1 --2- 172.21.15.72:0/1669147859 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ba8149050 0x7f5ba8149460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:41.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.003+0000 7f5ba6d9d640 1 -- 172.21.15.72:0/1669147859 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ba81f4c30 msgr2=0x7f5ba80cc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:41.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.003+0000 7f5ba6d9d640 1 --2- 172.21.15.72:0/1669147859 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ba81f4c30 0x7f5ba80cc900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:41.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.003+0000 7f5ba6d9d640 1 -- 172.21.15.72:0/1669147859 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ba8147ca0 con 0x7f5ba814a250 2024-05-09T05:58:41.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.003+0000 7f5ba659c640 1 --2- 172.21.15.72:0/1669147859 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ba81f4c30 0x7f5ba80cc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:58:41.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.003+0000 7f5ba6d9d640 1 --2- 172.21.15.72:0/1669147859 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ba814a250 0x7f5ba814a660 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f5ba0002240 tx=0x7f5ba0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:41.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.003+0000 7f5b9f7fe640 1 -- 172.21.15.72:0/1669147859 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba00b2040 con 0x7f5ba814a250 2024-05-09T05:58:41.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.003+0000 7f5b9f7fe640 1 -- 172.21.15.72:0/1669147859 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ba00bc070 con 0x7f5ba814a250 2024-05-09T05:58:41.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.003+0000 7f5baccdd640 1 -- 172.21.15.72:0/1669147859 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ba8147f80 con 0x7f5ba814a250 2024-05-09T05:58:41.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.003+0000 7f5b9f7fe640 1 -- 172.21.15.72:0/1669147859 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba0009c10 con 0x7f5ba814a250 2024-05-09T05:58:41.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.003+0000 7f5baccdd640 1 -- 172.21.15.72:0/1669147859 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ba8148540 con 0x7f5ba814a250 2024-05-09T05:58:41.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.007+0000 7f5baccdd640 1 -- 172.21.15.72:0/1669147859 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5ba806a520 con 0x7f5ba814a250 2024-05-09T05:58:41.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.007+0000 7f5b9f7fe640 1 -- 172.21.15.72:0/1669147859 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f5ba00aeb60 con 0x7f5ba814a250 2024-05-09T05:58:41.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.007+0000 7f5b9f7fe640 1 --2- 172.21.15.72:0/1669147859 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f5b8806f400 0x7f5b88071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:41.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.007+0000 7f5b9f7fe640 1 -- 172.21.15.72:0/1669147859 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6762+0+0 (secure 0 0 0) 0x7f5ba012a960 con 0x7f5ba814a250 2024-05-09T05:58:41.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.007+0000 7f5b9f7fe640 1 --2- 172.21.15.72:0/1669147859 >> [v2:172.21.15.110:6824/977576181,v1:172.21.15.110:6825/977576181] conn(0x7f5b88078db0 0x7f5b8807b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:41.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.007+0000 7f5b9f7fe640 1 -- 172.21.15.72:0/1669147859 --> [v2:172.21.15.110:6824/977576181,v1:172.21.15.110:6825/977576181] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5ba00b6e50 con 0x7f5b88078db0 2024-05-09T05:58:41.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.007+0000 7f5b9f7fe640 1 -- 172.21.15.72:0/1669147859 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5ba012adf0 con 0x7f5ba814a250 2024-05-09T05:58:41.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.007+0000 7f5ba659c640 1 --2- 172.21.15.72:0/1669147859 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f5b8806f400 0x7f5b88071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:41.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.007+0000 7f5b9dd9b640 1 --2- 172.21.15.72:0/1669147859 >> [v2:172.21.15.110:6824/977576181,v1:172.21.15.110:6825/977576181] conn(0x7f5b88078db0 0x7f5b8807b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:41.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.007+0000 7f5ba659c640 1 --2- 172.21.15.72:0/1669147859 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f5b8806f400 0x7f5b88071910 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5ba80c9190 tx=0x7f5b98009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:41.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.007+0000 7f5b9dd9b640 1 --2- 172.21.15.72:0/1669147859 >> [v2:172.21.15.110:6824/977576181,v1:172.21.15.110:6825/977576181] conn(0x7f5b88078db0 0x7f5b8807b280 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:41.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.011+0000 7f5b9f7fe640 1 -- 172.21.15.72:0/1669147859 <== osd.5 v2:172.21.15.110:6824/977576181 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5ba00b6e50 con 0x7f5b88078db0 2024-05-09T05:58:42.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.023+0000 7f5baccdd640 1 -- 172.21.15.72:0/1669147859 --> [v2:172.21.15.110:6824/977576181,v1:172.21.15.110:6825/977576181] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f5ba8148990 con 0x7f5b88078db0 2024-05-09T05:58:42.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.023+0000 7f5b9f7fe640 1 -- 172.21.15.72:0/1669147859 <== osd.5 v2:172.21.15.110:6824/977576181 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f5ba8148990 con 0x7f5b88078db0 2024-05-09T05:58:42.013 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-05-09T05:58:42.013 INFO:teuthology.orchestra.run.smithi072.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-09T05:58:42.013 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-05-09T05:58:42.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.023+0000 7f5baccdd640 1 -- 172.21.15.72:0/1669147859 >> [v2:172.21.15.110:6824/977576181,v1:172.21.15.110:6825/977576181] conn(0x7f5b88078db0 msgr2=0x7f5b8807b280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:42.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.023+0000 7f5baccdd640 1 --2- 172.21.15.72:0/1669147859 >> [v2:172.21.15.110:6824/977576181,v1:172.21.15.110:6825/977576181] conn(0x7f5b88078db0 0x7f5b8807b280 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:42.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.027+0000 7f5baccdd640 1 -- 172.21.15.72:0/1669147859 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f5b8806f400 msgr2=0x7f5b88071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:42.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.027+0000 7f5baccdd640 1 --2- 172.21.15.72:0/1669147859 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f5b8806f400 0x7f5b88071910 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5ba80c9190 tx=0x7f5b98009040 comp rx=0 tx=0).stop 2024-05-09T05:58:42.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.027+0000 7f5baccdd640 1 -- 172.21.15.72:0/1669147859 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ba814a250 msgr2=0x7f5ba814a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:42.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.027+0000 7f5baccdd640 1 --2- 172.21.15.72:0/1669147859 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ba814a250 0x7f5ba814a660 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f5ba0002240 tx=0x7f5ba0009750 comp rx=0 tx=0).stop 2024-05-09T05:58:42.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.027+0000 7f5ba6d9d640 1 -- 172.21.15.72:0/1669147859 reap_dead start 2024-05-09T05:58:42.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.027+0000 7f5baccdd640 1 -- 172.21.15.72:0/1669147859 shutdown_connections 2024-05-09T05:58:42.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.027+0000 7f5baccdd640 1 -- 172.21.15.72:0/1669147859 >> 172.21.15.72:0/1669147859 conn(0x7f5ba80cde90 msgr2=0x7f5ba8159980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:58:42.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.027+0000 7f5baccdd640 1 -- 172.21.15.72:0/1669147859 shutdown_connections 2024-05-09T05:58:42.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.027+0000 7f5baccdd640 1 -- 172.21.15.72:0/1669147859 wait complete. 2024-05-09T05:58:42.034 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-05-09T05:58:42.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.191+0000 7f236ec75640 1 Processor -- start 2024-05-09T05:58:42.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.191+0000 7f236ec75640 1 -- start start 2024-05-09T05:58:42.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.191+0000 7f236ec75640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f23680c77a0 0x7f23681537d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:42.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.191+0000 7f236ec75640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2368161d70 0x7f2368164190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:42.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.191+0000 7f236ec75640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23680c72c0 con 0x7f2368074740 2024-05-09T05:58:42.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.191+0000 7f236ec75640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f23680c7bb0 con 0x7f23680c77a0 2024-05-09T05:58:42.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.191+0000 7f236ec75640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f2368074460 con 0x7f2368161d70 2024-05-09T05:58:42.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.191+0000 7f236ca11640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f23680c77a0 0x7f23681537d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:42.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.191+0000 7f236ca11640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f23680c77a0 0x7f23681537d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41024/0 (socket says 172.21.15.72:41024) 2024-05-09T05:58:42.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.191+0000 7f236ca11640 1 -- 172.21.15.72:0/1102986947 learned_addr learned my addr 172.21.15.72:0/1102986947 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:58:42.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.191+0000 7f236d212640 1 --2- 172.21.15.72:0/1102986947 >> v2:172.21.15.110:3300/0 conn(0x7f2368161d70 0x7f2368164190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:42.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.191+0000 7f236ca11640 1 -- 172.21.15.72:0/1102986947 >> v2:172.21.15.110:3300/0 conn(0x7f2368161d70 msgr2=0x7f2368164190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:58:42.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.191+0000 7f236ca11640 1 --2- 172.21.15.72:0/1102986947 >> v2:172.21.15.110:3300/0 conn(0x7f2368161d70 0x7f2368164190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:42.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.191+0000 7f236ca11640 1 -- 172.21.15.72:0/1102986947 >> v1:172.21.15.110:6789/0 conn(0x7f2368074740 legacy=0x7f2368072e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:58:42.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.191+0000 7f236ca11640 1 -- 172.21.15.72:0/1102986947 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2368073af0 con 0x7f23680c77a0 2024-05-09T05:58:42.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.195+0000 7f236ca11640 1 --2- 172.21.15.72:0/1102986947 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23680c77a0 0x7f23681537d0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f23680ce500 tx=0x7f235c01eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd2b790f6d86bc36 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:42.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.195+0000 7f23677fe640 1 -- 172.21.15.72:0/1102986947 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f235c0b4070 con 0x7f23680c77a0 2024-05-09T05:58:42.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.195+0000 7f23677fe640 1 -- 172.21.15.72:0/1102986947 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f235c0a7b50 con 0x7f23680c77a0 2024-05-09T05:58:42.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.195+0000 7f23677fe640 1 -- 172.21.15.72:0/1102986947 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f235c0af440 con 0x7f23680c77a0 2024-05-09T05:58:42.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.195+0000 7f236ec75640 1 -- 172.21.15.72:0/1102986947 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23680c77a0 msgr2=0x7f23681537d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:42.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.195+0000 7f236ec75640 1 --2- 172.21.15.72:0/1102986947 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23680c77a0 0x7f23681537d0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f23680ce500 tx=0x7f235c01eba0 comp rx=0 tx=0).stop 2024-05-09T05:58:42.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.195+0000 7f236ec75640 1 -- 172.21.15.72:0/1102986947 shutdown_connections 2024-05-09T05:58:42.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.195+0000 7f236ec75640 1 --2- 172.21.15.72:0/1102986947 >> v2:172.21.15.110:3300/0 conn(0x7f2368161d70 0x7f2368164190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:42.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.195+0000 7f236ec75640 1 --2- 172.21.15.72:0/1102986947 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23680c77a0 0x7f23681537d0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:42.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.195+0000 7f236ec75640 1 -- 172.21.15.72:0/1102986947 >> 172.21.15.72:0/1102986947 conn(0x7f23680cde90 msgr2=0x7f23680ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:58:42.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.195+0000 7f236ec75640 1 -- 172.21.15.72:0/1102986947 shutdown_connections 2024-05-09T05:58:42.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.195+0000 7f236ec75640 1 -- 172.21.15.72:0/1102986947 wait complete. 2024-05-09T05:58:42.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.199+0000 7f236ec75640 1 Processor -- start 2024-05-09T05:58:42.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.199+0000 7f236ec75640 1 -- start start 2024-05-09T05:58:42.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.199+0000 7f236ec75640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2368074740 0x7f236815b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:42.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.199+0000 7f236ec75640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23680c77a0 0x7f23681633a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:42.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.199+0000 7f236ec75640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2368161d70 0x7f236814c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:42.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.199+0000 7f236ec75640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f23680c4cb0 con 0x7f23680c77a0 2024-05-09T05:58:42.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.199+0000 7f236ec75640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f2368072940 con 0x7f2368161d70 2024-05-09T05:58:42.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.199+0000 7f236ec75640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f23680c4e30 con 0x7f2368074740 2024-05-09T05:58:42.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.199+0000 7f2367fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23680c77a0 0x7f23681633a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:42.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.199+0000 7f2367fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23680c77a0 0x7f23681633a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41036/0 (socket says 172.21.15.72:41036) 2024-05-09T05:58:42.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.199+0000 7f2367fff640 1 -- 172.21.15.72:0/1903479112 learned_addr learned my addr 172.21.15.72:0/1903479112 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:58:42.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.199+0000 7f236ca11640 1 --2- 172.21.15.72:0/1903479112 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2368074740 0x7f236815b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:42.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.199+0000 7f236d212640 1 --2- 172.21.15.72:0/1903479112 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2368161d70 0x7f236814c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:42.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.199+0000 7f2367fff640 1 -- 172.21.15.72:0/1903479112 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2368074740 msgr2=0x7f236815b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:42.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.199+0000 7f2367fff640 1 --2- 172.21.15.72:0/1903479112 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2368074740 0x7f236815b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:42.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.199+0000 7f2367fff640 1 -- 172.21.15.72:0/1903479112 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2368161d70 msgr2=0x7f236814c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:42.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.199+0000 7f2367fff640 1 --2- 172.21.15.72:0/1903479112 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2368161d70 0x7f236814c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:42.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.199+0000 7f2367fff640 1 -- 172.21.15.72:0/1903479112 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f236815b7f0 con 0x7f23680c77a0 2024-05-09T05:58:42.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.199+0000 7f236ca11640 1 --2- 172.21.15.72:0/1903479112 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2368074740 0x7f236815b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:58:42.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.199+0000 7f236d212640 1 --2- 172.21.15.72:0/1903479112 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2368161d70 0x7f236814c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:58:42.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.199+0000 7f2367fff640 1 --2- 172.21.15.72:0/1903479112 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23680c77a0 0x7f23681633a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f235400b3f0 tx=0x7f235400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:42.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.199+0000 7f23657fa640 1 -- 172.21.15.72:0/1903479112 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2354015020 con 0x7f23680c77a0 2024-05-09T05:58:42.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.199+0000 7f23657fa640 1 -- 172.21.15.72:0/1903479112 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2354011830 con 0x7f23680c77a0 2024-05-09T05:58:42.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.199+0000 7f236ec75640 1 -- 172.21.15.72:0/1903479112 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23681f1ba0 con 0x7f23680c77a0 2024-05-09T05:58:42.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.199+0000 7f23657fa640 1 -- 172.21.15.72:0/1903479112 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2354011c00 con 0x7f23680c77a0 2024-05-09T05:58:42.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.199+0000 7f236ec75640 1 -- 172.21.15.72:0/1903479112 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23681f2160 con 0x7f23680c77a0 2024-05-09T05:58:42.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.199+0000 7f236ec75640 1 -- 172.21.15.72:0/1903479112 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f236806a520 con 0x7f23680c77a0 2024-05-09T05:58:42.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.203+0000 7f23657fa640 1 -- 172.21.15.72:0/1903479112 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f2354018020 con 0x7f23680c77a0 2024-05-09T05:58:42.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.203+0000 7f23657fa640 1 --2- 172.21.15.72:0/1903479112 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f234c06f400 0x7f234c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:42.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.203+0000 7f23657fa640 1 -- 172.21.15.72:0/1903479112 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6762+0+0 (secure 0 0 0) 0x7f235408f6b0 con 0x7f23680c77a0 2024-05-09T05:58:42.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.203+0000 7f236ca11640 1 --2- 172.21.15.72:0/1903479112 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f234c06f400 0x7f234c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:42.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.203+0000 7f236ca11640 1 --2- 172.21.15.72:0/1903479112 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f234c06f400 0x7f234c071910 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f235c0b1000 tx=0x7f235c0a9070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:42.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.207+0000 7f23657fa640 1 -- 172.21.15.72:0/1903479112 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f235401f030 con 0x7f23680c77a0 2024-05-09T05:58:42.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.359+0000 7f236ec75640 1 -- 172.21.15.72:0/1903479112 --> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f23681f1920 con 0x7f234c06f400 2024-05-09T05:58:42.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.359+0000 7f23657fa640 1 -- 172.21.15.72:0/1903479112 <== mgr.4102 v2:172.21.15.110:6832/1113420672 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f23681f1920 con 0x7f234c06f400 2024-05-09T05:58:42.348 INFO:teuthology.orchestra.run.smithi072.stderr:instructed osd(s) 5 to deep-scrub 2024-05-09T05:58:42.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.363+0000 7f236ec75640 1 -- 172.21.15.72:0/1903479112 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f234c06f400 msgr2=0x7f234c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:42.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.363+0000 7f236ec75640 1 --2- 172.21.15.72:0/1903479112 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f234c06f400 0x7f234c071910 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f235c0b1000 tx=0x7f235c0a9070 comp rx=0 tx=0).stop 2024-05-09T05:58:42.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.363+0000 7f236ec75640 1 -- 172.21.15.72:0/1903479112 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23680c77a0 msgr2=0x7f23681633a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:42.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.363+0000 7f236ec75640 1 --2- 172.21.15.72:0/1903479112 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23680c77a0 0x7f23681633a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f235400b3f0 tx=0x7f235400b8b0 comp rx=0 tx=0).stop 2024-05-09T05:58:42.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.363+0000 7f236ec75640 1 -- 172.21.15.72:0/1903479112 shutdown_connections 2024-05-09T05:58:42.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.363+0000 7f236ec75640 1 --2- 172.21.15.72:0/1903479112 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f234c06f400 0x7f234c071910 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:42.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.363+0000 7f236ec75640 1 --2- 172.21.15.72:0/1903479112 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2368161d70 0x7f236814c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:42.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.363+0000 7f236ec75640 1 --2- 172.21.15.72:0/1903479112 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23680c77a0 0x7f23681633a0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:42.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.363+0000 7f236ec75640 1 --2- 172.21.15.72:0/1903479112 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2368074740 0x7f236815b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:42.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.363+0000 7f236ec75640 1 -- 172.21.15.72:0/1903479112 >> 172.21.15.72:0/1903479112 conn(0x7f23680cde90 msgr2=0x7f236814d400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:58:42.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.363+0000 7f236ec75640 1 -- 172.21.15.72:0/1903479112 shutdown_connections 2024-05-09T05:58:42.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.363+0000 7f236ec75640 1 -- 172.21.15.72:0/1903479112 wait complete. 2024-05-09T05:58:42.370 INFO:tasks.ceph:Scrubbing osd.6 2024-05-09T05:58:42.370 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-05-09T05:58:42.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.523+0000 7f5e9fa13640 1 Processor -- start 2024-05-09T05:58:42.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.523+0000 7f5e9fa13640 1 -- start start 2024-05-09T05:58:42.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.523+0000 7f5e9fa13640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5e9815da90 0x7f5e980c7570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:42.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.523+0000 7f5e9fa13640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e9815a4f0 con 0x7f5e98162e60 2024-05-09T05:58:42.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.523+0000 7f5e9fa13640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e980c84f0 con 0x7f5e9815dea0 2024-05-09T05:58:42.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.523+0000 7f5e9fa13640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f5e981513f0 con 0x7f5e9815da90 2024-05-09T05:58:42.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.523+0000 7f5e9d7af640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5e9815da90 0x7f5e980c7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:42.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.523+0000 7f5e9dfb0640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f5e98162e60 0x7f5e98165280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48502/0 (socket says 172.21.15.72:48502) 2024-05-09T05:58:42.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.523+0000 7f5e9dfb0640 1 -- 172.21.15.72:0/1421028982 learned_addr learned my addr 172.21.15.72:0/1421028982 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:58:42.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.523+0000 7f5e9d7af640 1 -- 172.21.15.72:0/1421028982 >> v1:172.21.15.110:6789/0 conn(0x7f5e9815dea0 legacy=0x7f5e980745b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:58:42.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.523+0000 7f5e9d7af640 1 -- 172.21.15.72:0/1421028982 >> v1:172.21.15.72:6789/0 conn(0x7f5e98162e60 legacy=0x7f5e98165280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:42.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.523+0000 7f5e8ffff640 1 -- 172.21.15.72:0/1421028982 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 646316265 0 0) 0x7f5e9815a4f0 con 0x7f5e98162e60 2024-05-09T05:58:42.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.523+0000 7f5e9d7af640 1 -- 172.21.15.72:0/1421028982 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e980c87d0 con 0x7f5e9815da90 2024-05-09T05:58:42.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.527+0000 7f5e9d7af640 1 --2- 172.21.15.72:0/1421028982 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e9815da90 0x7f5e980c7570 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f5e940097c0 tx=0x7f5e9401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dc963acca390946 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:42.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.527+0000 7f5e8ffff640 1 -- 172.21.15.72:0/1421028982 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e940b0070 con 0x7f5e9815da90 2024-05-09T05:58:42.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.527+0000 7f5e8ffff640 1 -- 172.21.15.72:0/1421028982 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e940ab600 con 0x7f5e9815da90 2024-05-09T05:58:42.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.527+0000 7f5e8ffff640 1 -- 172.21.15.72:0/1421028982 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e940ab9d0 con 0x7f5e9815da90 2024-05-09T05:58:42.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.527+0000 7f5e9fa13640 1 -- 172.21.15.72:0/1421028982 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e9815da90 msgr2=0x7f5e980c7570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:42.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.527+0000 7f5e9fa13640 1 --2- 172.21.15.72:0/1421028982 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e9815da90 0x7f5e980c7570 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f5e940097c0 tx=0x7f5e9401c4a0 comp rx=0 tx=0).stop 2024-05-09T05:58:42.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.527+0000 7f5e9fa13640 1 -- 172.21.15.72:0/1421028982 shutdown_connections 2024-05-09T05:58:42.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.527+0000 7f5e9fa13640 1 --2- 172.21.15.72:0/1421028982 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e9815da90 0x7f5e980c7570 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:42.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.527+0000 7f5e9fa13640 1 -- 172.21.15.72:0/1421028982 >> 172.21.15.72:0/1421028982 conn(0x7f5e980cde90 msgr2=0x7f5e980ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:58:42.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.527+0000 7f5e9fa13640 1 -- 172.21.15.72:0/1421028982 shutdown_connections 2024-05-09T05:58:42.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.527+0000 7f5e9fa13640 1 -- 172.21.15.72:0/1421028982 wait complete. 2024-05-09T05:58:42.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.531+0000 7f5e9fa13640 1 Processor -- start 2024-05-09T05:58:42.518 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.531+0000 7f5e9fa13640 1 -- start start 2024-05-09T05:58:42.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.531+0000 7f5e9fa13640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e9815da90 0x7f5e98158b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:42.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.531+0000 7f5e9fa13640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e9815dea0 0x7f5e98149010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:42.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.531+0000 7f5e9fa13640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e98162e60 0x7f5e98140f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:42.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.531+0000 7f5e9fa13640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f5e980c81b0 con 0x7f5e98162e60 2024-05-09T05:58:42.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.531+0000 7f5e9fa13640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f5e9815ae30 con 0x7f5e9815dea0 2024-05-09T05:58:42.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.531+0000 7f5e9fa13640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f5e98154ab0 con 0x7f5e9815da90 2024-05-09T05:58:42.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.531+0000 7f5e9dfb0640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e98162e60 0x7f5e98140f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:42.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.531+0000 7f5e9dfb0640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e98162e60 0x7f5e98140f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41044/0 (socket says 172.21.15.72:41044) 2024-05-09T05:58:42.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.531+0000 7f5e9dfb0640 1 -- 172.21.15.72:0/2607293317 learned_addr learned my addr 172.21.15.72:0/2607293317 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:58:42.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.531+0000 7f5e9dfb0640 1 -- 172.21.15.72:0/2607293317 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e9815da90 msgr2=0x7f5e98158b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:42.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.531+0000 7f5e9dfb0640 1 --2- 172.21.15.72:0/2607293317 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e9815da90 0x7f5e98158b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:42.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.531+0000 7f5e9dfb0640 1 -- 172.21.15.72:0/2607293317 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e9815dea0 msgr2=0x7f5e98149010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:42.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.531+0000 7f5e9cfae640 1 --2- 172.21.15.72:0/2607293317 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e9815dea0 0x7f5e98149010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:42.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.531+0000 7f5e9dfb0640 1 --2- 172.21.15.72:0/2607293317 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e9815dea0 0x7f5e98149010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:42.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.531+0000 7f5e9dfb0640 1 -- 172.21.15.72:0/2607293317 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e980cd520 con 0x7f5e98162e60 2024-05-09T05:58:42.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.531+0000 7f5e9dfb0640 1 --2- 172.21.15.72:0/2607293317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e98162e60 0x7f5e98140f10 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f5e9000c6e0 tx=0x7f5e9000cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:42.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.531+0000 7f5e8dffb640 1 -- 172.21.15.72:0/2607293317 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e90018070 con 0x7f5e98162e60 2024-05-09T05:58:42.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.531+0000 7f5e8dffb640 1 -- 172.21.15.72:0/2607293317 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e90004d70 con 0x7f5e98162e60 2024-05-09T05:58:42.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.531+0000 7f5e8dffb640 1 -- 172.21.15.72:0/2607293317 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e9000a880 con 0x7f5e98162e60 2024-05-09T05:58:42.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.531+0000 7f5e9fa13640 1 -- 172.21.15.72:0/2607293317 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e9815d320 con 0x7f5e98162e60 2024-05-09T05:58:42.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.531+0000 7f5e9fa13640 1 -- 172.21.15.72:0/2607293317 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e9814a500 con 0x7f5e98162e60 2024-05-09T05:58:42.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.531+0000 7f5e9fa13640 1 -- 172.21.15.72:0/2607293317 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5e9806a520 con 0x7f5e98162e60 2024-05-09T05:58:42.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.535+0000 7f5e8dffb640 1 -- 172.21.15.72:0/2607293317 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f5e9001b070 con 0x7f5e98162e60 2024-05-09T05:58:42.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.535+0000 7f5e8dffb640 1 --2- 172.21.15.72:0/2607293317 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f5e7c06f430 0x7f5e7c071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:42.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.535+0000 7f5e8dffb640 1 -- 172.21.15.72:0/2607293317 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6762+0+0 (secure 0 0 0) 0x7f5e9008f0b0 con 0x7f5e98162e60 2024-05-09T05:58:42.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.535+0000 7f5e8dffb640 1 --2- 172.21.15.72:0/2607293317 >> [v2:172.21.15.110:6808/1817638786,v1:172.21.15.110:6809/1817638786] conn(0x7f5e7c078de0 0x7f5e7c07b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:42.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.535+0000 7f5e8dffb640 1 -- 172.21.15.72:0/2607293317 --> [v2:172.21.15.110:6808/1817638786,v1:172.21.15.110:6809/1817638786] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5e7c07b980 con 0x7f5e7c078de0 2024-05-09T05:58:42.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.535+0000 7f5e8dffb640 1 -- 172.21.15.72:0/2607293317 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5e9008f540 con 0x7f5e98162e60 2024-05-09T05:58:42.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.535+0000 7f5e9d7af640 1 --2- 172.21.15.72:0/2607293317 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f5e7c06f430 0x7f5e7c071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:42.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.535+0000 7f5e9cfae640 1 --2- 172.21.15.72:0/2607293317 >> [v2:172.21.15.110:6808/1817638786,v1:172.21.15.110:6809/1817638786] conn(0x7f5e7c078de0 0x7f5e7c07b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:42.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.535+0000 7f5e9d7af640 1 --2- 172.21.15.72:0/2607293317 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f5e7c06f430 0x7f5e7c071940 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5e940ad000 tx=0x7f5e94008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:42.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.535+0000 7f5e9cfae640 1 --2- 172.21.15.72:0/2607293317 >> [v2:172.21.15.110:6808/1817638786,v1:172.21.15.110:6809/1817638786] conn(0x7f5e7c078de0 0x7f5e7c07b2b0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:42.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.539+0000 7f5e8dffb640 1 -- 172.21.15.72:0/2607293317 <== osd.6 v2:172.21.15.110:6808/1817638786 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5e7c07b980 con 0x7f5e7c078de0 2024-05-09T05:58:42.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.551+0000 7f5e9fa13640 1 -- 172.21.15.72:0/2607293317 --> [v2:172.21.15.110:6808/1817638786,v1:172.21.15.110:6809/1817638786] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f5e98157e10 con 0x7f5e7c078de0 2024-05-09T05:58:42.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.551+0000 7f5e8dffb640 1 -- 172.21.15.72:0/2607293317 <== osd.6 v2:172.21.15.110:6808/1817638786 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f5e98157e10 con 0x7f5e7c078de0 2024-05-09T05:58:42.539 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-05-09T05:58:42.539 INFO:teuthology.orchestra.run.smithi072.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-09T05:58:42.539 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-05-09T05:58:42.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.551+0000 7f5e9fa13640 1 -- 172.21.15.72:0/2607293317 >> [v2:172.21.15.110:6808/1817638786,v1:172.21.15.110:6809/1817638786] conn(0x7f5e7c078de0 msgr2=0x7f5e7c07b2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:42.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.551+0000 7f5e9fa13640 1 --2- 172.21.15.72:0/2607293317 >> [v2:172.21.15.110:6808/1817638786,v1:172.21.15.110:6809/1817638786] conn(0x7f5e7c078de0 0x7f5e7c07b2b0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:42.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.551+0000 7f5e9fa13640 1 -- 172.21.15.72:0/2607293317 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f5e7c06f430 msgr2=0x7f5e7c071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:42.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.551+0000 7f5e9fa13640 1 --2- 172.21.15.72:0/2607293317 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f5e7c06f430 0x7f5e7c071940 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5e940ad000 tx=0x7f5e94008040 comp rx=0 tx=0).stop 2024-05-09T05:58:42.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.551+0000 7f5e9fa13640 1 -- 172.21.15.72:0/2607293317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e98162e60 msgr2=0x7f5e98140f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:42.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.551+0000 7f5e9fa13640 1 --2- 172.21.15.72:0/2607293317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e98162e60 0x7f5e98140f10 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f5e9000c6e0 tx=0x7f5e9000cba0 comp rx=0 tx=0).stop 2024-05-09T05:58:42.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.551+0000 7f5e9dfb0640 1 -- 172.21.15.72:0/2607293317 reap_dead start 2024-05-09T05:58:42.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.551+0000 7f5e9fa13640 1 -- 172.21.15.72:0/2607293317 shutdown_connections 2024-05-09T05:58:42.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.551+0000 7f5e9fa13640 1 -- 172.21.15.72:0/2607293317 >> 172.21.15.72:0/2607293317 conn(0x7f5e980cde90 msgr2=0x7f5e980cc780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:58:42.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.551+0000 7f5e9fa13640 1 -- 172.21.15.72:0/2607293317 shutdown_connections 2024-05-09T05:58:42.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.551+0000 7f5e9fa13640 1 -- 172.21.15.72:0/2607293317 wait complete. 2024-05-09T05:58:42.559 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-05-09T05:58:42.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.715+0000 7f86158e7640 1 Processor -- start 2024-05-09T05:58:42.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.715+0000 7f86158e7640 1 -- start start 2024-05-09T05:58:42.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.715+0000 7f86158e7640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86100c7480 0x7f86100c7890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:42.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.715+0000 7f86158e7640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8610161f80 0x7f86101643a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:42.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.715+0000 7f86158e7640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f861006e960 con 0x7f8610075020 2024-05-09T05:58:42.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.715+0000 7f86158e7640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f8610072b20 con 0x7f8610161f80 2024-05-09T05:58:42.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.715+0000 7f86158e7640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f8610072840 con 0x7f86100c7480 2024-05-09T05:58:42.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.715+0000 7f860f7fe640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8610161f80 0x7f86101643a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:42.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.715+0000 7f860f7fe640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8610161f80 0x7f86101643a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41056/0 (socket says 172.21.15.72:41056) 2024-05-09T05:58:42.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.715+0000 7f860f7fe640 1 -- 172.21.15.72:0/3634856993 learned_addr learned my addr 172.21.15.72:0/3634856993 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:58:42.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.715+0000 7f860e7fc640 1 --2- 172.21.15.72:0/3634856993 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86100c7480 0x7f86100c7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:42.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.715+0000 7f860f7fe640 1 -- 172.21.15.72:0/3634856993 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86100c7480 msgr2=0x7f86100c7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:58:42.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.715+0000 7f860f7fe640 1 --2- 172.21.15.72:0/3634856993 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86100c7480 0x7f86100c7890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:42.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.715+0000 7f860f7fe640 1 -- 172.21.15.72:0/3634856993 >> v1:172.21.15.110:6789/0 conn(0x7f8610075020 legacy=0x7f8610074090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:42.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.715+0000 7f860f7fe640 1 -- 172.21.15.72:0/3634856993 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f861006ec20 con 0x7f8610161f80 2024-05-09T05:58:42.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.715+0000 7f860e7fc640 1 --2- 172.21.15.72:0/3634856993 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86100c7480 0x7f86100c7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:58:42.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.719+0000 7f860f7fe640 1 --2- 172.21.15.72:0/3634856993 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8610161f80 0x7f86101643a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f8600009870 tx=0x7f860001ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a69bdc51eace5dcb server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:42.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.719+0000 7f860dffb640 1 -- 172.21.15.72:0/3634856993 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86000b5070 con 0x7f8610161f80 2024-05-09T05:58:42.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.719+0000 7f860dffb640 1 -- 172.21.15.72:0/3634856993 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86000a8a50 con 0x7f8610161f80 2024-05-09T05:58:42.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.719+0000 7f860dffb640 1 -- 172.21.15.72:0/3634856993 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86000a8e20 con 0x7f8610161f80 2024-05-09T05:58:42.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.719+0000 7f86158e7640 1 -- 172.21.15.72:0/3634856993 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8610161f80 msgr2=0x7f86101643a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:42.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.719+0000 7f86158e7640 1 --2- 172.21.15.72:0/3634856993 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8610161f80 0x7f86101643a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f8600009870 tx=0x7f860001ed50 comp rx=0 tx=0).stop 2024-05-09T05:58:42.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.719+0000 7f86158e7640 1 -- 172.21.15.72:0/3634856993 shutdown_connections 2024-05-09T05:58:42.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.719+0000 7f86158e7640 1 --2- 172.21.15.72:0/3634856993 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8610161f80 0x7f86101643a0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:42.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.719+0000 7f86158e7640 1 --2- 172.21.15.72:0/3634856993 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86100c7480 0x7f86100c7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:42.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.719+0000 7f86158e7640 1 -- 172.21.15.72:0/3634856993 >> 172.21.15.72:0/3634856993 conn(0x7f86100cb350 msgr2=0x7f86100cb760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:58:42.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.719+0000 7f86158e7640 1 -- 172.21.15.72:0/3634856993 shutdown_connections 2024-05-09T05:58:42.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.719+0000 7f86158e7640 1 -- 172.21.15.72:0/3634856993 wait complete. 2024-05-09T05:58:42.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.723+0000 7f86158e7640 1 Processor -- start 2024-05-09T05:58:42.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.723+0000 7f86158e7640 1 -- start start 2024-05-09T05:58:42.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.723+0000 7f86158e7640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8610075020 0x7f8610155640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:42.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.723+0000 7f86158e7640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86100c7480 0x7f86101524e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:42.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.723+0000 7f86158e7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8610161f80 0x7f8610164560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:42.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.723+0000 7f86158e7640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f8610159dc0 con 0x7f8610075020 2024-05-09T05:58:42.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.723+0000 7f86158e7640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f8610159ae0 con 0x7f8610161f80 2024-05-09T05:58:42.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.723+0000 7f86158e7640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f861015a0a0 con 0x7f86100c7480 2024-05-09T05:58:42.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.723+0000 7f860effd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8610075020 0x7f8610155640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:42.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.723+0000 7f860effd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8610075020 0x7f8610155640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41062/0 (socket says 172.21.15.72:41062) 2024-05-09T05:58:42.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.723+0000 7f860effd640 1 -- 172.21.15.72:0/2660623764 learned_addr learned my addr 172.21.15.72:0/2660623764 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:58:42.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.723+0000 7f860f7fe640 1 --2- 172.21.15.72:0/2660623764 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8610161f80 0x7f8610164560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:42.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.723+0000 7f860e7fc640 1 --2- 172.21.15.72:0/2660623764 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86100c7480 0x7f86101524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:42.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.723+0000 7f860effd640 1 -- 172.21.15.72:0/2660623764 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86100c7480 msgr2=0x7f86101524e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:42.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.723+0000 7f860effd640 1 --2- 172.21.15.72:0/2660623764 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86100c7480 0x7f86101524e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:42.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.723+0000 7f860effd640 1 -- 172.21.15.72:0/2660623764 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8610161f80 msgr2=0x7f8610164560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:42.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.723+0000 7f860effd640 1 --2- 172.21.15.72:0/2660623764 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8610161f80 0x7f8610164560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:42.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.723+0000 7f860effd640 1 -- 172.21.15.72:0/2660623764 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8610154b40 con 0x7f8610075020 2024-05-09T05:58:42.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.723+0000 7f860effd640 1 --2- 172.21.15.72:0/2660623764 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8610075020 0x7f8610155640 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f860800c730 tx=0x7f860800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:42.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.723+0000 7f85f7fff640 1 -- 172.21.15.72:0/2660623764 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8608003b80 con 0x7f8610075020 2024-05-09T05:58:42.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.723+0000 7f85f7fff640 1 -- 172.21.15.72:0/2660623764 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8608003d40 con 0x7f8610075020 2024-05-09T05:58:42.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.723+0000 7f86158e7640 1 -- 172.21.15.72:0/2660623764 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86101542c0 con 0x7f8610075020 2024-05-09T05:58:42.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.723+0000 7f85f7fff640 1 -- 172.21.15.72:0/2660623764 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f860800aa90 con 0x7f8610075020 2024-05-09T05:58:42.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.723+0000 7f86158e7640 1 -- 172.21.15.72:0/2660623764 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8610154580 con 0x7f8610075020 2024-05-09T05:58:42.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.723+0000 7f86158e7640 1 -- 172.21.15.72:0/2660623764 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f861006a520 con 0x7f8610075020 2024-05-09T05:58:42.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.727+0000 7f85f7fff640 1 -- 172.21.15.72:0/2660623764 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f860800ac30 con 0x7f8610075020 2024-05-09T05:58:42.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.727+0000 7f85f7fff640 1 --2- 172.21.15.72:0/2660623764 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f85fc06f430 0x7f85fc071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:42.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.727+0000 7f85f7fff640 1 -- 172.21.15.72:0/2660623764 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6762+0+0 (secure 0 0 0) 0x7f860808f580 con 0x7f8610075020 2024-05-09T05:58:42.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.727+0000 7f860e7fc640 1 --2- 172.21.15.72:0/2660623764 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f85fc06f430 0x7f85fc071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:42.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.727+0000 7f860e7fc640 1 --2- 172.21.15.72:0/2660623764 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f85fc06f430 0x7f85fc071940 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8604006fd0 tx=0x7f8604008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:42.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.731+0000 7f85f7fff640 1 -- 172.21.15.72:0/2660623764 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f860805c0e0 con 0x7f8610075020 2024-05-09T05:58:42.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.891+0000 7f86158e7640 1 -- 172.21.15.72:0/2660623764 --> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f8610154060 con 0x7f85fc06f430 2024-05-09T05:58:42.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.895+0000 7f85f7fff640 1 -- 172.21.15.72:0/2660623764 <== mgr.4102 v2:172.21.15.110:6832/1113420672 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f860400b510 con 0x7f85fc06f430 2024-05-09T05:58:42.882 INFO:teuthology.orchestra.run.smithi072.stderr:instructed osd(s) 6 to deep-scrub 2024-05-09T05:58:42.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.895+0000 7f86158e7640 1 -- 172.21.15.72:0/2660623764 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f85fc06f430 msgr2=0x7f85fc071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:42.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.895+0000 7f86158e7640 1 --2- 172.21.15.72:0/2660623764 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f85fc06f430 0x7f85fc071940 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8604006fd0 tx=0x7f8604008040 comp rx=0 tx=0).stop 2024-05-09T05:58:42.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.895+0000 7f86158e7640 1 -- 172.21.15.72:0/2660623764 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8610075020 msgr2=0x7f8610155640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:42.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.895+0000 7f86158e7640 1 --2- 172.21.15.72:0/2660623764 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8610075020 0x7f8610155640 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f860800c730 tx=0x7f860800cbf0 comp rx=0 tx=0).stop 2024-05-09T05:58:42.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.895+0000 7f86158e7640 1 -- 172.21.15.72:0/2660623764 shutdown_connections 2024-05-09T05:58:42.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.895+0000 7f86158e7640 1 --2- 172.21.15.72:0/2660623764 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f85fc06f430 0x7f85fc071940 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:42.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.895+0000 7f86158e7640 1 --2- 172.21.15.72:0/2660623764 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8610161f80 0x7f8610164560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:42.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.895+0000 7f86158e7640 1 --2- 172.21.15.72:0/2660623764 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86100c7480 0x7f86101524e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:42.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.895+0000 7f86158e7640 1 --2- 172.21.15.72:0/2660623764 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8610075020 0x7f8610155640 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:42.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.895+0000 7f86158e7640 1 -- 172.21.15.72:0/2660623764 >> 172.21.15.72:0/2660623764 conn(0x7f86100cb350 msgr2=0x7f86101535f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:58:42.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.895+0000 7f86158e7640 1 -- 172.21.15.72:0/2660623764 shutdown_connections 2024-05-09T05:58:42.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:42.895+0000 7f86158e7640 1 -- 172.21.15.72:0/2660623764 wait complete. 2024-05-09T05:58:42.904 INFO:tasks.ceph:Scrubbing osd.7 2024-05-09T05:58:42.904 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-05-09T05:58:43.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.067+0000 7f6266551640 1 Processor -- start 2024-05-09T05:58:43.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.067+0000 7f6266551640 1 -- start start 2024-05-09T05:58:43.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.067+0000 7f6266551640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6260154b10 0x7f62600c9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:43.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.067+0000 7f6266551640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6260070ef0 0x7f6260071300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:43.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.067+0000 7f6266551640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6260071dc0 con 0x7f62600734b0 2024-05-09T05:58:43.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.067+0000 7f6266551640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f62600c8340 con 0x7f6260154b10 2024-05-09T05:58:43.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.067+0000 7f6266551640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f62600c9600 con 0x7f6260070ef0 2024-05-09T05:58:43.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.067+0000 7f625ffff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6260154b10 0x7f62600c9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:43.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.067+0000 7f625ffff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6260154b10 0x7f62600c9fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41076/0 (socket says 172.21.15.72:41076) 2024-05-09T05:58:43.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.067+0000 7f625ffff640 1 -- 172.21.15.72:0/1904036755 learned_addr learned my addr 172.21.15.72:0/1904036755 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:58:43.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.067+0000 7f6264aee640 1 --2- 172.21.15.72:0/1904036755 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6260070ef0 0x7f6260071300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:43.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.067+0000 7f625ffff640 1 -- 172.21.15.72:0/1904036755 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6260070ef0 msgr2=0x7f6260071300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:58:43.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.067+0000 7f625ffff640 1 --2- 172.21.15.72:0/1904036755 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6260070ef0 0x7f6260071300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:43.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.067+0000 7f625ffff640 1 -- 172.21.15.72:0/1904036755 >> v1:172.21.15.110:6789/0 conn(0x7f62600734b0 legacy=0x7f626015dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:58:43.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.067+0000 7f625ffff640 1 -- 172.21.15.72:0/1904036755 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6260075040 con 0x7f6260154b10 2024-05-09T05:58:43.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.071+0000 7f625ffff640 1 --2- 172.21.15.72:0/1904036755 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6260154b10 0x7f62600c9fd0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6250009870 tx=0x7f625001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c36b633070e1884 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:43.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.071+0000 7f625effd640 1 -- 172.21.15.72:0/1904036755 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62500ab5f0 con 0x7f6260154b10 2024-05-09T05:58:43.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.071+0000 7f625effd640 1 -- 172.21.15.72:0/1904036755 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62500b0070 con 0x7f6260154b10 2024-05-09T05:58:43.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.071+0000 7f625effd640 1 -- 172.21.15.72:0/1904036755 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62500ab9b0 con 0x7f6260154b10 2024-05-09T05:58:43.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.071+0000 7f6266551640 1 -- 172.21.15.72:0/1904036755 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6260154b10 msgr2=0x7f62600c9fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:43.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.071+0000 7f6266551640 1 --2- 172.21.15.72:0/1904036755 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6260154b10 0x7f62600c9fd0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6250009870 tx=0x7f625001c560 comp rx=0 tx=0).stop 2024-05-09T05:58:43.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.071+0000 7f6266551640 1 -- 172.21.15.72:0/1904036755 shutdown_connections 2024-05-09T05:58:43.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.071+0000 7f6266551640 1 --2- 172.21.15.72:0/1904036755 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6260070ef0 0x7f6260071300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:43.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.071+0000 7f6266551640 1 --2- 172.21.15.72:0/1904036755 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6260154b10 0x7f62600c9fd0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:43.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.071+0000 7f6266551640 1 -- 172.21.15.72:0/1904036755 >> 172.21.15.72:0/1904036755 conn(0x7f62600ce8c0 msgr2=0x7f62600cecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:58:43.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.071+0000 7f6266551640 1 -- 172.21.15.72:0/1904036755 shutdown_connections 2024-05-09T05:58:43.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.071+0000 7f6266551640 1 -- 172.21.15.72:0/1904036755 wait complete. 2024-05-09T05:58:43.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.075+0000 7f6266551640 1 Processor -- start 2024-05-09T05:58:43.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.075+0000 7f6266551640 1 -- start start 2024-05-09T05:58:43.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.075+0000 7f6266551640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6260070ef0 0x7f6260156b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:43.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.075+0000 7f6266551640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62600734b0 0x7f62601f9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:43.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.075+0000 7f6266551640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6260154b10 0x7f6260157660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:43.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.075+0000 7f6266551640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f6260167980 con 0x7f6260070ef0 2024-05-09T05:58:43.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.075+0000 7f6266551640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f6260167800 con 0x7f6260154b10 2024-05-09T05:58:43.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.075+0000 7f6266551640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f6260167b00 con 0x7f62600734b0 2024-05-09T05:58:43.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.075+0000 7f625ffff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6260070ef0 0x7f6260156b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:43.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.075+0000 7f625ffff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6260070ef0 0x7f6260156b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41088/0 (socket says 172.21.15.72:41088) 2024-05-09T05:58:43.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.075+0000 7f625ffff640 1 -- 172.21.15.72:0/3360616300 learned_addr learned my addr 172.21.15.72:0/3360616300 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:58:43.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.075+0000 7f6264aee640 1 --2- 172.21.15.72:0/3360616300 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6260154b10 0x7f6260157660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:43.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.075+0000 7f625f7fe640 1 --2- 172.21.15.72:0/3360616300 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62600734b0 0x7f62601f9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:43.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.075+0000 7f625ffff640 1 -- 172.21.15.72:0/3360616300 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62600734b0 msgr2=0x7f62601f9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:43.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.075+0000 7f625ffff640 1 --2- 172.21.15.72:0/3360616300 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62600734b0 0x7f62601f9de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:43.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.075+0000 7f625ffff640 1 -- 172.21.15.72:0/3360616300 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6260154b10 msgr2=0x7f6260157660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:43.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.075+0000 7f625ffff640 1 --2- 172.21.15.72:0/3360616300 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6260154b10 0x7f6260157660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:43.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.075+0000 7f625ffff640 1 -- 172.21.15.72:0/3360616300 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6260157040 con 0x7f6260070ef0 2024-05-09T05:58:43.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.075+0000 7f6264aee640 1 --2- 172.21.15.72:0/3360616300 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6260154b10 0x7f6260157660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:58:43.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.075+0000 7f625ffff640 1 --2- 172.21.15.72:0/3360616300 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6260070ef0 0x7f6260156b00 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f62500ad040 tx=0x7f625001ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:43.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.075+0000 7f625cff9640 1 -- 172.21.15.72:0/3360616300 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62500be5f0 con 0x7f6260070ef0 2024-05-09T05:58:43.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.075+0000 7f625cff9640 1 -- 172.21.15.72:0/3360616300 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62500be7b0 con 0x7f6260070ef0 2024-05-09T05:58:43.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.075+0000 7f625cff9640 1 -- 172.21.15.72:0/3360616300 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62500beba0 con 0x7f6260070ef0 2024-05-09T05:58:43.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.075+0000 7f6266551640 1 -- 172.21.15.72:0/3360616300 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62601594d0 con 0x7f6260070ef0 2024-05-09T05:58:43.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.075+0000 7f6266551640 1 -- 172.21.15.72:0/3360616300 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62601597b0 con 0x7f6260070ef0 2024-05-09T05:58:43.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.079+0000 7f6266551640 1 -- 172.21.15.72:0/3360616300 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f62601599b0 con 0x7f6260070ef0 2024-05-09T05:58:43.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.079+0000 7f625cff9640 1 -- 172.21.15.72:0/3360616300 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f62500b43f0 con 0x7f6260070ef0 2024-05-09T05:58:43.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.079+0000 7f625cff9640 1 --2- 172.21.15.72:0/3360616300 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f624c06f430 0x7f624c071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:43.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.079+0000 7f625cff9640 1 -- 172.21.15.72:0/3360616300 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6762+0+0 (secure 0 0 0) 0x7f62501297e0 con 0x7f6260070ef0 2024-05-09T05:58:43.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.079+0000 7f625cff9640 1 --2- 172.21.15.72:0/3360616300 >> [v2:172.21.15.110:6800/214675920,v1:172.21.15.110:6801/214675920] conn(0x7f624c078de0 0x7f624c07b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:43.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.079+0000 7f625cff9640 1 -- 172.21.15.72:0/3360616300 --> [v2:172.21.15.110:6800/214675920,v1:172.21.15.110:6801/214675920] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f624c07b980 con 0x7f624c078de0 2024-05-09T05:58:43.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.079+0000 7f625cff9640 1 -- 172.21.15.72:0/3360616300 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6250129c70 con 0x7f6260070ef0 2024-05-09T05:58:43.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.079+0000 7f625f7fe640 1 --2- 172.21.15.72:0/3360616300 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f624c06f430 0x7f624c071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:43.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.079+0000 7f6264aee640 1 --2- 172.21.15.72:0/3360616300 >> [v2:172.21.15.110:6800/214675920,v1:172.21.15.110:6801/214675920] conn(0x7f624c078de0 0x7f624c07b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:43.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.079+0000 7f625f7fe640 1 --2- 172.21.15.72:0/3360616300 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f624c06f430 0x7f624c071940 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f626015b2f0 tx=0x7f6254008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:43.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.079+0000 7f6264aee640 1 --2- 172.21.15.72:0/3360616300 >> [v2:172.21.15.110:6800/214675920,v1:172.21.15.110:6801/214675920] conn(0x7f624c078de0 0x7f624c07b2b0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:43.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.083+0000 7f625cff9640 1 -- 172.21.15.72:0/3360616300 <== osd.7 v2:172.21.15.110:6800/214675920 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f624c07b980 con 0x7f624c078de0 2024-05-09T05:58:43.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.095+0000 7f6266551640 1 -- 172.21.15.72:0/3360616300 --> [v2:172.21.15.110:6800/214675920,v1:172.21.15.110:6801/214675920] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6260159280 con 0x7f624c078de0 2024-05-09T05:58:43.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.095+0000 7f625cff9640 1 -- 172.21.15.72:0/3360616300 <== osd.7 v2:172.21.15.110:6800/214675920 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f6260159280 con 0x7f624c078de0 2024-05-09T05:58:43.084 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-05-09T05:58:43.084 INFO:teuthology.orchestra.run.smithi072.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-09T05:58:43.084 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-05-09T05:58:43.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.095+0000 7f6266551640 1 -- 172.21.15.72:0/3360616300 >> [v2:172.21.15.110:6800/214675920,v1:172.21.15.110:6801/214675920] conn(0x7f624c078de0 msgr2=0x7f624c07b2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:43.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.095+0000 7f6266551640 1 --2- 172.21.15.72:0/3360616300 >> [v2:172.21.15.110:6800/214675920,v1:172.21.15.110:6801/214675920] conn(0x7f624c078de0 0x7f624c07b2b0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:43.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.095+0000 7f6266551640 1 -- 172.21.15.72:0/3360616300 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f624c06f430 msgr2=0x7f624c071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:43.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.095+0000 7f6266551640 1 --2- 172.21.15.72:0/3360616300 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f624c06f430 0x7f624c071940 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f626015b2f0 tx=0x7f6254008040 comp rx=0 tx=0).stop 2024-05-09T05:58:43.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.095+0000 7f6266551640 1 -- 172.21.15.72:0/3360616300 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6260070ef0 msgr2=0x7f6260156b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:43.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.095+0000 7f6266551640 1 --2- 172.21.15.72:0/3360616300 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6260070ef0 0x7f6260156b00 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f62500ad040 tx=0x7f625001ada0 comp rx=0 tx=0).stop 2024-05-09T05:58:43.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.095+0000 7f6264aee640 1 -- 172.21.15.72:0/3360616300 reap_dead start 2024-05-09T05:58:43.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.095+0000 7f6266551640 1 -- 172.21.15.72:0/3360616300 shutdown_connections 2024-05-09T05:58:43.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.095+0000 7f6266551640 1 -- 172.21.15.72:0/3360616300 >> 172.21.15.72:0/3360616300 conn(0x7f62600ce8c0 msgr2=0x7f6260153e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:58:43.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.095+0000 7f6266551640 1 -- 172.21.15.72:0/3360616300 shutdown_connections 2024-05-09T05:58:43.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.095+0000 7f6266551640 1 -- 172.21.15.72:0/3360616300 wait complete. 2024-05-09T05:58:43.104 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-05-09T05:58:43.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.255+0000 7fe2b2d22640 1 Processor -- start 2024-05-09T05:58:43.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.255+0000 7fe2b2d22640 1 -- start start 2024-05-09T05:58:43.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.259+0000 7fe2b2d22640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe2ac0c77a0 0x7fe2ac1537d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:43.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.259+0000 7fe2b2d22640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2ac074740 0x7fe2ac072e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:43.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.259+0000 7fe2b2d22640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2ac0c72c0 con 0x7fe2ac0733b0 2024-05-09T05:58:43.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.259+0000 7fe2b2d22640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fe2ac0c7bb0 con 0x7fe2ac0c77a0 2024-05-09T05:58:43.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.259+0000 7fe2b2d22640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fe2ac074460 con 0x7fe2ac074740 2024-05-09T05:58:43.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.259+0000 7fe2b0abe640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe2ac0c77a0 0x7fe2ac1537d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:43.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.259+0000 7fe2b0abe640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe2ac0c77a0 0x7fe2ac1537d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41104/0 (socket says 172.21.15.72:41104) 2024-05-09T05:58:43.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.259+0000 7fe2b0abe640 1 -- 172.21.15.72:0/3529223269 learned_addr learned my addr 172.21.15.72:0/3529223269 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:58:43.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.259+0000 7fe2abfff640 1 --2- 172.21.15.72:0/3529223269 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2ac074740 0x7fe2ac072e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:43.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.259+0000 7fe2b0abe640 1 -- 172.21.15.72:0/3529223269 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2ac074740 msgr2=0x7fe2ac072e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:58:43.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.259+0000 7fe2b0abe640 1 --2- 172.21.15.72:0/3529223269 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2ac074740 0x7fe2ac072e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:43.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.259+0000 7fe2b0abe640 1 -- 172.21.15.72:0/3529223269 >> v1:172.21.15.110:6789/0 conn(0x7fe2ac0733b0 legacy=0x7fe2ac15ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:58:43.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.259+0000 7fe2b0abe640 1 -- 172.21.15.72:0/3529223269 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2ac073af0 con 0x7fe2ac0c77a0 2024-05-09T05:58:43.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.259+0000 7fe2abfff640 1 --2- 172.21.15.72:0/3529223269 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2ac074740 0x7fe2ac072e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:58:43.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.259+0000 7fe2b0abe640 1 --2- 172.21.15.72:0/3529223269 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2ac0c77a0 0x7fe2ac1537d0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac0ce500 tx=0x7fe2a401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90834761737be676 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:43.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.259+0000 7fe2ab7fe640 1 -- 172.21.15.72:0/3529223269 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a40b0070 con 0x7fe2ac0c77a0 2024-05-09T05:58:43.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.259+0000 7fe2ab7fe640 1 -- 172.21.15.72:0/3529223269 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2a40ab600 con 0x7fe2ac0c77a0 2024-05-09T05:58:43.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.259+0000 7fe2ab7fe640 1 -- 172.21.15.72:0/3529223269 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a40ab9d0 con 0x7fe2ac0c77a0 2024-05-09T05:58:43.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.263+0000 7fe2b2d22640 1 -- 172.21.15.72:0/3529223269 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2ac0c77a0 msgr2=0x7fe2ac1537d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:43.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.263+0000 7fe2b2d22640 1 --2- 172.21.15.72:0/3529223269 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2ac0c77a0 0x7fe2ac1537d0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac0ce500 tx=0x7fe2a401c540 comp rx=0 tx=0).stop 2024-05-09T05:58:43.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.263+0000 7fe2b2d22640 1 -- 172.21.15.72:0/3529223269 shutdown_connections 2024-05-09T05:58:43.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.263+0000 7fe2b2d22640 1 --2- 172.21.15.72:0/3529223269 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2ac074740 0x7fe2ac072e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:43.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.263+0000 7fe2b2d22640 1 --2- 172.21.15.72:0/3529223269 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2ac0c77a0 0x7fe2ac1537d0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:43.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.263+0000 7fe2b2d22640 1 -- 172.21.15.72:0/3529223269 >> 172.21.15.72:0/3529223269 conn(0x7fe2ac0cde90 msgr2=0x7fe2ac0ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:58:43.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.263+0000 7fe2b2d22640 1 -- 172.21.15.72:0/3529223269 shutdown_connections 2024-05-09T05:58:43.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.263+0000 7fe2b2d22640 1 -- 172.21.15.72:0/3529223269 wait complete. 2024-05-09T05:58:43.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.263+0000 7fe2b2d22640 1 Processor -- start 2024-05-09T05:58:43.251 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.263+0000 7fe2b2d22640 1 -- start start 2024-05-09T05:58:43.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.263+0000 7fe2b2d22640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2ac0733b0 0x7fe2ac1f7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:43.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.263+0000 7fe2b2d22640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2ac074740 0x7fe2ac149c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:43.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.263+0000 7fe2b2d22640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2ac0c77a0 0x7fe2ac1434d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:43.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.263+0000 7fe2b2d22640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe2ac0c4cb0 con 0x7fe2ac0c77a0 2024-05-09T05:58:43.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.263+0000 7fe2b2d22640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fe2ac072940 con 0x7fe2ac0733b0 2024-05-09T05:58:43.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.263+0000 7fe2b2d22640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fe2ac0c4e30 con 0x7fe2ac074740 2024-05-09T05:58:43.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.263+0000 7fe2b12bf640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2ac0c77a0 0x7fe2ac1434d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:43.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.263+0000 7fe2b12bf640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2ac0c77a0 0x7fe2ac1434d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41114/0 (socket says 172.21.15.72:41114) 2024-05-09T05:58:43.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.263+0000 7fe2b12bf640 1 -- 172.21.15.72:0/4159404365 learned_addr learned my addr 172.21.15.72:0/4159404365 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:58:43.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.263+0000 7fe2abfff640 1 --2- 172.21.15.72:0/4159404365 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2ac074740 0x7fe2ac149c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:43.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.263+0000 7fe2b0abe640 1 --2- 172.21.15.72:0/4159404365 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2ac0733b0 0x7fe2ac1f7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:43.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.263+0000 7fe2b12bf640 1 -- 172.21.15.72:0/4159404365 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2ac074740 msgr2=0x7fe2ac149c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:43.254 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.263+0000 7fe2b12bf640 1 --2- 172.21.15.72:0/4159404365 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2ac074740 0x7fe2ac149c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:43.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.263+0000 7fe2b12bf640 1 -- 172.21.15.72:0/4159404365 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2ac0733b0 msgr2=0x7fe2ac1f7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:43.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.263+0000 7fe2b12bf640 1 --2- 172.21.15.72:0/4159404365 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2ac0733b0 0x7fe2ac1f7910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:43.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.263+0000 7fe2b12bf640 1 -- 172.21.15.72:0/4159404365 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2ac14afa0 con 0x7fe2ac0c77a0 2024-05-09T05:58:43.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.267+0000 7fe2b12bf640 1 --2- 172.21.15.72:0/4159404365 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2ac0c77a0 0x7fe2ac1434d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe29c00b9e0 tx=0x7fe29c00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:43.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.267+0000 7fe2a97fa640 1 -- 172.21.15.72:0/4159404365 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe29c003b80 con 0x7fe2ac0c77a0 2024-05-09T05:58:43.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.267+0000 7fe2a97fa640 1 -- 172.21.15.72:0/4159404365 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe29c003d20 con 0x7fe2ac0c77a0 2024-05-09T05:58:43.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.267+0000 7fe2a97fa640 1 -- 172.21.15.72:0/4159404365 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe29c00cb00 con 0x7fe2ac0c77a0 2024-05-09T05:58:43.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.267+0000 7fe2b2d22640 1 -- 172.21.15.72:0/4159404365 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2ac14b280 con 0x7fe2ac0c77a0 2024-05-09T05:58:43.255 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.267+0000 7fe2b2d22640 1 -- 172.21.15.72:0/4159404365 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2ac1f73f0 con 0x7fe2ac0c77a0 2024-05-09T05:58:43.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.267+0000 7fe2b2d22640 1 -- 172.21.15.72:0/4159404365 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2ac06a520 con 0x7fe2ac0c77a0 2024-05-09T05:58:43.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.267+0000 7fe2a97fa640 1 -- 172.21.15.72:0/4159404365 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe29c006d10 con 0x7fe2ac0c77a0 2024-05-09T05:58:43.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.267+0000 7fe2a97fa640 1 --2- 172.21.15.72:0/4159404365 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fe28c06f430 0x7fe28c071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:43.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.267+0000 7fe2a97fa640 1 -- 172.21.15.72:0/4159404365 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6762+0+0 (secure 0 0 0) 0x7fe29c08f020 con 0x7fe2ac0c77a0 2024-05-09T05:58:43.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.267+0000 7fe2b0abe640 1 --2- 172.21.15.72:0/4159404365 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fe28c06f430 0x7fe28c071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:43.256 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.267+0000 7fe2b0abe640 1 --2- 172.21.15.72:0/4159404365 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fe28c06f430 0x7fe28c071940 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe2a40ad000 tx=0x7fe2a40a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:43.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.271+0000 7fe2a97fa640 1 -- 172.21.15.72:0/4159404365 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fe29c05bc10 con 0x7fe2ac0c77a0 2024-05-09T05:58:43.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.431+0000 7fe2b2d22640 1 -- 172.21.15.72:0/4159404365 --> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7fe2ac072c50 con 0x7fe28c06f430 2024-05-09T05:58:43.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.431+0000 7fe2a97fa640 1 -- 172.21.15.72:0/4159404365 <== mgr.4102 v2:172.21.15.110:6832/1113420672 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe2ac072c50 con 0x7fe28c06f430 2024-05-09T05:58:43.420 INFO:teuthology.orchestra.run.smithi072.stderr:instructed osd(s) 7 to deep-scrub 2024-05-09T05:58:43.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.435+0000 7fe2b2d22640 1 -- 172.21.15.72:0/4159404365 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fe28c06f430 msgr2=0x7fe28c071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:43.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.435+0000 7fe2b2d22640 1 --2- 172.21.15.72:0/4159404365 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fe28c06f430 0x7fe28c071940 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe2a40ad000 tx=0x7fe2a40a6000 comp rx=0 tx=0).stop 2024-05-09T05:58:43.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.435+0000 7fe2b2d22640 1 -- 172.21.15.72:0/4159404365 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2ac0c77a0 msgr2=0x7fe2ac1434d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:43.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.435+0000 7fe2b2d22640 1 --2- 172.21.15.72:0/4159404365 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2ac0c77a0 0x7fe2ac1434d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe29c00b9e0 tx=0x7fe29c00bea0 comp rx=0 tx=0).stop 2024-05-09T05:58:43.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.435+0000 7fe2b2d22640 1 -- 172.21.15.72:0/4159404365 shutdown_connections 2024-05-09T05:58:43.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.435+0000 7fe2b2d22640 1 --2- 172.21.15.72:0/4159404365 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fe28c06f430 0x7fe28c071940 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:43.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.435+0000 7fe2b2d22640 1 --2- 172.21.15.72:0/4159404365 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2ac0c77a0 0x7fe2ac1434d0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:43.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.435+0000 7fe2b2d22640 1 --2- 172.21.15.72:0/4159404365 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2ac074740 0x7fe2ac149c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:43.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.435+0000 7fe2b2d22640 1 --2- 172.21.15.72:0/4159404365 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2ac0733b0 0x7fe2ac1f7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:43.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.435+0000 7fe2b2d22640 1 -- 172.21.15.72:0/4159404365 >> 172.21.15.72:0/4159404365 conn(0x7fe2ac0cde90 msgr2=0x7fe2ac06cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:58:43.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.435+0000 7fe2b2d22640 1 -- 172.21.15.72:0/4159404365 shutdown_connections 2024-05-09T05:58:43.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.435+0000 7fe2b2d22640 1 -- 172.21.15.72:0/4159404365 wait complete. 2024-05-09T05:58:43.441 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T05:58:43.586 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.599+0000 7f2572e93640 1 Processor -- start 2024-05-09T05:58:43.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.599+0000 7f2572e93640 1 -- start start 2024-05-09T05:58:43.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.599+0000 7f2572e93640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f256c06d2e0 0x7f256c154700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:43.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.599+0000 7f2572e93640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f256c0ca960 0x7f256c0cad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:43.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.599+0000 7f2572e93640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f256c0cc260 con 0x7f256c06c7a0 2024-05-09T05:58:43.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.599+0000 7f2572e93640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f256c15a5f0 con 0x7f256c06d2e0 2024-05-09T05:58:43.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.599+0000 7f2572e93640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f256c0c8660 con 0x7f256c0ca960 2024-05-09T05:58:43.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.599+0000 7f2571430640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f256c06c7a0 0x7f256c15dbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48504/0 (socket says 172.21.15.72:48504) 2024-05-09T05:58:43.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.599+0000 7f2571430640 1 -- 172.21.15.72:0/3862984031 learned_addr learned my addr 172.21.15.72:0/3862984031 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:58:43.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.599+0000 7f2570c2f640 1 --2- 172.21.15.72:0/3862984031 >> v2:172.21.15.72:3300/0 conn(0x7f256c06d2e0 0x7f256c154700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:43.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.599+0000 7f256bfff640 1 --2- 172.21.15.72:0/3862984031 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f256c0ca960 0x7f256c0cad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:43.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.599+0000 7f256b7fe640 1 -- 172.21.15.72:0/3862984031 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4271229971 0 0) 0x7f25640014a0 con 0x7f256c06c7a0 2024-05-09T05:58:43.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.599+0000 7f256b7fe640 1 -- 172.21.15.72:0/3862984031 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2554003530 con 0x7f256c06c7a0 2024-05-09T05:58:43.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.603+0000 7f2570c2f640 1 -- 172.21.15.72:0/3862984031 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f256c0ca960 msgr2=0x7f256c0cad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:58:43.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.603+0000 7f2570c2f640 1 --2- 172.21.15.72:0/3862984031 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f256c0ca960 0x7f256c0cad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:43.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.603+0000 7f2570c2f640 1 -- 172.21.15.72:0/3862984031 >> v1:172.21.15.72:6789/0 conn(0x7f256c06c7a0 legacy=0x7f256c15dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:43.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.603+0000 7f2570c2f640 1 -- 172.21.15.72:0/3862984031 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f256c06e9f0 con 0x7f256c06d2e0 2024-05-09T05:58:43.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.603+0000 7f2570c2f640 1 --2- 172.21.15.72:0/3862984031 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f256c06d2e0 0x7f256c154700 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f255c0097c0 tx=0x7f255c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e57af2f63fe1daa2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:43.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.603+0000 7f256b7fe640 1 -- 172.21.15.72:0/3862984031 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255c0b1070 con 0x7f256c06d2e0 2024-05-09T05:58:43.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.603+0000 7f256b7fe640 1 -- 172.21.15.72:0/3862984031 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f255c0ac410 con 0x7f256c06d2e0 2024-05-09T05:58:43.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.603+0000 7f256b7fe640 1 -- 172.21.15.72:0/3862984031 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255c0ac7c0 con 0x7f256c06d2e0 2024-05-09T05:58:43.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.603+0000 7f2572e93640 1 -- 172.21.15.72:0/3862984031 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f256c06d2e0 msgr2=0x7f256c154700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:43.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.603+0000 7f2572e93640 1 --2- 172.21.15.72:0/3862984031 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f256c06d2e0 0x7f256c154700 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f255c0097c0 tx=0x7f255c01c4a0 comp rx=0 tx=0).stop 2024-05-09T05:58:43.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.603+0000 7f2572e93640 1 -- 172.21.15.72:0/3862984031 shutdown_connections 2024-05-09T05:58:43.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.603+0000 7f2572e93640 1 --2- 172.21.15.72:0/3862984031 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f256c0ca960 0x7f256c0cad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:43.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.603+0000 7f2572e93640 1 --2- 172.21.15.72:0/3862984031 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f256c06d2e0 0x7f256c154700 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:43.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.603+0000 7f2572e93640 1 -- 172.21.15.72:0/3862984031 >> 172.21.15.72:0/3862984031 conn(0x7f256c0cb350 msgr2=0x7f256c0cb760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:58:43.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.603+0000 7f2572e93640 1 -- 172.21.15.72:0/3862984031 shutdown_connections 2024-05-09T05:58:43.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.603+0000 7f2572e93640 1 -- 172.21.15.72:0/3862984031 wait complete. 2024-05-09T05:58:43.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.607+0000 7f2572e93640 1 Processor -- start 2024-05-09T05:58:43.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.607+0000 7f2572e93640 1 -- start start 2024-05-09T05:58:43.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.607+0000 7f2572e93640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f256c06c7a0 0x7f256c15bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:43.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.607+0000 7f2572e93640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f256c06d2e0 0x7f256c159780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:43.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.607+0000 7f2572e93640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f256c0ca960 0x7f256c146100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:43.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.607+0000 7f2572e93640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f256c0cbeb0 con 0x7f256c0ca960 2024-05-09T05:58:43.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.607+0000 7f2572e93640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f256c0c2410 con 0x7f256c06d2e0 2024-05-09T05:58:43.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.607+0000 7f2572e93640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f256c15c690 con 0x7f256c06c7a0 2024-05-09T05:58:43.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.607+0000 7f2571430640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f256c0ca960 0x7f256c146100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:43.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.607+0000 7f2571430640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f256c0ca960 0x7f256c146100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41122/0 (socket says 172.21.15.72:41122) 2024-05-09T05:58:43.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.607+0000 7f2571430640 1 -- 172.21.15.72:0/3960800152 learned_addr learned my addr 172.21.15.72:0/3960800152 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:58:43.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.607+0000 7f2570c2f640 1 --2- 172.21.15.72:0/3960800152 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f256c06c7a0 0x7f256c15bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:43.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.607+0000 7f2571430640 1 -- 172.21.15.72:0/3960800152 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f256c06c7a0 msgr2=0x7f256c15bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:43.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.607+0000 7f2571430640 1 --2- 172.21.15.72:0/3960800152 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f256c06c7a0 0x7f256c15bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:43.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.607+0000 7f256bfff640 1 --2- 172.21.15.72:0/3960800152 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f256c06d2e0 0x7f256c159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:43.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.607+0000 7f2571430640 1 -- 172.21.15.72:0/3960800152 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f256c06d2e0 msgr2=0x7f256c159780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:43.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.607+0000 7f2571430640 1 --2- 172.21.15.72:0/3960800152 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f256c06d2e0 0x7f256c159780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:43.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.607+0000 7f2571430640 1 -- 172.21.15.72:0/3960800152 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f256c0c2d50 con 0x7f256c0ca960 2024-05-09T05:58:43.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.607+0000 7f2571430640 1 --2- 172.21.15.72:0/3960800152 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f256c0ca960 0x7f256c146100 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f256400caa0 tx=0x7f256400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:43.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.607+0000 7f25697fa640 1 -- 172.21.15.72:0/3960800152 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f256400aba0 con 0x7f256c0ca960 2024-05-09T05:58:43.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.607+0000 7f25697fa640 1 -- 172.21.15.72:0/3960800152 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f256400ad40 con 0x7f256c0ca960 2024-05-09T05:58:43.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.607+0000 7f2572e93640 1 -- 172.21.15.72:0/3960800152 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f256c1f4130 con 0x7f256c0ca960 2024-05-09T05:58:43.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.607+0000 7f25697fa640 1 -- 172.21.15.72:0/3960800152 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2564012600 con 0x7f256c0ca960 2024-05-09T05:58:43.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.607+0000 7f2572e93640 1 -- 172.21.15.72:0/3960800152 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f256c1f46f0 con 0x7f256c0ca960 2024-05-09T05:58:43.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.607+0000 7f2572e93640 1 -- 172.21.15.72:0/3960800152 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f256c06a520 con 0x7f256c0ca960 2024-05-09T05:58:43.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.611+0000 7f25697fa640 1 -- 172.21.15.72:0/3960800152 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f25640127a0 con 0x7f256c0ca960 2024-05-09T05:58:43.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.611+0000 7f25697fa640 1 --2- 172.21.15.72:0/3960800152 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f255806f430 0x7f2558071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:58:43.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.611+0000 7f25697fa640 1 -- 172.21.15.72:0/3960800152 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6762+0+0 (secure 0 0 0) 0x7f256408fbf0 con 0x7f256c0ca960 2024-05-09T05:58:43.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.611+0000 7f2570c2f640 1 --2- 172.21.15.72:0/3960800152 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f255806f430 0x7f2558071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:58:43.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.611+0000 7f2570c2f640 1 --2- 172.21.15.72:0/3960800152 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f255806f430 0x7f2558071940 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f255c0ae000 tx=0x7f255c0a6040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:58:43.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.615+0000 7f25697fa640 1 -- 172.21.15.72:0/3960800152 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f256c0cc260 con 0x7f256c0ca960 2024-05-09T05:58:43.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.775+0000 7f2572e93640 1 -- 172.21.15.72:0/3960800152 --> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f256c1f78c0 con 0x7f255806f430 2024-05-09T05:58:43.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.799+0000 7f25697fa640 1 -- 172.21.15.72:0/3960800152 <== mgr.4102 v2:172.21.15.110:6832/1113420672 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332023 (secure 0 0 0) 0x7f256c1f78c0 con 0x7f255806f430 2024-05-09T05:58:43.790 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:58:43.792 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2024-05-09T05:58:43.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.803+0000 7f2572e93640 1 -- 172.21.15.72:0/3960800152 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f255806f430 msgr2=0x7f2558071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:43.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.803+0000 7f2572e93640 1 --2- 172.21.15.72:0/3960800152 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f255806f430 0x7f2558071940 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f255c0ae000 tx=0x7f255c0a6040 comp rx=0 tx=0).stop 2024-05-09T05:58:43.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.803+0000 7f2572e93640 1 -- 172.21.15.72:0/3960800152 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f256c0ca960 msgr2=0x7f256c146100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:58:43.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.803+0000 7f2572e93640 1 --2- 172.21.15.72:0/3960800152 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f256c0ca960 0x7f256c146100 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f256400caa0 tx=0x7f256400cf60 comp rx=0 tx=0).stop 2024-05-09T05:58:43.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.803+0000 7f2572e93640 1 -- 172.21.15.72:0/3960800152 shutdown_connections 2024-05-09T05:58:43.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.803+0000 7f2572e93640 1 --2- 172.21.15.72:0/3960800152 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f255806f430 0x7f2558071940 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:43.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.803+0000 7f2572e93640 1 --2- 172.21.15.72:0/3960800152 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f256c0ca960 0x7f256c146100 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:43.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.803+0000 7f2572e93640 1 --2- 172.21.15.72:0/3960800152 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f256c06d2e0 0x7f256c159780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:43.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.803+0000 7f2572e93640 1 --2- 172.21.15.72:0/3960800152 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f256c06c7a0 0x7f256c15bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:58:43.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.803+0000 7f2572e93640 1 -- 172.21.15.72:0/3960800152 >> 172.21.15.72:0/3960800152 conn(0x7f256c0cb350 msgr2=0x7f256c0c9f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:58:43.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.803+0000 7f2572e93640 1 -- 172.21.15.72:0/3960800152 shutdown_connections 2024-05-09T05:58:43.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:58:43.803+0000 7f2572e93640 1 -- 172.21.15.72:0/3960800152 wait complete. 2024-05-09T05:58:43.813 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":189,"stamp":"2024-05-09T05:58:42.605822+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":813146,"num_objects":101,"num_object_clones":0,"num_object_copies":202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":101,"num_whiteouts":0,"num_read":219,"num_read_kb":214,"num_write":9675,"num_write_kb":25167793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10131,"ondisk_log_size":10131,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":490768,"kb_used_data":4240,"kb_used_omap":12,"kb_used_meta":486451,"kb_avail":754483952,"statfs":{"total":773094113280,"available":772591566848,"internally_reserved":0,"allocated":4341760,"data_stored":2661868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":498126385},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10737401867,"num_objects":-2560,"num_object_clones":0,"num_object_copies":-10240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2560,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":2583,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005175"},"pg_stats":[{"pgid":"2.1f","version":"29'15","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:56:49.474376+0000","last_change":"2024-05-09T05:53:23.121824+0000","last_active":"2024-05-09T05:56:49.474376+0000","last_peered":"2024-05-09T05:56:49.474376+0000","last_clean":"2024-05-09T05:56:49.474376+0000","last_became_active":"2024-05-09T05:53:23.121097+0000","last_became_peered":"2024-05-09T05:53:23.121097+0000","last_unstale":"2024-05-09T05:56:49.474376+0000","last_undegraded":"2024-05-09T05:56:49.474376+0000","last_fullsized":"2024-05-09T05:56:49.474376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:50:51.880238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"29'5","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.177886+0000","last_change":"2024-05-09T05:53:24.146985+0000","last_active":"2024-05-09T05:58:30.177886+0000","last_peered":"2024-05-09T05:58:30.177886+0000","last_clean":"2024-05-09T05:58:30.177886+0000","last_became_active":"2024-05-09T05:53:24.146540+0000","last_became_peered":"2024-05-09T05:53:24.146540+0000","last_unstale":"2024-05-09T05:58:30.177886+0000","last_undegraded":"2024-05-09T05:58:30.177886+0000","last_fullsized":"2024-05-09T05:58:30.177886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:02:29.318131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"29'306","reported_seq":330,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:32.918612+0000","last_change":"2024-05-09T05:53:28.236386+0000","last_active":"2024-05-09T05:58:32.918612+0000","last_peered":"2024-05-09T05:58:32.918612+0000","last_clean":"2024-05-09T05:58:32.918612+0000","last_became_active":"2024-05-09T05:53:28.235305+0000","last_became_peered":"2024-05-09T05:53:28.235305+0000","last_unstale":"2024-05-09T05:58:32.918612+0000","last_undegraded":"2024-05-09T05:58:32.918612+0000","last_fullsized":"2024-05-09T05:58:32.918612+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:57:57.134819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":306,"num_write_kb":835584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"25'2","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:56:44.380636+0000","last_change":"2024-05-09T05:53:23.139000+0000","last_active":"2024-05-09T05:56:44.380636+0000","last_peered":"2024-05-09T05:56:44.380636+0000","last_clean":"2024-05-09T05:56:44.380636+0000","last_became_active":"2024-05-09T05:53:23.138431+0000","last_became_peered":"2024-05-09T05:53:23.138431+0000","last_unstale":"2024-05-09T05:56:44.380636+0000","last_undegraded":"2024-05-09T05:56:44.380636+0000","last_fullsized":"2024-05-09T05:56:44.380636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:33:56.977263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"29'6","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.184685+0000","last_change":"2024-05-09T05:53:24.151811+0000","last_active":"2024-05-09T05:58:30.184685+0000","last_peered":"2024-05-09T05:58:30.184685+0000","last_clean":"2024-05-09T05:58:30.184685+0000","last_became_active":"2024-05-09T05:53:24.151407+0000","last_became_peered":"2024-05-09T05:53:24.151407+0000","last_unstale":"2024-05-09T05:58:30.184685+0000","last_undegraded":"2024-05-09T05:58:30.184685+0000","last_fullsized":"2024-05-09T05:58:30.184685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:54:17.819787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"29'339","reported_seq":364,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:33.029398+0000","last_change":"2024-05-09T05:53:28.213485+0000","last_active":"2024-05-09T05:58:33.029398+0000","last_peered":"2024-05-09T05:58:33.029398+0000","last_clean":"2024-05-09T05:58:33.029398+0000","last_became_active":"2024-05-09T05:53:28.213021+0000","last_became_peered":"2024-05-09T05:53:28.213021+0000","last_unstale":"2024-05-09T05:58:33.029398+0000","last_undegraded":"2024-05-09T05:58:33.029398+0000","last_fullsized":"2024-05-09T05:58:33.029398+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":925696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"29'15","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:26.731403+0000","last_change":"2024-05-09T05:53:23.095209+0000","last_active":"2024-05-09T05:58:26.731403+0000","last_peered":"2024-05-09T05:58:26.731403+0000","last_clean":"2024-05-09T05:58:26.731403+0000","last_became_active":"2024-05-09T05:53:23.094826+0000","last_became_peered":"2024-05-09T05:53:23.094826+0000","last_unstale":"2024-05-09T05:58:26.731403+0000","last_undegraded":"2024-05-09T05:58:26.731403+0000","last_fullsized":"2024-05-09T05:58:26.731403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"29'9","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.148448+0000","last_change":"2024-05-09T05:53:24.135281+0000","last_active":"2024-05-09T05:58:30.148448+0000","last_peered":"2024-05-09T05:58:30.148448+0000","last_clean":"2024-05-09T05:58:30.148448+0000","last_became_active":"2024-05-09T05:53:24.134610+0000","last_became_peered":"2024-05-09T05:53:24.134610+0000","last_unstale":"2024-05-09T05:58:30.148448+0000","last_undegraded":"2024-05-09T05:58:30.148448+0000","last_fullsized":"2024-05-09T05:58:30.148448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"29'273","reported_seq":298,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:33.013718+0000","last_change":"2024-05-09T05:53:28.205763+0000","last_active":"2024-05-09T05:58:33.013718+0000","last_peered":"2024-05-09T05:58:33.013718+0000","last_clean":"2024-05-09T05:58:33.013718+0000","last_became_active":"2024-05-09T05:53:28.205229+0000","last_became_peered":"2024-05-09T05:53:28.205229+0000","last_unstale":"2024-05-09T05:58:33.013718+0000","last_undegraded":"2024-05-09T05:58:33.013718+0000","last_fullsized":"2024-05-09T05:58:33.013718+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"27'5","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:26.731369+0000","last_change":"2024-05-09T05:53:23.097616+0000","last_active":"2024-05-09T05:58:26.731369+0000","last_peered":"2024-05-09T05:58:26.731369+0000","last_clean":"2024-05-09T05:58:26.731369+0000","last_became_active":"2024-05-09T05:53:23.094760+0000","last_became_peered":"2024-05-09T05:53:23.094760+0000","last_unstale":"2024-05-09T05:58:26.731369+0000","last_undegraded":"2024-05-09T05:58:26.731369+0000","last_fullsized":"2024-05-09T05:58:26.731369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"29'15","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.160427+0000","last_change":"2024-05-09T05:53:24.139467+0000","last_active":"2024-05-09T05:58:30.160427+0000","last_peered":"2024-05-09T05:58:30.160427+0000","last_clean":"2024-05-09T05:58:30.160427+0000","last_became_active":"2024-05-09T05:53:24.139109+0000","last_became_peered":"2024-05-09T05:53:24.139109+0000","last_unstale":"2024-05-09T05:58:30.160427+0000","last_undegraded":"2024-05-09T05:58:30.160427+0000","last_fullsized":"2024-05-09T05:58:30.160427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:36.783615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"29'252","reported_seq":277,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:32.972935+0000","last_change":"2024-05-09T05:53:28.216127+0000","last_active":"2024-05-09T05:58:32.972935+0000","last_peered":"2024-05-09T05:58:32.972935+0000","last_clean":"2024-05-09T05:58:32.972935+0000","last_became_active":"2024-05-09T05:53:28.215482+0000","last_became_peered":"2024-05-09T05:53:28.215482+0000","last_unstale":"2024-05-09T05:58:32.972935+0000","last_undegraded":"2024-05-09T05:58:32.972935+0000","last_fullsized":"2024-05-09T05:58:32.972935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":688128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"29'5","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.160135+0000","last_change":"2024-05-09T05:53:24.132483+0000","last_active":"2024-05-09T05:58:30.160135+0000","last_peered":"2024-05-09T05:58:30.160135+0000","last_clean":"2024-05-09T05:58:30.160135+0000","last_became_active":"2024-05-09T05:53:24.132118+0000","last_became_peered":"2024-05-09T05:53:24.132118+0000","last_unstale":"2024-05-09T05:58:30.160135+0000","last_undegraded":"2024-05-09T05:58:30.160135+0000","last_fullsized":"2024-05-09T05:58:30.160135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:06:01.787707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:56:45.401141+0000","last_change":"2024-05-09T05:53:23.117460+0000","last_active":"2024-05-09T05:56:45.401141+0000","last_peered":"2024-05-09T05:56:45.401141+0000","last_clean":"2024-05-09T05:56:45.401141+0000","last_became_active":"2024-05-09T05:53:23.114179+0000","last_became_peered":"2024-05-09T05:53:23.114179+0000","last_unstale":"2024-05-09T05:56:45.401141+0000","last_undegraded":"2024-05-09T05:56:45.401141+0000","last_fullsized":"2024-05-09T05:56:45.401141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:44:01.784905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"29'309","reported_seq":333,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:32.986876+0000","last_change":"2024-05-09T05:53:28.227135+0000","last_active":"2024-05-09T05:58:32.986876+0000","last_peered":"2024-05-09T05:58:32.986876+0000","last_clean":"2024-05-09T05:58:32.986876+0000","last_became_active":"2024-05-09T05:53:28.226427+0000","last_became_peered":"2024-05-09T05:53:28.226427+0000","last_unstale":"2024-05-09T05:58:32.986876+0000","last_undegraded":"2024-05-09T05:58:32.986876+0000","last_fullsized":"2024-05-09T05:58:32.986876+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:37:04.413804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":309,"num_write_kb":843776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"29'8","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.188143+0000","last_change":"2024-05-09T05:53:24.135982+0000","last_active":"2024-05-09T05:58:30.188143+0000","last_peered":"2024-05-09T05:58:30.188143+0000","last_clean":"2024-05-09T05:58:30.188143+0000","last_became_active":"2024-05-09T05:53:24.135580+0000","last_became_peered":"2024-05-09T05:53:24.135580+0000","last_unstale":"2024-05-09T05:58:30.188143+0000","last_undegraded":"2024-05-09T05:58:30.188143+0000","last_fullsized":"2024-05-09T05:58:30.188143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:03:04.589608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"27'3","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:56:44.379284+0000","last_change":"2024-05-09T05:53:23.142679+0000","last_active":"2024-05-09T05:56:44.379284+0000","last_peered":"2024-05-09T05:56:44.379284+0000","last_clean":"2024-05-09T05:56:44.379284+0000","last_became_active":"2024-05-09T05:53:23.142018+0000","last_became_peered":"2024-05-09T05:53:23.142018+0000","last_unstale":"2024-05-09T05:56:44.379284+0000","last_undegraded":"2024-05-09T05:56:44.379284+0000","last_fullsized":"2024-05-09T05:56:44.379284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:08:29.312049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"29'291","reported_seq":316,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:32.976356+0000","last_change":"2024-05-09T05:53:28.214167+0000","last_active":"2024-05-09T05:58:32.976356+0000","last_peered":"2024-05-09T05:58:32.976356+0000","last_clean":"2024-05-09T05:58:32.976356+0000","last_became_active":"2024-05-09T05:53:28.213623+0000","last_became_peered":"2024-05-09T05:53:28.213623+0000","last_unstale":"2024-05-09T05:58:32.976356+0000","last_undegraded":"2024-05-09T05:58:32.976356+0000","last_fullsized":"2024-05-09T05:58:32.976356+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":291,"num_write_kb":794624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"29'9","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.191092+0000","last_change":"2024-05-09T05:53:24.130342+0000","last_active":"2024-05-09T05:58:30.191092+0000","last_peered":"2024-05-09T05:58:30.191092+0000","last_clean":"2024-05-09T05:58:30.191092+0000","last_became_active":"2024-05-09T05:53:24.129938+0000","last_became_peered":"2024-05-09T05:53:24.129938+0000","last_unstale":"2024-05-09T05:58:30.191092+0000","last_undegraded":"2024-05-09T05:58:30.191092+0000","last_fullsized":"2024-05-09T05:58:30.191092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:58:13.879633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"27'7","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:57:10.705303+0000","last_change":"2024-05-09T05:53:23.111169+0000","last_active":"2024-05-09T05:57:10.705303+0000","last_peered":"2024-05-09T05:57:10.705303+0000","last_clean":"2024-05-09T05:57:10.705303+0000","last_became_active":"2024-05-09T05:53:23.110140+0000","last_became_peered":"2024-05-09T05:53:23.110140+0000","last_unstale":"2024-05-09T05:57:10.705303+0000","last_undegraded":"2024-05-09T05:57:10.705303+0000","last_fullsized":"2024-05-09T05:57:10.705303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:18:55.367553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"29'267","reported_seq":291,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:32.935823+0000","last_change":"2024-05-09T05:53:28.233648+0000","last_active":"2024-05-09T05:58:32.935823+0000","last_peered":"2024-05-09T05:58:32.935823+0000","last_clean":"2024-05-09T05:58:32.935823+0000","last_became_active":"2024-05-09T05:53:28.227087+0000","last_became_peered":"2024-05-09T05:53:28.227087+0000","last_unstale":"2024-05-09T05:58:32.935823+0000","last_undegraded":"2024-05-09T05:58:32.935823+0000","last_fullsized":"2024-05-09T05:58:32.935823+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:03:49.709580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":267,"num_write_kb":729088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"29'2","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.125901+0000","last_change":"2024-05-09T05:53:24.147343+0000","last_active":"2024-05-09T05:58:30.125901+0000","last_peered":"2024-05-09T05:58:30.125901+0000","last_clean":"2024-05-09T05:58:30.125901+0000","last_became_active":"2024-05-09T05:53:24.144596+0000","last_became_peered":"2024-05-09T05:53:24.144596+0000","last_unstale":"2024-05-09T05:58:30.125901+0000","last_undegraded":"2024-05-09T05:58:30.125901+0000","last_fullsized":"2024-05-09T05:58:30.125901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:52:43.052055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"25'2","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:57:46.723957+0000","last_change":"2024-05-09T05:53:23.102976+0000","last_active":"2024-05-09T05:57:46.723957+0000","last_peered":"2024-05-09T05:57:46.723957+0000","last_clean":"2024-05-09T05:57:46.723957+0000","last_became_active":"2024-05-09T05:53:23.102420+0000","last_became_peered":"2024-05-09T05:53:23.102420+0000","last_unstale":"2024-05-09T05:57:46.723957+0000","last_undegraded":"2024-05-09T05:57:46.723957+0000","last_fullsized":"2024-05-09T05:57:46.723957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"29'288","reported_seq":313,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:33.030518+0000","last_change":"2024-05-09T05:53:28.195537+0000","last_active":"2024-05-09T05:58:33.030518+0000","last_peered":"2024-05-09T05:58:33.030518+0000","last_clean":"2024-05-09T05:58:33.030518+0000","last_became_active":"2024-05-09T05:53:28.194915+0000","last_became_peered":"2024-05-09T05:53:28.194915+0000","last_unstale":"2024-05-09T05:58:33.030518+0000","last_undegraded":"2024-05-09T05:58:33.030518+0000","last_fullsized":"2024-05-09T05:58:33.030518+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":786432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"29'7","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.191355+0000","last_change":"2024-05-09T05:53:24.130312+0000","last_active":"2024-05-09T05:58:30.191355+0000","last_peered":"2024-05-09T05:58:30.191355+0000","last_clean":"2024-05-09T05:58:30.191355+0000","last_became_active":"2024-05-09T05:53:24.129953+0000","last_became_peered":"2024-05-09T05:53:24.129953+0000","last_unstale":"2024-05-09T05:58:30.191355+0000","last_undegraded":"2024-05-09T05:58:30.191355+0000","last_fullsized":"2024-05-09T05:58:30.191355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:07:09.368521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"29'8","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:57:43.751407+0000","last_change":"2024-05-09T05:53:23.127219+0000","last_active":"2024-05-09T05:57:43.751407+0000","last_peered":"2024-05-09T05:57:43.751407+0000","last_clean":"2024-05-09T05:57:43.751407+0000","last_became_active":"2024-05-09T05:53:23.126691+0000","last_became_peered":"2024-05-09T05:53:23.126691+0000","last_unstale":"2024-05-09T05:57:43.751407+0000","last_undegraded":"2024-05-09T05:57:43.751407+0000","last_fullsized":"2024-05-09T05:57:43.751407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:17:26.711941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"29'249","reported_seq":274,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:33.787299+0000","last_change":"2024-05-09T05:53:28.191045+0000","last_active":"2024-05-09T05:58:33.787299+0000","last_peered":"2024-05-09T05:58:33.787299+0000","last_clean":"2024-05-09T05:58:33.787299+0000","last_became_active":"2024-05-09T05:53:28.190564+0000","last_became_peered":"2024-05-09T05:53:28.190564+0000","last_unstale":"2024-05-09T05:58:33.787299+0000","last_undegraded":"2024-05-09T05:58:33.787299+0000","last_fullsized":"2024-05-09T05:58:33.787299+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":249,"num_write_kb":679936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"29'5","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.191251+0000","last_change":"2024-05-09T05:53:24.138682+0000","last_active":"2024-05-09T05:58:30.191251+0000","last_peered":"2024-05-09T05:58:30.191251+0000","last_clean":"2024-05-09T05:58:30.191251+0000","last_became_active":"2024-05-09T05:53:24.138417+0000","last_became_peered":"2024-05-09T05:53:24.138417+0000","last_unstale":"2024-05-09T05:58:30.191251+0000","last_undegraded":"2024-05-09T05:58:30.191251+0000","last_fullsized":"2024-05-09T05:58:30.191251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:57:55.403156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"29'27","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:29.274497+0000","last_change":"2024-05-09T05:53:23.102986+0000","last_active":"2024-05-09T05:58:29.274497+0000","last_peered":"2024-05-09T05:58:29.274497+0000","last_clean":"2024-05-09T05:58:29.274497+0000","last_became_active":"2024-05-09T05:53:23.102020+0000","last_became_peered":"2024-05-09T05:53:23.102020+0000","last_unstale":"2024-05-09T05:58:29.274497+0000","last_undegraded":"2024-05-09T05:58:29.274497+0000","last_fullsized":"2024-05-09T05:58:29.274497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:18:11.582575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"29'264","reported_seq":288,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:32.980948+0000","last_change":"2024-05-09T05:53:28.218326+0000","last_active":"2024-05-09T05:58:32.980948+0000","last_peered":"2024-05-09T05:58:32.980948+0000","last_clean":"2024-05-09T05:58:32.980948+0000","last_became_active":"2024-05-09T05:53:28.216634+0000","last_became_peered":"2024-05-09T05:53:28.216634+0000","last_unstale":"2024-05-09T05:58:32.980948+0000","last_undegraded":"2024-05-09T05:58:32.980948+0000","last_fullsized":"2024-05-09T05:58:32.980948+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:13:05.321932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":720896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"29'9","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.180943+0000","last_change":"2024-05-09T05:53:24.143161+0000","last_active":"2024-05-09T05:58:30.180943+0000","last_peered":"2024-05-09T05:58:30.180943+0000","last_clean":"2024-05-09T05:58:30.180943+0000","last_became_active":"2024-05-09T05:53:24.139369+0000","last_became_peered":"2024-05-09T05:53:24.139369+0000","last_unstale":"2024-05-09T05:58:30.180943+0000","last_undegraded":"2024-05-09T05:58:30.180943+0000","last_fullsized":"2024-05-09T05:58:30.180943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:25:21.472460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"27'4","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:56:49.370643+0000","last_change":"2024-05-09T05:53:23.123560+0000","last_active":"2024-05-09T05:56:49.370643+0000","last_peered":"2024-05-09T05:56:49.370643+0000","last_clean":"2024-05-09T05:56:49.370643+0000","last_became_active":"2024-05-09T05:53:23.123081+0000","last_became_peered":"2024-05-09T05:53:23.123081+0000","last_unstale":"2024-05-09T05:56:49.370643+0000","last_undegraded":"2024-05-09T05:56:49.370643+0000","last_fullsized":"2024-05-09T05:56:49.370643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:15:31.371756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"29'249","reported_seq":273,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:32.963386+0000","last_change":"2024-05-09T05:53:28.229352+0000","last_active":"2024-05-09T05:58:32.963386+0000","last_peered":"2024-05-09T05:58:32.963386+0000","last_clean":"2024-05-09T05:58:32.963386+0000","last_became_active":"2024-05-09T05:53:28.225810+0000","last_became_peered":"2024-05-09T05:53:28.225810+0000","last_unstale":"2024-05-09T05:58:32.963386+0000","last_undegraded":"2024-05-09T05:58:32.963386+0000","last_fullsized":"2024-05-09T05:58:32.963386+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:17:07.192105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":249,"num_write_kb":679936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.147119+0000","last_change":"2024-05-09T05:53:24.130533+0000","last_active":"2024-05-09T05:58:30.147119+0000","last_peered":"2024-05-09T05:58:30.147119+0000","last_clean":"2024-05-09T05:58:30.147119+0000","last_became_active":"2024-05-09T05:53:24.129787+0000","last_became_peered":"2024-05-09T05:53:24.129787+0000","last_unstale":"2024-05-09T05:58:30.147119+0000","last_undegraded":"2024-05-09T05:58:30.147119+0000","last_fullsized":"2024-05-09T05:58:30.147119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"26'1","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:56:44.379023+0000","last_change":"2024-05-09T05:53:23.134379+0000","last_active":"2024-05-09T05:56:44.379023+0000","last_peered":"2024-05-09T05:56:44.379023+0000","last_clean":"2024-05-09T05:56:44.379023+0000","last_became_active":"2024-05-09T05:53:23.133587+0000","last_became_peered":"2024-05-09T05:53:23.133587+0000","last_unstale":"2024-05-09T05:56:44.379023+0000","last_undegraded":"2024-05-09T05:56:44.379023+0000","last_fullsized":"2024-05-09T05:56:44.379023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:00:33.973787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"29'273","reported_seq":297,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:32.982789+0000","last_change":"2024-05-09T05:53:28.233620+0000","last_active":"2024-05-09T05:58:32.982789+0000","last_peered":"2024-05-09T05:58:32.982789+0000","last_clean":"2024-05-09T05:58:32.982789+0000","last_became_active":"2024-05-09T05:53:28.232539+0000","last_became_peered":"2024-05-09T05:53:28.232539+0000","last_unstale":"2024-05-09T05:58:32.982789+0000","last_undegraded":"2024-05-09T05:58:32.982789+0000","last_fullsized":"2024-05-09T05:58:32.982789+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:13.789448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"29'7","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:40.780464+0000","last_change":"2024-05-09T05:58:40.780487+0000","last_active":"2024-05-09T05:58:40.780464+0000","last_peered":"2024-05-09T05:58:40.780464+0000","last_clean":"2024-05-09T05:58:40.780464+0000","last_became_active":"2024-05-09T05:53:24.132309+0000","last_became_peered":"2024-05-09T05:53:24.132309+0000","last_unstale":"2024-05-09T05:58:40.780464+0000","last_undegraded":"2024-05-09T05:58:40.780464+0000","last_fullsized":"2024-05-09T05:58:40.780464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-05-09T05:58:40.780386+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-05-09T05:58:40.780386+0000","last_clean_scrub_stamp":"2024-05-09T05:58:40.780386+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:03:47.892710+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"29'7","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:57:10.708672+0000","last_change":"2024-05-09T05:53:23.120384+0000","last_active":"2024-05-09T05:57:10.708672+0000","last_peered":"2024-05-09T05:57:10.708672+0000","last_clean":"2024-05-09T05:57:10.708672+0000","last_became_active":"2024-05-09T05:53:23.118321+0000","last_became_peered":"2024-05-09T05:53:23.118321+0000","last_unstale":"2024-05-09T05:57:10.708672+0000","last_undegraded":"2024-05-09T05:57:10.708672+0000","last_fullsized":"2024-05-09T05:57:10.708672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:15:51.297111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":14,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'264","reported_seq":288,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:32.992445+0000","last_change":"2024-05-09T05:53:28.208383+0000","last_active":"2024-05-09T05:58:32.992445+0000","last_peered":"2024-05-09T05:58:32.992445+0000","last_clean":"2024-05-09T05:58:32.992445+0000","last_became_active":"2024-05-09T05:53:28.199359+0000","last_became_peered":"2024-05-09T05:53:28.199359+0000","last_unstale":"2024-05-09T05:58:32.992445+0000","last_undegraded":"2024-05-09T05:58:32.992445+0000","last_fullsized":"2024-05-09T05:58:32.992445+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:50:19.715242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":720896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"29'8","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.189540+0000","last_change":"2024-05-09T05:53:24.142740+0000","last_active":"2024-05-09T05:58:30.189540+0000","last_peered":"2024-05-09T05:58:30.189540+0000","last_clean":"2024-05-09T05:58:30.189540+0000","last_became_active":"2024-05-09T05:53:24.142265+0000","last_became_peered":"2024-05-09T05:53:24.142265+0000","last_unstale":"2024-05-09T05:58:30.189540+0000","last_undegraded":"2024-05-09T05:58:30.189540+0000","last_fullsized":"2024-05-09T05:58:30.189540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:46:53.729151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"29'13","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.475397+0000","last_change":"2024-05-09T05:53:23.142455+0000","last_active":"2024-05-09T05:58:30.475397+0000","last_peered":"2024-05-09T05:58:30.475397+0000","last_clean":"2024-05-09T05:58:30.475397+0000","last_became_active":"2024-05-09T05:53:23.141770+0000","last_became_peered":"2024-05-09T05:53:23.141770+0000","last_unstale":"2024-05-09T05:58:30.475397+0000","last_undegraded":"2024-05-09T05:58:30.475397+0000","last_fullsized":"2024-05-09T05:58:30.475397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:30:34.301349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":641,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"29'270","reported_seq":294,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:33.000358+0000","last_change":"2024-05-09T05:53:28.212176+0000","last_active":"2024-05-09T05:58:33.000358+0000","last_peered":"2024-05-09T05:58:33.000358+0000","last_clean":"2024-05-09T05:58:33.000358+0000","last_became_active":"2024-05-09T05:53:28.210981+0000","last_became_peered":"2024-05-09T05:53:28.210981+0000","last_unstale":"2024-05-09T05:58:33.000358+0000","last_undegraded":"2024-05-09T05:58:33.000358+0000","last_fullsized":"2024-05-09T05:58:33.000358+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:17:24.122805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":737280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"29'5","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.181917+0000","last_change":"2024-05-09T05:53:24.132887+0000","last_active":"2024-05-09T05:58:30.181917+0000","last_peered":"2024-05-09T05:58:30.181917+0000","last_clean":"2024-05-09T05:58:30.181917+0000","last_became_active":"2024-05-09T05:53:24.132398+0000","last_became_peered":"2024-05-09T05:53:24.132398+0000","last_unstale":"2024-05-09T05:58:30.181917+0000","last_undegraded":"2024-05-09T05:58:30.181917+0000","last_fullsized":"2024-05-09T05:58:30.181917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:36:49.369162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"29'6","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:56:49.477057+0000","last_change":"2024-05-09T05:53:23.126202+0000","last_active":"2024-05-09T05:56:49.477057+0000","last_peered":"2024-05-09T05:56:49.477057+0000","last_clean":"2024-05-09T05:56:49.477057+0000","last_became_active":"2024-05-09T05:53:23.125799+0000","last_became_peered":"2024-05-09T05:53:23.125799+0000","last_unstale":"2024-05-09T05:56:49.477057+0000","last_undegraded":"2024-05-09T05:56:49.477057+0000","last_fullsized":"2024-05-09T05:56:49.477057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:33:12.831705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"29'339","reported_seq":370,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:32.972228+0000","last_change":"2024-05-09T05:54:06.916943+0000","last_active":"2024-05-09T05:58:32.972228+0000","last_peered":"2024-05-09T05:58:32.972228+0000","last_clean":"2024-05-09T05:58:32.972228+0000","last_became_active":"2024-05-09T05:54:06.915734+0000","last_became_peered":"2024-05-09T05:54:06.915734+0000","last_unstale":"2024-05-09T05:58:32.972228+0000","last_undegraded":"2024-05-09T05:58:32.972228+0000","last_fullsized":"2024-05-09T05:58:32.972228+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:59:44.265794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":925696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,6,1],"acting":[5,0,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"29'8","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.179473+0000","last_change":"2024-05-09T05:53:24.139586+0000","last_active":"2024-05-09T05:58:30.179473+0000","last_peered":"2024-05-09T05:58:30.179473+0000","last_clean":"2024-05-09T05:58:30.179473+0000","last_became_active":"2024-05-09T05:53:24.138835+0000","last_became_peered":"2024-05-09T05:53:24.138835+0000","last_unstale":"2024-05-09T05:58:30.179473+0000","last_undegraded":"2024-05-09T05:58:30.179473+0000","last_fullsized":"2024-05-09T05:58:30.179473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:37:13.012588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"27'6","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:56:49.370370+0000","last_change":"2024-05-09T05:53:23.117121+0000","last_active":"2024-05-09T05:56:49.370370+0000","last_peered":"2024-05-09T05:56:49.370370+0000","last_clean":"2024-05-09T05:56:49.370370+0000","last_became_active":"2024-05-09T05:53:23.113294+0000","last_became_peered":"2024-05-09T05:53:23.113294+0000","last_unstale":"2024-05-09T05:56:49.370370+0000","last_undegraded":"2024-05-09T05:56:49.370370+0000","last_fullsized":"2024-05-09T05:56:49.370370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:53:41.591371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"29'74","reported_seq":138,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:40.501190+0000","last_change":"2024-05-09T05:58:40.501237+0000","last_active":"2024-05-09T05:58:40.501190+0000","last_peered":"2024-05-09T05:58:40.501190+0000","last_clean":"2024-05-09T05:58:40.501190+0000","last_became_active":"2024-05-09T05:53:12.481529+0000","last_became_peered":"2024-05-09T05:53:12.481529+0000","last_unstale":"2024-05-09T05:58:40.501190+0000","last_undegraded":"2024-05-09T05:58:40.501190+0000","last_fullsized":"2024-05-09T05:58:40.501190+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'74","last_scrub_stamp":"2024-05-09T05:58:40.501088+0000","last_deep_scrub":"29'74","last_deep_scrub_stamp":"2024-05-09T05:58:40.501088+0000","last_clean_scrub_stamp":"2024-05-09T05:58:40.501088+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:55:54.684313+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'276","reported_seq":300,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:32.994680+0000","last_change":"2024-05-09T05:53:28.190861+0000","last_active":"2024-05-09T05:58:32.994680+0000","last_peered":"2024-05-09T05:58:32.994680+0000","last_clean":"2024-05-09T05:58:32.994680+0000","last_became_active":"2024-05-09T05:53:28.190393+0000","last_became_peered":"2024-05-09T05:53:28.190393+0000","last_unstale":"2024-05-09T05:58:32.994680+0000","last_undegraded":"2024-05-09T05:58:32.994680+0000","last_fullsized":"2024-05-09T05:58:32.994680+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:05:37.653010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":276,"num_write_kb":753664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"29'7","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.163539+0000","last_change":"2024-05-09T05:53:24.143283+0000","last_active":"2024-05-09T05:58:30.163539+0000","last_peered":"2024-05-09T05:58:30.163539+0000","last_clean":"2024-05-09T05:58:30.163539+0000","last_became_active":"2024-05-09T05:53:24.139813+0000","last_became_peered":"2024-05-09T05:53:24.139813+0000","last_unstale":"2024-05-09T05:58:30.163539+0000","last_undegraded":"2024-05-09T05:58:30.163539+0000","last_fullsized":"2024-05-09T05:58:30.163539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:07:38.471778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"29'7","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:57:56.748839+0000","last_change":"2024-05-09T05:53:23.115534+0000","last_active":"2024-05-09T05:57:56.748839+0000","last_peered":"2024-05-09T05:57:56.748839+0000","last_clean":"2024-05-09T05:57:56.748839+0000","last_became_active":"2024-05-09T05:53:23.112260+0000","last_became_peered":"2024-05-09T05:53:23.112260+0000","last_unstale":"2024-05-09T05:57:56.748839+0000","last_undegraded":"2024-05-09T05:57:56.748839+0000","last_fullsized":"2024-05-09T05:57:56.748839+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:46:53.520691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"29'279","reported_seq":304,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:33.019303+0000","last_change":"2024-05-09T05:53:28.195687+0000","last_active":"2024-05-09T05:58:33.019303+0000","last_peered":"2024-05-09T05:58:33.019303+0000","last_clean":"2024-05-09T05:58:33.019303+0000","last_became_active":"2024-05-09T05:53:28.195082+0000","last_became_peered":"2024-05-09T05:53:28.195082+0000","last_unstale":"2024-05-09T05:58:33.019303+0000","last_undegraded":"2024-05-09T05:58:33.019303+0000","last_fullsized":"2024-05-09T05:58:33.019303+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":279,"num_write_kb":761856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"29'6","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.185270+0000","last_change":"2024-05-09T05:53:24.130460+0000","last_active":"2024-05-09T05:58:30.185270+0000","last_peered":"2024-05-09T05:58:30.185270+0000","last_clean":"2024-05-09T05:58:30.185270+0000","last_became_active":"2024-05-09T05:53:24.129808+0000","last_became_peered":"2024-05-09T05:53:24.129808+0000","last_unstale":"2024-05-09T05:58:30.185270+0000","last_undegraded":"2024-05-09T05:58:30.185270+0000","last_fullsized":"2024-05-09T05:58:30.185270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:56:49.475046+0000","last_change":"2024-05-09T05:53:23.139063+0000","last_active":"2024-05-09T05:56:49.475046+0000","last_peered":"2024-05-09T05:56:49.475046+0000","last_clean":"2024-05-09T05:56:49.475046+0000","last_became_active":"2024-05-09T05:53:23.138303+0000","last_became_peered":"2024-05-09T05:53:23.138303+0000","last_unstale":"2024-05-09T05:56:49.475046+0000","last_undegraded":"2024-05-09T05:56:49.475046+0000","last_fullsized":"2024-05-09T05:56:49.475046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:18:20.172877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"29'261","reported_seq":285,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:33.010968+0000","last_change":"2024-05-09T05:53:28.214251+0000","last_active":"2024-05-09T05:58:33.010968+0000","last_peered":"2024-05-09T05:58:33.010968+0000","last_clean":"2024-05-09T05:58:33.010968+0000","last_became_active":"2024-05-09T05:53:28.206229+0000","last_became_peered":"2024-05-09T05:53:28.206229+0000","last_unstale":"2024-05-09T05:58:33.010968+0000","last_undegraded":"2024-05-09T05:58:33.010968+0000","last_fullsized":"2024-05-09T05:58:33.010968+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":261,"log_dups_size":0,"ondisk_log_size":261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:12:26.761543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":261,"num_write_kb":712704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"29'9","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.417143+0000","last_change":"2024-05-09T05:53:24.135578+0000","last_active":"2024-05-09T05:58:30.417143+0000","last_peered":"2024-05-09T05:58:30.417143+0000","last_clean":"2024-05-09T05:58:30.417143+0000","last_became_active":"2024-05-09T05:53:24.135253+0000","last_became_peered":"2024-05-09T05:53:24.135253+0000","last_unstale":"2024-05-09T05:58:30.417143+0000","last_undegraded":"2024-05-09T05:58:30.417143+0000","last_fullsized":"2024-05-09T05:58:30.417143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"27'5","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:57:10.701585+0000","last_change":"2024-05-09T05:53:23.140175+0000","last_active":"2024-05-09T05:57:10.701585+0000","last_peered":"2024-05-09T05:57:10.701585+0000","last_clean":"2024-05-09T05:57:10.701585+0000","last_became_active":"2024-05-09T05:53:23.139516+0000","last_became_peered":"2024-05-09T05:53:23.139516+0000","last_unstale":"2024-05-09T05:57:10.701585+0000","last_undegraded":"2024-05-09T05:57:10.701585+0000","last_fullsized":"2024-05-09T05:57:10.701585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:48:42.473155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"29'318","reported_seq":342,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:32.979280+0000","last_change":"2024-05-09T05:53:28.199385+0000","last_active":"2024-05-09T05:58:32.979280+0000","last_peered":"2024-05-09T05:58:32.979280+0000","last_clean":"2024-05-09T05:58:32.979280+0000","last_became_active":"2024-05-09T05:53:28.198825+0000","last_became_peered":"2024-05-09T05:53:28.198825+0000","last_unstale":"2024-05-09T05:58:32.979280+0000","last_undegraded":"2024-05-09T05:58:32.979280+0000","last_fullsized":"2024-05-09T05:58:32.979280+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:48:22.224140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":318,"num_write_kb":868352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.148194+0000","last_change":"2024-05-09T05:53:24.133293+0000","last_active":"2024-05-09T05:58:30.148194+0000","last_peered":"2024-05-09T05:58:30.148194+0000","last_clean":"2024-05-09T05:58:30.148194+0000","last_became_active":"2024-05-09T05:53:24.131741+0000","last_became_peered":"2024-05-09T05:53:24.131741+0000","last_unstale":"2024-05-09T05:58:30.148194+0000","last_undegraded":"2024-05-09T05:58:30.148194+0000","last_fullsized":"2024-05-09T05:58:30.148194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"26'2","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:57:56.725685+0000","last_change":"2024-05-09T05:53:23.112592+0000","last_active":"2024-05-09T05:57:56.725685+0000","last_peered":"2024-05-09T05:57:56.725685+0000","last_clean":"2024-05-09T05:57:56.725685+0000","last_became_active":"2024-05-09T05:53:23.111968+0000","last_became_peered":"2024-05-09T05:53:23.111968+0000","last_unstale":"2024-05-09T05:57:56.725685+0000","last_undegraded":"2024-05-09T05:57:56.725685+0000","last_fullsized":"2024-05-09T05:57:56.725685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"29'258","reported_seq":283,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:32.990342+0000","last_change":"2024-05-09T05:53:28.227755+0000","last_active":"2024-05-09T05:58:32.990342+0000","last_peered":"2024-05-09T05:58:32.990342+0000","last_clean":"2024-05-09T05:58:32.990342+0000","last_became_active":"2024-05-09T05:53:28.227272+0000","last_became_peered":"2024-05-09T05:53:28.227272+0000","last_unstale":"2024-05-09T05:58:32.990342+0000","last_undegraded":"2024-05-09T05:58:32.990342+0000","last_fullsized":"2024-05-09T05:58:32.990342+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":258,"num_write_kb":704512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"29'6","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.158182+0000","last_change":"2024-05-09T05:53:24.144025+0000","last_active":"2024-05-09T05:58:30.158182+0000","last_peered":"2024-05-09T05:58:30.158182+0000","last_clean":"2024-05-09T05:58:30.158182+0000","last_became_active":"2024-05-09T05:53:24.143540+0000","last_became_peered":"2024-05-09T05:53:24.143540+0000","last_unstale":"2024-05-09T05:58:30.158182+0000","last_undegraded":"2024-05-09T05:58:30.158182+0000","last_fullsized":"2024-05-09T05:58:30.158182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:22:58.062541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"29'20","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:06.736201+0000","last_change":"2024-05-09T05:53:23.104452+0000","last_active":"2024-05-09T05:58:06.736201+0000","last_peered":"2024-05-09T05:58:06.736201+0000","last_clean":"2024-05-09T05:58:06.736201+0000","last_became_active":"2024-05-09T05:53:23.103471+0000","last_became_peered":"2024-05-09T05:53:23.103471+0000","last_unstale":"2024-05-09T05:58:06.736201+0000","last_undegraded":"2024-05-09T05:58:06.736201+0000","last_fullsized":"2024-05-09T05:58:06.736201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:33:30.508464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"29'360","reported_seq":384,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:33.029867+0000","last_change":"2024-05-09T05:53:28.241338+0000","last_active":"2024-05-09T05:58:33.029867+0000","last_peered":"2024-05-09T05:58:33.029867+0000","last_clean":"2024-05-09T05:58:33.029867+0000","last_became_active":"2024-05-09T05:53:28.239841+0000","last_became_peered":"2024-05-09T05:53:28.239841+0000","last_unstale":"2024-05-09T05:58:33.029867+0000","last_undegraded":"2024-05-09T05:58:33.029867+0000","last_fullsized":"2024-05-09T05:58:33.029867+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:44:47.854598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":360,"num_write_kb":983040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"29'6","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.181361+0000","last_change":"2024-05-09T05:53:24.149958+0000","last_active":"2024-05-09T05:58:30.181361+0000","last_peered":"2024-05-09T05:58:30.181361+0000","last_clean":"2024-05-09T05:58:30.181361+0000","last_became_active":"2024-05-09T05:53:24.149578+0000","last_became_peered":"2024-05-09T05:53:24.149578+0000","last_unstale":"2024-05-09T05:58:30.181361+0000","last_undegraded":"2024-05-09T05:58:30.181361+0000","last_fullsized":"2024-05-09T05:58:30.181361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"29'7","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.101436+0000","last_change":"2024-05-09T05:53:23.121266+0000","last_active":"2024-05-09T05:58:30.101436+0000","last_peered":"2024-05-09T05:58:30.101436+0000","last_clean":"2024-05-09T05:58:30.101436+0000","last_became_active":"2024-05-09T05:53:23.120857+0000","last_became_peered":"2024-05-09T05:53:23.120857+0000","last_unstale":"2024-05-09T05:58:30.101436+0000","last_undegraded":"2024-05-09T05:58:30.101436+0000","last_fullsized":"2024-05-09T05:58:30.101436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"29'273","reported_seq":297,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:33.018216+0000","last_change":"2024-05-09T05:53:28.240774+0000","last_active":"2024-05-09T05:58:33.018216+0000","last_peered":"2024-05-09T05:58:33.018216+0000","last_clean":"2024-05-09T05:58:33.018216+0000","last_became_active":"2024-05-09T05:53:28.240070+0000","last_became_peered":"2024-05-09T05:53:28.240070+0000","last_unstale":"2024-05-09T05:58:33.018216+0000","last_undegraded":"2024-05-09T05:58:33.018216+0000","last_fullsized":"2024-05-09T05:58:33.018216+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:25:24.019344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"29'15","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.166939+0000","last_change":"2024-05-09T05:54:06.645397+0000","last_active":"2024-05-09T05:58:30.166939+0000","last_peered":"2024-05-09T05:58:30.166939+0000","last_clean":"2024-05-09T05:58:30.166939+0000","last_became_active":"2024-05-09T05:54:06.644437+0000","last_became_peered":"2024-05-09T05:54:06.644437+0000","last_unstale":"2024-05-09T05:58:30.166939+0000","last_undegraded":"2024-05-09T05:58:30.166939+0000","last_fullsized":"2024-05-09T05:58:30.166939+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:41:52.843192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'5","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:56:49.370721+0000","last_change":"2024-05-09T05:53:23.120680+0000","last_active":"2024-05-09T05:56:49.370721+0000","last_peered":"2024-05-09T05:56:49.370721+0000","last_clean":"2024-05-09T05:56:49.370721+0000","last_became_active":"2024-05-09T05:53:23.118358+0000","last_became_peered":"2024-05-09T05:53:23.118358+0000","last_unstale":"2024-05-09T05:56:49.370721+0000","last_undegraded":"2024-05-09T05:56:49.370721+0000","last_fullsized":"2024-05-09T05:56:49.370721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:52:52.360128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"29'273","reported_seq":297,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:32.931227+0000","last_change":"2024-05-09T05:53:28.222341+0000","last_active":"2024-05-09T05:58:32.931227+0000","last_peered":"2024-05-09T05:58:32.931227+0000","last_clean":"2024-05-09T05:58:32.931227+0000","last_became_active":"2024-05-09T05:53:28.219636+0000","last_became_peered":"2024-05-09T05:53:28.219636+0000","last_unstale":"2024-05-09T05:58:32.931227+0000","last_undegraded":"2024-05-09T05:58:32.931227+0000","last_fullsized":"2024-05-09T05:58:32.931227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:29:03.459851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"29'10","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.170796+0000","last_change":"2024-05-09T05:53:24.143495+0000","last_active":"2024-05-09T05:58:30.170796+0000","last_peered":"2024-05-09T05:58:30.170796+0000","last_clean":"2024-05-09T05:58:30.170796+0000","last_became_active":"2024-05-09T05:53:24.143181+0000","last_became_peered":"2024-05-09T05:53:24.143181+0000","last_unstale":"2024-05-09T05:58:30.170796+0000","last_undegraded":"2024-05-09T05:58:30.170796+0000","last_fullsized":"2024-05-09T05:58:30.170796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:40:20.997659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"27'9","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:57:10.706735+0000","last_change":"2024-05-09T05:53:23.114815+0000","last_active":"2024-05-09T05:57:10.706735+0000","last_peered":"2024-05-09T05:57:10.706735+0000","last_clean":"2024-05-09T05:57:10.706735+0000","last_became_active":"2024-05-09T05:53:23.113524+0000","last_became_peered":"2024-05-09T05:53:23.113524+0000","last_unstale":"2024-05-09T05:57:10.706735+0000","last_undegraded":"2024-05-09T05:57:10.706735+0000","last_fullsized":"2024-05-09T05:57:10.706735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:35:45.537715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"29'327","reported_seq":351,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:32.902431+0000","last_change":"2024-05-09T05:53:28.226682+0000","last_active":"2024-05-09T05:58:32.902431+0000","last_peered":"2024-05-09T05:58:32.902431+0000","last_clean":"2024-05-09T05:58:32.902431+0000","last_became_active":"2024-05-09T05:53:28.226279+0000","last_became_peered":"2024-05-09T05:53:28.226279+0000","last_unstale":"2024-05-09T05:58:32.902431+0000","last_undegraded":"2024-05-09T05:58:32.902431+0000","last_fullsized":"2024-05-09T05:58:32.902431+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:15:55.146695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":327,"num_write_kb":892928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"29'6","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:39.737951+0000","last_change":"2024-05-09T05:58:39.738018+0000","last_active":"2024-05-09T05:58:39.737951+0000","last_peered":"2024-05-09T05:58:39.737951+0000","last_clean":"2024-05-09T05:58:39.737951+0000","last_became_active":"2024-05-09T05:53:24.134690+0000","last_became_peered":"2024-05-09T05:53:24.134690+0000","last_unstale":"2024-05-09T05:58:39.737951+0000","last_undegraded":"2024-05-09T05:58:39.737951+0000","last_fullsized":"2024-05-09T05:58:39.737951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-09T05:58:39.737769+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-09T05:58:39.737769+0000","last_clean_scrub_stamp":"2024-05-09T05:58:39.737769+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:20:52.374047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"29'106","reported_seq":151,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:41.565127+0000","last_change":"2024-05-09T05:58:41.565168+0000","last_active":"2024-05-09T05:58:41.565127+0000","last_peered":"2024-05-09T05:58:41.565127+0000","last_clean":"2024-05-09T05:58:41.565127+0000","last_became_active":"2024-05-09T05:53:23.119173+0000","last_became_peered":"2024-05-09T05:53:23.119173+0000","last_unstale":"2024-05-09T05:58:41.565127+0000","last_undegraded":"2024-05-09T05:58:41.565127+0000","last_fullsized":"2024-05-09T05:58:41.565127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'106","last_scrub_stamp":"2024-05-09T05:58:41.565053+0000","last_deep_scrub":"29'106","last_deep_scrub_stamp":"2024-05-09T05:58:41.565053+0000","last_clean_scrub_stamp":"2024-05-09T05:58:41.565053+0000","objects_scrubbed":6,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:44:09.320519+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":214081,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":103,"num_write_kb":251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"29'289","reported_seq":313,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:32.991639+0000","last_change":"2024-05-09T05:53:28.223167+0000","last_active":"2024-05-09T05:58:32.991639+0000","last_peered":"2024-05-09T05:58:32.991639+0000","last_clean":"2024-05-09T05:58:32.991639+0000","last_became_active":"2024-05-09T05:53:28.221846+0000","last_became_peered":"2024-05-09T05:53:28.221846+0000","last_unstale":"2024-05-09T05:58:32.991639+0000","last_undegraded":"2024-05-09T05:58:32.991639+0000","last_fullsized":"2024-05-09T05:58:32.991639+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":289,"log_dups_size":0,"ondisk_log_size":289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:47:12.366900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":786432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"29'11","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.160480+0000","last_change":"2024-05-09T05:53:24.133007+0000","last_active":"2024-05-09T05:58:30.160480+0000","last_peered":"2024-05-09T05:58:30.160480+0000","last_clean":"2024-05-09T05:58:30.160480+0000","last_became_active":"2024-05-09T05:53:24.132545+0000","last_became_peered":"2024-05-09T05:53:24.132545+0000","last_unstale":"2024-05-09T05:58:30.160480+0000","last_undegraded":"2024-05-09T05:58:30.160480+0000","last_fullsized":"2024-05-09T05:58:30.160480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:10:26.299015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"29'10","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.278556+0000","last_change":"2024-05-09T05:53:23.121124+0000","last_active":"2024-05-09T05:58:30.278556+0000","last_peered":"2024-05-09T05:58:30.278556+0000","last_clean":"2024-05-09T05:58:30.278556+0000","last_became_active":"2024-05-09T05:53:23.120303+0000","last_became_peered":"2024-05-09T05:53:23.120303+0000","last_unstale":"2024-05-09T05:58:30.278556+0000","last_undegraded":"2024-05-09T05:58:30.278556+0000","last_fullsized":"2024-05-09T05:58:30.278556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:36:49.445673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"29'297","reported_seq":322,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:33.004752+0000","last_change":"2024-05-09T05:53:28.188712+0000","last_active":"2024-05-09T05:58:33.004752+0000","last_peered":"2024-05-09T05:58:33.004752+0000","last_clean":"2024-05-09T05:58:33.004752+0000","last_became_active":"2024-05-09T05:53:28.184259+0000","last_became_peered":"2024-05-09T05:53:28.184259+0000","last_unstale":"2024-05-09T05:58:33.004752+0000","last_undegraded":"2024-05-09T05:58:33.004752+0000","last_fullsized":"2024-05-09T05:58:33.004752+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":297,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"29'9","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.183972+0000","last_change":"2024-05-09T05:53:24.146147+0000","last_active":"2024-05-09T05:58:30.183972+0000","last_peered":"2024-05-09T05:58:30.183972+0000","last_clean":"2024-05-09T05:58:30.183972+0000","last_became_active":"2024-05-09T05:53:24.145704+0000","last_became_peered":"2024-05-09T05:53:24.145704+0000","last_unstale":"2024-05-09T05:58:30.183972+0000","last_undegraded":"2024-05-09T05:58:30.183972+0000","last_fullsized":"2024-05-09T05:58:30.183972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:47:03.047479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"27'4","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:16.729448+0000","last_change":"2024-05-09T05:53:23.095689+0000","last_active":"2024-05-09T05:58:16.729448+0000","last_peered":"2024-05-09T05:58:16.729448+0000","last_clean":"2024-05-09T05:58:16.729448+0000","last_became_active":"2024-05-09T05:53:23.094889+0000","last_became_peered":"2024-05-09T05:53:23.094889+0000","last_unstale":"2024-05-09T05:58:16.729448+0000","last_undegraded":"2024-05-09T05:58:16.729448+0000","last_fullsized":"2024-05-09T05:58:16.729448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"29'297","reported_seq":321,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:32.947355+0000","last_change":"2024-05-09T05:53:28.223954+0000","last_active":"2024-05-09T05:58:32.947355+0000","last_peered":"2024-05-09T05:58:32.947355+0000","last_clean":"2024-05-09T05:58:32.947355+0000","last_became_active":"2024-05-09T05:53:28.222700+0000","last_became_peered":"2024-05-09T05:53:28.222700+0000","last_unstale":"2024-05-09T05:58:32.947355+0000","last_undegraded":"2024-05-09T05:58:32.947355+0000","last_fullsized":"2024-05-09T05:58:32.947355+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:17:17.864782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":297,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"29'10","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.161763+0000","last_change":"2024-05-09T05:53:24.140698+0000","last_active":"2024-05-09T05:58:30.161763+0000","last_peered":"2024-05-09T05:58:30.161763+0000","last_clean":"2024-05-09T05:58:30.161763+0000","last_became_active":"2024-05-09T05:53:24.139612+0000","last_became_peered":"2024-05-09T05:53:24.139612+0000","last_unstale":"2024-05-09T05:58:30.161763+0000","last_undegraded":"2024-05-09T05:58:30.161763+0000","last_fullsized":"2024-05-09T05:58:30.161763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"29'9","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:41.472431+0000","last_change":"2024-05-09T05:58:41.472647+0000","last_active":"2024-05-09T05:58:41.472431+0000","last_peered":"2024-05-09T05:58:41.472431+0000","last_clean":"2024-05-09T05:58:41.472431+0000","last_became_active":"2024-05-09T05:53:23.105346+0000","last_became_peered":"2024-05-09T05:53:23.105346+0000","last_unstale":"2024-05-09T05:58:41.472431+0000","last_undegraded":"2024-05-09T05:58:41.472431+0000","last_fullsized":"2024-05-09T05:58:41.472431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-05-09T05:58:41.472358+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-05-09T05:58:41.472358+0000","last_clean_scrub_stamp":"2024-05-09T05:58:41.472358+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:59:56.527270+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"29'327","reported_seq":351,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:33.005025+0000","last_change":"2024-05-09T05:53:28.194037+0000","last_active":"2024-05-09T05:58:33.005025+0000","last_peered":"2024-05-09T05:58:33.005025+0000","last_clean":"2024-05-09T05:58:33.005025+0000","last_became_active":"2024-05-09T05:53:28.192944+0000","last_became_peered":"2024-05-09T05:53:28.192944+0000","last_unstale":"2024-05-09T05:58:33.005025+0000","last_undegraded":"2024-05-09T05:58:33.005025+0000","last_fullsized":"2024-05-09T05:58:33.005025+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:28:47.664198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":327,"num_write_kb":892928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"29'273","reported_seq":297,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:32.994616+0000","last_change":"2024-05-09T05:53:28.226664+0000","last_active":"2024-05-09T05:58:32.994616+0000","last_peered":"2024-05-09T05:58:32.994616+0000","last_clean":"2024-05-09T05:58:32.994616+0000","last_became_active":"2024-05-09T05:53:28.222225+0000","last_became_peered":"2024-05-09T05:53:28.222225+0000","last_unstale":"2024-05-09T05:58:32.994616+0000","last_undegraded":"2024-05-09T05:58:32.994616+0000","last_fullsized":"2024-05-09T05:58:32.994616+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:24:23.614210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"29'11","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.193600+0000","last_change":"2024-05-09T05:53:24.128343+0000","last_active":"2024-05-09T05:58:30.193600+0000","last_peered":"2024-05-09T05:58:30.193600+0000","last_clean":"2024-05-09T05:58:30.193600+0000","last_became_active":"2024-05-09T05:53:24.127989+0000","last_became_peered":"2024-05-09T05:53:24.127989+0000","last_unstale":"2024-05-09T05:58:30.193600+0000","last_undegraded":"2024-05-09T05:58:30.193600+0000","last_fullsized":"2024-05-09T05:58:30.193600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:56:14.176175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:56:49.476291+0000","last_change":"2024-05-09T05:53:23.118882+0000","last_active":"2024-05-09T05:56:49.476291+0000","last_peered":"2024-05-09T05:56:49.476291+0000","last_clean":"2024-05-09T05:56:49.476291+0000","last_became_active":"2024-05-09T05:53:23.118119+0000","last_became_peered":"2024-05-09T05:53:23.118119+0000","last_unstale":"2024-05-09T05:56:49.476291+0000","last_undegraded":"2024-05-09T05:56:49.476291+0000","last_fullsized":"2024-05-09T05:56:49.476291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:06:48.203396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"29'267","reported_seq":291,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:33.001823+0000","last_change":"2024-05-09T05:53:28.235313+0000","last_active":"2024-05-09T05:58:33.001823+0000","last_peered":"2024-05-09T05:58:33.001823+0000","last_clean":"2024-05-09T05:58:33.001823+0000","last_became_active":"2024-05-09T05:53:28.234771+0000","last_became_peered":"2024-05-09T05:53:28.234771+0000","last_unstale":"2024-05-09T05:58:33.001823+0000","last_undegraded":"2024-05-09T05:58:33.001823+0000","last_fullsized":"2024-05-09T05:58:33.001823+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:38:46.942863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":267,"num_write_kb":729088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"29'8","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.179669+0000","last_change":"2024-05-09T05:53:24.141956+0000","last_active":"2024-05-09T05:58:30.179669+0000","last_peered":"2024-05-09T05:58:30.179669+0000","last_clean":"2024-05-09T05:58:30.179669+0000","last_became_active":"2024-05-09T05:53:24.139093+0000","last_became_peered":"2024-05-09T05:53:24.139093+0000","last_unstale":"2024-05-09T05:58:30.179669+0000","last_undegraded":"2024-05-09T05:58:30.179669+0000","last_fullsized":"2024-05-09T05:58:30.179669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:44:32.901168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"27'3","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:57:10.687185+0000","last_change":"2024-05-09T05:53:23.113865+0000","last_active":"2024-05-09T05:57:10.687185+0000","last_peered":"2024-05-09T05:57:10.687185+0000","last_clean":"2024-05-09T05:57:10.687185+0000","last_became_active":"2024-05-09T05:53:23.112020+0000","last_became_peered":"2024-05-09T05:53:23.112020+0000","last_unstale":"2024-05-09T05:57:10.687185+0000","last_undegraded":"2024-05-09T05:57:10.687185+0000","last_fullsized":"2024-05-09T05:57:10.687185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:37:04.425229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":14,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"26'7","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:56:44.375056+0000","last_change":"2024-05-09T05:53:23.127463+0000","last_active":"2024-05-09T05:56:44.375056+0000","last_peered":"2024-05-09T05:56:44.375056+0000","last_clean":"2024-05-09T05:56:44.375056+0000","last_became_active":"2024-05-09T05:53:23.126911+0000","last_became_peered":"2024-05-09T05:53:23.126911+0000","last_unstale":"2024-05-09T05:56:44.375056+0000","last_undegraded":"2024-05-09T05:56:44.375056+0000","last_fullsized":"2024-05-09T05:56:44.375056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:06:28.458926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"29'8","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.192543+0000","last_change":"2024-05-09T05:53:24.134391+0000","last_active":"2024-05-09T05:58:30.192543+0000","last_peered":"2024-05-09T05:58:30.192543+0000","last_clean":"2024-05-09T05:58:30.192543+0000","last_became_active":"2024-05-09T05:53:24.133994+0000","last_became_peered":"2024-05-09T05:53:24.133994+0000","last_unstale":"2024-05-09T05:58:30.192543+0000","last_undegraded":"2024-05-09T05:58:30.192543+0000","last_fullsized":"2024-05-09T05:58:30.192543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:30:32.872657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"29'297","reported_seq":321,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:32.911833+0000","last_change":"2024-05-09T05:53:28.223524+0000","last_active":"2024-05-09T05:58:32.911833+0000","last_peered":"2024-05-09T05:58:32.911833+0000","last_clean":"2024-05-09T05:58:32.911833+0000","last_became_active":"2024-05-09T05:53:28.222433+0000","last_became_peered":"2024-05-09T05:53:28.222433+0000","last_unstale":"2024-05-09T05:58:32.911833+0000","last_undegraded":"2024-05-09T05:58:32.911833+0000","last_fullsized":"2024-05-09T05:58:32.911833+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:52:35.361812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":297,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"29'7","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:24.721349+0000","last_change":"2024-05-09T05:53:23.133700+0000","last_active":"2024-05-09T05:58:24.721349+0000","last_peered":"2024-05-09T05:58:24.721349+0000","last_clean":"2024-05-09T05:58:24.721349+0000","last_became_active":"2024-05-09T05:53:23.132946+0000","last_became_peered":"2024-05-09T05:53:23.132946+0000","last_unstale":"2024-05-09T05:58:24.721349+0000","last_undegraded":"2024-05-09T05:58:24.721349+0000","last_fullsized":"2024-05-09T05:58:24.721349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:22.063568+0000","last_clean_scrub_stamp":"2024-05-09T05:53:22.063568+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:39:49.829592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"29'7","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.163778+0000","last_change":"2024-05-09T05:53:24.138174+0000","last_active":"2024-05-09T05:58:30.163778+0000","last_peered":"2024-05-09T05:58:30.163778+0000","last_clean":"2024-05-09T05:58:30.163778+0000","last_became_active":"2024-05-09T05:53:24.137794+0000","last_became_peered":"2024-05-09T05:53:24.137794+0000","last_unstale":"2024-05-09T05:58:30.163778+0000","last_undegraded":"2024-05-09T05:58:30.163778+0000","last_fullsized":"2024-05-09T05:58:30.163778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"29'312","reported_seq":336,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:32.958874+0000","last_change":"2024-05-09T05:53:28.238375+0000","last_active":"2024-05-09T05:58:32.958874+0000","last_peered":"2024-05-09T05:58:32.958874+0000","last_clean":"2024-05-09T05:58:32.958874+0000","last_became_active":"2024-05-09T05:53:28.237414+0000","last_became_peered":"2024-05-09T05:53:28.237414+0000","last_unstale":"2024-05-09T05:58:32.958874+0000","last_undegraded":"2024-05-09T05:58:32.958874+0000","last_fullsized":"2024-05-09T05:58:32.958874+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:13:50.396951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":851968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"29'9","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.147869+0000","last_change":"2024-05-09T05:53:24.130839+0000","last_active":"2024-05-09T05:58:30.147869+0000","last_peered":"2024-05-09T05:58:30.147869+0000","last_clean":"2024-05-09T05:58:30.147869+0000","last_became_active":"2024-05-09T05:53:24.130201+0000","last_became_peered":"2024-05-09T05:53:24.130201+0000","last_unstale":"2024-05-09T05:58:30.147869+0000","last_undegraded":"2024-05-09T05:58:30.147869+0000","last_fullsized":"2024-05-09T05:58:30.147869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"29'12","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.179014+0000","last_change":"2024-05-09T05:53:24.138681+0000","last_active":"2024-05-09T05:58:30.179014+0000","last_peered":"2024-05-09T05:58:30.179014+0000","last_clean":"2024-05-09T05:58:30.179014+0000","last_became_active":"2024-05-09T05:53:24.138366+0000","last_became_peered":"2024-05-09T05:53:24.138366+0000","last_unstale":"2024-05-09T05:58:30.179014+0000","last_undegraded":"2024-05-09T05:58:30.179014+0000","last_fullsized":"2024-05-09T05:58:30.179014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:49.856205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"29'8","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.159685+0000","last_change":"2024-05-09T05:53:24.139915+0000","last_active":"2024-05-09T05:58:30.159685+0000","last_peered":"2024-05-09T05:58:30.159685+0000","last_clean":"2024-05-09T05:58:30.159685+0000","last_became_active":"2024-05-09T05:53:24.139058+0000","last_became_peered":"2024-05-09T05:53:24.139058+0000","last_unstale":"2024-05-09T05:58:30.159685+0000","last_undegraded":"2024-05-09T05:58:30.159685+0000","last_fullsized":"2024-05-09T05:58:30.159685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:06:00.768431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"29'7","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.189065+0000","last_change":"2024-05-09T05:53:24.149759+0000","last_active":"2024-05-09T05:58:30.189065+0000","last_peered":"2024-05-09T05:58:30.189065+0000","last_clean":"2024-05-09T05:58:30.189065+0000","last_became_active":"2024-05-09T05:53:24.142812+0000","last_became_peered":"2024-05-09T05:53:24.142812+0000","last_unstale":"2024-05-09T05:58:30.189065+0000","last_undegraded":"2024-05-09T05:58:30.189065+0000","last_fullsized":"2024-05-09T05:58:30.189065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:04.522514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"29'4","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.185763+0000","last_change":"2024-05-09T05:53:24.135373+0000","last_active":"2024-05-09T05:58:30.185763+0000","last_peered":"2024-05-09T05:58:30.185763+0000","last_clean":"2024-05-09T05:58:30.185763+0000","last_became_active":"2024-05-09T05:53:24.135043+0000","last_became_peered":"2024-05-09T05:53:24.135043+0000","last_unstale":"2024-05-09T05:58:30.185763+0000","last_undegraded":"2024-05-09T05:58:30.185763+0000","last_fullsized":"2024-05-09T05:58:30.185763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:20:03.245696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"29'6","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.185380+0000","last_change":"2024-05-09T05:53:24.134712+0000","last_active":"2024-05-09T05:58:30.185380+0000","last_peered":"2024-05-09T05:58:30.185380+0000","last_clean":"2024-05-09T05:58:30.185380+0000","last_became_active":"2024-05-09T05:53:24.132453+0000","last_became_peered":"2024-05-09T05:53:24.132453+0000","last_unstale":"2024-05-09T05:58:30.185380+0000","last_undegraded":"2024-05-09T05:58:30.185380+0000","last_fullsized":"2024-05-09T05:58:30.185380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:47:30.716995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"29'15","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.161559+0000","last_change":"2024-05-09T05:53:24.140714+0000","last_active":"2024-05-09T05:58:30.161559+0000","last_peered":"2024-05-09T05:58:30.161559+0000","last_clean":"2024-05-09T05:58:30.161559+0000","last_became_active":"2024-05-09T05:53:24.140045+0000","last_became_peered":"2024-05-09T05:53:24.140045+0000","last_unstale":"2024-05-09T05:58:30.161559+0000","last_undegraded":"2024-05-09T05:58:30.161559+0000","last_fullsized":"2024-05-09T05:58:30.161559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"29'2","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.183512+0000","last_change":"2024-05-09T05:53:24.151591+0000","last_active":"2024-05-09T05:58:30.183512+0000","last_peered":"2024-05-09T05:58:30.183512+0000","last_clean":"2024-05-09T05:58:30.183512+0000","last_became_active":"2024-05-09T05:53:24.151275+0000","last_became_peered":"2024-05-09T05:53:24.151275+0000","last_unstale":"2024-05-09T05:58:30.183512+0000","last_undegraded":"2024-05-09T05:58:30.183512+0000","last_fullsized":"2024-05-09T05:58:30.183512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:28:28.552732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"29'6","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.183409+0000","last_change":"2024-05-09T05:53:24.144315+0000","last_active":"2024-05-09T05:58:30.183409+0000","last_peered":"2024-05-09T05:58:30.183409+0000","last_clean":"2024-05-09T05:58:30.183409+0000","last_became_active":"2024-05-09T05:53:24.144005+0000","last_became_peered":"2024-05-09T05:53:24.144005+0000","last_unstale":"2024-05-09T05:58:30.183409+0000","last_undegraded":"2024-05-09T05:58:30.183409+0000","last_fullsized":"2024-05-09T05:58:30.183409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:06:37.312541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"29'8","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.180625+0000","last_change":"2024-05-09T05:53:24.149852+0000","last_active":"2024-05-09T05:58:30.180625+0000","last_peered":"2024-05-09T05:58:30.180625+0000","last_clean":"2024-05-09T05:58:30.180625+0000","last_became_active":"2024-05-09T05:53:24.146965+0000","last_became_peered":"2024-05-09T05:53:24.146965+0000","last_unstale":"2024-05-09T05:58:30.180625+0000","last_undegraded":"2024-05-09T05:58:30.180625+0000","last_fullsized":"2024-05-09T05:58:30.180625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:02:26.991425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"29'10","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.147746+0000","last_change":"2024-05-09T05:53:24.131735+0000","last_active":"2024-05-09T05:58:30.147746+0000","last_peered":"2024-05-09T05:58:30.147746+0000","last_clean":"2024-05-09T05:58:30.147746+0000","last_became_active":"2024-05-09T05:53:24.131417+0000","last_became_peered":"2024-05-09T05:53:24.131417+0000","last_unstale":"2024-05-09T05:58:30.147746+0000","last_undegraded":"2024-05-09T05:58:30.147746+0000","last_fullsized":"2024-05-09T05:58:30.147746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"29'11","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.192644+0000","last_change":"2024-05-09T05:53:24.140697+0000","last_active":"2024-05-09T05:58:30.192644+0000","last_peered":"2024-05-09T05:58:30.192644+0000","last_clean":"2024-05-09T05:58:30.192644+0000","last_became_active":"2024-05-09T05:53:24.140024+0000","last_became_peered":"2024-05-09T05:53:24.140024+0000","last_unstale":"2024-05-09T05:58:30.192644+0000","last_undegraded":"2024-05-09T05:58:30.192644+0000","last_fullsized":"2024-05-09T05:58:30.192644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:14:14.543827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"29'8","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.156593+0000","last_change":"2024-05-09T05:53:24.136878+0000","last_active":"2024-05-09T05:58:30.156593+0000","last_peered":"2024-05-09T05:58:30.156593+0000","last_clean":"2024-05-09T05:58:30.156593+0000","last_became_active":"2024-05-09T05:53:24.136572+0000","last_became_peered":"2024-05-09T05:53:24.136572+0000","last_unstale":"2024-05-09T05:58:30.156593+0000","last_undegraded":"2024-05-09T05:58:30.156593+0000","last_fullsized":"2024-05-09T05:58:30.156593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"29'7","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.163381+0000","last_change":"2024-05-09T05:53:24.147372+0000","last_active":"2024-05-09T05:58:30.163381+0000","last_peered":"2024-05-09T05:58:30.163381+0000","last_clean":"2024-05-09T05:58:30.163381+0000","last_became_active":"2024-05-09T05:53:24.144573+0000","last_became_peered":"2024-05-09T05:53:24.144573+0000","last_unstale":"2024-05-09T05:58:30.163381+0000","last_undegraded":"2024-05-09T05:58:30.163381+0000","last_fullsized":"2024-05-09T05:58:30.163381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:51:09.845748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"29'10","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.179342+0000","last_change":"2024-05-09T05:53:24.135964+0000","last_active":"2024-05-09T05:58:30.179342+0000","last_peered":"2024-05-09T05:58:30.179342+0000","last_clean":"2024-05-09T05:58:30.179342+0000","last_became_active":"2024-05-09T05:53:24.135625+0000","last_became_peered":"2024-05-09T05:53:24.135625+0000","last_unstale":"2024-05-09T05:58:30.179342+0000","last_undegraded":"2024-05-09T05:58:30.179342+0000","last_fullsized":"2024-05-09T05:58:30.179342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:52:02.026146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"29'8","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.157333+0000","last_change":"2024-05-09T05:53:24.133916+0000","last_active":"2024-05-09T05:58:30.157333+0000","last_peered":"2024-05-09T05:58:30.157333+0000","last_clean":"2024-05-09T05:58:30.157333+0000","last_became_active":"2024-05-09T05:53:24.133405+0000","last_became_peered":"2024-05-09T05:53:24.133405+0000","last_unstale":"2024-05-09T05:58:30.157333+0000","last_undegraded":"2024-05-09T05:58:30.157333+0000","last_fullsized":"2024-05-09T05:58:30.157333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:30:16.477715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"29'9","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.158011+0000","last_change":"2024-05-09T05:53:24.139697+0000","last_active":"2024-05-09T05:58:30.158011+0000","last_peered":"2024-05-09T05:58:30.158011+0000","last_clean":"2024-05-09T05:58:30.158011+0000","last_became_active":"2024-05-09T05:53:24.139374+0000","last_became_peered":"2024-05-09T05:53:24.139374+0000","last_unstale":"2024-05-09T05:58:30.158011+0000","last_undegraded":"2024-05-09T05:58:30.158011+0000","last_fullsized":"2024-05-09T05:58:30.158011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:26:28.502867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"29'7","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.180122+0000","last_change":"2024-05-09T05:53:24.147755+0000","last_active":"2024-05-09T05:58:30.180122+0000","last_peered":"2024-05-09T05:58:30.180122+0000","last_clean":"2024-05-09T05:58:30.180122+0000","last_became_active":"2024-05-09T05:53:24.145616+0000","last_became_peered":"2024-05-09T05:53:24.145616+0000","last_unstale":"2024-05-09T05:58:30.180122+0000","last_undegraded":"2024-05-09T05:58:30.180122+0000","last_fullsized":"2024-05-09T05:58:30.180122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:21:10.387393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"29'8","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.185016+0000","last_change":"2024-05-09T05:53:24.131741+0000","last_active":"2024-05-09T05:58:30.185016+0000","last_peered":"2024-05-09T05:58:30.185016+0000","last_clean":"2024-05-09T05:58:30.185016+0000","last_became_active":"2024-05-09T05:53:24.128870+0000","last_became_peered":"2024-05-09T05:53:24.128870+0000","last_unstale":"2024-05-09T05:58:30.185016+0000","last_undegraded":"2024-05-09T05:58:30.185016+0000","last_fullsized":"2024-05-09T05:58:30.185016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:28:25.103524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"29'10","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.189062+0000","last_change":"2024-05-09T05:53:24.133443+0000","last_active":"2024-05-09T05:58:30.189062+0000","last_peered":"2024-05-09T05:58:30.189062+0000","last_clean":"2024-05-09T05:58:30.189062+0000","last_became_active":"2024-05-09T05:53:24.132688+0000","last_became_peered":"2024-05-09T05:53:24.132688+0000","last_unstale":"2024-05-09T05:58:30.189062+0000","last_undegraded":"2024-05-09T05:58:30.189062+0000","last_fullsized":"2024-05-09T05:58:30.189062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:43:24.750805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"29'7","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.156608+0000","last_change":"2024-05-09T05:53:24.142600+0000","last_active":"2024-05-09T05:58:30.156608+0000","last_peered":"2024-05-09T05:58:30.156608+0000","last_clean":"2024-05-09T05:58:30.156608+0000","last_became_active":"2024-05-09T05:53:24.142280+0000","last_became_peered":"2024-05-09T05:53:24.142280+0000","last_unstale":"2024-05-09T05:58:30.156608+0000","last_undegraded":"2024-05-09T05:58:30.156608+0000","last_fullsized":"2024-05-09T05:58:30.156608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"29'6","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.158029+0000","last_change":"2024-05-09T05:53:24.144839+0000","last_active":"2024-05-09T05:58:30.158029+0000","last_peered":"2024-05-09T05:58:30.158029+0000","last_clean":"2024-05-09T05:58:30.158029+0000","last_became_active":"2024-05-09T05:53:24.144381+0000","last_became_peered":"2024-05-09T05:53:24.144381+0000","last_unstale":"2024-05-09T05:58:30.158029+0000","last_undegraded":"2024-05-09T05:58:30.158029+0000","last_fullsized":"2024-05-09T05:58:30.158029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"29'16","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.147453+0000","last_change":"2024-05-09T05:53:24.131521+0000","last_active":"2024-05-09T05:58:30.147453+0000","last_peered":"2024-05-09T05:58:30.147453+0000","last_clean":"2024-05-09T05:58:30.147453+0000","last_became_active":"2024-05-09T05:53:24.131218+0000","last_became_peered":"2024-05-09T05:53:24.131218+0000","last_unstale":"2024-05-09T05:58:30.147453+0000","last_undegraded":"2024-05-09T05:58:30.147453+0000","last_fullsized":"2024-05-09T05:58:30.147453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"29'11","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.160853+0000","last_change":"2024-05-09T05:53:24.139922+0000","last_active":"2024-05-09T05:58:30.160853+0000","last_peered":"2024-05-09T05:58:30.160853+0000","last_clean":"2024-05-09T05:58:30.160853+0000","last_became_active":"2024-05-09T05:53:24.139473+0000","last_became_peered":"2024-05-09T05:53:24.139473+0000","last_unstale":"2024-05-09T05:58:30.160853+0000","last_undegraded":"2024-05-09T05:58:30.160853+0000","last_fullsized":"2024-05-09T05:58:30.160853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"29'9","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.180793+0000","last_change":"2024-05-09T05:53:24.143338+0000","last_active":"2024-05-09T05:58:30.180793+0000","last_peered":"2024-05-09T05:58:30.180793+0000","last_clean":"2024-05-09T05:58:30.180793+0000","last_became_active":"2024-05-09T05:53:24.143053+0000","last_became_peered":"2024-05-09T05:53:24.143053+0000","last_unstale":"2024-05-09T05:58:30.180793+0000","last_undegraded":"2024-05-09T05:58:30.180793+0000","last_fullsized":"2024-05-09T05:58:30.180793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:22:16.337090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.182643+0000","last_change":"2024-05-09T05:53:24.145517+0000","last_active":"2024-05-09T05:58:30.182643+0000","last_peered":"2024-05-09T05:58:30.182643+0000","last_clean":"2024-05-09T05:58:30.182643+0000","last_became_active":"2024-05-09T05:53:24.145150+0000","last_became_peered":"2024-05-09T05:53:24.145150+0000","last_unstale":"2024-05-09T05:58:30.182643+0000","last_undegraded":"2024-05-09T05:58:30.182643+0000","last_fullsized":"2024-05-09T05:58:30.182643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"29'6","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.182358+0000","last_change":"2024-05-09T05:53:24.129669+0000","last_active":"2024-05-09T05:58:30.182358+0000","last_peered":"2024-05-09T05:58:30.182358+0000","last_clean":"2024-05-09T05:58:30.182358+0000","last_became_active":"2024-05-09T05:53:24.129339+0000","last_became_peered":"2024-05-09T05:53:24.129339+0000","last_unstale":"2024-05-09T05:58:30.182358+0000","last_undegraded":"2024-05-09T05:58:30.182358+0000","last_fullsized":"2024-05-09T05:58:30.182358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"29'4","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.177512+0000","last_change":"2024-05-09T05:53:24.138914+0000","last_active":"2024-05-09T05:58:30.177512+0000","last_peered":"2024-05-09T05:58:30.177512+0000","last_clean":"2024-05-09T05:58:30.177512+0000","last_became_active":"2024-05-09T05:53:24.138499+0000","last_became_peered":"2024-05-09T05:53:24.138499+0000","last_unstale":"2024-05-09T05:58:30.177512+0000","last_undegraded":"2024-05-09T05:58:30.177512+0000","last_fullsized":"2024-05-09T05:58:30.177512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"29'8","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.233777+0000","last_change":"2024-05-09T05:53:24.144296+0000","last_active":"2024-05-09T05:58:30.233777+0000","last_peered":"2024-05-09T05:58:30.233777+0000","last_clean":"2024-05-09T05:58:30.233777+0000","last_became_active":"2024-05-09T05:53:24.143890+0000","last_became_peered":"2024-05-09T05:53:24.143890+0000","last_unstale":"2024-05-09T05:58:30.233777+0000","last_undegraded":"2024-05-09T05:58:30.233777+0000","last_fullsized":"2024-05-09T05:58:30.233777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"29'7","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.178572+0000","last_change":"2024-05-09T05:53:24.152635+0000","last_active":"2024-05-09T05:58:30.178572+0000","last_peered":"2024-05-09T05:58:30.178572+0000","last_clean":"2024-05-09T05:58:30.178572+0000","last_became_active":"2024-05-09T05:53:24.151674+0000","last_became_peered":"2024-05-09T05:53:24.151674+0000","last_unstale":"2024-05-09T05:58:30.178572+0000","last_undegraded":"2024-05-09T05:58:30.178572+0000","last_fullsized":"2024-05-09T05:58:30.178572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:18:47.495857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"29'4","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.177792+0000","last_change":"2024-05-09T05:53:24.152746+0000","last_active":"2024-05-09T05:58:30.177792+0000","last_peered":"2024-05-09T05:58:30.177792+0000","last_clean":"2024-05-09T05:58:30.177792+0000","last_became_active":"2024-05-09T05:53:24.151418+0000","last_became_peered":"2024-05-09T05:53:24.151418+0000","last_unstale":"2024-05-09T05:58:30.177792+0000","last_undegraded":"2024-05-09T05:58:30.177792+0000","last_fullsized":"2024-05-09T05:58:30.177792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:27:19.121790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"29'8","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.161163+0000","last_change":"2024-05-09T05:53:24.140908+0000","last_active":"2024-05-09T05:58:30.161163+0000","last_peered":"2024-05-09T05:58:30.161163+0000","last_clean":"2024-05-09T05:58:30.161163+0000","last_became_active":"2024-05-09T05:53:24.140589+0000","last_became_peered":"2024-05-09T05:53:24.140589+0000","last_unstale":"2024-05-09T05:58:30.161163+0000","last_undegraded":"2024-05-09T05:58:30.161163+0000","last_fullsized":"2024-05-09T05:58:30.161163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9216,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9217,"ondisk_log_size":9217,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":503,"ondisk_log_size":503,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":222778,"num_objects":99,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":153,"num_read_kb":159,"num_write":358,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":696320,"data_stored":445556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":337,"ondisk_log_size":337,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509508,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71708,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94300132,"statfs":{"total":96636764160,"available":96563335168,"internally_reserved":0,"allocated":348160,"data_stored":131030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":73071050},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509511,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71688,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94300152,"statfs":{"total":96636764160,"available":96563355648,"internally_reserved":0,"allocated":327680,"data_stored":132991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":73071047},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509511,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49788,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94322052,"statfs":{"total":96636764160,"available":96585781248,"internally_reserved":0,"allocated":577536,"data_stored":345366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509508,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58072,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313768,"statfs":{"total":96636764160,"available":96577298432,"internally_reserved":0,"allocated":540672,"data_stored":343596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509510,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68108,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94303732,"statfs":{"total":96636764160,"available":96567021568,"internally_reserved":0,"allocated":921600,"data_stored":721229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68811205},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509510,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53720,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94318120,"statfs":{"total":96636764160,"available":96581754880,"internally_reserved":0,"allocated":344064,"data_stored":133153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574916,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50132,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321708,"statfs":{"total":96636764160,"available":96585428992,"internally_reserved":0,"allocated":929792,"data_stored":721752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574917,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67552,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94304288,"statfs":{"total":96636764160,"available":96567590912,"internally_reserved":0,"allocated":352256,"data_stored":132751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68811207},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":3706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":233472,"data_stored":214149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":270336,"data_stored":215919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T05:58:43.821 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-05-09T05:53:22.063568+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.821 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-05-09T05:53:23.073858+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=23, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.821 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-05-09T05:53:27.153646+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=27, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.821 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-05-09T05:53:22.063568+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.821 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-05-09T05:53:23.073858+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=23, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.822 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-05-09T05:53:27.153646+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=27, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.822 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-05-09T05:53:22.063568+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.822 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-05-09T05:53:23.073858+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=23, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.822 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-05-09T05:53:27.153646+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=27, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.822 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-05-09T05:53:22.063568+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.822 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-09T05:53:23.073858+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=23, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.822 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-05-09T05:53:27.153646+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=27, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.822 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-05-09T05:53:23.073858+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=23, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.823 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-05-09T05:53:22.063568+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.823 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-05-09T05:53:27.153646+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=27, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.823 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-05-09T05:53:23.073858+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=23, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.823 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-05-09T05:53:22.063568+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.823 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-05-09T05:53:27.153646+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=27, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.823 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-05-09T05:53:23.073858+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=23, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.823 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-05-09T05:53:22.063568+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.823 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-05-09T05:53:27.153646+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=27, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.823 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-05-09T05:53:23.073858+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=23, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.824 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-05-09T05:53:22.063568+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.824 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-05-09T05:53:27.153646+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=27, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.824 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-05-09T05:53:23.073858+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=23, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.824 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-05-09T05:53:22.063568+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.824 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-05-09T05:53:27.153646+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=27, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.824 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-09T05:53:23.073858+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=23, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.824 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-05-09T05:53:22.063568+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.824 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-05-09T05:53:27.153646+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=27, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.824 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-05-09T05:53:23.073858+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=23, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.825 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-09T05:53:22.063568+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.825 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-05-09T05:53:27.153646+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=27, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.825 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-05-09T05:53:23.073858+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=23, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.825 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-05-09T05:53:22.063568+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.825 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-05-09T05:53:27.153646+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=27, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.825 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-05-09T05:53:22.063568+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.825 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-05-09T05:53:27.153646+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=27, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.825 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-05-09T05:53:23.073858+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=23, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.825 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-05-09T05:53:22.063568+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.826 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-05-09T05:53:27.153646+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=27, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.826 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-05-09T05:53:23.073858+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=23, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.826 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-09T05:53:22.063568+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.826 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-05-09T05:53:27.153646+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=27, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.826 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-09T05:53:23.073858+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=23, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.826 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-05-09T05:53:22.063568+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.826 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-05-09T05:53:27.153646+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=27, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.826 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-05-09T05:53:23.073858+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=23, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.826 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-05-09T05:53:22.063568+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.827 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-05-09T05:53:27.153646+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=27, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.827 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-09T05:53:23.073858+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=23, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.827 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-05-09T05:53:22.063568+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.827 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-05-09T05:53:27.153646+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=27, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.827 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-05-09T05:53:23.073858+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=23, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.827 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-05-09T05:53:22.063568+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.827 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-05-09T05:53:27.153646+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=27, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.827 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-05-09T05:53:23.073858+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=23, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.827 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-05-09T05:53:22.063568+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.828 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-05-09T05:53:27.153646+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=27, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.828 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-05-09T05:53:23.073858+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=23, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.828 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-05-09T05:53:22.063568+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.828 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-05-09T05:53:27.153646+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=27, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.828 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-05-09T05:53:23.073858+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=23, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.828 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-05-09T05:53:22.063568+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.828 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-05-09T05:53:27.153646+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=27, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.828 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-09T05:53:23.073858+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=23, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.828 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-05-09T05:53:22.063568+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.829 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-05-09T05:53:27.153646+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=27, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.829 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-05-09T05:53:23.073858+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=23, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.829 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-05-09T05:53:22.063568+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.829 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-05-09T05:53:27.153646+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=27, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.829 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-05-09T05:53:27.153646+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=27, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.829 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-05-09T05:53:23.073858+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=23, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.829 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-05-09T05:53:22.063568+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.829 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-05-09T05:53:27.153646+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=27, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.829 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-05-09T05:53:23.073858+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=23, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.830 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-05-09T05:53:22.063568+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.830 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-05-09T05:53:27.153646+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=27, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.830 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-05-09T05:53:23.073858+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=23, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.830 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-05-09T05:53:27.153646+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=27, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.830 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-05-09T05:53:27.153646+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=27, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.830 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-05-09T05:53:23.073858+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=23, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.830 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-05-09T05:53:22.063568+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.830 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-05-09T05:53:27.153646+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=27, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.830 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-05-09T05:53:23.073858+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=23, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.831 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-05-09T05:53:22.063568+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.831 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-05-09T05:53:22.063568+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.831 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-05-09T05:53:23.073858+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=23, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.831 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-05-09T05:53:27.153646+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=27, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.831 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-05-09T05:53:22.063568+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=22, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.831 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-05-09T05:53:23.073858+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=23, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.831 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-05-09T05:53:27.153646+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=27, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.832 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-05-09T05:53:23.073858+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=23, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.832 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-05-09T05:53:23.073858+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=23, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.832 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-05-09T05:53:23.073858+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=23, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.832 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-05-09T05:53:23.073858+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=23, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.832 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-05-09T05:53:23.073858+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=23, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.832 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-05-09T05:53:23.073858+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=23, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.832 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-05-09T05:53:23.073858+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=23, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.832 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-05-09T05:53:23.073858+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=23, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.832 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-05-09T05:53:23.073858+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=23, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.833 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-05-09T05:53:23.073858+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=23, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.833 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-05-09T05:53:23.073858+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=23, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.833 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-05-09T05:53:23.073858+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=23, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.833 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-05-09T05:53:23.073858+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=23, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.833 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-09T05:53:23.073858+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=23, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.833 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-05-09T05:53:23.073858+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=23, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.833 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-05-09T05:53:23.073858+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=23, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.833 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-09T05:53:23.073858+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=23, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.833 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-05-09T05:53:23.073858+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=23, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.833 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-05-09T05:53:23.073858+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=23, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.834 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-05-09T05:53:23.073858+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=23, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.834 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-05-09T05:53:23.073858+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=23, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.834 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-05-09T05:53:23.073858+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=23, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.834 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-05-09T05:53:23.073858+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=23, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.834 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-05-09T05:53:23.073858+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=23, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.834 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-05-09T05:53:23.073858+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=23, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.834 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-09T05:53:23.073858+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=23, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.834 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-05-09T05:53:23.073858+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=23, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.834 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-09T05:53:23.073858+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=23, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.835 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-05-09T05:53:23.073858+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=23, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.835 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-05-09T05:53:23.073858+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=23, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.835 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-05-09T05:53:23.073858+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=23, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.835 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-05-09T05:53:23.073858+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=23, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:58:43.835 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-09T05:58:57.179 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T05:58:57.182 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T05:59:03.837 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T05:59:03.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.011+0000 7f5c4ad78640 1 Processor -- start 2024-05-09T05:59:03.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.011+0000 7f5c4ad78640 1 -- start start 2024-05-09T05:59:03.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.011+0000 7f5c4ad78640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5c441537d0 0x7f5c44074740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:03.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.011+0000 7f5c4ad78640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5c44161d70 0x7f5c44164190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:03.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.011+0000 7f5c4ad78640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c440c72c0 con 0x7f5c440c77a0 2024-05-09T05:59:04.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.011+0000 7f5c4ad78640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f5c44074c80 con 0x7f5c441537d0 2024-05-09T05:59:04.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.011+0000 7f5c4ad78640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f5c440c7bb0 con 0x7f5c44161d70 2024-05-09T05:59:04.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.011+0000 7f5c48b14640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f5c440c77a0 0x7f5c44072e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:38222/0 (socket says 172.21.15.72:38222) 2024-05-09T05:59:04.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.011+0000 7f5c43fff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5c441537d0 0x7f5c44074740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:04.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.011+0000 7f5c48b14640 1 -- 172.21.15.72:0/122478698 learned_addr learned my addr 172.21.15.72:0/122478698 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:59:04.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.011+0000 7f5c49315640 1 --2- 172.21.15.72:0/122478698 >> v2:172.21.15.110:3300/0 conn(0x7f5c44161d70 0x7f5c44164190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:04.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.011+0000 7f5c437fe640 1 -- 172.21.15.72:0/122478698 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 381657711 0 0) 0x7f5c440c72c0 con 0x7f5c440c77a0 2024-05-09T05:59:04.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.011+0000 7f5c437fe640 1 -- 172.21.15.72:0/122478698 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c34003530 con 0x7f5c440c77a0 2024-05-09T05:59:04.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.011+0000 7f5c43fff640 1 -- 172.21.15.72:0/122478698 >> v2:172.21.15.110:3300/0 conn(0x7f5c44161d70 msgr2=0x7f5c44164190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:59:04.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.011+0000 7f5c43fff640 1 --2- 172.21.15.72:0/122478698 >> v2:172.21.15.110:3300/0 conn(0x7f5c44161d70 0x7f5c44164190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:04.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.011+0000 7f5c43fff640 1 -- 172.21.15.72:0/122478698 >> v1:172.21.15.72:6789/0 conn(0x7f5c440c77a0 legacy=0x7f5c44072e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:59:04.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.011+0000 7f5c43fff640 1 -- 172.21.15.72:0/122478698 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c44153be0 con 0x7f5c441537d0 2024-05-09T05:59:04.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.015+0000 7f5c43fff640 1 --2- 172.21.15.72:0/122478698 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c441537d0 0x7f5c44074740 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f5c440ca000 tx=0x7f5c3001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e81612ece2147fb5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:59:04.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.015+0000 7f5c437fe640 1 -- 172.21.15.72:0/122478698 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c300ab650 con 0x7f5c441537d0 2024-05-09T05:59:04.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.015+0000 7f5c437fe640 1 -- 172.21.15.72:0/122478698 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c300b0070 con 0x7f5c441537d0 2024-05-09T05:59:04.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.015+0000 7f5c437fe640 1 -- 172.21.15.72:0/122478698 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c300aba10 con 0x7f5c441537d0 2024-05-09T05:59:04.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.015+0000 7f5c4ad78640 1 -- 172.21.15.72:0/122478698 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c441537d0 msgr2=0x7f5c44074740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:59:04.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.015+0000 7f5c4ad78640 1 --2- 172.21.15.72:0/122478698 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c441537d0 0x7f5c44074740 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f5c440ca000 tx=0x7f5c3001c450 comp rx=0 tx=0).stop 2024-05-09T05:59:04.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.015+0000 7f5c4ad78640 1 -- 172.21.15.72:0/122478698 shutdown_connections 2024-05-09T05:59:04.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.015+0000 7f5c4ad78640 1 --2- 172.21.15.72:0/122478698 >> v2:172.21.15.110:3300/0 conn(0x7f5c44161d70 0x7f5c44164190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:04.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.015+0000 7f5c4ad78640 1 --2- 172.21.15.72:0/122478698 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c441537d0 0x7f5c44074740 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:04.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.015+0000 7f5c4ad78640 1 -- 172.21.15.72:0/122478698 >> 172.21.15.72:0/122478698 conn(0x7f5c440cde90 msgr2=0x7f5c440ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:59:04.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.015+0000 7f5c4ad78640 1 -- 172.21.15.72:0/122478698 shutdown_connections 2024-05-09T05:59:04.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.015+0000 7f5c4ad78640 1 -- 172.21.15.72:0/122478698 wait complete. 2024-05-09T05:59:04.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.015+0000 7f5c4ad78640 1 Processor -- start 2024-05-09T05:59:04.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.015+0000 7f5c4ad78640 1 -- start start 2024-05-09T05:59:04.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.019+0000 7f5c4ad78640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5c440c77a0 0x7f5c44147370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:04.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.019+0000 7f5c4ad78640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c441537d0 0x7f5c4414c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:04.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.019+0000 7f5c4ad78640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5c44161d70 0x7f5c4415abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:04.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.019+0000 7f5c4ad78640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f5c44072940 con 0x7f5c441537d0 2024-05-09T05:59:04.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.019+0000 7f5c4ad78640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f5c440740b0 con 0x7f5c440c77a0 2024-05-09T05:59:04.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.019+0000 7f5c4ad78640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f5c440c4cb0 con 0x7f5c44161d70 2024-05-09T05:59:04.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.019+0000 7f5c43fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c441537d0 0x7f5c4414c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:04.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.019+0000 7f5c43fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c441537d0 0x7f5c4414c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40592/0 (socket says 172.21.15.72:40592) 2024-05-09T05:59:04.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.019+0000 7f5c43fff640 1 -- 172.21.15.72:0/1091490671 learned_addr learned my addr 172.21.15.72:0/1091490671 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:59:04.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.019+0000 7f5c48b14640 1 --2- 172.21.15.72:0/1091490671 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5c440c77a0 0x7f5c44147370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:04.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.019+0000 7f5c49315640 1 --2- 172.21.15.72:0/1091490671 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5c44161d70 0x7f5c4415abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:04.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.019+0000 7f5c43fff640 1 -- 172.21.15.72:0/1091490671 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5c44161d70 msgr2=0x7f5c4415abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:59:04.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.019+0000 7f5c43fff640 1 --2- 172.21.15.72:0/1091490671 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5c44161d70 0x7f5c4415abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:04.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.019+0000 7f5c43fff640 1 -- 172.21.15.72:0/1091490671 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5c440c77a0 msgr2=0x7f5c44147370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:59:04.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.019+0000 7f5c43fff640 1 --2- 172.21.15.72:0/1091490671 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5c440c77a0 0x7f5c44147370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:04.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.019+0000 7f5c43fff640 1 -- 172.21.15.72:0/1091490671 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c4415c320 con 0x7f5c441537d0 2024-05-09T05:59:04.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.019+0000 7f5c49315640 1 --2- 172.21.15.72:0/1091490671 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5c44161d70 0x7f5c4415abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:59:04.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.019+0000 7f5c43fff640 1 --2- 172.21.15.72:0/1091490671 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c441537d0 0x7f5c4414c5b0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f5c300ad040 tx=0x7f5c3001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:59:04.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.019+0000 7f5c417fa640 1 -- 172.21.15.72:0/1091490671 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c300bf610 con 0x7f5c441537d0 2024-05-09T05:59:04.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.019+0000 7f5c417fa640 1 -- 172.21.15.72:0/1091490671 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c300bf7d0 con 0x7f5c441537d0 2024-05-09T05:59:04.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.019+0000 7f5c4ad78640 1 -- 172.21.15.72:0/1091490671 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c4415c600 con 0x7f5c441537d0 2024-05-09T05:59:04.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.019+0000 7f5c417fa640 1 -- 172.21.15.72:0/1091490671 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c300bfbc0 con 0x7f5c441537d0 2024-05-09T05:59:04.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.019+0000 7f5c4ad78640 1 -- 172.21.15.72:0/1091490671 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c4415cbc0 con 0x7f5c441537d0 2024-05-09T05:59:04.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.019+0000 7f5c4ad78640 1 -- 172.21.15.72:0/1091490671 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c4406a520 con 0x7f5c441537d0 2024-05-09T05:59:04.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.019+0000 7f5c417fa640 1 -- 172.21.15.72:0/1091490671 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f5c300bd020 con 0x7f5c441537d0 2024-05-09T05:59:04.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.023+0000 7f5c417fa640 1 --2- 172.21.15.72:0/1091490671 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f5c2806f400 0x7f5c28071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:04.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.023+0000 7f5c417fa640 1 -- 172.21.15.72:0/1091490671 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6762+0+0 (secure 0 0 0) 0x7f5c30129f70 con 0x7f5c441537d0 2024-05-09T05:59:04.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.023+0000 7f5c48b14640 1 --2- 172.21.15.72:0/1091490671 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f5c2806f400 0x7f5c28071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:04.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.023+0000 7f5c48b14640 1 --2- 172.21.15.72:0/1091490671 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f5c2806f400 0x7f5c28071910 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5c38007a70 tx=0x7f5c38009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:59:04.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.027+0000 7f5c417fa640 1 -- 172.21.15.72:0/1091490671 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f5c30016070 con 0x7f5c441537d0 2024-05-09T05:59:04.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.187+0000 7f5c4ad78640 1 -- 172.21.15.72:0/1091490671 --> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5c44072c50 con 0x7f5c2806f400 2024-05-09T05:59:04.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.211+0000 7f5c417fa640 1 -- 172.21.15.72:0/1091490671 <== mgr.4102 v2:172.21.15.110:6832/1113420672 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+333319 (secure 0 0 0) 0x7f5c44072c50 con 0x7f5c2806f400 2024-05-09T05:59:04.202 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:59:04.204 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2024-05-09T05:59:04.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.215+0000 7f5c4ad78640 1 -- 172.21.15.72:0/1091490671 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f5c2806f400 msgr2=0x7f5c28071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:59:04.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.215+0000 7f5c4ad78640 1 --2- 172.21.15.72:0/1091490671 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f5c2806f400 0x7f5c28071910 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5c38007a70 tx=0x7f5c38009040 comp rx=0 tx=0).stop 2024-05-09T05:59:04.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.215+0000 7f5c4ad78640 1 -- 172.21.15.72:0/1091490671 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c441537d0 msgr2=0x7f5c4414c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:59:04.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.215+0000 7f5c4ad78640 1 --2- 172.21.15.72:0/1091490671 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c441537d0 0x7f5c4414c5b0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f5c300ad040 tx=0x7f5c3001ac90 comp rx=0 tx=0).stop 2024-05-09T05:59:04.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.215+0000 7f5c4ad78640 1 -- 172.21.15.72:0/1091490671 shutdown_connections 2024-05-09T05:59:04.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.215+0000 7f5c4ad78640 1 --2- 172.21.15.72:0/1091490671 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f5c2806f400 0x7f5c28071910 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:04.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.215+0000 7f5c4ad78640 1 --2- 172.21.15.72:0/1091490671 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5c44161d70 0x7f5c4415abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:04.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.215+0000 7f5c4ad78640 1 --2- 172.21.15.72:0/1091490671 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c441537d0 0x7f5c4414c5b0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:04.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.215+0000 7f5c4ad78640 1 --2- 172.21.15.72:0/1091490671 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5c440c77a0 0x7f5c44147370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:04.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.215+0000 7f5c4ad78640 1 -- 172.21.15.72:0/1091490671 >> 172.21.15.72:0/1091490671 conn(0x7f5c440cde90 msgr2=0x7f5c4414fc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:59:04.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.215+0000 7f5c4ad78640 1 -- 172.21.15.72:0/1091490671 shutdown_connections 2024-05-09T05:59:04.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:04.215+0000 7f5c4ad78640 1 -- 172.21.15.72:0/1091490671 wait complete. 2024-05-09T05:59:04.226 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":199,"stamp":"2024-05-09T05:59:02.615814+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":813146,"num_objects":101,"num_object_clones":0,"num_object_copies":202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":101,"num_whiteouts":0,"num_read":219,"num_read_kb":214,"num_write":9675,"num_write_kb":25167793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10214,"ondisk_log_size":10214,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":490768,"kb_used_data":4240,"kb_used_omap":12,"kb_used_meta":486451,"kb_avail":754483952,"statfs":{"total":773094113280,"available":772591566848,"internally_reserved":0,"allocated":4341760,"data_stored":2661868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":498126385},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006063"},"pg_stats":[{"pgid":"2.1f","version":"29'21","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:46.166208+0000","last_change":"2024-05-09T05:58:46.166296+0000","last_active":"2024-05-09T05:58:46.166208+0000","last_peered":"2024-05-09T05:58:46.166208+0000","last_clean":"2024-05-09T05:58:46.166208+0000","last_became_active":"2024-05-09T05:53:23.121097+0000","last_became_peered":"2024-05-09T05:53:23.121097+0000","last_unstale":"2024-05-09T05:58:46.166208+0000","last_undegraded":"2024-05-09T05:58:46.166208+0000","last_fullsized":"2024-05-09T05:58:46.166208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'21","last_scrub_stamp":"2024-05-09T05:58:46.166000+0000","last_deep_scrub":"29'21","last_deep_scrub_stamp":"2024-05-09T05:58:46.166000+0000","last_clean_scrub_stamp":"2024-05-09T05:58:46.166000+0000","objects_scrubbed":6,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:30:36.128640+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"29'5","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:45.796855+0000","last_change":"2024-05-09T05:58:45.796982+0000","last_active":"2024-05-09T05:58:45.796855+0000","last_peered":"2024-05-09T05:58:45.796855+0000","last_clean":"2024-05-09T05:58:45.796855+0000","last_became_active":"2024-05-09T05:53:24.146540+0000","last_became_peered":"2024-05-09T05:53:24.146540+0000","last_unstale":"2024-05-09T05:58:45.796855+0000","last_undegraded":"2024-05-09T05:58:45.796855+0000","last_fullsized":"2024-05-09T05:58:45.796855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-05-09T05:58:45.796497+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-05-09T05:58:45.796497+0000","last_clean_scrub_stamp":"2024-05-09T05:58:45.796497+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:53:20.097174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"29'306","reported_seq":339,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:51.618677+0000","last_change":"2024-05-09T05:58:51.618753+0000","last_active":"2024-05-09T05:58:51.618677+0000","last_peered":"2024-05-09T05:58:51.618677+0000","last_clean":"2024-05-09T05:58:51.618677+0000","last_became_active":"2024-05-09T05:53:28.235305+0000","last_became_peered":"2024-05-09T05:53:28.235305+0000","last_unstale":"2024-05-09T05:58:51.618677+0000","last_undegraded":"2024-05-09T05:58:51.618677+0000","last_fullsized":"2024-05-09T05:58:51.618677+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'306","last_scrub_stamp":"2024-05-09T05:58:51.618468+0000","last_deep_scrub":"29'306","last_deep_scrub_stamp":"2024-05-09T05:58:51.618468+0000","last_clean_scrub_stamp":"2024-05-09T05:58:51.618468+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:31:52.722355+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":306,"num_write_kb":835584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"25'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:48.853168+0000","last_change":"2024-05-09T05:58:48.853260+0000","last_active":"2024-05-09T05:58:48.853168+0000","last_peered":"2024-05-09T05:58:48.853168+0000","last_clean":"2024-05-09T05:58:48.853168+0000","last_became_active":"2024-05-09T05:53:23.138431+0000","last_became_peered":"2024-05-09T05:53:23.138431+0000","last_unstale":"2024-05-09T05:58:48.853168+0000","last_undegraded":"2024-05-09T05:58:48.853168+0000","last_fullsized":"2024-05-09T05:58:48.853168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-05-09T05:58:48.852956+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-05-09T05:58:48.852956+0000","last_clean_scrub_stamp":"2024-05-09T05:58:48.852956+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:37:54.240412+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"29'6","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:55.936090+0000","last_change":"2024-05-09T05:58:55.936241+0000","last_active":"2024-05-09T05:58:55.936090+0000","last_peered":"2024-05-09T05:58:55.936090+0000","last_clean":"2024-05-09T05:58:55.936090+0000","last_became_active":"2024-05-09T05:53:24.151407+0000","last_became_peered":"2024-05-09T05:53:24.151407+0000","last_unstale":"2024-05-09T05:58:55.936090+0000","last_undegraded":"2024-05-09T05:58:55.936090+0000","last_fullsized":"2024-05-09T05:58:55.936090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-09T05:58:55.935842+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-09T05:58:55.935842+0000","last_clean_scrub_stamp":"2024-05-09T05:58:55.935842+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:19:45.145948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"29'339","reported_seq":372,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:54.529210+0000","last_change":"2024-05-09T05:58:54.529279+0000","last_active":"2024-05-09T05:58:54.529210+0000","last_peered":"2024-05-09T05:58:54.529210+0000","last_clean":"2024-05-09T05:58:54.529210+0000","last_became_active":"2024-05-09T05:53:28.213021+0000","last_became_peered":"2024-05-09T05:53:28.213021+0000","last_unstale":"2024-05-09T05:58:54.529210+0000","last_undegraded":"2024-05-09T05:58:54.529210+0000","last_fullsized":"2024-05-09T05:58:54.529210+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'339","last_scrub_stamp":"2024-05-09T05:58:54.529011+0000","last_deep_scrub":"29'339","last_deep_scrub_stamp":"2024-05-09T05:58:54.529011+0000","last_clean_scrub_stamp":"2024-05-09T05:58:54.529011+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:09:21.016415+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":925696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"29'22","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:41.829454+0000","last_change":"2024-05-09T05:58:41.829530+0000","last_active":"2024-05-09T05:58:41.829454+0000","last_peered":"2024-05-09T05:58:41.829454+0000","last_clean":"2024-05-09T05:58:41.829454+0000","last_became_active":"2024-05-09T05:53:23.094826+0000","last_became_peered":"2024-05-09T05:53:23.094826+0000","last_unstale":"2024-05-09T05:58:41.829454+0000","last_undegraded":"2024-05-09T05:58:41.829454+0000","last_fullsized":"2024-05-09T05:58:41.829454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'22","last_scrub_stamp":"2024-05-09T05:58:41.829340+0000","last_deep_scrub":"29'22","last_deep_scrub_stamp":"2024-05-09T05:58:41.829340+0000","last_clean_scrub_stamp":"2024-05-09T05:58:41.829340+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:43:51.707469+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"29'9","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:43.498697+0000","last_change":"2024-05-09T05:58:43.498722+0000","last_active":"2024-05-09T05:58:43.498697+0000","last_peered":"2024-05-09T05:58:43.498697+0000","last_clean":"2024-05-09T05:58:43.498697+0000","last_became_active":"2024-05-09T05:53:24.134610+0000","last_became_peered":"2024-05-09T05:53:24.134610+0000","last_unstale":"2024-05-09T05:58:43.498697+0000","last_undegraded":"2024-05-09T05:58:43.498697+0000","last_fullsized":"2024-05-09T05:58:43.498697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-05-09T05:58:43.498621+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-05-09T05:58:43.498621+0000","last_clean_scrub_stamp":"2024-05-09T05:58:43.498621+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:03:41.573691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"29'273","reported_seq":306,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:53.517350+0000","last_change":"2024-05-09T05:58:53.517422+0000","last_active":"2024-05-09T05:58:53.517350+0000","last_peered":"2024-05-09T05:58:53.517350+0000","last_clean":"2024-05-09T05:58:53.517350+0000","last_became_active":"2024-05-09T05:53:28.205229+0000","last_became_peered":"2024-05-09T05:53:28.205229+0000","last_unstale":"2024-05-09T05:58:53.517350+0000","last_undegraded":"2024-05-09T05:58:53.517350+0000","last_fullsized":"2024-05-09T05:58:53.517350+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'273","last_scrub_stamp":"2024-05-09T05:58:53.517154+0000","last_deep_scrub":"29'273","last_deep_scrub_stamp":"2024-05-09T05:58:53.517154+0000","last_clean_scrub_stamp":"2024-05-09T05:58:53.517154+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:39:54.292745+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"29'8","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:43.851258+0000","last_change":"2024-05-09T05:58:43.851288+0000","last_active":"2024-05-09T05:58:43.851258+0000","last_peered":"2024-05-09T05:58:43.851258+0000","last_clean":"2024-05-09T05:58:43.851258+0000","last_became_active":"2024-05-09T05:53:23.094760+0000","last_became_peered":"2024-05-09T05:53:23.094760+0000","last_unstale":"2024-05-09T05:58:43.851258+0000","last_undegraded":"2024-05-09T05:58:43.851258+0000","last_fullsized":"2024-05-09T05:58:43.851258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-09T05:58:43.851185+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-09T05:58:43.851185+0000","last_clean_scrub_stamp":"2024-05-09T05:58:43.851185+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:09:07.685151+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"29'15","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:42.284356+0000","last_change":"2024-05-09T05:58:42.284420+0000","last_active":"2024-05-09T05:58:42.284356+0000","last_peered":"2024-05-09T05:58:42.284356+0000","last_clean":"2024-05-09T05:58:42.284356+0000","last_became_active":"2024-05-09T05:53:24.139109+0000","last_became_peered":"2024-05-09T05:53:24.139109+0000","last_unstale":"2024-05-09T05:58:42.284356+0000","last_undegraded":"2024-05-09T05:58:42.284356+0000","last_fullsized":"2024-05-09T05:58:42.284356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-05-09T05:58:42.284169+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-05-09T05:58:42.284169+0000","last_clean_scrub_stamp":"2024-05-09T05:58:42.284169+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:49:09.248349+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"29'252","reported_seq":285,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:55.535102+0000","last_change":"2024-05-09T05:58:55.535180+0000","last_active":"2024-05-09T05:58:55.535102+0000","last_peered":"2024-05-09T05:58:55.535102+0000","last_clean":"2024-05-09T05:58:55.535102+0000","last_became_active":"2024-05-09T05:53:28.215482+0000","last_became_peered":"2024-05-09T05:53:28.215482+0000","last_unstale":"2024-05-09T05:58:55.535102+0000","last_undegraded":"2024-05-09T05:58:55.535102+0000","last_fullsized":"2024-05-09T05:58:55.535102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'252","last_scrub_stamp":"2024-05-09T05:58:55.534888+0000","last_deep_scrub":"29'252","last_deep_scrub_stamp":"2024-05-09T05:58:55.534888+0000","last_clean_scrub_stamp":"2024-05-09T05:58:55.534888+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:56:48.654742+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":688128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"29'5","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:48.310499+0000","last_change":"2024-05-09T05:58:48.310570+0000","last_active":"2024-05-09T05:58:48.310499+0000","last_peered":"2024-05-09T05:58:48.310499+0000","last_clean":"2024-05-09T05:58:48.310499+0000","last_became_active":"2024-05-09T05:53:24.132118+0000","last_became_peered":"2024-05-09T05:53:24.132118+0000","last_unstale":"2024-05-09T05:58:48.310499+0000","last_undegraded":"2024-05-09T05:58:48.310499+0000","last_fullsized":"2024-05-09T05:58:48.310499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-05-09T05:58:48.310293+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-05-09T05:58:48.310293+0000","last_clean_scrub_stamp":"2024-05-09T05:58:48.310293+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:34:14.471232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"29'7","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:52.315519+0000","last_change":"2024-05-09T05:58:52.315599+0000","last_active":"2024-05-09T05:58:52.315519+0000","last_peered":"2024-05-09T05:58:52.315519+0000","last_clean":"2024-05-09T05:58:52.315519+0000","last_became_active":"2024-05-09T05:53:23.114179+0000","last_became_peered":"2024-05-09T05:53:23.114179+0000","last_unstale":"2024-05-09T05:58:52.315519+0000","last_undegraded":"2024-05-09T05:58:52.315519+0000","last_fullsized":"2024-05-09T05:58:52.315519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-05-09T05:58:52.315318+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-05-09T05:58:52.315318+0000","last_clean_scrub_stamp":"2024-05-09T05:58:52.315318+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:55:03.917904+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"29'309","reported_seq":334,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:33.003456+0000","last_change":"2024-05-09T05:53:28.227135+0000","last_active":"2024-05-09T05:58:33.003456+0000","last_peered":"2024-05-09T05:58:33.003456+0000","last_clean":"2024-05-09T05:58:33.003456+0000","last_became_active":"2024-05-09T05:53:28.226427+0000","last_became_peered":"2024-05-09T05:53:28.226427+0000","last_unstale":"2024-05-09T05:58:33.003456+0000","last_undegraded":"2024-05-09T05:58:33.003456+0000","last_fullsized":"2024-05-09T05:58:33.003456+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":309,"num_write_kb":843776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"29'8","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:47.543862+0000","last_change":"2024-05-09T05:58:47.543931+0000","last_active":"2024-05-09T05:58:47.543862+0000","last_peered":"2024-05-09T05:58:47.543862+0000","last_clean":"2024-05-09T05:58:47.543862+0000","last_became_active":"2024-05-09T05:53:24.135580+0000","last_became_peered":"2024-05-09T05:53:24.135580+0000","last_unstale":"2024-05-09T05:58:47.543862+0000","last_undegraded":"2024-05-09T05:58:47.543862+0000","last_fullsized":"2024-05-09T05:58:47.543862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-09T05:58:47.543656+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-09T05:58:47.543656+0000","last_clean_scrub_stamp":"2024-05-09T05:58:47.543656+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:27:14.809903+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"29'5","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:45.719258+0000","last_change":"2024-05-09T05:58:45.719429+0000","last_active":"2024-05-09T05:58:45.719258+0000","last_peered":"2024-05-09T05:58:45.719258+0000","last_clean":"2024-05-09T05:58:45.719258+0000","last_became_active":"2024-05-09T05:53:23.142018+0000","last_became_peered":"2024-05-09T05:53:23.142018+0000","last_unstale":"2024-05-09T05:58:45.719258+0000","last_undegraded":"2024-05-09T05:58:45.719258+0000","last_fullsized":"2024-05-09T05:58:45.719258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-05-09T05:58:45.718909+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-05-09T05:58:45.718909+0000","last_clean_scrub_stamp":"2024-05-09T05:58:45.718909+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:33:47.058865+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"29'291","reported_seq":324,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:56.761212+0000","last_change":"2024-05-09T05:58:56.761291+0000","last_active":"2024-05-09T05:58:56.761212+0000","last_peered":"2024-05-09T05:58:56.761212+0000","last_clean":"2024-05-09T05:58:56.761212+0000","last_became_active":"2024-05-09T05:53:28.213623+0000","last_became_peered":"2024-05-09T05:53:28.213623+0000","last_unstale":"2024-05-09T05:58:56.761212+0000","last_undegraded":"2024-05-09T05:58:56.761212+0000","last_fullsized":"2024-05-09T05:58:56.761212+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'291","last_scrub_stamp":"2024-05-09T05:58:56.760985+0000","last_deep_scrub":"29'291","last_deep_scrub_stamp":"2024-05-09T05:58:56.760985+0000","last_clean_scrub_stamp":"2024-05-09T05:58:56.760985+0000","objects_scrubbed":0,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:11:17.325743+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":291,"num_write_kb":794624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"29'9","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:50.211854+0000","last_change":"2024-05-09T05:58:50.211921+0000","last_active":"2024-05-09T05:58:50.211854+0000","last_peered":"2024-05-09T05:58:50.211854+0000","last_clean":"2024-05-09T05:58:50.211854+0000","last_became_active":"2024-05-09T05:53:24.129938+0000","last_became_peered":"2024-05-09T05:53:24.129938+0000","last_unstale":"2024-05-09T05:58:50.211854+0000","last_undegraded":"2024-05-09T05:58:50.211854+0000","last_fullsized":"2024-05-09T05:58:50.211854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-05-09T05:58:50.211656+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-05-09T05:58:50.211656+0000","last_clean_scrub_stamp":"2024-05-09T05:58:50.211656+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:13:39.451113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"29'11","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:45.207808+0000","last_change":"2024-05-09T05:58:45.207885+0000","last_active":"2024-05-09T05:58:45.207808+0000","last_peered":"2024-05-09T05:58:45.207808+0000","last_clean":"2024-05-09T05:58:45.207808+0000","last_became_active":"2024-05-09T05:53:23.110140+0000","last_became_peered":"2024-05-09T05:53:23.110140+0000","last_unstale":"2024-05-09T05:58:45.207808+0000","last_undegraded":"2024-05-09T05:58:45.207808+0000","last_fullsized":"2024-05-09T05:58:45.207808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'11","last_scrub_stamp":"2024-05-09T05:58:45.207590+0000","last_deep_scrub":"29'11","last_deep_scrub_stamp":"2024-05-09T05:58:45.207590+0000","last_clean_scrub_stamp":"2024-05-09T05:58:45.207590+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:16:12.036932+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"29'267","reported_seq":300,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:50.596816+0000","last_change":"2024-05-09T05:58:50.596965+0000","last_active":"2024-05-09T05:58:50.596816+0000","last_peered":"2024-05-09T05:58:50.596816+0000","last_clean":"2024-05-09T05:58:50.596816+0000","last_became_active":"2024-05-09T05:53:28.227087+0000","last_became_peered":"2024-05-09T05:53:28.227087+0000","last_unstale":"2024-05-09T05:58:50.596816+0000","last_undegraded":"2024-05-09T05:58:50.596816+0000","last_fullsized":"2024-05-09T05:58:50.596816+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'267","last_scrub_stamp":"2024-05-09T05:58:50.596554+0000","last_deep_scrub":"29'267","last_deep_scrub_stamp":"2024-05-09T05:58:50.596554+0000","last_clean_scrub_stamp":"2024-05-09T05:58:50.596554+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:46.245808+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":267,"num_write_kb":729088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"29'2","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.177708+0000","last_change":"2024-05-09T05:53:24.147343+0000","last_active":"2024-05-09T05:58:30.177708+0000","last_peered":"2024-05-09T05:58:30.177708+0000","last_clean":"2024-05-09T05:58:30.177708+0000","last_became_active":"2024-05-09T05:53:24.144596+0000","last_became_peered":"2024-05-09T05:53:24.144596+0000","last_unstale":"2024-05-09T05:58:30.177708+0000","last_undegraded":"2024-05-09T05:58:30.177708+0000","last_fullsized":"2024-05-09T05:58:30.177708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"29'3","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:44.857198+0000","last_change":"2024-05-09T05:58:44.857375+0000","last_active":"2024-05-09T05:58:44.857198+0000","last_peered":"2024-05-09T05:58:44.857198+0000","last_clean":"2024-05-09T05:58:44.857198+0000","last_became_active":"2024-05-09T05:53:23.102420+0000","last_became_peered":"2024-05-09T05:53:23.102420+0000","last_unstale":"2024-05-09T05:58:44.857198+0000","last_undegraded":"2024-05-09T05:58:44.857198+0000","last_fullsized":"2024-05-09T05:58:44.857198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-05-09T05:58:44.856953+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-05-09T05:58:44.856953+0000","last_clean_scrub_stamp":"2024-05-09T05:58:44.856953+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:10:23.476072+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"29'288","reported_seq":321,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:51.505136+0000","last_change":"2024-05-09T05:58:51.505210+0000","last_active":"2024-05-09T05:58:51.505136+0000","last_peered":"2024-05-09T05:58:51.505136+0000","last_clean":"2024-05-09T05:58:51.505136+0000","last_became_active":"2024-05-09T05:53:28.194915+0000","last_became_peered":"2024-05-09T05:53:28.194915+0000","last_unstale":"2024-05-09T05:58:51.505136+0000","last_undegraded":"2024-05-09T05:58:51.505136+0000","last_fullsized":"2024-05-09T05:58:51.505136+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'288","last_scrub_stamp":"2024-05-09T05:58:51.504927+0000","last_deep_scrub":"29'288","last_deep_scrub_stamp":"2024-05-09T05:58:51.504927+0000","last_clean_scrub_stamp":"2024-05-09T05:58:51.504927+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:29:10.381536+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":786432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"29'7","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:49.211270+0000","last_change":"2024-05-09T05:58:49.211341+0000","last_active":"2024-05-09T05:58:49.211270+0000","last_peered":"2024-05-09T05:58:49.211270+0000","last_clean":"2024-05-09T05:58:49.211270+0000","last_became_active":"2024-05-09T05:53:24.129953+0000","last_became_peered":"2024-05-09T05:53:24.129953+0000","last_unstale":"2024-05-09T05:58:49.211270+0000","last_undegraded":"2024-05-09T05:58:49.211270+0000","last_fullsized":"2024-05-09T05:58:49.211270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-05-09T05:58:49.211036+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-05-09T05:58:49.211036+0000","last_clean_scrub_stamp":"2024-05-09T05:58:49.211036+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:17:36.560375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"29'12","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:58.246223+0000","last_change":"2024-05-09T05:58:58.246308+0000","last_active":"2024-05-09T05:58:58.246223+0000","last_peered":"2024-05-09T05:58:58.246223+0000","last_clean":"2024-05-09T05:58:58.246223+0000","last_became_active":"2024-05-09T05:53:23.126691+0000","last_became_peered":"2024-05-09T05:53:23.126691+0000","last_unstale":"2024-05-09T05:58:58.246223+0000","last_undegraded":"2024-05-09T05:58:58.246223+0000","last_fullsized":"2024-05-09T05:58:58.246223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-09T05:58:58.246034+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-09T05:58:58.246034+0000","last_clean_scrub_stamp":"2024-05-09T05:58:58.246034+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:52:38.144017+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"29'249","reported_seq":282,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:50.549166+0000","last_change":"2024-05-09T05:58:50.549242+0000","last_active":"2024-05-09T05:58:50.549166+0000","last_peered":"2024-05-09T05:58:50.549166+0000","last_clean":"2024-05-09T05:58:50.549166+0000","last_became_active":"2024-05-09T05:53:28.190564+0000","last_became_peered":"2024-05-09T05:53:28.190564+0000","last_unstale":"2024-05-09T05:58:50.549166+0000","last_undegraded":"2024-05-09T05:58:50.549166+0000","last_fullsized":"2024-05-09T05:58:50.549166+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'249","last_scrub_stamp":"2024-05-09T05:58:50.548918+0000","last_deep_scrub":"29'249","last_deep_scrub_stamp":"2024-05-09T05:58:50.548918+0000","last_clean_scrub_stamp":"2024-05-09T05:58:50.548918+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:18:13.307469+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":249,"num_write_kb":679936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"29'5","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:51.179447+0000","last_change":"2024-05-09T05:58:51.179523+0000","last_active":"2024-05-09T05:58:51.179447+0000","last_peered":"2024-05-09T05:58:51.179447+0000","last_clean":"2024-05-09T05:58:51.179447+0000","last_became_active":"2024-05-09T05:53:24.138417+0000","last_became_peered":"2024-05-09T05:53:24.138417+0000","last_unstale":"2024-05-09T05:58:51.179447+0000","last_undegraded":"2024-05-09T05:58:51.179447+0000","last_fullsized":"2024-05-09T05:58:51.179447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-05-09T05:58:51.179239+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-05-09T05:58:51.179239+0000","last_clean_scrub_stamp":"2024-05-09T05:58:51.179239+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:57:08.127832+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"29'30","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:44.227481+0000","last_change":"2024-05-09T05:58:44.227656+0000","last_active":"2024-05-09T05:58:44.227481+0000","last_peered":"2024-05-09T05:58:44.227481+0000","last_clean":"2024-05-09T05:58:44.227481+0000","last_became_active":"2024-05-09T05:53:23.102020+0000","last_became_peered":"2024-05-09T05:53:23.102020+0000","last_unstale":"2024-05-09T05:58:44.227481+0000","last_undegraded":"2024-05-09T05:58:44.227481+0000","last_fullsized":"2024-05-09T05:58:44.227481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2024-05-09T05:58:44.227241+0000","last_deep_scrub":"29'30","last_deep_scrub_stamp":"2024-05-09T05:58:44.227241+0000","last_clean_scrub_stamp":"2024-05-09T05:58:44.227241+0000","objects_scrubbed":4,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:05:03.506622+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"29'264","reported_seq":297,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:55.145338+0000","last_change":"2024-05-09T05:58:55.145409+0000","last_active":"2024-05-09T05:58:55.145338+0000","last_peered":"2024-05-09T05:58:55.145338+0000","last_clean":"2024-05-09T05:58:55.145338+0000","last_became_active":"2024-05-09T05:53:28.216634+0000","last_became_peered":"2024-05-09T05:53:28.216634+0000","last_unstale":"2024-05-09T05:58:55.145338+0000","last_undegraded":"2024-05-09T05:58:55.145338+0000","last_fullsized":"2024-05-09T05:58:55.145338+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'264","last_scrub_stamp":"2024-05-09T05:58:55.145126+0000","last_deep_scrub":"29'264","last_deep_scrub_stamp":"2024-05-09T05:58:55.145126+0000","last_clean_scrub_stamp":"2024-05-09T05:58:55.145126+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:14:00.907222+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":720896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"29'9","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:51.745685+0000","last_change":"2024-05-09T05:58:51.745752+0000","last_active":"2024-05-09T05:58:51.745685+0000","last_peered":"2024-05-09T05:58:51.745685+0000","last_clean":"2024-05-09T05:58:51.745685+0000","last_became_active":"2024-05-09T05:53:24.139369+0000","last_became_peered":"2024-05-09T05:53:24.139369+0000","last_unstale":"2024-05-09T05:58:51.745685+0000","last_undegraded":"2024-05-09T05:58:51.745685+0000","last_fullsized":"2024-05-09T05:58:51.745685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-05-09T05:58:51.745494+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-05-09T05:58:51.745494+0000","last_clean_scrub_stamp":"2024-05-09T05:58:51.745494+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:55:03.900813+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"29'7","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:56.338875+0000","last_change":"2024-05-09T05:58:56.338953+0000","last_active":"2024-05-09T05:58:56.338875+0000","last_peered":"2024-05-09T05:58:56.338875+0000","last_clean":"2024-05-09T05:58:56.338875+0000","last_became_active":"2024-05-09T05:53:23.123081+0000","last_became_peered":"2024-05-09T05:53:23.123081+0000","last_unstale":"2024-05-09T05:58:56.338875+0000","last_undegraded":"2024-05-09T05:58:56.338875+0000","last_fullsized":"2024-05-09T05:58:56.338875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-05-09T05:58:56.338668+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-05-09T05:58:56.338668+0000","last_clean_scrub_stamp":"2024-05-09T05:58:56.338668+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:18:02.734290+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"29'249","reported_seq":282,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:56.833916+0000","last_change":"2024-05-09T05:58:56.834069+0000","last_active":"2024-05-09T05:58:56.833916+0000","last_peered":"2024-05-09T05:58:56.833916+0000","last_clean":"2024-05-09T05:58:56.833916+0000","last_became_active":"2024-05-09T05:53:28.225810+0000","last_became_peered":"2024-05-09T05:53:28.225810+0000","last_unstale":"2024-05-09T05:58:56.833916+0000","last_undegraded":"2024-05-09T05:58:56.833916+0000","last_fullsized":"2024-05-09T05:58:56.833916+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'249","last_scrub_stamp":"2024-05-09T05:58:56.833512+0000","last_deep_scrub":"29'249","last_deep_scrub_stamp":"2024-05-09T05:58:56.833512+0000","last_clean_scrub_stamp":"2024-05-09T05:58:56.833512+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:52:45.019744+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":249,"num_write_kb":679936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"29'5","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:43.580562+0000","last_change":"2024-05-09T05:58:43.580624+0000","last_active":"2024-05-09T05:58:43.580562+0000","last_peered":"2024-05-09T05:58:43.580562+0000","last_clean":"2024-05-09T05:58:43.580562+0000","last_became_active":"2024-05-09T05:53:24.129787+0000","last_became_peered":"2024-05-09T05:53:24.129787+0000","last_unstale":"2024-05-09T05:58:43.580562+0000","last_undegraded":"2024-05-09T05:58:43.580562+0000","last_fullsized":"2024-05-09T05:58:43.580562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-05-09T05:58:43.580375+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-05-09T05:58:43.580375+0000","last_clean_scrub_stamp":"2024-05-09T05:58:43.580375+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:59:27.409876+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"26'1","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:47.875553+0000","last_change":"2024-05-09T05:58:47.875703+0000","last_active":"2024-05-09T05:58:47.875553+0000","last_peered":"2024-05-09T05:58:47.875553+0000","last_clean":"2024-05-09T05:58:47.875553+0000","last_became_active":"2024-05-09T05:53:23.133587+0000","last_became_peered":"2024-05-09T05:53:23.133587+0000","last_unstale":"2024-05-09T05:58:47.875553+0000","last_undegraded":"2024-05-09T05:58:47.875553+0000","last_fullsized":"2024-05-09T05:58:47.875553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1","last_scrub_stamp":"2024-05-09T05:58:47.875317+0000","last_deep_scrub":"26'1","last_deep_scrub_stamp":"2024-05-09T05:58:47.875317+0000","last_clean_scrub_stamp":"2024-05-09T05:58:47.875317+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:35:29.182673+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"29'273","reported_seq":306,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:57.828021+0000","last_change":"2024-05-09T05:58:57.828092+0000","last_active":"2024-05-09T05:58:57.828021+0000","last_peered":"2024-05-09T05:58:57.828021+0000","last_clean":"2024-05-09T05:58:57.828021+0000","last_became_active":"2024-05-09T05:53:28.232539+0000","last_became_peered":"2024-05-09T05:53:28.232539+0000","last_unstale":"2024-05-09T05:58:57.828021+0000","last_undegraded":"2024-05-09T05:58:57.828021+0000","last_fullsized":"2024-05-09T05:58:57.828021+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'273","last_scrub_stamp":"2024-05-09T05:58:57.827804+0000","last_deep_scrub":"29'273","last_deep_scrub_stamp":"2024-05-09T05:58:57.827804+0000","last_clean_scrub_stamp":"2024-05-09T05:58:57.827804+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:47:00.374049+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"29'7","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:40.780464+0000","last_change":"2024-05-09T05:58:40.780487+0000","last_active":"2024-05-09T05:58:40.780464+0000","last_peered":"2024-05-09T05:58:40.780464+0000","last_clean":"2024-05-09T05:58:40.780464+0000","last_became_active":"2024-05-09T05:53:24.132309+0000","last_became_peered":"2024-05-09T05:53:24.132309+0000","last_unstale":"2024-05-09T05:58:40.780464+0000","last_undegraded":"2024-05-09T05:58:40.780464+0000","last_fullsized":"2024-05-09T05:58:40.780464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-05-09T05:58:40.780386+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-05-09T05:58:40.780386+0000","last_clean_scrub_stamp":"2024-05-09T05:58:40.780386+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:03:47.892710+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"29'9","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:54.342211+0000","last_change":"2024-05-09T05:58:54.342286+0000","last_active":"2024-05-09T05:58:54.342211+0000","last_peered":"2024-05-09T05:58:54.342211+0000","last_clean":"2024-05-09T05:58:54.342211+0000","last_became_active":"2024-05-09T05:53:23.118321+0000","last_became_peered":"2024-05-09T05:53:23.118321+0000","last_unstale":"2024-05-09T05:58:54.342211+0000","last_undegraded":"2024-05-09T05:58:54.342211+0000","last_fullsized":"2024-05-09T05:58:54.342211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-05-09T05:58:54.342017+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-05-09T05:58:54.342017+0000","last_clean_scrub_stamp":"2024-05-09T05:58:54.342017+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:27:37.167081+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":14,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'264","reported_seq":297,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:53.751810+0000","last_change":"2024-05-09T05:58:53.751882+0000","last_active":"2024-05-09T05:58:53.751810+0000","last_peered":"2024-05-09T05:58:53.751810+0000","last_clean":"2024-05-09T05:58:53.751810+0000","last_became_active":"2024-05-09T05:53:28.199359+0000","last_became_peered":"2024-05-09T05:53:28.199359+0000","last_unstale":"2024-05-09T05:58:53.751810+0000","last_undegraded":"2024-05-09T05:58:53.751810+0000","last_fullsized":"2024-05-09T05:58:53.751810+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'264","last_scrub_stamp":"2024-05-09T05:58:53.751595+0000","last_deep_scrub":"29'264","last_deep_scrub_stamp":"2024-05-09T05:58:53.751595+0000","last_clean_scrub_stamp":"2024-05-09T05:58:53.751595+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:16:49.246565+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":720896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"29'8","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:51.892000+0000","last_change":"2024-05-09T05:58:51.892129+0000","last_active":"2024-05-09T05:58:51.892000+0000","last_peered":"2024-05-09T05:58:51.892000+0000","last_clean":"2024-05-09T05:58:51.892000+0000","last_became_active":"2024-05-09T05:53:24.142265+0000","last_became_peered":"2024-05-09T05:53:24.142265+0000","last_unstale":"2024-05-09T05:58:51.892000+0000","last_undegraded":"2024-05-09T05:58:51.892000+0000","last_fullsized":"2024-05-09T05:58:51.892000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-09T05:58:51.891670+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-09T05:58:51.891670+0000","last_clean_scrub_stamp":"2024-05-09T05:58:51.891670+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:26:23.157391+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"29'15","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:45.554323+0000","last_change":"2024-05-09T05:58:45.554407+0000","last_active":"2024-05-09T05:58:45.554323+0000","last_peered":"2024-05-09T05:58:45.554323+0000","last_clean":"2024-05-09T05:58:45.554323+0000","last_became_active":"2024-05-09T05:53:23.141770+0000","last_became_peered":"2024-05-09T05:53:23.141770+0000","last_unstale":"2024-05-09T05:58:45.554323+0000","last_undegraded":"2024-05-09T05:58:45.554323+0000","last_fullsized":"2024-05-09T05:58:45.554323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-05-09T05:58:45.554074+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-05-09T05:58:45.554074+0000","last_clean_scrub_stamp":"2024-05-09T05:58:45.554074+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:41:47.969104+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":641,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"29'270","reported_seq":303,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:54.801497+0000","last_change":"2024-05-09T05:58:54.801567+0000","last_active":"2024-05-09T05:58:54.801497+0000","last_peered":"2024-05-09T05:58:54.801497+0000","last_clean":"2024-05-09T05:58:54.801497+0000","last_became_active":"2024-05-09T05:53:28.210981+0000","last_became_peered":"2024-05-09T05:53:28.210981+0000","last_unstale":"2024-05-09T05:58:54.801497+0000","last_undegraded":"2024-05-09T05:58:54.801497+0000","last_fullsized":"2024-05-09T05:58:54.801497+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'270","last_scrub_stamp":"2024-05-09T05:58:54.801289+0000","last_deep_scrub":"29'270","last_deep_scrub_stamp":"2024-05-09T05:58:54.801289+0000","last_clean_scrub_stamp":"2024-05-09T05:58:54.801289+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:52:06.045841+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":737280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"29'5","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:47.797274+0000","last_change":"2024-05-09T05:58:47.797405+0000","last_active":"2024-05-09T05:58:47.797274+0000","last_peered":"2024-05-09T05:58:47.797274+0000","last_clean":"2024-05-09T05:58:47.797274+0000","last_became_active":"2024-05-09T05:53:24.132398+0000","last_became_peered":"2024-05-09T05:53:24.132398+0000","last_unstale":"2024-05-09T05:58:47.797274+0000","last_undegraded":"2024-05-09T05:58:47.797274+0000","last_fullsized":"2024-05-09T05:58:47.797274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-05-09T05:58:47.796947+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-05-09T05:58:47.796947+0000","last_clean_scrub_stamp":"2024-05-09T05:58:47.796947+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:00:50.206617+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"29'7","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:57.288122+0000","last_change":"2024-05-09T05:58:57.288190+0000","last_active":"2024-05-09T05:58:57.288122+0000","last_peered":"2024-05-09T05:58:57.288122+0000","last_clean":"2024-05-09T05:58:57.288122+0000","last_became_active":"2024-05-09T05:53:23.125799+0000","last_became_peered":"2024-05-09T05:53:23.125799+0000","last_unstale":"2024-05-09T05:58:57.288122+0000","last_undegraded":"2024-05-09T05:58:57.288122+0000","last_fullsized":"2024-05-09T05:58:57.288122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-05-09T05:58:57.287997+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-05-09T05:58:57.287997+0000","last_clean_scrub_stamp":"2024-05-09T05:58:57.287997+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:09:46.978597+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"29'339","reported_seq":371,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:32.985922+0000","last_change":"2024-05-09T05:54:06.916943+0000","last_active":"2024-05-09T05:58:32.985922+0000","last_peered":"2024-05-09T05:58:32.985922+0000","last_clean":"2024-05-09T05:58:32.985922+0000","last_became_active":"2024-05-09T05:54:06.915734+0000","last_became_peered":"2024-05-09T05:54:06.915734+0000","last_unstale":"2024-05-09T05:58:32.985922+0000","last_undegraded":"2024-05-09T05:58:32.985922+0000","last_fullsized":"2024-05-09T05:58:32.985922+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":925696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,6,1],"acting":[5,0,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"29'8","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:52.164247+0000","last_change":"2024-05-09T05:58:52.164317+0000","last_active":"2024-05-09T05:58:52.164247+0000","last_peered":"2024-05-09T05:58:52.164247+0000","last_clean":"2024-05-09T05:58:52.164247+0000","last_became_active":"2024-05-09T05:53:24.138835+0000","last_became_peered":"2024-05-09T05:53:24.138835+0000","last_unstale":"2024-05-09T05:58:52.164247+0000","last_undegraded":"2024-05-09T05:58:52.164247+0000","last_fullsized":"2024-05-09T05:58:52.164247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-09T05:58:52.164019+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-09T05:58:52.164019+0000","last_clean_scrub_stamp":"2024-05-09T05:58:52.164019+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:53:33.369696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"29'11","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:51.295845+0000","last_change":"2024-05-09T05:58:51.296017+0000","last_active":"2024-05-09T05:58:51.295845+0000","last_peered":"2024-05-09T05:58:51.295845+0000","last_clean":"2024-05-09T05:58:51.295845+0000","last_became_active":"2024-05-09T05:53:23.113294+0000","last_became_peered":"2024-05-09T05:53:23.113294+0000","last_unstale":"2024-05-09T05:58:51.295845+0000","last_undegraded":"2024-05-09T05:58:51.295845+0000","last_fullsized":"2024-05-09T05:58:51.295845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'11","last_scrub_stamp":"2024-05-09T05:58:51.295603+0000","last_deep_scrub":"29'11","last_deep_scrub_stamp":"2024-05-09T05:58:51.295603+0000","last_clean_scrub_stamp":"2024-05-09T05:58:51.295603+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:08:51.244267+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"29'74","reported_seq":138,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:40.501190+0000","last_change":"2024-05-09T05:58:40.501237+0000","last_active":"2024-05-09T05:58:40.501190+0000","last_peered":"2024-05-09T05:58:40.501190+0000","last_clean":"2024-05-09T05:58:40.501190+0000","last_became_active":"2024-05-09T05:53:12.481529+0000","last_became_peered":"2024-05-09T05:53:12.481529+0000","last_unstale":"2024-05-09T05:58:40.501190+0000","last_undegraded":"2024-05-09T05:58:40.501190+0000","last_fullsized":"2024-05-09T05:58:40.501190+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'74","last_scrub_stamp":"2024-05-09T05:58:40.501088+0000","last_deep_scrub":"29'74","last_deep_scrub_stamp":"2024-05-09T05:58:40.501088+0000","last_clean_scrub_stamp":"2024-05-09T05:58:40.501088+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:55:54.684313+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'276","reported_seq":301,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:33.012329+0000","last_change":"2024-05-09T05:53:28.190861+0000","last_active":"2024-05-09T05:58:33.012329+0000","last_peered":"2024-05-09T05:58:33.012329+0000","last_clean":"2024-05-09T05:58:33.012329+0000","last_became_active":"2024-05-09T05:53:28.190393+0000","last_became_peered":"2024-05-09T05:53:28.190393+0000","last_unstale":"2024-05-09T05:58:33.012329+0000","last_undegraded":"2024-05-09T05:58:33.012329+0000","last_fullsized":"2024-05-09T05:58:33.012329+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":276,"num_write_kb":753664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"29'7","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:45.272870+0000","last_change":"2024-05-09T05:58:45.272936+0000","last_active":"2024-05-09T05:58:45.272870+0000","last_peered":"2024-05-09T05:58:45.272870+0000","last_clean":"2024-05-09T05:58:45.272870+0000","last_became_active":"2024-05-09T05:53:24.139813+0000","last_became_peered":"2024-05-09T05:53:24.139813+0000","last_unstale":"2024-05-09T05:58:45.272870+0000","last_undegraded":"2024-05-09T05:58:45.272870+0000","last_fullsized":"2024-05-09T05:58:45.272870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-05-09T05:58:45.272687+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-05-09T05:58:45.272687+0000","last_clean_scrub_stamp":"2024-05-09T05:58:45.272687+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:12:25.558329+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"29'9","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:44.712388+0000","last_change":"2024-05-09T05:58:44.712541+0000","last_active":"2024-05-09T05:58:44.712388+0000","last_peered":"2024-05-09T05:58:44.712388+0000","last_clean":"2024-05-09T05:58:44.712388+0000","last_became_active":"2024-05-09T05:53:23.112260+0000","last_became_peered":"2024-05-09T05:53:23.112260+0000","last_unstale":"2024-05-09T05:58:44.712388+0000","last_undegraded":"2024-05-09T05:58:44.712388+0000","last_fullsized":"2024-05-09T05:58:44.712388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-05-09T05:58:44.712133+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-05-09T05:58:44.712133+0000","last_clean_scrub_stamp":"2024-05-09T05:58:44.712133+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:04:50.621793+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"29'279","reported_seq":312,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:52.500236+0000","last_change":"2024-05-09T05:58:52.500374+0000","last_active":"2024-05-09T05:58:52.500236+0000","last_peered":"2024-05-09T05:58:52.500236+0000","last_clean":"2024-05-09T05:58:52.500236+0000","last_became_active":"2024-05-09T05:53:28.195082+0000","last_became_peered":"2024-05-09T05:53:28.195082+0000","last_unstale":"2024-05-09T05:58:52.500236+0000","last_undegraded":"2024-05-09T05:58:52.500236+0000","last_fullsized":"2024-05-09T05:58:52.500236+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'279","last_scrub_stamp":"2024-05-09T05:58:52.499907+0000","last_deep_scrub":"29'279","last_deep_scrub_stamp":"2024-05-09T05:58:52.499907+0000","last_clean_scrub_stamp":"2024-05-09T05:58:52.499907+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:58:19.373628+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":279,"num_write_kb":761856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"29'6","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:47.836508+0000","last_change":"2024-05-09T05:58:47.836602+0000","last_active":"2024-05-09T05:58:47.836508+0000","last_peered":"2024-05-09T05:58:47.836508+0000","last_clean":"2024-05-09T05:58:47.836508+0000","last_became_active":"2024-05-09T05:53:24.129808+0000","last_became_peered":"2024-05-09T05:53:24.129808+0000","last_unstale":"2024-05-09T05:58:47.836508+0000","last_undegraded":"2024-05-09T05:58:47.836508+0000","last_fullsized":"2024-05-09T05:58:47.836508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-09T05:58:47.836301+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-09T05:58:47.836301+0000","last_clean_scrub_stamp":"2024-05-09T05:58:47.836301+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:00:40.896337+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"29'6","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:49.901152+0000","last_change":"2024-05-09T05:58:49.901228+0000","last_active":"2024-05-09T05:58:49.901152+0000","last_peered":"2024-05-09T05:58:49.901152+0000","last_clean":"2024-05-09T05:58:49.901152+0000","last_became_active":"2024-05-09T05:53:23.138303+0000","last_became_peered":"2024-05-09T05:53:23.138303+0000","last_unstale":"2024-05-09T05:58:49.901152+0000","last_undegraded":"2024-05-09T05:58:49.901152+0000","last_fullsized":"2024-05-09T05:58:49.901152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-09T05:58:49.900951+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-09T05:58:49.900951+0000","last_clean_scrub_stamp":"2024-05-09T05:58:49.900951+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:39:30.999478+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"29'261","reported_seq":294,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:59.036993+0000","last_change":"2024-05-09T05:58:59.037070+0000","last_active":"2024-05-09T05:58:59.036993+0000","last_peered":"2024-05-09T05:58:59.036993+0000","last_clean":"2024-05-09T05:58:59.036993+0000","last_became_active":"2024-05-09T05:53:28.206229+0000","last_became_peered":"2024-05-09T05:53:28.206229+0000","last_unstale":"2024-05-09T05:58:59.036993+0000","last_undegraded":"2024-05-09T05:58:59.036993+0000","last_fullsized":"2024-05-09T05:58:59.036993+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'261","last_scrub_stamp":"2024-05-09T05:58:59.036727+0000","last_deep_scrub":"29'261","last_deep_scrub_stamp":"2024-05-09T05:58:59.036727+0000","last_clean_scrub_stamp":"2024-05-09T05:58:59.036727+0000","objects_scrubbed":0,"log_size":261,"log_dups_size":0,"ondisk_log_size":261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:26:16.414093+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":261,"num_write_kb":712704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"29'9","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:49.786536+0000","last_change":"2024-05-09T05:58:49.786615+0000","last_active":"2024-05-09T05:58:49.786536+0000","last_peered":"2024-05-09T05:58:49.786536+0000","last_clean":"2024-05-09T05:58:49.786536+0000","last_became_active":"2024-05-09T05:53:24.135253+0000","last_became_peered":"2024-05-09T05:53:24.135253+0000","last_unstale":"2024-05-09T05:58:49.786536+0000","last_undegraded":"2024-05-09T05:58:49.786536+0000","last_fullsized":"2024-05-09T05:58:49.786536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-05-09T05:58:49.786332+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-05-09T05:58:49.786332+0000","last_clean_scrub_stamp":"2024-05-09T05:58:49.786332+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:16:35.039907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"29'7","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:47.195262+0000","last_change":"2024-05-09T05:58:47.195361+0000","last_active":"2024-05-09T05:58:47.195262+0000","last_peered":"2024-05-09T05:58:47.195262+0000","last_clean":"2024-05-09T05:58:47.195262+0000","last_became_active":"2024-05-09T05:53:23.139516+0000","last_became_peered":"2024-05-09T05:53:23.139516+0000","last_unstale":"2024-05-09T05:58:47.195262+0000","last_undegraded":"2024-05-09T05:58:47.195262+0000","last_fullsized":"2024-05-09T05:58:47.195262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-05-09T05:58:47.195055+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-05-09T05:58:47.195055+0000","last_clean_scrub_stamp":"2024-05-09T05:58:47.195055+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:12:20.351896+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"29'318","reported_seq":343,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:33.012400+0000","last_change":"2024-05-09T05:53:28.199385+0000","last_active":"2024-05-09T05:58:33.012400+0000","last_peered":"2024-05-09T05:58:33.012400+0000","last_clean":"2024-05-09T05:58:33.012400+0000","last_became_active":"2024-05-09T05:53:28.198825+0000","last_became_peered":"2024-05-09T05:53:28.198825+0000","last_unstale":"2024-05-09T05:58:33.012400+0000","last_undegraded":"2024-05-09T05:58:33.012400+0000","last_fullsized":"2024-05-09T05:58:33.012400+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":318,"num_write_kb":868352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"29'5","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:45.590666+0000","last_change":"2024-05-09T05:58:45.590797+0000","last_active":"2024-05-09T05:58:45.590666+0000","last_peered":"2024-05-09T05:58:45.590666+0000","last_clean":"2024-05-09T05:58:45.590666+0000","last_became_active":"2024-05-09T05:53:24.131741+0000","last_became_peered":"2024-05-09T05:53:24.131741+0000","last_unstale":"2024-05-09T05:58:45.590666+0000","last_undegraded":"2024-05-09T05:58:45.590666+0000","last_fullsized":"2024-05-09T05:58:45.590666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-05-09T05:58:45.590360+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-05-09T05:58:45.590360+0000","last_clean_scrub_stamp":"2024-05-09T05:58:45.590360+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:44:40.841354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"29'4","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:45.809296+0000","last_change":"2024-05-09T05:58:45.809369+0000","last_active":"2024-05-09T05:58:45.809296+0000","last_peered":"2024-05-09T05:58:45.809296+0000","last_clean":"2024-05-09T05:58:45.809296+0000","last_became_active":"2024-05-09T05:53:23.111968+0000","last_became_peered":"2024-05-09T05:53:23.111968+0000","last_unstale":"2024-05-09T05:58:45.809296+0000","last_undegraded":"2024-05-09T05:58:45.809296+0000","last_fullsized":"2024-05-09T05:58:45.809296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-09T05:58:45.809102+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-09T05:58:45.809102+0000","last_clean_scrub_stamp":"2024-05-09T05:58:45.809102+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:23:06.578670+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"29'258","reported_seq":291,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:47.507506+0000","last_change":"2024-05-09T05:58:47.507579+0000","last_active":"2024-05-09T05:58:47.507506+0000","last_peered":"2024-05-09T05:58:47.507506+0000","last_clean":"2024-05-09T05:58:47.507506+0000","last_became_active":"2024-05-09T05:53:28.227272+0000","last_became_peered":"2024-05-09T05:53:28.227272+0000","last_unstale":"2024-05-09T05:58:47.507506+0000","last_undegraded":"2024-05-09T05:58:47.507506+0000","last_fullsized":"2024-05-09T05:58:47.507506+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'258","last_scrub_stamp":"2024-05-09T05:58:47.507300+0000","last_deep_scrub":"29'258","last_deep_scrub_stamp":"2024-05-09T05:58:47.507300+0000","last_clean_scrub_stamp":"2024-05-09T05:58:47.507300+0000","objects_scrubbed":0,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:40:36.209618+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":258,"num_write_kb":704512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"29'6","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:47.272038+0000","last_change":"2024-05-09T05:58:47.272117+0000","last_active":"2024-05-09T05:58:47.272038+0000","last_peered":"2024-05-09T05:58:47.272038+0000","last_clean":"2024-05-09T05:58:47.272038+0000","last_became_active":"2024-05-09T05:53:24.143540+0000","last_became_peered":"2024-05-09T05:53:24.143540+0000","last_unstale":"2024-05-09T05:58:47.272038+0000","last_undegraded":"2024-05-09T05:58:47.272038+0000","last_fullsized":"2024-05-09T05:58:47.272038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-09T05:58:47.271826+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-09T05:58:47.271826+0000","last_clean_scrub_stamp":"2024-05-09T05:58:47.271826+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:37:24.428515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"29'28","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:43.228620+0000","last_change":"2024-05-09T05:58:43.228745+0000","last_active":"2024-05-09T05:58:43.228620+0000","last_peered":"2024-05-09T05:58:43.228620+0000","last_clean":"2024-05-09T05:58:43.228620+0000","last_became_active":"2024-05-09T05:53:23.103471+0000","last_became_peered":"2024-05-09T05:53:23.103471+0000","last_unstale":"2024-05-09T05:58:43.228620+0000","last_undegraded":"2024-05-09T05:58:43.228620+0000","last_fullsized":"2024-05-09T05:58:43.228620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'28","last_scrub_stamp":"2024-05-09T05:58:43.228404+0000","last_deep_scrub":"29'28","last_deep_scrub_stamp":"2024-05-09T05:58:43.228404+0000","last_clean_scrub_stamp":"2024-05-09T05:58:43.228404+0000","objects_scrubbed":8,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:13:01.227344+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"29'360","reported_seq":385,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:33.561806+0000","last_change":"2024-05-09T05:53:28.241338+0000","last_active":"2024-05-09T05:58:33.561806+0000","last_peered":"2024-05-09T05:58:33.561806+0000","last_clean":"2024-05-09T05:58:33.561806+0000","last_became_active":"2024-05-09T05:53:28.239841+0000","last_became_peered":"2024-05-09T05:53:28.239841+0000","last_unstale":"2024-05-09T05:58:33.561806+0000","last_undegraded":"2024-05-09T05:58:33.561806+0000","last_fullsized":"2024-05-09T05:58:33.561806+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":360,"num_write_kb":983040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"29'6","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:46.464888+0000","last_change":"2024-05-09T05:58:46.464956+0000","last_active":"2024-05-09T05:58:46.464888+0000","last_peered":"2024-05-09T05:58:46.464888+0000","last_clean":"2024-05-09T05:58:46.464888+0000","last_became_active":"2024-05-09T05:53:24.149578+0000","last_became_peered":"2024-05-09T05:53:24.149578+0000","last_unstale":"2024-05-09T05:58:46.464888+0000","last_undegraded":"2024-05-09T05:58:46.464888+0000","last_fullsized":"2024-05-09T05:58:46.464888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-09T05:58:46.464690+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-09T05:58:46.464690+0000","last_clean_scrub_stamp":"2024-05-09T05:58:46.464690+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:20:00.169790+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"29'9","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:46.792520+0000","last_change":"2024-05-09T05:58:46.792597+0000","last_active":"2024-05-09T05:58:46.792520+0000","last_peered":"2024-05-09T05:58:46.792520+0000","last_clean":"2024-05-09T05:58:46.792520+0000","last_became_active":"2024-05-09T05:53:23.120857+0000","last_became_peered":"2024-05-09T05:53:23.120857+0000","last_unstale":"2024-05-09T05:58:46.792520+0000","last_undegraded":"2024-05-09T05:58:46.792520+0000","last_fullsized":"2024-05-09T05:58:46.792520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-05-09T05:58:46.792316+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-05-09T05:58:46.792316+0000","last_clean_scrub_stamp":"2024-05-09T05:58:46.792316+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:47:02.064452+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"29'273","reported_seq":298,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:33.026563+0000","last_change":"2024-05-09T05:53:28.240774+0000","last_active":"2024-05-09T05:58:33.026563+0000","last_peered":"2024-05-09T05:58:33.026563+0000","last_clean":"2024-05-09T05:58:33.026563+0000","last_became_active":"2024-05-09T05:53:28.240070+0000","last_became_peered":"2024-05-09T05:53:28.240070+0000","last_unstale":"2024-05-09T05:58:33.026563+0000","last_undegraded":"2024-05-09T05:58:33.026563+0000","last_fullsized":"2024-05-09T05:58:33.026563+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"29'15","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.167007+0000","last_change":"2024-05-09T05:54:06.645397+0000","last_active":"2024-05-09T05:58:30.167007+0000","last_peered":"2024-05-09T05:58:30.167007+0000","last_clean":"2024-05-09T05:58:30.167007+0000","last_became_active":"2024-05-09T05:54:06.644437+0000","last_became_peered":"2024-05-09T05:54:06.644437+0000","last_unstale":"2024-05-09T05:58:30.167007+0000","last_undegraded":"2024-05-09T05:58:30.167007+0000","last_fullsized":"2024-05-09T05:58:30.167007+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"29'8","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:55.329762+0000","last_change":"2024-05-09T05:58:55.329844+0000","last_active":"2024-05-09T05:58:55.329762+0000","last_peered":"2024-05-09T05:58:55.329762+0000","last_clean":"2024-05-09T05:58:55.329762+0000","last_became_active":"2024-05-09T05:53:23.118358+0000","last_became_peered":"2024-05-09T05:53:23.118358+0000","last_unstale":"2024-05-09T05:58:55.329762+0000","last_undegraded":"2024-05-09T05:58:55.329762+0000","last_fullsized":"2024-05-09T05:58:55.329762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-09T05:58:55.329578+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-09T05:58:55.329578+0000","last_clean_scrub_stamp":"2024-05-09T05:58:55.329578+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:10:19.781635+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"29'273","reported_seq":306,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:55.804208+0000","last_change":"2024-05-09T05:58:55.804354+0000","last_active":"2024-05-09T05:58:55.804208+0000","last_peered":"2024-05-09T05:58:55.804208+0000","last_clean":"2024-05-09T05:58:55.804208+0000","last_became_active":"2024-05-09T05:53:28.219636+0000","last_became_peered":"2024-05-09T05:53:28.219636+0000","last_unstale":"2024-05-09T05:58:55.804208+0000","last_undegraded":"2024-05-09T05:58:55.804208+0000","last_fullsized":"2024-05-09T05:58:55.804208+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'273","last_scrub_stamp":"2024-05-09T05:58:55.803966+0000","last_deep_scrub":"29'273","last_deep_scrub_stamp":"2024-05-09T05:58:55.803966+0000","last_clean_scrub_stamp":"2024-05-09T05:58:55.803966+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:26:19.930653+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"29'10","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:52.781331+0000","last_change":"2024-05-09T05:58:52.781459+0000","last_active":"2024-05-09T05:58:52.781331+0000","last_peered":"2024-05-09T05:58:52.781331+0000","last_clean":"2024-05-09T05:58:52.781331+0000","last_became_active":"2024-05-09T05:53:24.143181+0000","last_became_peered":"2024-05-09T05:53:24.143181+0000","last_unstale":"2024-05-09T05:58:52.781331+0000","last_undegraded":"2024-05-09T05:58:52.781331+0000","last_fullsized":"2024-05-09T05:58:52.781331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-09T05:58:52.781013+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-09T05:58:52.781013+0000","last_clean_scrub_stamp":"2024-05-09T05:58:52.781013+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:43:36.608061+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"29'15","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:43.548473+0000","last_change":"2024-05-09T05:58:43.548583+0000","last_active":"2024-05-09T05:58:43.548473+0000","last_peered":"2024-05-09T05:58:43.548473+0000","last_clean":"2024-05-09T05:58:43.548473+0000","last_became_active":"2024-05-09T05:53:23.113524+0000","last_became_peered":"2024-05-09T05:53:23.113524+0000","last_unstale":"2024-05-09T05:58:43.548473+0000","last_undegraded":"2024-05-09T05:58:43.548473+0000","last_fullsized":"2024-05-09T05:58:43.548473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-05-09T05:58:43.548259+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-05-09T05:58:43.548259+0000","last_clean_scrub_stamp":"2024-05-09T05:58:43.548259+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:58:36.493905+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"29'327","reported_seq":352,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:32.980237+0000","last_change":"2024-05-09T05:53:28.226682+0000","last_active":"2024-05-09T05:58:32.980237+0000","last_peered":"2024-05-09T05:58:32.980237+0000","last_clean":"2024-05-09T05:58:32.980237+0000","last_became_active":"2024-05-09T05:53:28.226279+0000","last_became_peered":"2024-05-09T05:53:28.226279+0000","last_unstale":"2024-05-09T05:58:32.980237+0000","last_undegraded":"2024-05-09T05:58:32.980237+0000","last_fullsized":"2024-05-09T05:58:32.980237+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":327,"num_write_kb":892928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"29'6","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:39.737951+0000","last_change":"2024-05-09T05:58:39.738018+0000","last_active":"2024-05-09T05:58:39.737951+0000","last_peered":"2024-05-09T05:58:39.737951+0000","last_clean":"2024-05-09T05:58:39.737951+0000","last_became_active":"2024-05-09T05:53:24.134690+0000","last_became_peered":"2024-05-09T05:53:24.134690+0000","last_unstale":"2024-05-09T05:58:39.737951+0000","last_undegraded":"2024-05-09T05:58:39.737951+0000","last_fullsized":"2024-05-09T05:58:39.737951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-09T05:58:39.737769+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-09T05:58:39.737769+0000","last_clean_scrub_stamp":"2024-05-09T05:58:39.737769+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:20:52.374047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"29'106","reported_seq":151,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:41.565127+0000","last_change":"2024-05-09T05:58:41.565168+0000","last_active":"2024-05-09T05:58:41.565127+0000","last_peered":"2024-05-09T05:58:41.565127+0000","last_clean":"2024-05-09T05:58:41.565127+0000","last_became_active":"2024-05-09T05:53:23.119173+0000","last_became_peered":"2024-05-09T05:53:23.119173+0000","last_unstale":"2024-05-09T05:58:41.565127+0000","last_undegraded":"2024-05-09T05:58:41.565127+0000","last_fullsized":"2024-05-09T05:58:41.565127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'106","last_scrub_stamp":"2024-05-09T05:58:41.565053+0000","last_deep_scrub":"29'106","last_deep_scrub_stamp":"2024-05-09T05:58:41.565053+0000","last_clean_scrub_stamp":"2024-05-09T05:58:41.565053+0000","objects_scrubbed":6,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:44:09.320519+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":214081,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":103,"num_write_kb":251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"29'289","reported_seq":322,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:56.109572+0000","last_change":"2024-05-09T05:58:56.109738+0000","last_active":"2024-05-09T05:58:56.109572+0000","last_peered":"2024-05-09T05:58:56.109572+0000","last_clean":"2024-05-09T05:58:56.109572+0000","last_became_active":"2024-05-09T05:53:28.221846+0000","last_became_peered":"2024-05-09T05:53:28.221846+0000","last_unstale":"2024-05-09T05:58:56.109572+0000","last_undegraded":"2024-05-09T05:58:56.109572+0000","last_fullsized":"2024-05-09T05:58:56.109572+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'289","last_scrub_stamp":"2024-05-09T05:58:56.109324+0000","last_deep_scrub":"29'289","last_deep_scrub_stamp":"2024-05-09T05:58:56.109324+0000","last_clean_scrub_stamp":"2024-05-09T05:58:56.109324+0000","objects_scrubbed":0,"log_size":289,"log_dups_size":0,"ondisk_log_size":289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:18:00.372684+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":786432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"29'11","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:46.269344+0000","last_change":"2024-05-09T05:58:46.269414+0000","last_active":"2024-05-09T05:58:46.269344+0000","last_peered":"2024-05-09T05:58:46.269344+0000","last_clean":"2024-05-09T05:58:46.269344+0000","last_became_active":"2024-05-09T05:53:24.132545+0000","last_became_peered":"2024-05-09T05:53:24.132545+0000","last_unstale":"2024-05-09T05:58:46.269344+0000","last_undegraded":"2024-05-09T05:58:46.269344+0000","last_fullsized":"2024-05-09T05:58:46.269344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'11","last_scrub_stamp":"2024-05-09T05:58:46.269143+0000","last_deep_scrub":"29'11","last_deep_scrub_stamp":"2024-05-09T05:58:46.269143+0000","last_clean_scrub_stamp":"2024-05-09T05:58:46.269143+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:44:47.828674+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"29'13","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:44.573922+0000","last_change":"2024-05-09T05:58:44.574010+0000","last_active":"2024-05-09T05:58:44.573922+0000","last_peered":"2024-05-09T05:58:44.573922+0000","last_clean":"2024-05-09T05:58:44.573922+0000","last_became_active":"2024-05-09T05:53:23.120303+0000","last_became_peered":"2024-05-09T05:53:23.120303+0000","last_unstale":"2024-05-09T05:58:44.573922+0000","last_undegraded":"2024-05-09T05:58:44.573922+0000","last_fullsized":"2024-05-09T05:58:44.573922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'13","last_scrub_stamp":"2024-05-09T05:58:44.573713+0000","last_deep_scrub":"29'13","last_deep_scrub_stamp":"2024-05-09T05:58:44.573713+0000","last_clean_scrub_stamp":"2024-05-09T05:58:44.573713+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:19:58.034122+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"29'297","reported_seq":330,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:49.544055+0000","last_change":"2024-05-09T05:58:49.544220+0000","last_active":"2024-05-09T05:58:49.544055+0000","last_peered":"2024-05-09T05:58:49.544055+0000","last_clean":"2024-05-09T05:58:49.544055+0000","last_became_active":"2024-05-09T05:53:28.184259+0000","last_became_peered":"2024-05-09T05:53:28.184259+0000","last_unstale":"2024-05-09T05:58:49.544055+0000","last_undegraded":"2024-05-09T05:58:49.544055+0000","last_fullsized":"2024-05-09T05:58:49.544055+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'297","last_scrub_stamp":"2024-05-09T05:58:49.543741+0000","last_deep_scrub":"29'297","last_deep_scrub_stamp":"2024-05-09T05:58:49.543741+0000","last_clean_scrub_stamp":"2024-05-09T05:58:49.543741+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:58:54.942744+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":297,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"29'9","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:53.912943+0000","last_change":"2024-05-09T05:58:53.913013+0000","last_active":"2024-05-09T05:58:53.912943+0000","last_peered":"2024-05-09T05:58:53.912943+0000","last_clean":"2024-05-09T05:58:53.912943+0000","last_became_active":"2024-05-09T05:53:24.145704+0000","last_became_peered":"2024-05-09T05:53:24.145704+0000","last_unstale":"2024-05-09T05:58:53.912943+0000","last_undegraded":"2024-05-09T05:58:53.912943+0000","last_fullsized":"2024-05-09T05:58:53.912943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-05-09T05:58:53.912727+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-05-09T05:58:53.912727+0000","last_clean_scrub_stamp":"2024-05-09T05:58:53.912727+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:02:23.834718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"29'6","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:42.810961+0000","last_change":"2024-05-09T05:58:42.811080+0000","last_active":"2024-05-09T05:58:42.810961+0000","last_peered":"2024-05-09T05:58:42.810961+0000","last_clean":"2024-05-09T05:58:42.810961+0000","last_became_active":"2024-05-09T05:53:23.094889+0000","last_became_peered":"2024-05-09T05:53:23.094889+0000","last_unstale":"2024-05-09T05:58:42.810961+0000","last_undegraded":"2024-05-09T05:58:42.810961+0000","last_fullsized":"2024-05-09T05:58:42.810961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-09T05:58:42.810743+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-09T05:58:42.810743+0000","last_clean_scrub_stamp":"2024-05-09T05:58:42.810743+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:59:03.097916+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"29'297","reported_seq":330,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:49.583139+0000","last_change":"2024-05-09T05:58:49.583217+0000","last_active":"2024-05-09T05:58:49.583139+0000","last_peered":"2024-05-09T05:58:49.583139+0000","last_clean":"2024-05-09T05:58:49.583139+0000","last_became_active":"2024-05-09T05:53:28.222700+0000","last_became_peered":"2024-05-09T05:53:28.222700+0000","last_unstale":"2024-05-09T05:58:49.583139+0000","last_undegraded":"2024-05-09T05:58:49.583139+0000","last_fullsized":"2024-05-09T05:58:49.583139+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'297","last_scrub_stamp":"2024-05-09T05:58:49.582925+0000","last_deep_scrub":"29'297","last_deep_scrub_stamp":"2024-05-09T05:58:49.582925+0000","last_clean_scrub_stamp":"2024-05-09T05:58:49.582925+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:45:24.149688+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":297,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"29'10","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:46.544597+0000","last_change":"2024-05-09T05:58:46.544668+0000","last_active":"2024-05-09T05:58:46.544597+0000","last_peered":"2024-05-09T05:58:46.544597+0000","last_clean":"2024-05-09T05:58:46.544597+0000","last_became_active":"2024-05-09T05:53:24.139612+0000","last_became_peered":"2024-05-09T05:53:24.139612+0000","last_unstale":"2024-05-09T05:58:46.544597+0000","last_undegraded":"2024-05-09T05:58:46.544597+0000","last_fullsized":"2024-05-09T05:58:46.544597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-09T05:58:46.544401+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-09T05:58:46.544401+0000","last_clean_scrub_stamp":"2024-05-09T05:58:46.544401+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:19:21.600222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"29'9","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:41.472431+0000","last_change":"2024-05-09T05:58:41.472647+0000","last_active":"2024-05-09T05:58:41.472431+0000","last_peered":"2024-05-09T05:58:41.472431+0000","last_clean":"2024-05-09T05:58:41.472431+0000","last_became_active":"2024-05-09T05:53:23.105346+0000","last_became_peered":"2024-05-09T05:53:23.105346+0000","last_unstale":"2024-05-09T05:58:41.472431+0000","last_undegraded":"2024-05-09T05:58:41.472431+0000","last_fullsized":"2024-05-09T05:58:41.472431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-05-09T05:58:41.472358+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-05-09T05:58:41.472358+0000","last_clean_scrub_stamp":"2024-05-09T05:58:41.472358+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:59:56.527270+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"29'327","reported_seq":360,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:54.165398+0000","last_change":"2024-05-09T05:58:54.165473+0000","last_active":"2024-05-09T05:58:54.165398+0000","last_peered":"2024-05-09T05:58:54.165398+0000","last_clean":"2024-05-09T05:58:54.165398+0000","last_became_active":"2024-05-09T05:53:28.192944+0000","last_became_peered":"2024-05-09T05:53:28.192944+0000","last_unstale":"2024-05-09T05:58:54.165398+0000","last_undegraded":"2024-05-09T05:58:54.165398+0000","last_fullsized":"2024-05-09T05:58:54.165398+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'327","last_scrub_stamp":"2024-05-09T05:58:54.165192+0000","last_deep_scrub":"29'327","last_deep_scrub_stamp":"2024-05-09T05:58:54.165192+0000","last_clean_scrub_stamp":"2024-05-09T05:58:54.165192+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:27:15.065082+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":327,"num_write_kb":892928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"29'273","reported_seq":306,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:58.147958+0000","last_change":"2024-05-09T05:58:58.148100+0000","last_active":"2024-05-09T05:58:58.147958+0000","last_peered":"2024-05-09T05:58:58.147958+0000","last_clean":"2024-05-09T05:58:58.147958+0000","last_became_active":"2024-05-09T05:53:28.222225+0000","last_became_peered":"2024-05-09T05:53:28.222225+0000","last_unstale":"2024-05-09T05:58:58.147958+0000","last_undegraded":"2024-05-09T05:58:58.147958+0000","last_fullsized":"2024-05-09T05:58:58.147958+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'273","last_scrub_stamp":"2024-05-09T05:58:58.147624+0000","last_deep_scrub":"29'273","last_deep_scrub_stamp":"2024-05-09T05:58:58.147624+0000","last_clean_scrub_stamp":"2024-05-09T05:58:58.147624+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:57:41.481800+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"29'11","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:48.241046+0000","last_change":"2024-05-09T05:58:48.241179+0000","last_active":"2024-05-09T05:58:48.241046+0000","last_peered":"2024-05-09T05:58:48.241046+0000","last_clean":"2024-05-09T05:58:48.241046+0000","last_became_active":"2024-05-09T05:53:24.127989+0000","last_became_peered":"2024-05-09T05:53:24.127989+0000","last_unstale":"2024-05-09T05:58:48.241046+0000","last_undegraded":"2024-05-09T05:58:48.241046+0000","last_fullsized":"2024-05-09T05:58:48.241046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'11","last_scrub_stamp":"2024-05-09T05:58:48.240802+0000","last_deep_scrub":"29'11","last_deep_scrub_stamp":"2024-05-09T05:58:48.240802+0000","last_clean_scrub_stamp":"2024-05-09T05:58:48.240802+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:05:53.057614+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"29'6","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:53.329288+0000","last_change":"2024-05-09T05:58:53.329363+0000","last_active":"2024-05-09T05:58:53.329288+0000","last_peered":"2024-05-09T05:58:53.329288+0000","last_clean":"2024-05-09T05:58:53.329288+0000","last_became_active":"2024-05-09T05:53:23.118119+0000","last_became_peered":"2024-05-09T05:53:23.118119+0000","last_unstale":"2024-05-09T05:58:53.329288+0000","last_undegraded":"2024-05-09T05:58:53.329288+0000","last_fullsized":"2024-05-09T05:58:53.329288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-09T05:58:53.329091+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-09T05:58:53.329091+0000","last_clean_scrub_stamp":"2024-05-09T05:58:53.329091+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:56:16.606713+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"29'267","reported_seq":292,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:33.019950+0000","last_change":"2024-05-09T05:53:28.235313+0000","last_active":"2024-05-09T05:58:33.019950+0000","last_peered":"2024-05-09T05:58:33.019950+0000","last_clean":"2024-05-09T05:58:33.019950+0000","last_became_active":"2024-05-09T05:53:28.234771+0000","last_became_peered":"2024-05-09T05:53:28.234771+0000","last_unstale":"2024-05-09T05:58:33.019950+0000","last_undegraded":"2024-05-09T05:58:33.019950+0000","last_fullsized":"2024-05-09T05:58:33.019950+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:27.153646+0000","last_clean_scrub_stamp":"2024-05-09T05:53:27.153646+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":267,"num_write_kb":729088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"29'8","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:50.867472+0000","last_change":"2024-05-09T05:58:50.867545+0000","last_active":"2024-05-09T05:58:50.867472+0000","last_peered":"2024-05-09T05:58:50.867472+0000","last_clean":"2024-05-09T05:58:50.867472+0000","last_became_active":"2024-05-09T05:53:24.139093+0000","last_became_peered":"2024-05-09T05:53:24.139093+0000","last_unstale":"2024-05-09T05:58:50.867472+0000","last_undegraded":"2024-05-09T05:58:50.867472+0000","last_fullsized":"2024-05-09T05:58:50.867472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-09T05:58:50.867236+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-09T05:58:50.867236+0000","last_clean_scrub_stamp":"2024-05-09T05:58:50.867236+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:12:43.158365+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"29'5","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:43.759809+0000","last_change":"2024-05-09T05:58:43.759890+0000","last_active":"2024-05-09T05:58:43.759809+0000","last_peered":"2024-05-09T05:58:43.759809+0000","last_clean":"2024-05-09T05:58:43.759809+0000","last_became_active":"2024-05-09T05:53:23.112020+0000","last_became_peered":"2024-05-09T05:53:23.112020+0000","last_unstale":"2024-05-09T05:58:43.759809+0000","last_undegraded":"2024-05-09T05:58:43.759809+0000","last_fullsized":"2024-05-09T05:58:43.759809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-05-09T05:58:43.759591+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-05-09T05:58:43.759591+0000","last_clean_scrub_stamp":"2024-05-09T05:58:43.759591+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:23:06.539517+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":14,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"29'10","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:50.323711+0000","last_change":"2024-05-09T05:58:50.323789+0000","last_active":"2024-05-09T05:58:50.323711+0000","last_peered":"2024-05-09T05:58:50.323711+0000","last_clean":"2024-05-09T05:58:50.323711+0000","last_became_active":"2024-05-09T05:53:23.126911+0000","last_became_peered":"2024-05-09T05:53:23.126911+0000","last_unstale":"2024-05-09T05:58:50.323711+0000","last_undegraded":"2024-05-09T05:58:50.323711+0000","last_fullsized":"2024-05-09T05:58:50.323711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-09T05:58:50.323528+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-09T05:58:50.323528+0000","last_clean_scrub_stamp":"2024-05-09T05:58:50.323528+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:24:04.300623+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"29'8","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:42.249499+0000","last_change":"2024-05-09T05:58:42.249577+0000","last_active":"2024-05-09T05:58:42.249499+0000","last_peered":"2024-05-09T05:58:42.249499+0000","last_clean":"2024-05-09T05:58:42.249499+0000","last_became_active":"2024-05-09T05:53:24.133994+0000","last_became_peered":"2024-05-09T05:53:24.133994+0000","last_unstale":"2024-05-09T05:58:42.249499+0000","last_undegraded":"2024-05-09T05:58:42.249499+0000","last_fullsized":"2024-05-09T05:58:42.249499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-09T05:58:42.249297+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-09T05:58:42.249297+0000","last_clean_scrub_stamp":"2024-05-09T05:58:42.249297+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:54:45.600917+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"29'297","reported_seq":330,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:57.149002+0000","last_change":"2024-05-09T05:58:57.149098+0000","last_active":"2024-05-09T05:58:57.149002+0000","last_peered":"2024-05-09T05:58:57.149002+0000","last_clean":"2024-05-09T05:58:57.149002+0000","last_became_active":"2024-05-09T05:53:28.222433+0000","last_became_peered":"2024-05-09T05:53:28.222433+0000","last_unstale":"2024-05-09T05:58:57.149002+0000","last_undegraded":"2024-05-09T05:58:57.149002+0000","last_fullsized":"2024-05-09T05:58:57.149002+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'297","last_scrub_stamp":"2024-05-09T05:58:57.148787+0000","last_deep_scrub":"29'297","last_deep_scrub_stamp":"2024-05-09T05:58:57.148787+0000","last_clean_scrub_stamp":"2024-05-09T05:58:57.148787+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:41:47.873414+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":297,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"29'8","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:46.845549+0000","last_change":"2024-05-09T05:58:46.845648+0000","last_active":"2024-05-09T05:58:46.845549+0000","last_peered":"2024-05-09T05:58:46.845549+0000","last_clean":"2024-05-09T05:58:46.845549+0000","last_became_active":"2024-05-09T05:53:23.132946+0000","last_became_peered":"2024-05-09T05:53:23.132946+0000","last_unstale":"2024-05-09T05:58:46.845549+0000","last_undegraded":"2024-05-09T05:58:46.845549+0000","last_fullsized":"2024-05-09T05:58:46.845549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-09T05:58:46.845348+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-09T05:58:46.845348+0000","last_clean_scrub_stamp":"2024-05-09T05:58:46.845348+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:22:03.273797+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"29'7","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:44.510785+0000","last_change":"2024-05-09T05:58:44.510872+0000","last_active":"2024-05-09T05:58:44.510785+0000","last_peered":"2024-05-09T05:58:44.510785+0000","last_clean":"2024-05-09T05:58:44.510785+0000","last_became_active":"2024-05-09T05:53:24.137794+0000","last_became_peered":"2024-05-09T05:53:24.137794+0000","last_unstale":"2024-05-09T05:58:44.510785+0000","last_undegraded":"2024-05-09T05:58:44.510785+0000","last_fullsized":"2024-05-09T05:58:44.510785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-05-09T05:58:44.510575+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-05-09T05:58:44.510575+0000","last_clean_scrub_stamp":"2024-05-09T05:58:44.510575+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:51:13.054382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"29'312","reported_seq":345,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:52.597700+0000","last_change":"2024-05-09T05:58:52.597770+0000","last_active":"2024-05-09T05:58:52.597700+0000","last_peered":"2024-05-09T05:58:52.597700+0000","last_clean":"2024-05-09T05:58:52.597700+0000","last_became_active":"2024-05-09T05:53:28.237414+0000","last_became_peered":"2024-05-09T05:53:28.237414+0000","last_unstale":"2024-05-09T05:58:52.597700+0000","last_undegraded":"2024-05-09T05:58:52.597700+0000","last_fullsized":"2024-05-09T05:58:52.597700+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'312","last_scrub_stamp":"2024-05-09T05:58:52.597495+0000","last_deep_scrub":"29'312","last_deep_scrub_stamp":"2024-05-09T05:58:52.597495+0000","last_clean_scrub_stamp":"2024-05-09T05:58:52.597495+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:54:33.413504+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":851968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"29'9","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:44.542421+0000","last_change":"2024-05-09T05:58:44.542490+0000","last_active":"2024-05-09T05:58:44.542421+0000","last_peered":"2024-05-09T05:58:44.542421+0000","last_clean":"2024-05-09T05:58:44.542421+0000","last_became_active":"2024-05-09T05:53:24.130201+0000","last_became_peered":"2024-05-09T05:53:24.130201+0000","last_unstale":"2024-05-09T05:58:44.542421+0000","last_undegraded":"2024-05-09T05:58:44.542421+0000","last_fullsized":"2024-05-09T05:58:44.542421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-05-09T05:58:44.542191+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-05-09T05:58:44.542191+0000","last_clean_scrub_stamp":"2024-05-09T05:58:44.542191+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:07:31.085109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"29'12","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:48.531732+0000","last_change":"2024-05-09T05:58:48.531800+0000","last_active":"2024-05-09T05:58:48.531732+0000","last_peered":"2024-05-09T05:58:48.531732+0000","last_clean":"2024-05-09T05:58:48.531732+0000","last_became_active":"2024-05-09T05:53:24.138366+0000","last_became_peered":"2024-05-09T05:53:24.138366+0000","last_unstale":"2024-05-09T05:58:48.531732+0000","last_undegraded":"2024-05-09T05:58:48.531732+0000","last_fullsized":"2024-05-09T05:58:48.531732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-09T05:58:48.531523+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-09T05:58:48.531523+0000","last_clean_scrub_stamp":"2024-05-09T05:58:48.531523+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:38:04.242592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"29'8","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:43.308456+0000","last_change":"2024-05-09T05:58:43.308520+0000","last_active":"2024-05-09T05:58:43.308456+0000","last_peered":"2024-05-09T05:58:43.308456+0000","last_clean":"2024-05-09T05:58:43.308456+0000","last_became_active":"2024-05-09T05:53:24.139058+0000","last_became_peered":"2024-05-09T05:53:24.139058+0000","last_unstale":"2024-05-09T05:58:43.308456+0000","last_undegraded":"2024-05-09T05:58:43.308456+0000","last_fullsized":"2024-05-09T05:58:43.308456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-09T05:58:43.308260+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-09T05:58:43.308260+0000","last_clean_scrub_stamp":"2024-05-09T05:58:43.308260+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:48:02.427985+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"29'7","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:42.813469+0000","last_change":"2024-05-09T05:58:42.813534+0000","last_active":"2024-05-09T05:58:42.813469+0000","last_peered":"2024-05-09T05:58:42.813469+0000","last_clean":"2024-05-09T05:58:42.813469+0000","last_became_active":"2024-05-09T05:53:24.142812+0000","last_became_peered":"2024-05-09T05:53:24.142812+0000","last_unstale":"2024-05-09T05:58:42.813469+0000","last_undegraded":"2024-05-09T05:58:42.813469+0000","last_fullsized":"2024-05-09T05:58:42.813469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-05-09T05:58:42.813268+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-05-09T05:58:42.813268+0000","last_clean_scrub_stamp":"2024-05-09T05:58:42.813268+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:13:54.170266+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"29'4","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:50.791778+0000","last_change":"2024-05-09T05:58:50.791859+0000","last_active":"2024-05-09T05:58:50.791778+0000","last_peered":"2024-05-09T05:58:50.791778+0000","last_clean":"2024-05-09T05:58:50.791778+0000","last_became_active":"2024-05-09T05:53:24.135043+0000","last_became_peered":"2024-05-09T05:53:24.135043+0000","last_unstale":"2024-05-09T05:58:50.791778+0000","last_undegraded":"2024-05-09T05:58:50.791778+0000","last_fullsized":"2024-05-09T05:58:50.791778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-09T05:58:50.791576+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-09T05:58:50.791576+0000","last_clean_scrub_stamp":"2024-05-09T05:58:50.791576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:08:47.683437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"29'6","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:49.834790+0000","last_change":"2024-05-09T05:58:49.834864+0000","last_active":"2024-05-09T05:58:49.834790+0000","last_peered":"2024-05-09T05:58:49.834790+0000","last_clean":"2024-05-09T05:58:49.834790+0000","last_became_active":"2024-05-09T05:53:24.132453+0000","last_became_peered":"2024-05-09T05:53:24.132453+0000","last_unstale":"2024-05-09T05:58:49.834790+0000","last_undegraded":"2024-05-09T05:58:49.834790+0000","last_fullsized":"2024-05-09T05:58:49.834790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-09T05:58:49.834552+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-09T05:58:49.834552+0000","last_clean_scrub_stamp":"2024-05-09T05:58:49.834552+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:56:24.116272+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"29'15","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:47.515625+0000","last_change":"2024-05-09T05:58:47.515714+0000","last_active":"2024-05-09T05:58:47.515625+0000","last_peered":"2024-05-09T05:58:47.515625+0000","last_clean":"2024-05-09T05:58:47.515625+0000","last_became_active":"2024-05-09T05:53:24.140045+0000","last_became_peered":"2024-05-09T05:53:24.140045+0000","last_unstale":"2024-05-09T05:58:47.515625+0000","last_undegraded":"2024-05-09T05:58:47.515625+0000","last_fullsized":"2024-05-09T05:58:47.515625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-05-09T05:58:47.515424+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-05-09T05:58:47.515424+0000","last_clean_scrub_stamp":"2024-05-09T05:58:47.515424+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:11:18.077043+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"29'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:54.931434+0000","last_change":"2024-05-09T05:58:54.931510+0000","last_active":"2024-05-09T05:58:54.931434+0000","last_peered":"2024-05-09T05:58:54.931434+0000","last_clean":"2024-05-09T05:58:54.931434+0000","last_became_active":"2024-05-09T05:53:24.151275+0000","last_became_peered":"2024-05-09T05:53:24.151275+0000","last_unstale":"2024-05-09T05:58:54.931434+0000","last_undegraded":"2024-05-09T05:58:54.931434+0000","last_fullsized":"2024-05-09T05:58:54.931434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-09T05:58:54.931235+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-09T05:58:54.931235+0000","last_clean_scrub_stamp":"2024-05-09T05:58:54.931235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:21:51.172039+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"29'6","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:49.344639+0000","last_change":"2024-05-09T05:58:49.344705+0000","last_active":"2024-05-09T05:58:49.344639+0000","last_peered":"2024-05-09T05:58:49.344639+0000","last_clean":"2024-05-09T05:58:49.344639+0000","last_became_active":"2024-05-09T05:53:24.144005+0000","last_became_peered":"2024-05-09T05:53:24.144005+0000","last_unstale":"2024-05-09T05:58:49.344639+0000","last_undegraded":"2024-05-09T05:58:49.344639+0000","last_fullsized":"2024-05-09T05:58:49.344639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-09T05:58:49.344431+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-09T05:58:49.344431+0000","last_clean_scrub_stamp":"2024-05-09T05:58:49.344431+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:39:44.834463+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"29'8","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:44.793589+0000","last_change":"2024-05-09T05:58:44.793660+0000","last_active":"2024-05-09T05:58:44.793589+0000","last_peered":"2024-05-09T05:58:44.793589+0000","last_clean":"2024-05-09T05:58:44.793589+0000","last_became_active":"2024-05-09T05:53:24.146965+0000","last_became_peered":"2024-05-09T05:53:24.146965+0000","last_unstale":"2024-05-09T05:58:44.793589+0000","last_undegraded":"2024-05-09T05:58:44.793589+0000","last_fullsized":"2024-05-09T05:58:44.793589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-09T05:58:44.793375+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-09T05:58:44.793375+0000","last_clean_scrub_stamp":"2024-05-09T05:58:44.793375+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:09:50.183791+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"29'10","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:42.492980+0000","last_change":"2024-05-09T05:58:42.493047+0000","last_active":"2024-05-09T05:58:42.492980+0000","last_peered":"2024-05-09T05:58:42.492980+0000","last_clean":"2024-05-09T05:58:42.492980+0000","last_became_active":"2024-05-09T05:53:24.131417+0000","last_became_peered":"2024-05-09T05:53:24.131417+0000","last_unstale":"2024-05-09T05:58:42.492980+0000","last_undegraded":"2024-05-09T05:58:42.492980+0000","last_fullsized":"2024-05-09T05:58:42.492980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-09T05:58:42.492788+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-09T05:58:42.492788+0000","last_clean_scrub_stamp":"2024-05-09T05:58:42.492788+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:34:03.858343+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"29'11","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:53.167272+0000","last_change":"2024-05-09T05:58:53.167436+0000","last_active":"2024-05-09T05:58:53.167272+0000","last_peered":"2024-05-09T05:58:53.167272+0000","last_clean":"2024-05-09T05:58:53.167272+0000","last_became_active":"2024-05-09T05:53:24.140024+0000","last_became_peered":"2024-05-09T05:53:24.140024+0000","last_unstale":"2024-05-09T05:58:53.167272+0000","last_undegraded":"2024-05-09T05:58:53.167272+0000","last_fullsized":"2024-05-09T05:58:53.167272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'11","last_scrub_stamp":"2024-05-09T05:58:53.166990+0000","last_deep_scrub":"29'11","last_deep_scrub_stamp":"2024-05-09T05:58:53.166990+0000","last_clean_scrub_stamp":"2024-05-09T05:58:53.166990+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:17:53.409559+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"29'8","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:50.817882+0000","last_change":"2024-05-09T05:58:50.817950+0000","last_active":"2024-05-09T05:58:50.817882+0000","last_peered":"2024-05-09T05:58:50.817882+0000","last_clean":"2024-05-09T05:58:50.817882+0000","last_became_active":"2024-05-09T05:53:24.136572+0000","last_became_peered":"2024-05-09T05:53:24.136572+0000","last_unstale":"2024-05-09T05:58:50.817882+0000","last_undegraded":"2024-05-09T05:58:50.817882+0000","last_fullsized":"2024-05-09T05:58:50.817882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-09T05:58:50.817683+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-09T05:58:50.817683+0000","last_clean_scrub_stamp":"2024-05-09T05:58:50.817683+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:50:05.950510+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"29'7","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:30.163557+0000","last_change":"2024-05-09T05:53:24.147372+0000","last_active":"2024-05-09T05:58:30.163557+0000","last_peered":"2024-05-09T05:58:30.163557+0000","last_clean":"2024-05-09T05:58:30.163557+0000","last_became_active":"2024-05-09T05:53:24.144573+0000","last_became_peered":"2024-05-09T05:53:24.144573+0000","last_unstale":"2024-05-09T05:58:30.163557+0000","last_undegraded":"2024-05-09T05:58:30.163557+0000","last_fullsized":"2024-05-09T05:58:30.163557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:53:23.073858+0000","last_clean_scrub_stamp":"2024-05-09T05:53:23.073858+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"29'10","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:46.516588+0000","last_change":"2024-05-09T05:58:46.516752+0000","last_active":"2024-05-09T05:58:46.516588+0000","last_peered":"2024-05-09T05:58:46.516588+0000","last_clean":"2024-05-09T05:58:46.516588+0000","last_became_active":"2024-05-09T05:53:24.135625+0000","last_became_peered":"2024-05-09T05:53:24.135625+0000","last_unstale":"2024-05-09T05:58:46.516588+0000","last_undegraded":"2024-05-09T05:58:46.516588+0000","last_fullsized":"2024-05-09T05:58:46.516588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-09T05:58:46.516249+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-09T05:58:46.516249+0000","last_clean_scrub_stamp":"2024-05-09T05:58:46.516249+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:45:40.737353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"29'8","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:44.321001+0000","last_change":"2024-05-09T05:58:44.321127+0000","last_active":"2024-05-09T05:58:44.321001+0000","last_peered":"2024-05-09T05:58:44.321001+0000","last_clean":"2024-05-09T05:58:44.321001+0000","last_became_active":"2024-05-09T05:53:24.133405+0000","last_became_peered":"2024-05-09T05:53:24.133405+0000","last_unstale":"2024-05-09T05:58:44.321001+0000","last_undegraded":"2024-05-09T05:58:44.321001+0000","last_fullsized":"2024-05-09T05:58:44.321001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-09T05:58:44.320688+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-09T05:58:44.320688+0000","last_clean_scrub_stamp":"2024-05-09T05:58:44.320688+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:48:48.160173+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"29'9","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:41.318536+0000","last_change":"2024-05-09T05:58:41.318562+0000","last_active":"2024-05-09T05:58:41.318536+0000","last_peered":"2024-05-09T05:58:41.318536+0000","last_clean":"2024-05-09T05:58:41.318536+0000","last_became_active":"2024-05-09T05:53:24.139374+0000","last_became_peered":"2024-05-09T05:53:24.139374+0000","last_unstale":"2024-05-09T05:58:41.318536+0000","last_undegraded":"2024-05-09T05:58:41.318536+0000","last_fullsized":"2024-05-09T05:58:41.318536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-05-09T05:58:41.318452+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-05-09T05:58:41.318452+0000","last_clean_scrub_stamp":"2024-05-09T05:58:41.318452+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:13:44.296256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"29'7","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:43.818174+0000","last_change":"2024-05-09T05:58:43.818243+0000","last_active":"2024-05-09T05:58:43.818174+0000","last_peered":"2024-05-09T05:58:43.818174+0000","last_clean":"2024-05-09T05:58:43.818174+0000","last_became_active":"2024-05-09T05:53:24.145616+0000","last_became_peered":"2024-05-09T05:53:24.145616+0000","last_unstale":"2024-05-09T05:58:43.818174+0000","last_undegraded":"2024-05-09T05:58:43.818174+0000","last_fullsized":"2024-05-09T05:58:43.818174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-05-09T05:58:43.817982+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-05-09T05:58:43.817982+0000","last_clean_scrub_stamp":"2024-05-09T05:58:43.817982+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:52:31.395834+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"29'8","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:46.755004+0000","last_change":"2024-05-09T05:58:46.755075+0000","last_active":"2024-05-09T05:58:46.755004+0000","last_peered":"2024-05-09T05:58:46.755004+0000","last_clean":"2024-05-09T05:58:46.755004+0000","last_became_active":"2024-05-09T05:53:24.128870+0000","last_became_peered":"2024-05-09T05:53:24.128870+0000","last_unstale":"2024-05-09T05:58:46.755004+0000","last_undegraded":"2024-05-09T05:58:46.755004+0000","last_fullsized":"2024-05-09T05:58:46.755004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-09T05:58:46.754803+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-09T05:58:46.754803+0000","last_clean_scrub_stamp":"2024-05-09T05:58:46.754803+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:02:20.384584+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"29'10","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:48.791179+0000","last_change":"2024-05-09T05:58:48.791309+0000","last_active":"2024-05-09T05:58:48.791179+0000","last_peered":"2024-05-09T05:58:48.791179+0000","last_clean":"2024-05-09T05:58:48.791179+0000","last_became_active":"2024-05-09T05:53:24.132688+0000","last_became_peered":"2024-05-09T05:53:24.132688+0000","last_unstale":"2024-05-09T05:58:48.791179+0000","last_undegraded":"2024-05-09T05:58:48.791179+0000","last_fullsized":"2024-05-09T05:58:48.791179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-09T05:58:48.790928+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-09T05:58:48.790928+0000","last_clean_scrub_stamp":"2024-05-09T05:58:48.790928+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:15:49.375135+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"29'7","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:53.812944+0000","last_change":"2024-05-09T05:58:53.813013+0000","last_active":"2024-05-09T05:58:53.812944+0000","last_peered":"2024-05-09T05:58:53.812944+0000","last_clean":"2024-05-09T05:58:53.812944+0000","last_became_active":"2024-05-09T05:53:24.142280+0000","last_became_peered":"2024-05-09T05:53:24.142280+0000","last_unstale":"2024-05-09T05:58:53.812944+0000","last_undegraded":"2024-05-09T05:58:53.812944+0000","last_fullsized":"2024-05-09T05:58:53.812944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-05-09T05:58:53.812755+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-05-09T05:58:53.812755+0000","last_clean_scrub_stamp":"2024-05-09T05:58:53.812755+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:24:43.084628+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"29'6","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:54.786360+0000","last_change":"2024-05-09T05:58:54.786520+0000","last_active":"2024-05-09T05:58:54.786360+0000","last_peered":"2024-05-09T05:58:54.786360+0000","last_clean":"2024-05-09T05:58:54.786360+0000","last_became_active":"2024-05-09T05:53:24.144381+0000","last_became_peered":"2024-05-09T05:53:24.144381+0000","last_unstale":"2024-05-09T05:58:54.786360+0000","last_undegraded":"2024-05-09T05:58:54.786360+0000","last_fullsized":"2024-05-09T05:58:54.786360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-09T05:58:54.786099+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-09T05:58:54.786099+0000","last_clean_scrub_stamp":"2024-05-09T05:58:54.786099+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:54:56.044842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"29'16","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:48.803371+0000","last_change":"2024-05-09T05:58:48.803449+0000","last_active":"2024-05-09T05:58:48.803371+0000","last_peered":"2024-05-09T05:58:48.803371+0000","last_clean":"2024-05-09T05:58:48.803371+0000","last_became_active":"2024-05-09T05:53:24.131218+0000","last_became_peered":"2024-05-09T05:53:24.131218+0000","last_unstale":"2024-05-09T05:58:48.803371+0000","last_undegraded":"2024-05-09T05:58:48.803371+0000","last_fullsized":"2024-05-09T05:58:48.803371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-05-09T05:58:48.803166+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-05-09T05:58:48.803166+0000","last_clean_scrub_stamp":"2024-05-09T05:58:48.803166+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:46:19.864725+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"29'11","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:45.495530+0000","last_change":"2024-05-09T05:58:45.495598+0000","last_active":"2024-05-09T05:58:45.495530+0000","last_peered":"2024-05-09T05:58:45.495530+0000","last_clean":"2024-05-09T05:58:45.495530+0000","last_became_active":"2024-05-09T05:53:24.139473+0000","last_became_peered":"2024-05-09T05:53:24.139473+0000","last_unstale":"2024-05-09T05:58:45.495530+0000","last_undegraded":"2024-05-09T05:58:45.495530+0000","last_fullsized":"2024-05-09T05:58:45.495530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'11","last_scrub_stamp":"2024-05-09T05:58:45.495349+0000","last_deep_scrub":"29'11","last_deep_scrub_stamp":"2024-05-09T05:58:45.495349+0000","last_clean_scrub_stamp":"2024-05-09T05:58:45.495349+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:21:36.200041+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"29'9","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:52.876803+0000","last_change":"2024-05-09T05:58:52.876877+0000","last_active":"2024-05-09T05:58:52.876803+0000","last_peered":"2024-05-09T05:58:52.876803+0000","last_clean":"2024-05-09T05:58:52.876803+0000","last_became_active":"2024-05-09T05:53:24.143053+0000","last_became_peered":"2024-05-09T05:53:24.143053+0000","last_unstale":"2024-05-09T05:58:52.876803+0000","last_undegraded":"2024-05-09T05:58:52.876803+0000","last_fullsized":"2024-05-09T05:58:52.876803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-05-09T05:58:52.876572+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-05-09T05:58:52.876572+0000","last_clean_scrub_stamp":"2024-05-09T05:58:52.876572+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:23:49.737399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"29'5","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:55.771689+0000","last_change":"2024-05-09T05:58:55.771817+0000","last_active":"2024-05-09T05:58:55.771689+0000","last_peered":"2024-05-09T05:58:55.771689+0000","last_clean":"2024-05-09T05:58:55.771689+0000","last_became_active":"2024-05-09T05:53:24.145150+0000","last_became_peered":"2024-05-09T05:53:24.145150+0000","last_unstale":"2024-05-09T05:58:55.771689+0000","last_undegraded":"2024-05-09T05:58:55.771689+0000","last_fullsized":"2024-05-09T05:58:55.771689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-05-09T05:58:55.771302+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-05-09T05:58:55.771302+0000","last_clean_scrub_stamp":"2024-05-09T05:58:55.771302+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:27:44.851705+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"29'6","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:42.565921+0000","last_change":"2024-05-09T05:58:42.565967+0000","last_active":"2024-05-09T05:58:42.565921+0000","last_peered":"2024-05-09T05:58:42.565921+0000","last_clean":"2024-05-09T05:58:42.565921+0000","last_became_active":"2024-05-09T05:53:24.129339+0000","last_became_peered":"2024-05-09T05:53:24.129339+0000","last_unstale":"2024-05-09T05:58:42.565921+0000","last_undegraded":"2024-05-09T05:58:42.565921+0000","last_fullsized":"2024-05-09T05:58:42.565921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-09T05:58:42.565827+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-09T05:58:42.565827+0000","last_clean_scrub_stamp":"2024-05-09T05:58:42.565827+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:59:55.093867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"29'4","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:51.788477+0000","last_change":"2024-05-09T05:58:51.788548+0000","last_active":"2024-05-09T05:58:51.788477+0000","last_peered":"2024-05-09T05:58:51.788477+0000","last_clean":"2024-05-09T05:58:51.788477+0000","last_became_active":"2024-05-09T05:53:24.138499+0000","last_became_peered":"2024-05-09T05:53:24.138499+0000","last_unstale":"2024-05-09T05:58:51.788477+0000","last_undegraded":"2024-05-09T05:58:51.788477+0000","last_fullsized":"2024-05-09T05:58:51.788477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-09T05:58:51.788274+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-09T05:58:51.788274+0000","last_clean_scrub_stamp":"2024-05-09T05:58:51.788274+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:59:48.715614+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"29'8","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:48.532325+0000","last_change":"2024-05-09T05:58:48.532455+0000","last_active":"2024-05-09T05:58:48.532325+0000","last_peered":"2024-05-09T05:58:48.532325+0000","last_clean":"2024-05-09T05:58:48.532325+0000","last_became_active":"2024-05-09T05:53:24.143890+0000","last_became_peered":"2024-05-09T05:53:24.143890+0000","last_unstale":"2024-05-09T05:58:48.532325+0000","last_undegraded":"2024-05-09T05:58:48.532325+0000","last_fullsized":"2024-05-09T05:58:48.532325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-09T05:58:48.531982+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-09T05:58:48.531982+0000","last_clean_scrub_stamp":"2024-05-09T05:58:48.531982+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:35:45.237691+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"29'7","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:56.978147+0000","last_change":"2024-05-09T05:58:56.978219+0000","last_active":"2024-05-09T05:58:56.978147+0000","last_peered":"2024-05-09T05:58:56.978147+0000","last_clean":"2024-05-09T05:58:56.978147+0000","last_became_active":"2024-05-09T05:53:24.151674+0000","last_became_peered":"2024-05-09T05:53:24.151674+0000","last_unstale":"2024-05-09T05:58:56.978147+0000","last_undegraded":"2024-05-09T05:58:56.978147+0000","last_fullsized":"2024-05-09T05:58:56.978147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-05-09T05:58:56.977887+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-05-09T05:58:56.977887+0000","last_clean_scrub_stamp":"2024-05-09T05:58:56.977887+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:59:49.685408+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"29'4","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:57.985166+0000","last_change":"2024-05-09T05:58:57.985238+0000","last_active":"2024-05-09T05:58:57.985166+0000","last_peered":"2024-05-09T05:58:57.985166+0000","last_clean":"2024-05-09T05:58:57.985166+0000","last_became_active":"2024-05-09T05:53:24.151418+0000","last_became_peered":"2024-05-09T05:53:24.151418+0000","last_unstale":"2024-05-09T05:58:57.985166+0000","last_undegraded":"2024-05-09T05:58:57.985166+0000","last_fullsized":"2024-05-09T05:58:57.985166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-09T05:58:57.984921+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-09T05:58:57.984921+0000","last_clean_scrub_stamp":"2024-05-09T05:58:57.984921+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:16:39.536674+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"29'8","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:52.809294+0000","last_change":"2024-05-09T05:58:52.809429+0000","last_active":"2024-05-09T05:58:52.809294+0000","last_peered":"2024-05-09T05:58:52.809294+0000","last_clean":"2024-05-09T05:58:52.809294+0000","last_became_active":"2024-05-09T05:53:24.140589+0000","last_became_peered":"2024-05-09T05:53:24.140589+0000","last_unstale":"2024-05-09T05:58:52.809294+0000","last_undegraded":"2024-05-09T05:58:52.809294+0000","last_fullsized":"2024-05-09T05:58:52.809294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-09T05:58:52.809040+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-09T05:58:52.809040+0000","last_clean_scrub_stamp":"2024-05-09T05:58:52.809040+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:17:34.396269+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9216,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9217,"ondisk_log_size":9217,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":503,"ondisk_log_size":503,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":222778,"num_objects":99,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":153,"num_read_kb":159,"num_write":358,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":696320,"data_stored":445556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":420,"ondisk_log_size":420,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509512,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71708,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94300132,"statfs":{"total":96636764160,"available":96563335168,"internally_reserved":0,"allocated":348160,"data_stored":131030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":73071050},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509515,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71688,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94300152,"statfs":{"total":96636764160,"available":96563355648,"internally_reserved":0,"allocated":327680,"data_stored":132991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":73071047},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509515,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49788,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94322052,"statfs":{"total":96636764160,"available":96585781248,"internally_reserved":0,"allocated":577536,"data_stored":345366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509512,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58072,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313768,"statfs":{"total":96636764160,"available":96577298432,"internally_reserved":0,"allocated":540672,"data_stored":343596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509514,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68108,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94303732,"statfs":{"total":96636764160,"available":96567021568,"internally_reserved":0,"allocated":921600,"data_stored":721229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68811205},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509514,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53720,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94318120,"statfs":{"total":96636764160,"available":96581754880,"internally_reserved":0,"allocated":344064,"data_stored":133153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574920,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50132,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321708,"statfs":{"total":96636764160,"available":96585428992,"internally_reserved":0,"allocated":929792,"data_stored":721752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574921,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67552,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94304288,"statfs":{"total":96636764160,"available":96567590912,"internally_reserved":0,"allocated":352256,"data_stored":132751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68811207},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":3706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":233472,"data_stored":214149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":270336,"data_stored":215919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T05:59:04.236 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-05-09T05:53:27.153646+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=27, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:59:04.236 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-05-09T05:53:23.073858+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=23, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:59:04.236 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-05-09T05:53:27.153646+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=27, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:59:04.237 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-05-09T05:53:27.153646+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=27, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:59:04.237 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-05-09T05:53:27.153646+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=27, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:59:04.237 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-05-09T05:53:27.153646+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=27, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:59:04.237 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-05-09T05:53:27.153646+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=27, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:59:04.237 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-09T05:53:23.073858+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=23, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:59:04.237 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-05-09T05:53:27.153646+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=27, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:59:04.238 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-05-09T05:53:27.153646+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=27, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:59:04.238 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-09T05:53:23.073858+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=53, tm_sec=23, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=58, tm_sec=38, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:59:04.238 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-09T05:59:24.239 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T05:59:24.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.414+0000 7f61ed1c8640 1 Processor -- start 2024-05-09T05:59:24.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.414+0000 7f61ed1c8640 1 -- start start 2024-05-09T05:59:24.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.414+0000 7f61ed1c8640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f61e80b3b70 0x7f61e8073c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:24.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.414+0000 7f61ed1c8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f61e815d6f0 0x7f61e8163f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:24.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.414+0000 7f61ed1c8640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61e8068dc0 con 0x7f61e815cbd0 2024-05-09T05:59:24.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.414+0000 7f61ed1c8640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f61e806efb0 con 0x7f61e80b3b70 2024-05-09T05:59:24.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.414+0000 7f61ed1c8640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f61e8068820 con 0x7f61e815d6f0 2024-05-09T05:59:24.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.414+0000 7f61e659c640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f61e815cbd0 0x7f61e815cfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:46338/0 (socket says 172.21.15.72:46338) 2024-05-09T05:59:24.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.414+0000 7f61e659c640 1 -- 172.21.15.72:0/1488997161 learned_addr learned my addr 172.21.15.72:0/1488997161 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:59:24.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.414+0000 7f61e5d9b640 1 -- 172.21.15.72:0/1488997161 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3350668408 0 0) 0x7f61e8068dc0 con 0x7f61e815cbd0 2024-05-09T05:59:24.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.414+0000 7f61e6d9d640 1 --2- 172.21.15.72:0/1488997161 >> v2:172.21.15.110:3300/0 conn(0x7f61e80b3b70 0x7f61e8073c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:24.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.414+0000 7f61e759e640 1 --2- 172.21.15.72:0/1488997161 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f61e815d6f0 0x7f61e8163f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:24.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.414+0000 7f61e5d9b640 1 -- 172.21.15.72:0/1488997161 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61d4003530 con 0x7f61e815cbd0 2024-05-09T05:59:24.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.414+0000 7f61e5d9b640 1 -- 172.21.15.72:0/1488997161 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1091845571 0 0) 0x7f61d4003530 con 0x7f61e815cbd0 2024-05-09T05:59:24.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.414+0000 7f61e5d9b640 1 -- 172.21.15.72:0/1488997161 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f61e815d6f0 msgr2=0x7f61e8163f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:59:24.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.414+0000 7f61e5d9b640 1 --2- 172.21.15.72:0/1488997161 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f61e815d6f0 0x7f61e8163f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:24.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.414+0000 7f61e5d9b640 1 -- 172.21.15.72:0/1488997161 >> v2:172.21.15.110:3300/0 conn(0x7f61e80b3b70 msgr2=0x7f61e8073c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:59:24.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.414+0000 7f61e5d9b640 1 --2- 172.21.15.72:0/1488997161 >> v2:172.21.15.110:3300/0 conn(0x7f61e80b3b70 0x7f61e8073c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:24.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.414+0000 7f61e5d9b640 1 -- 172.21.15.72:0/1488997161 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61e8068ae0 con 0x7f61e815cbd0 2024-05-09T05:59:24.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.418+0000 7f61e5d9b640 1 -- 172.21.15.72:0/1488997161 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2749052815 0 0) 0x7f61e0001700 con 0x7f61e815cbd0 2024-05-09T05:59:24.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.418+0000 7f61e5d9b640 1 -- 172.21.15.72:0/1488997161 >> v1:172.21.15.72:6789/0 conn(0x7f61e815cbd0 legacy=0x7f61e815cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:59:24.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.418+0000 7f61e5d9b640 1 --2- 172.21.15.72:0/1488997161 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61d4003a10 0x7f61d4003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:24.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.418+0000 7f61e5d9b640 1 --2- 172.21.15.72:0/1488997161 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61d4004810 0x7f61d4004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:24.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.418+0000 7f61e5d9b640 1 --2- 172.21.15.72:0/1488997161 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f61e815d6f0 0x7f61d4005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:24.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.418+0000 7f61e5d9b640 1 -- 172.21.15.72:0/1488997161 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f61e806efb0 con 0x7f61d4003a10 2024-05-09T05:59:24.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.418+0000 7f61e5d9b640 1 -- 172.21.15.72:0/1488997161 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f61e8068820 con 0x7f61d4004810 2024-05-09T05:59:24.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.418+0000 7f61e5d9b640 1 -- 172.21.15.72:0/1488997161 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f61d400bb00 con 0x7f61e815d6f0 2024-05-09T05:59:24.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.418+0000 7f61e6d9d640 1 --2- 172.21.15.72:0/1488997161 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61d4003a10 0x7f61d4003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:24.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.418+0000 7f61e759e640 1 --2- 172.21.15.72:0/1488997161 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f61e815d6f0 0x7f61d4005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:24.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.418+0000 7f61e6d9d640 1 -- 172.21.15.72:0/1488997161 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f61e815d6f0 msgr2=0x7f61d4005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:59:24.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.418+0000 7f61e6d9d640 1 --2- 172.21.15.72:0/1488997161 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f61e815d6f0 0x7f61d4005160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:24.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.418+0000 7f61e6d9d640 1 -- 172.21.15.72:0/1488997161 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61d4004810 msgr2=0x7f61d4004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:59:24.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.418+0000 7f61e6d9d640 1 --2- 172.21.15.72:0/1488997161 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61d4004810 0x7f61d4004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:24.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.418+0000 7f61e6d9d640 1 -- 172.21.15.72:0/1488997161 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61d4003530 con 0x7f61d4003a10 2024-05-09T05:59:24.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.418+0000 7f61e6d9d640 1 --2- 172.21.15.72:0/1488997161 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61d4003a10 0x7f61d4003e80 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f61d0009fc0 tx=0x7f61d001cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab7b32b49c91c2c3 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:59:24.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.418+0000 7f61e5d9b640 1 -- 172.21.15.72:0/1488997161 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d00b2070 con 0x7f61d4003a10 2024-05-09T05:59:24.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.418+0000 7f61e5d9b640 1 -- 172.21.15.72:0/1488997161 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61d00a5d60 con 0x7f61d4003a10 2024-05-09T05:59:24.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.418+0000 7f61e5d9b640 1 -- 172.21.15.72:0/1488997161 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d0009c10 con 0x7f61d4003a10 2024-05-09T05:59:24.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.418+0000 7f61ed1c8640 1 -- 172.21.15.72:0/1488997161 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61d4003a10 msgr2=0x7f61d4003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:59:24.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.418+0000 7f61ed1c8640 1 --2- 172.21.15.72:0/1488997161 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61d4003a10 0x7f61d4003e80 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f61d0009fc0 tx=0x7f61d001cd50 comp rx=0 tx=0).stop 2024-05-09T05:59:24.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.418+0000 7f61e759e640 1 -- 172.21.15.72:0/1488997161 reap_dead start 2024-05-09T05:59:24.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.418+0000 7f61ed1c8640 1 -- 172.21.15.72:0/1488997161 shutdown_connections 2024-05-09T05:59:24.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.418+0000 7f61ed1c8640 1 -- 172.21.15.72:0/1488997161 >> 172.21.15.72:0/1488997161 conn(0x7f61e80cbe10 msgr2=0x7f61e80cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:59:24.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.418+0000 7f61ed1c8640 1 -- 172.21.15.72:0/1488997161 shutdown_connections 2024-05-09T05:59:24.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.418+0000 7f61ed1c8640 1 -- 172.21.15.72:0/1488997161 wait complete. 2024-05-09T05:59:24.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.422+0000 7f61ed1c8640 1 Processor -- start 2024-05-09T05:59:24.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.422+0000 7f61ed1c8640 1 -- start start 2024-05-09T05:59:24.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.422+0000 7f61ed1c8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61d4003a10 0x7f61e80c12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:24.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.422+0000 7f61ed1c8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f61e8158500 0x7f61e81f40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:24.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.422+0000 7f61ed1c8640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61e81520f0 0x7f61e8156700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:24.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.422+0000 7f61ed1c8640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f61e806db80 con 0x7f61e81520f0 2024-05-09T05:59:24.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.422+0000 7f61ed1c8640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f61e806cb90 con 0x7f61d4003a10 2024-05-09T05:59:24.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.422+0000 7f61ed1c8640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f61e80b3f80 con 0x7f61e8158500 2024-05-09T05:59:24.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.422+0000 7f61e759e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61e81520f0 0x7f61e8156700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:24.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.422+0000 7f61e759e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61e81520f0 0x7f61e8156700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60030/0 (socket says 172.21.15.72:60030) 2024-05-09T05:59:24.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.422+0000 7f61e759e640 1 -- 172.21.15.72:0/2830552676 learned_addr learned my addr 172.21.15.72:0/2830552676 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:59:24.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.422+0000 7f61e659c640 1 --2- 172.21.15.72:0/2830552676 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f61e8158500 0x7f61e81f40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:24.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.422+0000 7f61e6d9d640 1 --2- 172.21.15.72:0/2830552676 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61d4003a10 0x7f61e80c12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:24.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.422+0000 7f61e759e640 1 -- 172.21.15.72:0/2830552676 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f61e8158500 msgr2=0x7f61e81f40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:59:24.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.422+0000 7f61e759e640 1 --2- 172.21.15.72:0/2830552676 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f61e8158500 0x7f61e81f40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:24.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.422+0000 7f61e759e640 1 -- 172.21.15.72:0/2830552676 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61d4003a10 msgr2=0x7f61e80c12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:59:24.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.422+0000 7f61e759e640 1 --2- 172.21.15.72:0/2830552676 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61d4003a10 0x7f61e80c12e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:24.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.422+0000 7f61e759e640 1 -- 172.21.15.72:0/2830552676 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61e80c8010 con 0x7f61e81520f0 2024-05-09T05:59:24.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.422+0000 7f61e6d9d640 1 --2- 172.21.15.72:0/2830552676 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61d4003a10 0x7f61e80c12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:59:24.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.422+0000 7f61e759e640 1 --2- 172.21.15.72:0/2830552676 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61e81520f0 0x7f61e8156700 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f61e80c1de0 tx=0x7f61d8010c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:59:24.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.422+0000 7f61df7fe640 1 -- 172.21.15.72:0/2830552676 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d800f040 con 0x7f61e81520f0 2024-05-09T05:59:24.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.422+0000 7f61df7fe640 1 -- 172.21.15.72:0/2830552676 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61d800e8c0 con 0x7f61e81520f0 2024-05-09T05:59:24.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.422+0000 7f61ed1c8640 1 -- 172.21.15.72:0/2830552676 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61e8152a40 con 0x7f61e81520f0 2024-05-09T05:59:24.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.422+0000 7f61df7fe640 1 -- 172.21.15.72:0/2830552676 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d800ecb0 con 0x7f61e81520f0 2024-05-09T05:59:24.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.422+0000 7f61ed1c8640 1 -- 172.21.15.72:0/2830552676 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61e81f45f0 con 0x7f61e81520f0 2024-05-09T05:59:24.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.426+0000 7f61ed1c8640 1 -- 172.21.15.72:0/2830552676 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61e80c4040 con 0x7f61e81520f0 2024-05-09T05:59:24.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.426+0000 7f61df7fe640 1 -- 172.21.15.72:0/2830552676 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f61d8025420 con 0x7f61e81520f0 2024-05-09T05:59:24.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.426+0000 7f61df7fe640 1 --2- 172.21.15.72:0/2830552676 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f61c806f400 0x7f61c8071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:24.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.426+0000 7f61df7fe640 1 -- 172.21.15.72:0/2830552676 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6762+0+0 (secure 0 0 0) 0x7f61d808f8b0 con 0x7f61e81520f0 2024-05-09T05:59:24.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.426+0000 7f61e6d9d640 1 --2- 172.21.15.72:0/2830552676 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f61c806f400 0x7f61c8071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:24.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.426+0000 7f61e6d9d640 1 --2- 172.21.15.72:0/2830552676 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f61c806f400 0x7f61c8071910 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f61d001cd90 tx=0x7f61d00a7040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:59:24.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.430+0000 7f61df7fe640 1 -- 172.21.15.72:0/2830552676 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f61e8152a40 con 0x7f61e81520f0 2024-05-09T05:59:24.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.590+0000 7f61ed1c8640 1 -- 172.21.15.72:0/2830552676 --> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f61e806a520 con 0x7f61c806f400 2024-05-09T05:59:24.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.614+0000 7f61df7fe640 1 -- 172.21.15.72:0/2830552676 <== mgr.4102 v2:172.21.15.110:6832/1113420672 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+333779 (secure 0 0 0) 0x7f61e806a520 con 0x7f61c806f400 2024-05-09T05:59:24.607 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:59:24.609 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2024-05-09T05:59:24.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.618+0000 7f61ed1c8640 1 -- 172.21.15.72:0/2830552676 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f61c806f400 msgr2=0x7f61c8071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:59:24.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.618+0000 7f61ed1c8640 1 --2- 172.21.15.72:0/2830552676 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f61c806f400 0x7f61c8071910 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f61d001cd90 tx=0x7f61d00a7040 comp rx=0 tx=0).stop 2024-05-09T05:59:24.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.618+0000 7f61ed1c8640 1 -- 172.21.15.72:0/2830552676 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61e81520f0 msgr2=0x7f61e8156700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:59:24.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.618+0000 7f61ed1c8640 1 --2- 172.21.15.72:0/2830552676 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61e81520f0 0x7f61e8156700 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f61e80c1de0 tx=0x7f61d8010c20 comp rx=0 tx=0).stop 2024-05-09T05:59:24.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.618+0000 7f61ed1c8640 1 -- 172.21.15.72:0/2830552676 shutdown_connections 2024-05-09T05:59:24.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.618+0000 7f61ed1c8640 1 --2- 172.21.15.72:0/2830552676 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f61c806f400 0x7f61c8071910 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:24.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.618+0000 7f61ed1c8640 1 --2- 172.21.15.72:0/2830552676 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61e81520f0 0x7f61e8156700 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:24.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.618+0000 7f61ed1c8640 1 --2- 172.21.15.72:0/2830552676 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f61e8158500 0x7f61e81f40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:24.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.618+0000 7f61ed1c8640 1 --2- 172.21.15.72:0/2830552676 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61d4003a10 0x7f61e80c12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:24.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.618+0000 7f61ed1c8640 1 -- 172.21.15.72:0/2830552676 >> 172.21.15.72:0/2830552676 conn(0x7f61e80cbe10 msgr2=0x7f61e80c76c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:59:24.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.618+0000 7f61ed1c8640 1 -- 172.21.15.72:0/2830552676 shutdown_connections 2024-05-09T05:59:24.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.622+0000 7f61ed1c8640 1 -- 172.21.15.72:0/2830552676 wait complete. 2024-05-09T05:59:24.630 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":209,"stamp":"2024-05-09T05:59:22.626726+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":813146,"num_objects":101,"num_object_clones":0,"num_object_copies":202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":101,"num_whiteouts":0,"num_read":219,"num_read_kb":214,"num_write":9675,"num_write_kb":25167793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10214,"ondisk_log_size":10214,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":490768,"kb_used_data":4240,"kb_used_omap":12,"kb_used_meta":486451,"kb_avail":754483952,"statfs":{"total":773094113280,"available":772591566848,"internally_reserved":0,"allocated":4341760,"data_stored":2661868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":498126385},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006493"},"pg_stats":[{"pgid":"2.1f","version":"29'21","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:46.166208+0000","last_change":"2024-05-09T05:58:46.166296+0000","last_active":"2024-05-09T05:58:46.166208+0000","last_peered":"2024-05-09T05:58:46.166208+0000","last_clean":"2024-05-09T05:58:46.166208+0000","last_became_active":"2024-05-09T05:53:23.121097+0000","last_became_peered":"2024-05-09T05:53:23.121097+0000","last_unstale":"2024-05-09T05:58:46.166208+0000","last_undegraded":"2024-05-09T05:58:46.166208+0000","last_fullsized":"2024-05-09T05:58:46.166208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'21","last_scrub_stamp":"2024-05-09T05:58:46.166000+0000","last_deep_scrub":"29'21","last_deep_scrub_stamp":"2024-05-09T05:58:46.166000+0000","last_clean_scrub_stamp":"2024-05-09T05:58:46.166000+0000","objects_scrubbed":6,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:30:36.128640+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"29'5","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:45.796855+0000","last_change":"2024-05-09T05:58:45.796982+0000","last_active":"2024-05-09T05:58:45.796855+0000","last_peered":"2024-05-09T05:58:45.796855+0000","last_clean":"2024-05-09T05:58:45.796855+0000","last_became_active":"2024-05-09T05:53:24.146540+0000","last_became_peered":"2024-05-09T05:53:24.146540+0000","last_unstale":"2024-05-09T05:58:45.796855+0000","last_undegraded":"2024-05-09T05:58:45.796855+0000","last_fullsized":"2024-05-09T05:58:45.796855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-05-09T05:58:45.796497+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-05-09T05:58:45.796497+0000","last_clean_scrub_stamp":"2024-05-09T05:58:45.796497+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:53:20.097174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"29'306","reported_seq":339,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:51.618677+0000","last_change":"2024-05-09T05:58:51.618753+0000","last_active":"2024-05-09T05:58:51.618677+0000","last_peered":"2024-05-09T05:58:51.618677+0000","last_clean":"2024-05-09T05:58:51.618677+0000","last_became_active":"2024-05-09T05:53:28.235305+0000","last_became_peered":"2024-05-09T05:53:28.235305+0000","last_unstale":"2024-05-09T05:58:51.618677+0000","last_undegraded":"2024-05-09T05:58:51.618677+0000","last_fullsized":"2024-05-09T05:58:51.618677+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'306","last_scrub_stamp":"2024-05-09T05:58:51.618468+0000","last_deep_scrub":"29'306","last_deep_scrub_stamp":"2024-05-09T05:58:51.618468+0000","last_clean_scrub_stamp":"2024-05-09T05:58:51.618468+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:31:52.722355+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":306,"num_write_kb":835584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"25'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:48.853168+0000","last_change":"2024-05-09T05:58:48.853260+0000","last_active":"2024-05-09T05:58:48.853168+0000","last_peered":"2024-05-09T05:58:48.853168+0000","last_clean":"2024-05-09T05:58:48.853168+0000","last_became_active":"2024-05-09T05:53:23.138431+0000","last_became_peered":"2024-05-09T05:53:23.138431+0000","last_unstale":"2024-05-09T05:58:48.853168+0000","last_undegraded":"2024-05-09T05:58:48.853168+0000","last_fullsized":"2024-05-09T05:58:48.853168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-05-09T05:58:48.852956+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-05-09T05:58:48.852956+0000","last_clean_scrub_stamp":"2024-05-09T05:58:48.852956+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:37:54.240412+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"29'6","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:55.936090+0000","last_change":"2024-05-09T05:58:55.936241+0000","last_active":"2024-05-09T05:58:55.936090+0000","last_peered":"2024-05-09T05:58:55.936090+0000","last_clean":"2024-05-09T05:58:55.936090+0000","last_became_active":"2024-05-09T05:53:24.151407+0000","last_became_peered":"2024-05-09T05:53:24.151407+0000","last_unstale":"2024-05-09T05:58:55.936090+0000","last_undegraded":"2024-05-09T05:58:55.936090+0000","last_fullsized":"2024-05-09T05:58:55.936090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-09T05:58:55.935842+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-09T05:58:55.935842+0000","last_clean_scrub_stamp":"2024-05-09T05:58:55.935842+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:19:45.145948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"29'339","reported_seq":372,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:54.529210+0000","last_change":"2024-05-09T05:58:54.529279+0000","last_active":"2024-05-09T05:58:54.529210+0000","last_peered":"2024-05-09T05:58:54.529210+0000","last_clean":"2024-05-09T05:58:54.529210+0000","last_became_active":"2024-05-09T05:53:28.213021+0000","last_became_peered":"2024-05-09T05:53:28.213021+0000","last_unstale":"2024-05-09T05:58:54.529210+0000","last_undegraded":"2024-05-09T05:58:54.529210+0000","last_fullsized":"2024-05-09T05:58:54.529210+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'339","last_scrub_stamp":"2024-05-09T05:58:54.529011+0000","last_deep_scrub":"29'339","last_deep_scrub_stamp":"2024-05-09T05:58:54.529011+0000","last_clean_scrub_stamp":"2024-05-09T05:58:54.529011+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:09:21.016415+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":925696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"29'22","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:41.829454+0000","last_change":"2024-05-09T05:58:41.829530+0000","last_active":"2024-05-09T05:58:41.829454+0000","last_peered":"2024-05-09T05:58:41.829454+0000","last_clean":"2024-05-09T05:58:41.829454+0000","last_became_active":"2024-05-09T05:53:23.094826+0000","last_became_peered":"2024-05-09T05:53:23.094826+0000","last_unstale":"2024-05-09T05:58:41.829454+0000","last_undegraded":"2024-05-09T05:58:41.829454+0000","last_fullsized":"2024-05-09T05:58:41.829454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'22","last_scrub_stamp":"2024-05-09T05:58:41.829340+0000","last_deep_scrub":"29'22","last_deep_scrub_stamp":"2024-05-09T05:58:41.829340+0000","last_clean_scrub_stamp":"2024-05-09T05:58:41.829340+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:43:51.707469+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"29'9","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:43.498697+0000","last_change":"2024-05-09T05:58:43.498722+0000","last_active":"2024-05-09T05:58:43.498697+0000","last_peered":"2024-05-09T05:58:43.498697+0000","last_clean":"2024-05-09T05:58:43.498697+0000","last_became_active":"2024-05-09T05:53:24.134610+0000","last_became_peered":"2024-05-09T05:53:24.134610+0000","last_unstale":"2024-05-09T05:58:43.498697+0000","last_undegraded":"2024-05-09T05:58:43.498697+0000","last_fullsized":"2024-05-09T05:58:43.498697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-05-09T05:58:43.498621+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-05-09T05:58:43.498621+0000","last_clean_scrub_stamp":"2024-05-09T05:58:43.498621+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:03:41.573691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"29'273","reported_seq":306,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:53.517350+0000","last_change":"2024-05-09T05:58:53.517422+0000","last_active":"2024-05-09T05:58:53.517350+0000","last_peered":"2024-05-09T05:58:53.517350+0000","last_clean":"2024-05-09T05:58:53.517350+0000","last_became_active":"2024-05-09T05:53:28.205229+0000","last_became_peered":"2024-05-09T05:53:28.205229+0000","last_unstale":"2024-05-09T05:58:53.517350+0000","last_undegraded":"2024-05-09T05:58:53.517350+0000","last_fullsized":"2024-05-09T05:58:53.517350+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'273","last_scrub_stamp":"2024-05-09T05:58:53.517154+0000","last_deep_scrub":"29'273","last_deep_scrub_stamp":"2024-05-09T05:58:53.517154+0000","last_clean_scrub_stamp":"2024-05-09T05:58:53.517154+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:39:54.292745+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"29'8","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:43.851258+0000","last_change":"2024-05-09T05:58:43.851288+0000","last_active":"2024-05-09T05:58:43.851258+0000","last_peered":"2024-05-09T05:58:43.851258+0000","last_clean":"2024-05-09T05:58:43.851258+0000","last_became_active":"2024-05-09T05:53:23.094760+0000","last_became_peered":"2024-05-09T05:53:23.094760+0000","last_unstale":"2024-05-09T05:58:43.851258+0000","last_undegraded":"2024-05-09T05:58:43.851258+0000","last_fullsized":"2024-05-09T05:58:43.851258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-09T05:58:43.851185+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-09T05:58:43.851185+0000","last_clean_scrub_stamp":"2024-05-09T05:58:43.851185+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:09:07.685151+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"29'15","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:42.284356+0000","last_change":"2024-05-09T05:58:42.284420+0000","last_active":"2024-05-09T05:58:42.284356+0000","last_peered":"2024-05-09T05:58:42.284356+0000","last_clean":"2024-05-09T05:58:42.284356+0000","last_became_active":"2024-05-09T05:53:24.139109+0000","last_became_peered":"2024-05-09T05:53:24.139109+0000","last_unstale":"2024-05-09T05:58:42.284356+0000","last_undegraded":"2024-05-09T05:58:42.284356+0000","last_fullsized":"2024-05-09T05:58:42.284356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-05-09T05:58:42.284169+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-05-09T05:58:42.284169+0000","last_clean_scrub_stamp":"2024-05-09T05:58:42.284169+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:49:09.248349+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"29'252","reported_seq":285,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:55.535102+0000","last_change":"2024-05-09T05:58:55.535180+0000","last_active":"2024-05-09T05:58:55.535102+0000","last_peered":"2024-05-09T05:58:55.535102+0000","last_clean":"2024-05-09T05:58:55.535102+0000","last_became_active":"2024-05-09T05:53:28.215482+0000","last_became_peered":"2024-05-09T05:53:28.215482+0000","last_unstale":"2024-05-09T05:58:55.535102+0000","last_undegraded":"2024-05-09T05:58:55.535102+0000","last_fullsized":"2024-05-09T05:58:55.535102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'252","last_scrub_stamp":"2024-05-09T05:58:55.534888+0000","last_deep_scrub":"29'252","last_deep_scrub_stamp":"2024-05-09T05:58:55.534888+0000","last_clean_scrub_stamp":"2024-05-09T05:58:55.534888+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:56:48.654742+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":688128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"29'5","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:48.310499+0000","last_change":"2024-05-09T05:58:48.310570+0000","last_active":"2024-05-09T05:58:48.310499+0000","last_peered":"2024-05-09T05:58:48.310499+0000","last_clean":"2024-05-09T05:58:48.310499+0000","last_became_active":"2024-05-09T05:53:24.132118+0000","last_became_peered":"2024-05-09T05:53:24.132118+0000","last_unstale":"2024-05-09T05:58:48.310499+0000","last_undegraded":"2024-05-09T05:58:48.310499+0000","last_fullsized":"2024-05-09T05:58:48.310499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-05-09T05:58:48.310293+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-05-09T05:58:48.310293+0000","last_clean_scrub_stamp":"2024-05-09T05:58:48.310293+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:34:14.471232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"29'7","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:52.315519+0000","last_change":"2024-05-09T05:58:52.315599+0000","last_active":"2024-05-09T05:58:52.315519+0000","last_peered":"2024-05-09T05:58:52.315519+0000","last_clean":"2024-05-09T05:58:52.315519+0000","last_became_active":"2024-05-09T05:53:23.114179+0000","last_became_peered":"2024-05-09T05:53:23.114179+0000","last_unstale":"2024-05-09T05:58:52.315519+0000","last_undegraded":"2024-05-09T05:58:52.315519+0000","last_fullsized":"2024-05-09T05:58:52.315519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-05-09T05:58:52.315318+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-05-09T05:58:52.315318+0000","last_clean_scrub_stamp":"2024-05-09T05:58:52.315318+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:55:03.917904+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"29'309","reported_seq":342,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:59:04.223157+0000","last_change":"2024-05-09T05:59:04.223244+0000","last_active":"2024-05-09T05:59:04.223157+0000","last_peered":"2024-05-09T05:59:04.223157+0000","last_clean":"2024-05-09T05:59:04.223157+0000","last_became_active":"2024-05-09T05:53:28.226427+0000","last_became_peered":"2024-05-09T05:53:28.226427+0000","last_unstale":"2024-05-09T05:59:04.223157+0000","last_undegraded":"2024-05-09T05:59:04.223157+0000","last_fullsized":"2024-05-09T05:59:04.223157+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'309","last_scrub_stamp":"2024-05-09T05:59:04.222944+0000","last_deep_scrub":"29'309","last_deep_scrub_stamp":"2024-05-09T05:59:04.222944+0000","last_clean_scrub_stamp":"2024-05-09T05:59:04.222944+0000","objects_scrubbed":0,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:00.552057+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":309,"num_write_kb":843776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"29'8","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:47.543862+0000","last_change":"2024-05-09T05:58:47.543931+0000","last_active":"2024-05-09T05:58:47.543862+0000","last_peered":"2024-05-09T05:58:47.543862+0000","last_clean":"2024-05-09T05:58:47.543862+0000","last_became_active":"2024-05-09T05:53:24.135580+0000","last_became_peered":"2024-05-09T05:53:24.135580+0000","last_unstale":"2024-05-09T05:58:47.543862+0000","last_undegraded":"2024-05-09T05:58:47.543862+0000","last_fullsized":"2024-05-09T05:58:47.543862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-09T05:58:47.543656+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-09T05:58:47.543656+0000","last_clean_scrub_stamp":"2024-05-09T05:58:47.543656+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:27:14.809903+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"29'5","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:45.719258+0000","last_change":"2024-05-09T05:58:45.719429+0000","last_active":"2024-05-09T05:58:45.719258+0000","last_peered":"2024-05-09T05:58:45.719258+0000","last_clean":"2024-05-09T05:58:45.719258+0000","last_became_active":"2024-05-09T05:53:23.142018+0000","last_became_peered":"2024-05-09T05:53:23.142018+0000","last_unstale":"2024-05-09T05:58:45.719258+0000","last_undegraded":"2024-05-09T05:58:45.719258+0000","last_fullsized":"2024-05-09T05:58:45.719258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-05-09T05:58:45.718909+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-05-09T05:58:45.718909+0000","last_clean_scrub_stamp":"2024-05-09T05:58:45.718909+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:33:47.058865+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"29'291","reported_seq":324,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:56.761212+0000","last_change":"2024-05-09T05:58:56.761291+0000","last_active":"2024-05-09T05:58:56.761212+0000","last_peered":"2024-05-09T05:58:56.761212+0000","last_clean":"2024-05-09T05:58:56.761212+0000","last_became_active":"2024-05-09T05:53:28.213623+0000","last_became_peered":"2024-05-09T05:53:28.213623+0000","last_unstale":"2024-05-09T05:58:56.761212+0000","last_undegraded":"2024-05-09T05:58:56.761212+0000","last_fullsized":"2024-05-09T05:58:56.761212+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'291","last_scrub_stamp":"2024-05-09T05:58:56.760985+0000","last_deep_scrub":"29'291","last_deep_scrub_stamp":"2024-05-09T05:58:56.760985+0000","last_clean_scrub_stamp":"2024-05-09T05:58:56.760985+0000","objects_scrubbed":0,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:11:17.325743+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":291,"num_write_kb":794624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"29'9","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:50.211854+0000","last_change":"2024-05-09T05:58:50.211921+0000","last_active":"2024-05-09T05:58:50.211854+0000","last_peered":"2024-05-09T05:58:50.211854+0000","last_clean":"2024-05-09T05:58:50.211854+0000","last_became_active":"2024-05-09T05:53:24.129938+0000","last_became_peered":"2024-05-09T05:53:24.129938+0000","last_unstale":"2024-05-09T05:58:50.211854+0000","last_undegraded":"2024-05-09T05:58:50.211854+0000","last_fullsized":"2024-05-09T05:58:50.211854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-05-09T05:58:50.211656+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-05-09T05:58:50.211656+0000","last_clean_scrub_stamp":"2024-05-09T05:58:50.211656+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:13:39.451113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"29'11","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:45.207808+0000","last_change":"2024-05-09T05:58:45.207885+0000","last_active":"2024-05-09T05:58:45.207808+0000","last_peered":"2024-05-09T05:58:45.207808+0000","last_clean":"2024-05-09T05:58:45.207808+0000","last_became_active":"2024-05-09T05:53:23.110140+0000","last_became_peered":"2024-05-09T05:53:23.110140+0000","last_unstale":"2024-05-09T05:58:45.207808+0000","last_undegraded":"2024-05-09T05:58:45.207808+0000","last_fullsized":"2024-05-09T05:58:45.207808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'11","last_scrub_stamp":"2024-05-09T05:58:45.207590+0000","last_deep_scrub":"29'11","last_deep_scrub_stamp":"2024-05-09T05:58:45.207590+0000","last_clean_scrub_stamp":"2024-05-09T05:58:45.207590+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:16:12.036932+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"29'267","reported_seq":300,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:50.596816+0000","last_change":"2024-05-09T05:58:50.596965+0000","last_active":"2024-05-09T05:58:50.596816+0000","last_peered":"2024-05-09T05:58:50.596816+0000","last_clean":"2024-05-09T05:58:50.596816+0000","last_became_active":"2024-05-09T05:53:28.227087+0000","last_became_peered":"2024-05-09T05:53:28.227087+0000","last_unstale":"2024-05-09T05:58:50.596816+0000","last_undegraded":"2024-05-09T05:58:50.596816+0000","last_fullsized":"2024-05-09T05:58:50.596816+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'267","last_scrub_stamp":"2024-05-09T05:58:50.596554+0000","last_deep_scrub":"29'267","last_deep_scrub_stamp":"2024-05-09T05:58:50.596554+0000","last_clean_scrub_stamp":"2024-05-09T05:58:50.596554+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:46.245808+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":267,"num_write_kb":729088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"29'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:59.254154+0000","last_change":"2024-05-09T05:58:59.254282+0000","last_active":"2024-05-09T05:58:59.254154+0000","last_peered":"2024-05-09T05:58:59.254154+0000","last_clean":"2024-05-09T05:58:59.254154+0000","last_became_active":"2024-05-09T05:53:24.144596+0000","last_became_peered":"2024-05-09T05:53:24.144596+0000","last_unstale":"2024-05-09T05:58:59.254154+0000","last_undegraded":"2024-05-09T05:58:59.254154+0000","last_fullsized":"2024-05-09T05:58:59.254154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-09T05:58:59.253844+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-09T05:58:59.253844+0000","last_clean_scrub_stamp":"2024-05-09T05:58:59.253844+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:24:42.285619+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"29'3","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:44.857198+0000","last_change":"2024-05-09T05:58:44.857375+0000","last_active":"2024-05-09T05:58:44.857198+0000","last_peered":"2024-05-09T05:58:44.857198+0000","last_clean":"2024-05-09T05:58:44.857198+0000","last_became_active":"2024-05-09T05:53:23.102420+0000","last_became_peered":"2024-05-09T05:53:23.102420+0000","last_unstale":"2024-05-09T05:58:44.857198+0000","last_undegraded":"2024-05-09T05:58:44.857198+0000","last_fullsized":"2024-05-09T05:58:44.857198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-05-09T05:58:44.856953+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-05-09T05:58:44.856953+0000","last_clean_scrub_stamp":"2024-05-09T05:58:44.856953+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:10:23.476072+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"29'288","reported_seq":321,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:51.505136+0000","last_change":"2024-05-09T05:58:51.505210+0000","last_active":"2024-05-09T05:58:51.505136+0000","last_peered":"2024-05-09T05:58:51.505136+0000","last_clean":"2024-05-09T05:58:51.505136+0000","last_became_active":"2024-05-09T05:53:28.194915+0000","last_became_peered":"2024-05-09T05:53:28.194915+0000","last_unstale":"2024-05-09T05:58:51.505136+0000","last_undegraded":"2024-05-09T05:58:51.505136+0000","last_fullsized":"2024-05-09T05:58:51.505136+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'288","last_scrub_stamp":"2024-05-09T05:58:51.504927+0000","last_deep_scrub":"29'288","last_deep_scrub_stamp":"2024-05-09T05:58:51.504927+0000","last_clean_scrub_stamp":"2024-05-09T05:58:51.504927+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:29:10.381536+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":786432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"29'7","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:49.211270+0000","last_change":"2024-05-09T05:58:49.211341+0000","last_active":"2024-05-09T05:58:49.211270+0000","last_peered":"2024-05-09T05:58:49.211270+0000","last_clean":"2024-05-09T05:58:49.211270+0000","last_became_active":"2024-05-09T05:53:24.129953+0000","last_became_peered":"2024-05-09T05:53:24.129953+0000","last_unstale":"2024-05-09T05:58:49.211270+0000","last_undegraded":"2024-05-09T05:58:49.211270+0000","last_fullsized":"2024-05-09T05:58:49.211270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-05-09T05:58:49.211036+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-05-09T05:58:49.211036+0000","last_clean_scrub_stamp":"2024-05-09T05:58:49.211036+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:17:36.560375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"29'12","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:58.246223+0000","last_change":"2024-05-09T05:58:58.246308+0000","last_active":"2024-05-09T05:58:58.246223+0000","last_peered":"2024-05-09T05:58:58.246223+0000","last_clean":"2024-05-09T05:58:58.246223+0000","last_became_active":"2024-05-09T05:53:23.126691+0000","last_became_peered":"2024-05-09T05:53:23.126691+0000","last_unstale":"2024-05-09T05:58:58.246223+0000","last_undegraded":"2024-05-09T05:58:58.246223+0000","last_fullsized":"2024-05-09T05:58:58.246223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-09T05:58:58.246034+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-09T05:58:58.246034+0000","last_clean_scrub_stamp":"2024-05-09T05:58:58.246034+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:52:38.144017+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"29'249","reported_seq":282,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:50.549166+0000","last_change":"2024-05-09T05:58:50.549242+0000","last_active":"2024-05-09T05:58:50.549166+0000","last_peered":"2024-05-09T05:58:50.549166+0000","last_clean":"2024-05-09T05:58:50.549166+0000","last_became_active":"2024-05-09T05:53:28.190564+0000","last_became_peered":"2024-05-09T05:53:28.190564+0000","last_unstale":"2024-05-09T05:58:50.549166+0000","last_undegraded":"2024-05-09T05:58:50.549166+0000","last_fullsized":"2024-05-09T05:58:50.549166+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'249","last_scrub_stamp":"2024-05-09T05:58:50.548918+0000","last_deep_scrub":"29'249","last_deep_scrub_stamp":"2024-05-09T05:58:50.548918+0000","last_clean_scrub_stamp":"2024-05-09T05:58:50.548918+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:18:13.307469+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":249,"num_write_kb":679936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"29'5","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:51.179447+0000","last_change":"2024-05-09T05:58:51.179523+0000","last_active":"2024-05-09T05:58:51.179447+0000","last_peered":"2024-05-09T05:58:51.179447+0000","last_clean":"2024-05-09T05:58:51.179447+0000","last_became_active":"2024-05-09T05:53:24.138417+0000","last_became_peered":"2024-05-09T05:53:24.138417+0000","last_unstale":"2024-05-09T05:58:51.179447+0000","last_undegraded":"2024-05-09T05:58:51.179447+0000","last_fullsized":"2024-05-09T05:58:51.179447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-05-09T05:58:51.179239+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-05-09T05:58:51.179239+0000","last_clean_scrub_stamp":"2024-05-09T05:58:51.179239+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:57:08.127832+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"29'30","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:44.227481+0000","last_change":"2024-05-09T05:58:44.227656+0000","last_active":"2024-05-09T05:58:44.227481+0000","last_peered":"2024-05-09T05:58:44.227481+0000","last_clean":"2024-05-09T05:58:44.227481+0000","last_became_active":"2024-05-09T05:53:23.102020+0000","last_became_peered":"2024-05-09T05:53:23.102020+0000","last_unstale":"2024-05-09T05:58:44.227481+0000","last_undegraded":"2024-05-09T05:58:44.227481+0000","last_fullsized":"2024-05-09T05:58:44.227481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2024-05-09T05:58:44.227241+0000","last_deep_scrub":"29'30","last_deep_scrub_stamp":"2024-05-09T05:58:44.227241+0000","last_clean_scrub_stamp":"2024-05-09T05:58:44.227241+0000","objects_scrubbed":4,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:05:03.506622+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"29'264","reported_seq":297,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:55.145338+0000","last_change":"2024-05-09T05:58:55.145409+0000","last_active":"2024-05-09T05:58:55.145338+0000","last_peered":"2024-05-09T05:58:55.145338+0000","last_clean":"2024-05-09T05:58:55.145338+0000","last_became_active":"2024-05-09T05:53:28.216634+0000","last_became_peered":"2024-05-09T05:53:28.216634+0000","last_unstale":"2024-05-09T05:58:55.145338+0000","last_undegraded":"2024-05-09T05:58:55.145338+0000","last_fullsized":"2024-05-09T05:58:55.145338+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'264","last_scrub_stamp":"2024-05-09T05:58:55.145126+0000","last_deep_scrub":"29'264","last_deep_scrub_stamp":"2024-05-09T05:58:55.145126+0000","last_clean_scrub_stamp":"2024-05-09T05:58:55.145126+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:14:00.907222+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":720896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"29'9","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:51.745685+0000","last_change":"2024-05-09T05:58:51.745752+0000","last_active":"2024-05-09T05:58:51.745685+0000","last_peered":"2024-05-09T05:58:51.745685+0000","last_clean":"2024-05-09T05:58:51.745685+0000","last_became_active":"2024-05-09T05:53:24.139369+0000","last_became_peered":"2024-05-09T05:53:24.139369+0000","last_unstale":"2024-05-09T05:58:51.745685+0000","last_undegraded":"2024-05-09T05:58:51.745685+0000","last_fullsized":"2024-05-09T05:58:51.745685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-05-09T05:58:51.745494+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-05-09T05:58:51.745494+0000","last_clean_scrub_stamp":"2024-05-09T05:58:51.745494+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:55:03.900813+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"29'7","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:56.338875+0000","last_change":"2024-05-09T05:58:56.338953+0000","last_active":"2024-05-09T05:58:56.338875+0000","last_peered":"2024-05-09T05:58:56.338875+0000","last_clean":"2024-05-09T05:58:56.338875+0000","last_became_active":"2024-05-09T05:53:23.123081+0000","last_became_peered":"2024-05-09T05:53:23.123081+0000","last_unstale":"2024-05-09T05:58:56.338875+0000","last_undegraded":"2024-05-09T05:58:56.338875+0000","last_fullsized":"2024-05-09T05:58:56.338875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-05-09T05:58:56.338668+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-05-09T05:58:56.338668+0000","last_clean_scrub_stamp":"2024-05-09T05:58:56.338668+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:18:02.734290+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"29'249","reported_seq":282,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:56.833916+0000","last_change":"2024-05-09T05:58:56.834069+0000","last_active":"2024-05-09T05:58:56.833916+0000","last_peered":"2024-05-09T05:58:56.833916+0000","last_clean":"2024-05-09T05:58:56.833916+0000","last_became_active":"2024-05-09T05:53:28.225810+0000","last_became_peered":"2024-05-09T05:53:28.225810+0000","last_unstale":"2024-05-09T05:58:56.833916+0000","last_undegraded":"2024-05-09T05:58:56.833916+0000","last_fullsized":"2024-05-09T05:58:56.833916+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'249","last_scrub_stamp":"2024-05-09T05:58:56.833512+0000","last_deep_scrub":"29'249","last_deep_scrub_stamp":"2024-05-09T05:58:56.833512+0000","last_clean_scrub_stamp":"2024-05-09T05:58:56.833512+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:52:45.019744+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":249,"num_write_kb":679936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"29'5","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:43.580562+0000","last_change":"2024-05-09T05:58:43.580624+0000","last_active":"2024-05-09T05:58:43.580562+0000","last_peered":"2024-05-09T05:58:43.580562+0000","last_clean":"2024-05-09T05:58:43.580562+0000","last_became_active":"2024-05-09T05:53:24.129787+0000","last_became_peered":"2024-05-09T05:53:24.129787+0000","last_unstale":"2024-05-09T05:58:43.580562+0000","last_undegraded":"2024-05-09T05:58:43.580562+0000","last_fullsized":"2024-05-09T05:58:43.580562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-05-09T05:58:43.580375+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-05-09T05:58:43.580375+0000","last_clean_scrub_stamp":"2024-05-09T05:58:43.580375+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:59:27.409876+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"26'1","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:47.875553+0000","last_change":"2024-05-09T05:58:47.875703+0000","last_active":"2024-05-09T05:58:47.875553+0000","last_peered":"2024-05-09T05:58:47.875553+0000","last_clean":"2024-05-09T05:58:47.875553+0000","last_became_active":"2024-05-09T05:53:23.133587+0000","last_became_peered":"2024-05-09T05:53:23.133587+0000","last_unstale":"2024-05-09T05:58:47.875553+0000","last_undegraded":"2024-05-09T05:58:47.875553+0000","last_fullsized":"2024-05-09T05:58:47.875553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1","last_scrub_stamp":"2024-05-09T05:58:47.875317+0000","last_deep_scrub":"26'1","last_deep_scrub_stamp":"2024-05-09T05:58:47.875317+0000","last_clean_scrub_stamp":"2024-05-09T05:58:47.875317+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:35:29.182673+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"29'273","reported_seq":306,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:57.828021+0000","last_change":"2024-05-09T05:58:57.828092+0000","last_active":"2024-05-09T05:58:57.828021+0000","last_peered":"2024-05-09T05:58:57.828021+0000","last_clean":"2024-05-09T05:58:57.828021+0000","last_became_active":"2024-05-09T05:53:28.232539+0000","last_became_peered":"2024-05-09T05:53:28.232539+0000","last_unstale":"2024-05-09T05:58:57.828021+0000","last_undegraded":"2024-05-09T05:58:57.828021+0000","last_fullsized":"2024-05-09T05:58:57.828021+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'273","last_scrub_stamp":"2024-05-09T05:58:57.827804+0000","last_deep_scrub":"29'273","last_deep_scrub_stamp":"2024-05-09T05:58:57.827804+0000","last_clean_scrub_stamp":"2024-05-09T05:58:57.827804+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:47:00.374049+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"29'7","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:40.780464+0000","last_change":"2024-05-09T05:58:40.780487+0000","last_active":"2024-05-09T05:58:40.780464+0000","last_peered":"2024-05-09T05:58:40.780464+0000","last_clean":"2024-05-09T05:58:40.780464+0000","last_became_active":"2024-05-09T05:53:24.132309+0000","last_became_peered":"2024-05-09T05:53:24.132309+0000","last_unstale":"2024-05-09T05:58:40.780464+0000","last_undegraded":"2024-05-09T05:58:40.780464+0000","last_fullsized":"2024-05-09T05:58:40.780464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-05-09T05:58:40.780386+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-05-09T05:58:40.780386+0000","last_clean_scrub_stamp":"2024-05-09T05:58:40.780386+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:03:47.892710+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"29'9","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:54.342211+0000","last_change":"2024-05-09T05:58:54.342286+0000","last_active":"2024-05-09T05:58:54.342211+0000","last_peered":"2024-05-09T05:58:54.342211+0000","last_clean":"2024-05-09T05:58:54.342211+0000","last_became_active":"2024-05-09T05:53:23.118321+0000","last_became_peered":"2024-05-09T05:53:23.118321+0000","last_unstale":"2024-05-09T05:58:54.342211+0000","last_undegraded":"2024-05-09T05:58:54.342211+0000","last_fullsized":"2024-05-09T05:58:54.342211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-05-09T05:58:54.342017+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-05-09T05:58:54.342017+0000","last_clean_scrub_stamp":"2024-05-09T05:58:54.342017+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:27:37.167081+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":14,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'264","reported_seq":297,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:53.751810+0000","last_change":"2024-05-09T05:58:53.751882+0000","last_active":"2024-05-09T05:58:53.751810+0000","last_peered":"2024-05-09T05:58:53.751810+0000","last_clean":"2024-05-09T05:58:53.751810+0000","last_became_active":"2024-05-09T05:53:28.199359+0000","last_became_peered":"2024-05-09T05:53:28.199359+0000","last_unstale":"2024-05-09T05:58:53.751810+0000","last_undegraded":"2024-05-09T05:58:53.751810+0000","last_fullsized":"2024-05-09T05:58:53.751810+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'264","last_scrub_stamp":"2024-05-09T05:58:53.751595+0000","last_deep_scrub":"29'264","last_deep_scrub_stamp":"2024-05-09T05:58:53.751595+0000","last_clean_scrub_stamp":"2024-05-09T05:58:53.751595+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:16:49.246565+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":720896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"29'8","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:51.892000+0000","last_change":"2024-05-09T05:58:51.892129+0000","last_active":"2024-05-09T05:58:51.892000+0000","last_peered":"2024-05-09T05:58:51.892000+0000","last_clean":"2024-05-09T05:58:51.892000+0000","last_became_active":"2024-05-09T05:53:24.142265+0000","last_became_peered":"2024-05-09T05:53:24.142265+0000","last_unstale":"2024-05-09T05:58:51.892000+0000","last_undegraded":"2024-05-09T05:58:51.892000+0000","last_fullsized":"2024-05-09T05:58:51.892000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-09T05:58:51.891670+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-09T05:58:51.891670+0000","last_clean_scrub_stamp":"2024-05-09T05:58:51.891670+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:26:23.157391+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"29'15","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:45.554323+0000","last_change":"2024-05-09T05:58:45.554407+0000","last_active":"2024-05-09T05:58:45.554323+0000","last_peered":"2024-05-09T05:58:45.554323+0000","last_clean":"2024-05-09T05:58:45.554323+0000","last_became_active":"2024-05-09T05:53:23.141770+0000","last_became_peered":"2024-05-09T05:53:23.141770+0000","last_unstale":"2024-05-09T05:58:45.554323+0000","last_undegraded":"2024-05-09T05:58:45.554323+0000","last_fullsized":"2024-05-09T05:58:45.554323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-05-09T05:58:45.554074+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-05-09T05:58:45.554074+0000","last_clean_scrub_stamp":"2024-05-09T05:58:45.554074+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:41:47.969104+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":641,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"29'270","reported_seq":303,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:54.801497+0000","last_change":"2024-05-09T05:58:54.801567+0000","last_active":"2024-05-09T05:58:54.801497+0000","last_peered":"2024-05-09T05:58:54.801497+0000","last_clean":"2024-05-09T05:58:54.801497+0000","last_became_active":"2024-05-09T05:53:28.210981+0000","last_became_peered":"2024-05-09T05:53:28.210981+0000","last_unstale":"2024-05-09T05:58:54.801497+0000","last_undegraded":"2024-05-09T05:58:54.801497+0000","last_fullsized":"2024-05-09T05:58:54.801497+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'270","last_scrub_stamp":"2024-05-09T05:58:54.801289+0000","last_deep_scrub":"29'270","last_deep_scrub_stamp":"2024-05-09T05:58:54.801289+0000","last_clean_scrub_stamp":"2024-05-09T05:58:54.801289+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:52:06.045841+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":737280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"29'5","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:47.797274+0000","last_change":"2024-05-09T05:58:47.797405+0000","last_active":"2024-05-09T05:58:47.797274+0000","last_peered":"2024-05-09T05:58:47.797274+0000","last_clean":"2024-05-09T05:58:47.797274+0000","last_became_active":"2024-05-09T05:53:24.132398+0000","last_became_peered":"2024-05-09T05:53:24.132398+0000","last_unstale":"2024-05-09T05:58:47.797274+0000","last_undegraded":"2024-05-09T05:58:47.797274+0000","last_fullsized":"2024-05-09T05:58:47.797274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-05-09T05:58:47.796947+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-05-09T05:58:47.796947+0000","last_clean_scrub_stamp":"2024-05-09T05:58:47.796947+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:00:50.206617+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"29'7","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:57.288122+0000","last_change":"2024-05-09T05:58:57.288190+0000","last_active":"2024-05-09T05:58:57.288122+0000","last_peered":"2024-05-09T05:58:57.288122+0000","last_clean":"2024-05-09T05:58:57.288122+0000","last_became_active":"2024-05-09T05:53:23.125799+0000","last_became_peered":"2024-05-09T05:53:23.125799+0000","last_unstale":"2024-05-09T05:58:57.288122+0000","last_undegraded":"2024-05-09T05:58:57.288122+0000","last_fullsized":"2024-05-09T05:58:57.288122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-05-09T05:58:57.287997+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-05-09T05:58:57.287997+0000","last_clean_scrub_stamp":"2024-05-09T05:58:57.287997+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:09:46.978597+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"29'339","reported_seq":379,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:59:02.114545+0000","last_change":"2024-05-09T05:59:02.114681+0000","last_active":"2024-05-09T05:59:02.114545+0000","last_peered":"2024-05-09T05:59:02.114545+0000","last_clean":"2024-05-09T05:59:02.114545+0000","last_became_active":"2024-05-09T05:54:06.915734+0000","last_became_peered":"2024-05-09T05:54:06.915734+0000","last_unstale":"2024-05-09T05:59:02.114545+0000","last_undegraded":"2024-05-09T05:59:02.114545+0000","last_fullsized":"2024-05-09T05:59:02.114545+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'339","last_scrub_stamp":"2024-05-09T05:59:02.114287+0000","last_deep_scrub":"29'339","last_deep_scrub_stamp":"2024-05-09T05:59:02.114287+0000","last_clean_scrub_stamp":"2024-05-09T05:59:02.114287+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:12:24.750494+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":925696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,6,1],"acting":[5,0,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"29'8","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:52.164247+0000","last_change":"2024-05-09T05:58:52.164317+0000","last_active":"2024-05-09T05:58:52.164247+0000","last_peered":"2024-05-09T05:58:52.164247+0000","last_clean":"2024-05-09T05:58:52.164247+0000","last_became_active":"2024-05-09T05:53:24.138835+0000","last_became_peered":"2024-05-09T05:53:24.138835+0000","last_unstale":"2024-05-09T05:58:52.164247+0000","last_undegraded":"2024-05-09T05:58:52.164247+0000","last_fullsized":"2024-05-09T05:58:52.164247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-09T05:58:52.164019+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-09T05:58:52.164019+0000","last_clean_scrub_stamp":"2024-05-09T05:58:52.164019+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:53:33.369696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"29'11","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:51.295845+0000","last_change":"2024-05-09T05:58:51.296017+0000","last_active":"2024-05-09T05:58:51.295845+0000","last_peered":"2024-05-09T05:58:51.295845+0000","last_clean":"2024-05-09T05:58:51.295845+0000","last_became_active":"2024-05-09T05:53:23.113294+0000","last_became_peered":"2024-05-09T05:53:23.113294+0000","last_unstale":"2024-05-09T05:58:51.295845+0000","last_undegraded":"2024-05-09T05:58:51.295845+0000","last_fullsized":"2024-05-09T05:58:51.295845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'11","last_scrub_stamp":"2024-05-09T05:58:51.295603+0000","last_deep_scrub":"29'11","last_deep_scrub_stamp":"2024-05-09T05:58:51.295603+0000","last_clean_scrub_stamp":"2024-05-09T05:58:51.295603+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:08:51.244267+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"29'74","reported_seq":139,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:40.501237+0000","last_change":"2024-05-09T05:58:40.501237+0000","last_active":"2024-05-09T05:58:40.501237+0000","last_peered":"2024-05-09T05:58:40.501237+0000","last_clean":"2024-05-09T05:58:40.501237+0000","last_became_active":"2024-05-09T05:53:12.481529+0000","last_became_peered":"2024-05-09T05:53:12.481529+0000","last_unstale":"2024-05-09T05:58:40.501237+0000","last_undegraded":"2024-05-09T05:58:40.501237+0000","last_fullsized":"2024-05-09T05:58:40.501237+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'74","last_scrub_stamp":"2024-05-09T05:58:40.501088+0000","last_deep_scrub":"29'74","last_deep_scrub_stamp":"2024-05-09T05:58:40.501088+0000","last_clean_scrub_stamp":"2024-05-09T05:58:40.501088+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:55:54.684313+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'276","reported_seq":309,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:59:01.224160+0000","last_change":"2024-05-09T05:59:01.224235+0000","last_active":"2024-05-09T05:59:01.224160+0000","last_peered":"2024-05-09T05:59:01.224160+0000","last_clean":"2024-05-09T05:59:01.224160+0000","last_became_active":"2024-05-09T05:53:28.190393+0000","last_became_peered":"2024-05-09T05:53:28.190393+0000","last_unstale":"2024-05-09T05:59:01.224160+0000","last_undegraded":"2024-05-09T05:59:01.224160+0000","last_fullsized":"2024-05-09T05:59:01.224160+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'276","last_scrub_stamp":"2024-05-09T05:59:01.223956+0000","last_deep_scrub":"29'276","last_deep_scrub_stamp":"2024-05-09T05:59:01.223956+0000","last_clean_scrub_stamp":"2024-05-09T05:59:01.223956+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:06:39.628407+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":276,"num_write_kb":753664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"29'7","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:45.272870+0000","last_change":"2024-05-09T05:58:45.272936+0000","last_active":"2024-05-09T05:58:45.272870+0000","last_peered":"2024-05-09T05:58:45.272870+0000","last_clean":"2024-05-09T05:58:45.272870+0000","last_became_active":"2024-05-09T05:53:24.139813+0000","last_became_peered":"2024-05-09T05:53:24.139813+0000","last_unstale":"2024-05-09T05:58:45.272870+0000","last_undegraded":"2024-05-09T05:58:45.272870+0000","last_fullsized":"2024-05-09T05:58:45.272870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-05-09T05:58:45.272687+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-05-09T05:58:45.272687+0000","last_clean_scrub_stamp":"2024-05-09T05:58:45.272687+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:12:25.558329+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"29'9","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:44.712388+0000","last_change":"2024-05-09T05:58:44.712541+0000","last_active":"2024-05-09T05:58:44.712388+0000","last_peered":"2024-05-09T05:58:44.712388+0000","last_clean":"2024-05-09T05:58:44.712388+0000","last_became_active":"2024-05-09T05:53:23.112260+0000","last_became_peered":"2024-05-09T05:53:23.112260+0000","last_unstale":"2024-05-09T05:58:44.712388+0000","last_undegraded":"2024-05-09T05:58:44.712388+0000","last_fullsized":"2024-05-09T05:58:44.712388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-05-09T05:58:44.712133+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-05-09T05:58:44.712133+0000","last_clean_scrub_stamp":"2024-05-09T05:58:44.712133+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:04:50.621793+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"29'279","reported_seq":312,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:52.500236+0000","last_change":"2024-05-09T05:58:52.500374+0000","last_active":"2024-05-09T05:58:52.500236+0000","last_peered":"2024-05-09T05:58:52.500236+0000","last_clean":"2024-05-09T05:58:52.500236+0000","last_became_active":"2024-05-09T05:53:28.195082+0000","last_became_peered":"2024-05-09T05:53:28.195082+0000","last_unstale":"2024-05-09T05:58:52.500236+0000","last_undegraded":"2024-05-09T05:58:52.500236+0000","last_fullsized":"2024-05-09T05:58:52.500236+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'279","last_scrub_stamp":"2024-05-09T05:58:52.499907+0000","last_deep_scrub":"29'279","last_deep_scrub_stamp":"2024-05-09T05:58:52.499907+0000","last_clean_scrub_stamp":"2024-05-09T05:58:52.499907+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:58:19.373628+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":279,"num_write_kb":761856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"29'6","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:47.836508+0000","last_change":"2024-05-09T05:58:47.836602+0000","last_active":"2024-05-09T05:58:47.836508+0000","last_peered":"2024-05-09T05:58:47.836508+0000","last_clean":"2024-05-09T05:58:47.836508+0000","last_became_active":"2024-05-09T05:53:24.129808+0000","last_became_peered":"2024-05-09T05:53:24.129808+0000","last_unstale":"2024-05-09T05:58:47.836508+0000","last_undegraded":"2024-05-09T05:58:47.836508+0000","last_fullsized":"2024-05-09T05:58:47.836508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-09T05:58:47.836301+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-09T05:58:47.836301+0000","last_clean_scrub_stamp":"2024-05-09T05:58:47.836301+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:00:40.896337+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"29'6","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:49.901152+0000","last_change":"2024-05-09T05:58:49.901228+0000","last_active":"2024-05-09T05:58:49.901152+0000","last_peered":"2024-05-09T05:58:49.901152+0000","last_clean":"2024-05-09T05:58:49.901152+0000","last_became_active":"2024-05-09T05:53:23.138303+0000","last_became_peered":"2024-05-09T05:53:23.138303+0000","last_unstale":"2024-05-09T05:58:49.901152+0000","last_undegraded":"2024-05-09T05:58:49.901152+0000","last_fullsized":"2024-05-09T05:58:49.901152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-09T05:58:49.900951+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-09T05:58:49.900951+0000","last_clean_scrub_stamp":"2024-05-09T05:58:49.900951+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:39:30.999478+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"29'261","reported_seq":294,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:59.036993+0000","last_change":"2024-05-09T05:58:59.037070+0000","last_active":"2024-05-09T05:58:59.036993+0000","last_peered":"2024-05-09T05:58:59.036993+0000","last_clean":"2024-05-09T05:58:59.036993+0000","last_became_active":"2024-05-09T05:53:28.206229+0000","last_became_peered":"2024-05-09T05:53:28.206229+0000","last_unstale":"2024-05-09T05:58:59.036993+0000","last_undegraded":"2024-05-09T05:58:59.036993+0000","last_fullsized":"2024-05-09T05:58:59.036993+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'261","last_scrub_stamp":"2024-05-09T05:58:59.036727+0000","last_deep_scrub":"29'261","last_deep_scrub_stamp":"2024-05-09T05:58:59.036727+0000","last_clean_scrub_stamp":"2024-05-09T05:58:59.036727+0000","objects_scrubbed":0,"log_size":261,"log_dups_size":0,"ondisk_log_size":261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:26:16.414093+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":261,"num_write_kb":712704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"29'9","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:49.786536+0000","last_change":"2024-05-09T05:58:49.786615+0000","last_active":"2024-05-09T05:58:49.786536+0000","last_peered":"2024-05-09T05:58:49.786536+0000","last_clean":"2024-05-09T05:58:49.786536+0000","last_became_active":"2024-05-09T05:53:24.135253+0000","last_became_peered":"2024-05-09T05:53:24.135253+0000","last_unstale":"2024-05-09T05:58:49.786536+0000","last_undegraded":"2024-05-09T05:58:49.786536+0000","last_fullsized":"2024-05-09T05:58:49.786536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-05-09T05:58:49.786332+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-05-09T05:58:49.786332+0000","last_clean_scrub_stamp":"2024-05-09T05:58:49.786332+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:16:35.039907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"29'7","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:47.195262+0000","last_change":"2024-05-09T05:58:47.195361+0000","last_active":"2024-05-09T05:58:47.195262+0000","last_peered":"2024-05-09T05:58:47.195262+0000","last_clean":"2024-05-09T05:58:47.195262+0000","last_became_active":"2024-05-09T05:53:23.139516+0000","last_became_peered":"2024-05-09T05:53:23.139516+0000","last_unstale":"2024-05-09T05:58:47.195262+0000","last_undegraded":"2024-05-09T05:58:47.195262+0000","last_fullsized":"2024-05-09T05:58:47.195262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-05-09T05:58:47.195055+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-05-09T05:58:47.195055+0000","last_clean_scrub_stamp":"2024-05-09T05:58:47.195055+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:12:20.351896+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"29'318","reported_seq":351,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:59:02.234413+0000","last_change":"2024-05-09T05:59:02.234553+0000","last_active":"2024-05-09T05:59:02.234413+0000","last_peered":"2024-05-09T05:59:02.234413+0000","last_clean":"2024-05-09T05:59:02.234413+0000","last_became_active":"2024-05-09T05:53:28.198825+0000","last_became_peered":"2024-05-09T05:53:28.198825+0000","last_unstale":"2024-05-09T05:59:02.234413+0000","last_undegraded":"2024-05-09T05:59:02.234413+0000","last_fullsized":"2024-05-09T05:59:02.234413+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'318","last_scrub_stamp":"2024-05-09T05:59:02.234150+0000","last_deep_scrub":"29'318","last_deep_scrub_stamp":"2024-05-09T05:59:02.234150+0000","last_clean_scrub_stamp":"2024-05-09T05:59:02.234150+0000","objects_scrubbed":0,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:43:16.894246+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":318,"num_write_kb":868352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"29'5","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:45.590666+0000","last_change":"2024-05-09T05:58:45.590797+0000","last_active":"2024-05-09T05:58:45.590666+0000","last_peered":"2024-05-09T05:58:45.590666+0000","last_clean":"2024-05-09T05:58:45.590666+0000","last_became_active":"2024-05-09T05:53:24.131741+0000","last_became_peered":"2024-05-09T05:53:24.131741+0000","last_unstale":"2024-05-09T05:58:45.590666+0000","last_undegraded":"2024-05-09T05:58:45.590666+0000","last_fullsized":"2024-05-09T05:58:45.590666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-05-09T05:58:45.590360+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-05-09T05:58:45.590360+0000","last_clean_scrub_stamp":"2024-05-09T05:58:45.590360+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:44:40.841354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"29'4","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:45.809296+0000","last_change":"2024-05-09T05:58:45.809369+0000","last_active":"2024-05-09T05:58:45.809296+0000","last_peered":"2024-05-09T05:58:45.809296+0000","last_clean":"2024-05-09T05:58:45.809296+0000","last_became_active":"2024-05-09T05:53:23.111968+0000","last_became_peered":"2024-05-09T05:53:23.111968+0000","last_unstale":"2024-05-09T05:58:45.809296+0000","last_undegraded":"2024-05-09T05:58:45.809296+0000","last_fullsized":"2024-05-09T05:58:45.809296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-09T05:58:45.809102+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-09T05:58:45.809102+0000","last_clean_scrub_stamp":"2024-05-09T05:58:45.809102+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:23:06.578670+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"29'258","reported_seq":291,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:47.507506+0000","last_change":"2024-05-09T05:58:47.507579+0000","last_active":"2024-05-09T05:58:47.507506+0000","last_peered":"2024-05-09T05:58:47.507506+0000","last_clean":"2024-05-09T05:58:47.507506+0000","last_became_active":"2024-05-09T05:53:28.227272+0000","last_became_peered":"2024-05-09T05:53:28.227272+0000","last_unstale":"2024-05-09T05:58:47.507506+0000","last_undegraded":"2024-05-09T05:58:47.507506+0000","last_fullsized":"2024-05-09T05:58:47.507506+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'258","last_scrub_stamp":"2024-05-09T05:58:47.507300+0000","last_deep_scrub":"29'258","last_deep_scrub_stamp":"2024-05-09T05:58:47.507300+0000","last_clean_scrub_stamp":"2024-05-09T05:58:47.507300+0000","objects_scrubbed":0,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:40:36.209618+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":258,"num_write_kb":704512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"29'6","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:47.272038+0000","last_change":"2024-05-09T05:58:47.272117+0000","last_active":"2024-05-09T05:58:47.272038+0000","last_peered":"2024-05-09T05:58:47.272038+0000","last_clean":"2024-05-09T05:58:47.272038+0000","last_became_active":"2024-05-09T05:53:24.143540+0000","last_became_peered":"2024-05-09T05:53:24.143540+0000","last_unstale":"2024-05-09T05:58:47.272038+0000","last_undegraded":"2024-05-09T05:58:47.272038+0000","last_fullsized":"2024-05-09T05:58:47.272038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-09T05:58:47.271826+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-09T05:58:47.271826+0000","last_clean_scrub_stamp":"2024-05-09T05:58:47.271826+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:37:24.428515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"29'28","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:43.228620+0000","last_change":"2024-05-09T05:58:43.228745+0000","last_active":"2024-05-09T05:58:43.228620+0000","last_peered":"2024-05-09T05:58:43.228620+0000","last_clean":"2024-05-09T05:58:43.228620+0000","last_became_active":"2024-05-09T05:53:23.103471+0000","last_became_peered":"2024-05-09T05:53:23.103471+0000","last_unstale":"2024-05-09T05:58:43.228620+0000","last_undegraded":"2024-05-09T05:58:43.228620+0000","last_fullsized":"2024-05-09T05:58:43.228620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'28","last_scrub_stamp":"2024-05-09T05:58:43.228404+0000","last_deep_scrub":"29'28","last_deep_scrub_stamp":"2024-05-09T05:58:43.228404+0000","last_clean_scrub_stamp":"2024-05-09T05:58:43.228404+0000","objects_scrubbed":8,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:13:01.227344+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"29'360","reported_seq":393,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:59:01.070946+0000","last_change":"2024-05-09T05:59:01.071078+0000","last_active":"2024-05-09T05:59:01.070946+0000","last_peered":"2024-05-09T05:59:01.070946+0000","last_clean":"2024-05-09T05:59:01.070946+0000","last_became_active":"2024-05-09T05:53:28.239841+0000","last_became_peered":"2024-05-09T05:53:28.239841+0000","last_unstale":"2024-05-09T05:59:01.070946+0000","last_undegraded":"2024-05-09T05:59:01.070946+0000","last_fullsized":"2024-05-09T05:59:01.070946+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'360","last_scrub_stamp":"2024-05-09T05:59:01.070656+0000","last_deep_scrub":"29'360","last_deep_scrub_stamp":"2024-05-09T05:59:01.070656+0000","last_clean_scrub_stamp":"2024-05-09T05:59:01.070656+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:53:14.029329+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":360,"num_write_kb":983040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"29'6","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:46.464888+0000","last_change":"2024-05-09T05:58:46.464956+0000","last_active":"2024-05-09T05:58:46.464888+0000","last_peered":"2024-05-09T05:58:46.464888+0000","last_clean":"2024-05-09T05:58:46.464888+0000","last_became_active":"2024-05-09T05:53:24.149578+0000","last_became_peered":"2024-05-09T05:53:24.149578+0000","last_unstale":"2024-05-09T05:58:46.464888+0000","last_undegraded":"2024-05-09T05:58:46.464888+0000","last_fullsized":"2024-05-09T05:58:46.464888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-09T05:58:46.464690+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-09T05:58:46.464690+0000","last_clean_scrub_stamp":"2024-05-09T05:58:46.464690+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:20:00.169790+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"29'9","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:46.792520+0000","last_change":"2024-05-09T05:58:46.792597+0000","last_active":"2024-05-09T05:58:46.792520+0000","last_peered":"2024-05-09T05:58:46.792520+0000","last_clean":"2024-05-09T05:58:46.792520+0000","last_became_active":"2024-05-09T05:53:23.120857+0000","last_became_peered":"2024-05-09T05:53:23.120857+0000","last_unstale":"2024-05-09T05:58:46.792520+0000","last_undegraded":"2024-05-09T05:58:46.792520+0000","last_fullsized":"2024-05-09T05:58:46.792520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-05-09T05:58:46.792316+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-05-09T05:58:46.792316+0000","last_clean_scrub_stamp":"2024-05-09T05:58:46.792316+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:47:02.064452+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"29'273","reported_seq":306,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:59:00.049699+0000","last_change":"2024-05-09T05:59:00.049774+0000","last_active":"2024-05-09T05:59:00.049699+0000","last_peered":"2024-05-09T05:59:00.049699+0000","last_clean":"2024-05-09T05:59:00.049699+0000","last_became_active":"2024-05-09T05:53:28.240070+0000","last_became_peered":"2024-05-09T05:53:28.240070+0000","last_unstale":"2024-05-09T05:59:00.049699+0000","last_undegraded":"2024-05-09T05:59:00.049699+0000","last_fullsized":"2024-05-09T05:59:00.049699+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'273","last_scrub_stamp":"2024-05-09T05:59:00.049472+0000","last_deep_scrub":"29'273","last_deep_scrub_stamp":"2024-05-09T05:59:00.049472+0000","last_clean_scrub_stamp":"2024-05-09T05:59:00.049472+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:37:21.291482+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"29'15","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:59:06.220192+0000","last_change":"2024-05-09T05:59:06.220262+0000","last_active":"2024-05-09T05:59:06.220192+0000","last_peered":"2024-05-09T05:59:06.220192+0000","last_clean":"2024-05-09T05:59:06.220192+0000","last_became_active":"2024-05-09T05:54:06.644437+0000","last_became_peered":"2024-05-09T05:54:06.644437+0000","last_unstale":"2024-05-09T05:59:06.220192+0000","last_undegraded":"2024-05-09T05:59:06.220192+0000","last_fullsized":"2024-05-09T05:59:06.220192+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-05-09T05:59:06.219980+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-05-09T05:59:06.219980+0000","last_clean_scrub_stamp":"2024-05-09T05:59:06.219980+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:18:56.411756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"29'8","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:55.329762+0000","last_change":"2024-05-09T05:58:55.329844+0000","last_active":"2024-05-09T05:58:55.329762+0000","last_peered":"2024-05-09T05:58:55.329762+0000","last_clean":"2024-05-09T05:58:55.329762+0000","last_became_active":"2024-05-09T05:53:23.118358+0000","last_became_peered":"2024-05-09T05:53:23.118358+0000","last_unstale":"2024-05-09T05:58:55.329762+0000","last_undegraded":"2024-05-09T05:58:55.329762+0000","last_fullsized":"2024-05-09T05:58:55.329762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-09T05:58:55.329578+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-09T05:58:55.329578+0000","last_clean_scrub_stamp":"2024-05-09T05:58:55.329578+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:10:19.781635+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"29'273","reported_seq":306,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:55.804208+0000","last_change":"2024-05-09T05:58:55.804354+0000","last_active":"2024-05-09T05:58:55.804208+0000","last_peered":"2024-05-09T05:58:55.804208+0000","last_clean":"2024-05-09T05:58:55.804208+0000","last_became_active":"2024-05-09T05:53:28.219636+0000","last_became_peered":"2024-05-09T05:53:28.219636+0000","last_unstale":"2024-05-09T05:58:55.804208+0000","last_undegraded":"2024-05-09T05:58:55.804208+0000","last_fullsized":"2024-05-09T05:58:55.804208+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'273","last_scrub_stamp":"2024-05-09T05:58:55.803966+0000","last_deep_scrub":"29'273","last_deep_scrub_stamp":"2024-05-09T05:58:55.803966+0000","last_clean_scrub_stamp":"2024-05-09T05:58:55.803966+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:26:19.930653+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"29'10","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:52.781331+0000","last_change":"2024-05-09T05:58:52.781459+0000","last_active":"2024-05-09T05:58:52.781331+0000","last_peered":"2024-05-09T05:58:52.781331+0000","last_clean":"2024-05-09T05:58:52.781331+0000","last_became_active":"2024-05-09T05:53:24.143181+0000","last_became_peered":"2024-05-09T05:53:24.143181+0000","last_unstale":"2024-05-09T05:58:52.781331+0000","last_undegraded":"2024-05-09T05:58:52.781331+0000","last_fullsized":"2024-05-09T05:58:52.781331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-09T05:58:52.781013+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-09T05:58:52.781013+0000","last_clean_scrub_stamp":"2024-05-09T05:58:52.781013+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:43:36.608061+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"29'15","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:43.548473+0000","last_change":"2024-05-09T05:58:43.548583+0000","last_active":"2024-05-09T05:58:43.548473+0000","last_peered":"2024-05-09T05:58:43.548473+0000","last_clean":"2024-05-09T05:58:43.548473+0000","last_became_active":"2024-05-09T05:53:23.113524+0000","last_became_peered":"2024-05-09T05:53:23.113524+0000","last_unstale":"2024-05-09T05:58:43.548473+0000","last_undegraded":"2024-05-09T05:58:43.548473+0000","last_fullsized":"2024-05-09T05:58:43.548473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-05-09T05:58:43.548259+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-05-09T05:58:43.548259+0000","last_clean_scrub_stamp":"2024-05-09T05:58:43.548259+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:58:36.493905+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"29'327","reported_seq":360,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:59:03.238461+0000","last_change":"2024-05-09T05:59:03.238635+0000","last_active":"2024-05-09T05:59:03.238461+0000","last_peered":"2024-05-09T05:59:03.238461+0000","last_clean":"2024-05-09T05:59:03.238461+0000","last_became_active":"2024-05-09T05:53:28.226279+0000","last_became_peered":"2024-05-09T05:53:28.226279+0000","last_unstale":"2024-05-09T05:59:03.238461+0000","last_undegraded":"2024-05-09T05:59:03.238461+0000","last_fullsized":"2024-05-09T05:59:03.238461+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'327","last_scrub_stamp":"2024-05-09T05:59:03.238119+0000","last_deep_scrub":"29'327","last_deep_scrub_stamp":"2024-05-09T05:59:03.238119+0000","last_clean_scrub_stamp":"2024-05-09T05:59:03.238119+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:59:46.525274+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":327,"num_write_kb":892928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"29'6","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:39.737951+0000","last_change":"2024-05-09T05:58:39.738018+0000","last_active":"2024-05-09T05:58:39.737951+0000","last_peered":"2024-05-09T05:58:39.737951+0000","last_clean":"2024-05-09T05:58:39.737951+0000","last_became_active":"2024-05-09T05:53:24.134690+0000","last_became_peered":"2024-05-09T05:53:24.134690+0000","last_unstale":"2024-05-09T05:58:39.737951+0000","last_undegraded":"2024-05-09T05:58:39.737951+0000","last_fullsized":"2024-05-09T05:58:39.737951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-09T05:58:39.737769+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-09T05:58:39.737769+0000","last_clean_scrub_stamp":"2024-05-09T05:58:39.737769+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:20:52.374047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"29'106","reported_seq":151,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:41.565127+0000","last_change":"2024-05-09T05:58:41.565168+0000","last_active":"2024-05-09T05:58:41.565127+0000","last_peered":"2024-05-09T05:58:41.565127+0000","last_clean":"2024-05-09T05:58:41.565127+0000","last_became_active":"2024-05-09T05:53:23.119173+0000","last_became_peered":"2024-05-09T05:53:23.119173+0000","last_unstale":"2024-05-09T05:58:41.565127+0000","last_undegraded":"2024-05-09T05:58:41.565127+0000","last_fullsized":"2024-05-09T05:58:41.565127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'106","last_scrub_stamp":"2024-05-09T05:58:41.565053+0000","last_deep_scrub":"29'106","last_deep_scrub_stamp":"2024-05-09T05:58:41.565053+0000","last_clean_scrub_stamp":"2024-05-09T05:58:41.565053+0000","objects_scrubbed":6,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:44:09.320519+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":214081,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":103,"num_write_kb":251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"29'289","reported_seq":322,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:56.109572+0000","last_change":"2024-05-09T05:58:56.109738+0000","last_active":"2024-05-09T05:58:56.109572+0000","last_peered":"2024-05-09T05:58:56.109572+0000","last_clean":"2024-05-09T05:58:56.109572+0000","last_became_active":"2024-05-09T05:53:28.221846+0000","last_became_peered":"2024-05-09T05:53:28.221846+0000","last_unstale":"2024-05-09T05:58:56.109572+0000","last_undegraded":"2024-05-09T05:58:56.109572+0000","last_fullsized":"2024-05-09T05:58:56.109572+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'289","last_scrub_stamp":"2024-05-09T05:58:56.109324+0000","last_deep_scrub":"29'289","last_deep_scrub_stamp":"2024-05-09T05:58:56.109324+0000","last_clean_scrub_stamp":"2024-05-09T05:58:56.109324+0000","objects_scrubbed":0,"log_size":289,"log_dups_size":0,"ondisk_log_size":289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:18:00.372684+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":786432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"29'11","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:46.269344+0000","last_change":"2024-05-09T05:58:46.269414+0000","last_active":"2024-05-09T05:58:46.269344+0000","last_peered":"2024-05-09T05:58:46.269344+0000","last_clean":"2024-05-09T05:58:46.269344+0000","last_became_active":"2024-05-09T05:53:24.132545+0000","last_became_peered":"2024-05-09T05:53:24.132545+0000","last_unstale":"2024-05-09T05:58:46.269344+0000","last_undegraded":"2024-05-09T05:58:46.269344+0000","last_fullsized":"2024-05-09T05:58:46.269344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'11","last_scrub_stamp":"2024-05-09T05:58:46.269143+0000","last_deep_scrub":"29'11","last_deep_scrub_stamp":"2024-05-09T05:58:46.269143+0000","last_clean_scrub_stamp":"2024-05-09T05:58:46.269143+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:44:47.828674+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"29'13","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:44.573922+0000","last_change":"2024-05-09T05:58:44.574010+0000","last_active":"2024-05-09T05:58:44.573922+0000","last_peered":"2024-05-09T05:58:44.573922+0000","last_clean":"2024-05-09T05:58:44.573922+0000","last_became_active":"2024-05-09T05:53:23.120303+0000","last_became_peered":"2024-05-09T05:53:23.120303+0000","last_unstale":"2024-05-09T05:58:44.573922+0000","last_undegraded":"2024-05-09T05:58:44.573922+0000","last_fullsized":"2024-05-09T05:58:44.573922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'13","last_scrub_stamp":"2024-05-09T05:58:44.573713+0000","last_deep_scrub":"29'13","last_deep_scrub_stamp":"2024-05-09T05:58:44.573713+0000","last_clean_scrub_stamp":"2024-05-09T05:58:44.573713+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:19:58.034122+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"29'297","reported_seq":330,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:49.544055+0000","last_change":"2024-05-09T05:58:49.544220+0000","last_active":"2024-05-09T05:58:49.544055+0000","last_peered":"2024-05-09T05:58:49.544055+0000","last_clean":"2024-05-09T05:58:49.544055+0000","last_became_active":"2024-05-09T05:53:28.184259+0000","last_became_peered":"2024-05-09T05:53:28.184259+0000","last_unstale":"2024-05-09T05:58:49.544055+0000","last_undegraded":"2024-05-09T05:58:49.544055+0000","last_fullsized":"2024-05-09T05:58:49.544055+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'297","last_scrub_stamp":"2024-05-09T05:58:49.543741+0000","last_deep_scrub":"29'297","last_deep_scrub_stamp":"2024-05-09T05:58:49.543741+0000","last_clean_scrub_stamp":"2024-05-09T05:58:49.543741+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:58:54.942744+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":297,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"29'9","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:53.912943+0000","last_change":"2024-05-09T05:58:53.913013+0000","last_active":"2024-05-09T05:58:53.912943+0000","last_peered":"2024-05-09T05:58:53.912943+0000","last_clean":"2024-05-09T05:58:53.912943+0000","last_became_active":"2024-05-09T05:53:24.145704+0000","last_became_peered":"2024-05-09T05:53:24.145704+0000","last_unstale":"2024-05-09T05:58:53.912943+0000","last_undegraded":"2024-05-09T05:58:53.912943+0000","last_fullsized":"2024-05-09T05:58:53.912943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-05-09T05:58:53.912727+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-05-09T05:58:53.912727+0000","last_clean_scrub_stamp":"2024-05-09T05:58:53.912727+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:02:23.834718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"29'6","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:42.810961+0000","last_change":"2024-05-09T05:58:42.811080+0000","last_active":"2024-05-09T05:58:42.810961+0000","last_peered":"2024-05-09T05:58:42.810961+0000","last_clean":"2024-05-09T05:58:42.810961+0000","last_became_active":"2024-05-09T05:53:23.094889+0000","last_became_peered":"2024-05-09T05:53:23.094889+0000","last_unstale":"2024-05-09T05:58:42.810961+0000","last_undegraded":"2024-05-09T05:58:42.810961+0000","last_fullsized":"2024-05-09T05:58:42.810961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-09T05:58:42.810743+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-09T05:58:42.810743+0000","last_clean_scrub_stamp":"2024-05-09T05:58:42.810743+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:59:03.097916+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"29'297","reported_seq":330,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:49.583139+0000","last_change":"2024-05-09T05:58:49.583217+0000","last_active":"2024-05-09T05:58:49.583139+0000","last_peered":"2024-05-09T05:58:49.583139+0000","last_clean":"2024-05-09T05:58:49.583139+0000","last_became_active":"2024-05-09T05:53:28.222700+0000","last_became_peered":"2024-05-09T05:53:28.222700+0000","last_unstale":"2024-05-09T05:58:49.583139+0000","last_undegraded":"2024-05-09T05:58:49.583139+0000","last_fullsized":"2024-05-09T05:58:49.583139+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'297","last_scrub_stamp":"2024-05-09T05:58:49.582925+0000","last_deep_scrub":"29'297","last_deep_scrub_stamp":"2024-05-09T05:58:49.582925+0000","last_clean_scrub_stamp":"2024-05-09T05:58:49.582925+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:45:24.149688+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":297,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"29'10","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:46.544597+0000","last_change":"2024-05-09T05:58:46.544668+0000","last_active":"2024-05-09T05:58:46.544597+0000","last_peered":"2024-05-09T05:58:46.544597+0000","last_clean":"2024-05-09T05:58:46.544597+0000","last_became_active":"2024-05-09T05:53:24.139612+0000","last_became_peered":"2024-05-09T05:53:24.139612+0000","last_unstale":"2024-05-09T05:58:46.544597+0000","last_undegraded":"2024-05-09T05:58:46.544597+0000","last_fullsized":"2024-05-09T05:58:46.544597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-09T05:58:46.544401+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-09T05:58:46.544401+0000","last_clean_scrub_stamp":"2024-05-09T05:58:46.544401+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:19:21.600222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"29'9","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:41.472431+0000","last_change":"2024-05-09T05:58:41.472647+0000","last_active":"2024-05-09T05:58:41.472431+0000","last_peered":"2024-05-09T05:58:41.472431+0000","last_clean":"2024-05-09T05:58:41.472431+0000","last_became_active":"2024-05-09T05:53:23.105346+0000","last_became_peered":"2024-05-09T05:53:23.105346+0000","last_unstale":"2024-05-09T05:58:41.472431+0000","last_undegraded":"2024-05-09T05:58:41.472431+0000","last_fullsized":"2024-05-09T05:58:41.472431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-05-09T05:58:41.472358+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-05-09T05:58:41.472358+0000","last_clean_scrub_stamp":"2024-05-09T05:58:41.472358+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:59:56.527270+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"29'327","reported_seq":360,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:54.165398+0000","last_change":"2024-05-09T05:58:54.165473+0000","last_active":"2024-05-09T05:58:54.165398+0000","last_peered":"2024-05-09T05:58:54.165398+0000","last_clean":"2024-05-09T05:58:54.165398+0000","last_became_active":"2024-05-09T05:53:28.192944+0000","last_became_peered":"2024-05-09T05:53:28.192944+0000","last_unstale":"2024-05-09T05:58:54.165398+0000","last_undegraded":"2024-05-09T05:58:54.165398+0000","last_fullsized":"2024-05-09T05:58:54.165398+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'327","last_scrub_stamp":"2024-05-09T05:58:54.165192+0000","last_deep_scrub":"29'327","last_deep_scrub_stamp":"2024-05-09T05:58:54.165192+0000","last_clean_scrub_stamp":"2024-05-09T05:58:54.165192+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:27:15.065082+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":327,"num_write_kb":892928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"29'273","reported_seq":306,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:58.147958+0000","last_change":"2024-05-09T05:58:58.148100+0000","last_active":"2024-05-09T05:58:58.147958+0000","last_peered":"2024-05-09T05:58:58.147958+0000","last_clean":"2024-05-09T05:58:58.147958+0000","last_became_active":"2024-05-09T05:53:28.222225+0000","last_became_peered":"2024-05-09T05:53:28.222225+0000","last_unstale":"2024-05-09T05:58:58.147958+0000","last_undegraded":"2024-05-09T05:58:58.147958+0000","last_fullsized":"2024-05-09T05:58:58.147958+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'273","last_scrub_stamp":"2024-05-09T05:58:58.147624+0000","last_deep_scrub":"29'273","last_deep_scrub_stamp":"2024-05-09T05:58:58.147624+0000","last_clean_scrub_stamp":"2024-05-09T05:58:58.147624+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:57:41.481800+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"29'11","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:48.241046+0000","last_change":"2024-05-09T05:58:48.241179+0000","last_active":"2024-05-09T05:58:48.241046+0000","last_peered":"2024-05-09T05:58:48.241046+0000","last_clean":"2024-05-09T05:58:48.241046+0000","last_became_active":"2024-05-09T05:53:24.127989+0000","last_became_peered":"2024-05-09T05:53:24.127989+0000","last_unstale":"2024-05-09T05:58:48.241046+0000","last_undegraded":"2024-05-09T05:58:48.241046+0000","last_fullsized":"2024-05-09T05:58:48.241046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'11","last_scrub_stamp":"2024-05-09T05:58:48.240802+0000","last_deep_scrub":"29'11","last_deep_scrub_stamp":"2024-05-09T05:58:48.240802+0000","last_clean_scrub_stamp":"2024-05-09T05:58:48.240802+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:05:53.057614+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"29'6","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:53.329288+0000","last_change":"2024-05-09T05:58:53.329363+0000","last_active":"2024-05-09T05:58:53.329288+0000","last_peered":"2024-05-09T05:58:53.329288+0000","last_clean":"2024-05-09T05:58:53.329288+0000","last_became_active":"2024-05-09T05:53:23.118119+0000","last_became_peered":"2024-05-09T05:53:23.118119+0000","last_unstale":"2024-05-09T05:58:53.329288+0000","last_undegraded":"2024-05-09T05:58:53.329288+0000","last_fullsized":"2024-05-09T05:58:53.329288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-09T05:58:53.329091+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-09T05:58:53.329091+0000","last_clean_scrub_stamp":"2024-05-09T05:58:53.329091+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:56:16.606713+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"29'267","reported_seq":300,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:59:05.207417+0000","last_change":"2024-05-09T05:59:05.207491+0000","last_active":"2024-05-09T05:59:05.207417+0000","last_peered":"2024-05-09T05:59:05.207417+0000","last_clean":"2024-05-09T05:59:05.207417+0000","last_became_active":"2024-05-09T05:53:28.234771+0000","last_became_peered":"2024-05-09T05:53:28.234771+0000","last_unstale":"2024-05-09T05:59:05.207417+0000","last_undegraded":"2024-05-09T05:59:05.207417+0000","last_fullsized":"2024-05-09T05:59:05.207417+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'267","last_scrub_stamp":"2024-05-09T05:59:05.207196+0000","last_deep_scrub":"29'267","last_deep_scrub_stamp":"2024-05-09T05:59:05.207196+0000","last_clean_scrub_stamp":"2024-05-09T05:59:05.207196+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:45:54.786827+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":267,"num_write_kb":729088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"29'8","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:50.867472+0000","last_change":"2024-05-09T05:58:50.867545+0000","last_active":"2024-05-09T05:58:50.867472+0000","last_peered":"2024-05-09T05:58:50.867472+0000","last_clean":"2024-05-09T05:58:50.867472+0000","last_became_active":"2024-05-09T05:53:24.139093+0000","last_became_peered":"2024-05-09T05:53:24.139093+0000","last_unstale":"2024-05-09T05:58:50.867472+0000","last_undegraded":"2024-05-09T05:58:50.867472+0000","last_fullsized":"2024-05-09T05:58:50.867472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-09T05:58:50.867236+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-09T05:58:50.867236+0000","last_clean_scrub_stamp":"2024-05-09T05:58:50.867236+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:12:43.158365+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"29'5","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:43.759809+0000","last_change":"2024-05-09T05:58:43.759890+0000","last_active":"2024-05-09T05:58:43.759809+0000","last_peered":"2024-05-09T05:58:43.759809+0000","last_clean":"2024-05-09T05:58:43.759809+0000","last_became_active":"2024-05-09T05:53:23.112020+0000","last_became_peered":"2024-05-09T05:53:23.112020+0000","last_unstale":"2024-05-09T05:58:43.759809+0000","last_undegraded":"2024-05-09T05:58:43.759809+0000","last_fullsized":"2024-05-09T05:58:43.759809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-05-09T05:58:43.759591+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-05-09T05:58:43.759591+0000","last_clean_scrub_stamp":"2024-05-09T05:58:43.759591+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:23:06.539517+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":14,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"29'10","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:50.323711+0000","last_change":"2024-05-09T05:58:50.323789+0000","last_active":"2024-05-09T05:58:50.323711+0000","last_peered":"2024-05-09T05:58:50.323711+0000","last_clean":"2024-05-09T05:58:50.323711+0000","last_became_active":"2024-05-09T05:53:23.126911+0000","last_became_peered":"2024-05-09T05:53:23.126911+0000","last_unstale":"2024-05-09T05:58:50.323711+0000","last_undegraded":"2024-05-09T05:58:50.323711+0000","last_fullsized":"2024-05-09T05:58:50.323711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-09T05:58:50.323528+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-09T05:58:50.323528+0000","last_clean_scrub_stamp":"2024-05-09T05:58:50.323528+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:24:04.300623+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"29'8","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:42.249499+0000","last_change":"2024-05-09T05:58:42.249577+0000","last_active":"2024-05-09T05:58:42.249499+0000","last_peered":"2024-05-09T05:58:42.249499+0000","last_clean":"2024-05-09T05:58:42.249499+0000","last_became_active":"2024-05-09T05:53:24.133994+0000","last_became_peered":"2024-05-09T05:53:24.133994+0000","last_unstale":"2024-05-09T05:58:42.249499+0000","last_undegraded":"2024-05-09T05:58:42.249499+0000","last_fullsized":"2024-05-09T05:58:42.249499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-09T05:58:42.249297+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-09T05:58:42.249297+0000","last_clean_scrub_stamp":"2024-05-09T05:58:42.249297+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:54:45.600917+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"29'297","reported_seq":330,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:57.149002+0000","last_change":"2024-05-09T05:58:57.149098+0000","last_active":"2024-05-09T05:58:57.149002+0000","last_peered":"2024-05-09T05:58:57.149002+0000","last_clean":"2024-05-09T05:58:57.149002+0000","last_became_active":"2024-05-09T05:53:28.222433+0000","last_became_peered":"2024-05-09T05:53:28.222433+0000","last_unstale":"2024-05-09T05:58:57.149002+0000","last_undegraded":"2024-05-09T05:58:57.149002+0000","last_fullsized":"2024-05-09T05:58:57.149002+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'297","last_scrub_stamp":"2024-05-09T05:58:57.148787+0000","last_deep_scrub":"29'297","last_deep_scrub_stamp":"2024-05-09T05:58:57.148787+0000","last_clean_scrub_stamp":"2024-05-09T05:58:57.148787+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:41:47.873414+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":297,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"29'8","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:46.845549+0000","last_change":"2024-05-09T05:58:46.845648+0000","last_active":"2024-05-09T05:58:46.845549+0000","last_peered":"2024-05-09T05:58:46.845549+0000","last_clean":"2024-05-09T05:58:46.845549+0000","last_became_active":"2024-05-09T05:53:23.132946+0000","last_became_peered":"2024-05-09T05:53:23.132946+0000","last_unstale":"2024-05-09T05:58:46.845549+0000","last_undegraded":"2024-05-09T05:58:46.845549+0000","last_fullsized":"2024-05-09T05:58:46.845549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-09T05:58:46.845348+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-09T05:58:46.845348+0000","last_clean_scrub_stamp":"2024-05-09T05:58:46.845348+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:22:03.273797+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"29'7","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:44.510785+0000","last_change":"2024-05-09T05:58:44.510872+0000","last_active":"2024-05-09T05:58:44.510785+0000","last_peered":"2024-05-09T05:58:44.510785+0000","last_clean":"2024-05-09T05:58:44.510785+0000","last_became_active":"2024-05-09T05:53:24.137794+0000","last_became_peered":"2024-05-09T05:53:24.137794+0000","last_unstale":"2024-05-09T05:58:44.510785+0000","last_undegraded":"2024-05-09T05:58:44.510785+0000","last_fullsized":"2024-05-09T05:58:44.510785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-05-09T05:58:44.510575+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-05-09T05:58:44.510575+0000","last_clean_scrub_stamp":"2024-05-09T05:58:44.510575+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:51:13.054382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"29'312","reported_seq":345,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:52.597700+0000","last_change":"2024-05-09T05:58:52.597770+0000","last_active":"2024-05-09T05:58:52.597700+0000","last_peered":"2024-05-09T05:58:52.597700+0000","last_clean":"2024-05-09T05:58:52.597700+0000","last_became_active":"2024-05-09T05:53:28.237414+0000","last_became_peered":"2024-05-09T05:53:28.237414+0000","last_unstale":"2024-05-09T05:58:52.597700+0000","last_undegraded":"2024-05-09T05:58:52.597700+0000","last_fullsized":"2024-05-09T05:58:52.597700+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'312","last_scrub_stamp":"2024-05-09T05:58:52.597495+0000","last_deep_scrub":"29'312","last_deep_scrub_stamp":"2024-05-09T05:58:52.597495+0000","last_clean_scrub_stamp":"2024-05-09T05:58:52.597495+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:54:33.413504+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":851968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"29'9","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:44.542421+0000","last_change":"2024-05-09T05:58:44.542490+0000","last_active":"2024-05-09T05:58:44.542421+0000","last_peered":"2024-05-09T05:58:44.542421+0000","last_clean":"2024-05-09T05:58:44.542421+0000","last_became_active":"2024-05-09T05:53:24.130201+0000","last_became_peered":"2024-05-09T05:53:24.130201+0000","last_unstale":"2024-05-09T05:58:44.542421+0000","last_undegraded":"2024-05-09T05:58:44.542421+0000","last_fullsized":"2024-05-09T05:58:44.542421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-05-09T05:58:44.542191+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-05-09T05:58:44.542191+0000","last_clean_scrub_stamp":"2024-05-09T05:58:44.542191+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:07:31.085109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"29'12","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:48.531732+0000","last_change":"2024-05-09T05:58:48.531800+0000","last_active":"2024-05-09T05:58:48.531732+0000","last_peered":"2024-05-09T05:58:48.531732+0000","last_clean":"2024-05-09T05:58:48.531732+0000","last_became_active":"2024-05-09T05:53:24.138366+0000","last_became_peered":"2024-05-09T05:53:24.138366+0000","last_unstale":"2024-05-09T05:58:48.531732+0000","last_undegraded":"2024-05-09T05:58:48.531732+0000","last_fullsized":"2024-05-09T05:58:48.531732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-09T05:58:48.531523+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-09T05:58:48.531523+0000","last_clean_scrub_stamp":"2024-05-09T05:58:48.531523+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:38:04.242592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"29'8","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:43.308456+0000","last_change":"2024-05-09T05:58:43.308520+0000","last_active":"2024-05-09T05:58:43.308456+0000","last_peered":"2024-05-09T05:58:43.308456+0000","last_clean":"2024-05-09T05:58:43.308456+0000","last_became_active":"2024-05-09T05:53:24.139058+0000","last_became_peered":"2024-05-09T05:53:24.139058+0000","last_unstale":"2024-05-09T05:58:43.308456+0000","last_undegraded":"2024-05-09T05:58:43.308456+0000","last_fullsized":"2024-05-09T05:58:43.308456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-09T05:58:43.308260+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-09T05:58:43.308260+0000","last_clean_scrub_stamp":"2024-05-09T05:58:43.308260+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:48:02.427985+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"29'7","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:42.813469+0000","last_change":"2024-05-09T05:58:42.813534+0000","last_active":"2024-05-09T05:58:42.813469+0000","last_peered":"2024-05-09T05:58:42.813469+0000","last_clean":"2024-05-09T05:58:42.813469+0000","last_became_active":"2024-05-09T05:53:24.142812+0000","last_became_peered":"2024-05-09T05:53:24.142812+0000","last_unstale":"2024-05-09T05:58:42.813469+0000","last_undegraded":"2024-05-09T05:58:42.813469+0000","last_fullsized":"2024-05-09T05:58:42.813469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-05-09T05:58:42.813268+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-05-09T05:58:42.813268+0000","last_clean_scrub_stamp":"2024-05-09T05:58:42.813268+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:13:54.170266+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"29'4","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:50.791778+0000","last_change":"2024-05-09T05:58:50.791859+0000","last_active":"2024-05-09T05:58:50.791778+0000","last_peered":"2024-05-09T05:58:50.791778+0000","last_clean":"2024-05-09T05:58:50.791778+0000","last_became_active":"2024-05-09T05:53:24.135043+0000","last_became_peered":"2024-05-09T05:53:24.135043+0000","last_unstale":"2024-05-09T05:58:50.791778+0000","last_undegraded":"2024-05-09T05:58:50.791778+0000","last_fullsized":"2024-05-09T05:58:50.791778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-09T05:58:50.791576+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-09T05:58:50.791576+0000","last_clean_scrub_stamp":"2024-05-09T05:58:50.791576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:08:47.683437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"29'6","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:49.834790+0000","last_change":"2024-05-09T05:58:49.834864+0000","last_active":"2024-05-09T05:58:49.834790+0000","last_peered":"2024-05-09T05:58:49.834790+0000","last_clean":"2024-05-09T05:58:49.834790+0000","last_became_active":"2024-05-09T05:53:24.132453+0000","last_became_peered":"2024-05-09T05:53:24.132453+0000","last_unstale":"2024-05-09T05:58:49.834790+0000","last_undegraded":"2024-05-09T05:58:49.834790+0000","last_fullsized":"2024-05-09T05:58:49.834790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-09T05:58:49.834552+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-09T05:58:49.834552+0000","last_clean_scrub_stamp":"2024-05-09T05:58:49.834552+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:56:24.116272+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"29'15","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:47.515625+0000","last_change":"2024-05-09T05:58:47.515714+0000","last_active":"2024-05-09T05:58:47.515625+0000","last_peered":"2024-05-09T05:58:47.515625+0000","last_clean":"2024-05-09T05:58:47.515625+0000","last_became_active":"2024-05-09T05:53:24.140045+0000","last_became_peered":"2024-05-09T05:53:24.140045+0000","last_unstale":"2024-05-09T05:58:47.515625+0000","last_undegraded":"2024-05-09T05:58:47.515625+0000","last_fullsized":"2024-05-09T05:58:47.515625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-05-09T05:58:47.515424+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-05-09T05:58:47.515424+0000","last_clean_scrub_stamp":"2024-05-09T05:58:47.515424+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:11:18.077043+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"29'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:54.931434+0000","last_change":"2024-05-09T05:58:54.931510+0000","last_active":"2024-05-09T05:58:54.931434+0000","last_peered":"2024-05-09T05:58:54.931434+0000","last_clean":"2024-05-09T05:58:54.931434+0000","last_became_active":"2024-05-09T05:53:24.151275+0000","last_became_peered":"2024-05-09T05:53:24.151275+0000","last_unstale":"2024-05-09T05:58:54.931434+0000","last_undegraded":"2024-05-09T05:58:54.931434+0000","last_fullsized":"2024-05-09T05:58:54.931434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-09T05:58:54.931235+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-09T05:58:54.931235+0000","last_clean_scrub_stamp":"2024-05-09T05:58:54.931235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:21:51.172039+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"29'6","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:49.344639+0000","last_change":"2024-05-09T05:58:49.344705+0000","last_active":"2024-05-09T05:58:49.344639+0000","last_peered":"2024-05-09T05:58:49.344639+0000","last_clean":"2024-05-09T05:58:49.344639+0000","last_became_active":"2024-05-09T05:53:24.144005+0000","last_became_peered":"2024-05-09T05:53:24.144005+0000","last_unstale":"2024-05-09T05:58:49.344639+0000","last_undegraded":"2024-05-09T05:58:49.344639+0000","last_fullsized":"2024-05-09T05:58:49.344639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-09T05:58:49.344431+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-09T05:58:49.344431+0000","last_clean_scrub_stamp":"2024-05-09T05:58:49.344431+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:39:44.834463+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"29'8","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:44.793589+0000","last_change":"2024-05-09T05:58:44.793660+0000","last_active":"2024-05-09T05:58:44.793589+0000","last_peered":"2024-05-09T05:58:44.793589+0000","last_clean":"2024-05-09T05:58:44.793589+0000","last_became_active":"2024-05-09T05:53:24.146965+0000","last_became_peered":"2024-05-09T05:53:24.146965+0000","last_unstale":"2024-05-09T05:58:44.793589+0000","last_undegraded":"2024-05-09T05:58:44.793589+0000","last_fullsized":"2024-05-09T05:58:44.793589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-09T05:58:44.793375+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-09T05:58:44.793375+0000","last_clean_scrub_stamp":"2024-05-09T05:58:44.793375+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:09:50.183791+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"29'10","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:42.492980+0000","last_change":"2024-05-09T05:58:42.493047+0000","last_active":"2024-05-09T05:58:42.492980+0000","last_peered":"2024-05-09T05:58:42.492980+0000","last_clean":"2024-05-09T05:58:42.492980+0000","last_became_active":"2024-05-09T05:53:24.131417+0000","last_became_peered":"2024-05-09T05:53:24.131417+0000","last_unstale":"2024-05-09T05:58:42.492980+0000","last_undegraded":"2024-05-09T05:58:42.492980+0000","last_fullsized":"2024-05-09T05:58:42.492980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-09T05:58:42.492788+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-09T05:58:42.492788+0000","last_clean_scrub_stamp":"2024-05-09T05:58:42.492788+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:34:03.858343+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"29'11","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:53.167272+0000","last_change":"2024-05-09T05:58:53.167436+0000","last_active":"2024-05-09T05:58:53.167272+0000","last_peered":"2024-05-09T05:58:53.167272+0000","last_clean":"2024-05-09T05:58:53.167272+0000","last_became_active":"2024-05-09T05:53:24.140024+0000","last_became_peered":"2024-05-09T05:53:24.140024+0000","last_unstale":"2024-05-09T05:58:53.167272+0000","last_undegraded":"2024-05-09T05:58:53.167272+0000","last_fullsized":"2024-05-09T05:58:53.167272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'11","last_scrub_stamp":"2024-05-09T05:58:53.166990+0000","last_deep_scrub":"29'11","last_deep_scrub_stamp":"2024-05-09T05:58:53.166990+0000","last_clean_scrub_stamp":"2024-05-09T05:58:53.166990+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:17:53.409559+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"29'8","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:50.817882+0000","last_change":"2024-05-09T05:58:50.817950+0000","last_active":"2024-05-09T05:58:50.817882+0000","last_peered":"2024-05-09T05:58:50.817882+0000","last_clean":"2024-05-09T05:58:50.817882+0000","last_became_active":"2024-05-09T05:53:24.136572+0000","last_became_peered":"2024-05-09T05:53:24.136572+0000","last_unstale":"2024-05-09T05:58:50.817882+0000","last_undegraded":"2024-05-09T05:58:50.817882+0000","last_fullsized":"2024-05-09T05:58:50.817882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-09T05:58:50.817683+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-09T05:58:50.817683+0000","last_clean_scrub_stamp":"2024-05-09T05:58:50.817683+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:50:05.950510+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"29'7","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:59:00.209007+0000","last_change":"2024-05-09T05:59:00.209140+0000","last_active":"2024-05-09T05:59:00.209007+0000","last_peered":"2024-05-09T05:59:00.209007+0000","last_clean":"2024-05-09T05:59:00.209007+0000","last_became_active":"2024-05-09T05:53:24.144573+0000","last_became_peered":"2024-05-09T05:53:24.144573+0000","last_unstale":"2024-05-09T05:59:00.209007+0000","last_undegraded":"2024-05-09T05:59:00.209007+0000","last_fullsized":"2024-05-09T05:59:00.209007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-05-09T05:59:00.208745+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-05-09T05:59:00.208745+0000","last_clean_scrub_stamp":"2024-05-09T05:59:00.208745+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:02:52.999272+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"29'10","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:46.516588+0000","last_change":"2024-05-09T05:58:46.516752+0000","last_active":"2024-05-09T05:58:46.516588+0000","last_peered":"2024-05-09T05:58:46.516588+0000","last_clean":"2024-05-09T05:58:46.516588+0000","last_became_active":"2024-05-09T05:53:24.135625+0000","last_became_peered":"2024-05-09T05:53:24.135625+0000","last_unstale":"2024-05-09T05:58:46.516588+0000","last_undegraded":"2024-05-09T05:58:46.516588+0000","last_fullsized":"2024-05-09T05:58:46.516588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-09T05:58:46.516249+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-09T05:58:46.516249+0000","last_clean_scrub_stamp":"2024-05-09T05:58:46.516249+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:45:40.737353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"29'8","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:44.321001+0000","last_change":"2024-05-09T05:58:44.321127+0000","last_active":"2024-05-09T05:58:44.321001+0000","last_peered":"2024-05-09T05:58:44.321001+0000","last_clean":"2024-05-09T05:58:44.321001+0000","last_became_active":"2024-05-09T05:53:24.133405+0000","last_became_peered":"2024-05-09T05:53:24.133405+0000","last_unstale":"2024-05-09T05:58:44.321001+0000","last_undegraded":"2024-05-09T05:58:44.321001+0000","last_fullsized":"2024-05-09T05:58:44.321001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-09T05:58:44.320688+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-09T05:58:44.320688+0000","last_clean_scrub_stamp":"2024-05-09T05:58:44.320688+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:48:48.160173+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"29'9","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:41.318536+0000","last_change":"2024-05-09T05:58:41.318562+0000","last_active":"2024-05-09T05:58:41.318536+0000","last_peered":"2024-05-09T05:58:41.318536+0000","last_clean":"2024-05-09T05:58:41.318536+0000","last_became_active":"2024-05-09T05:53:24.139374+0000","last_became_peered":"2024-05-09T05:53:24.139374+0000","last_unstale":"2024-05-09T05:58:41.318536+0000","last_undegraded":"2024-05-09T05:58:41.318536+0000","last_fullsized":"2024-05-09T05:58:41.318536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-05-09T05:58:41.318452+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-05-09T05:58:41.318452+0000","last_clean_scrub_stamp":"2024-05-09T05:58:41.318452+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:13:44.296256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"29'7","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:43.818174+0000","last_change":"2024-05-09T05:58:43.818243+0000","last_active":"2024-05-09T05:58:43.818174+0000","last_peered":"2024-05-09T05:58:43.818174+0000","last_clean":"2024-05-09T05:58:43.818174+0000","last_became_active":"2024-05-09T05:53:24.145616+0000","last_became_peered":"2024-05-09T05:53:24.145616+0000","last_unstale":"2024-05-09T05:58:43.818174+0000","last_undegraded":"2024-05-09T05:58:43.818174+0000","last_fullsized":"2024-05-09T05:58:43.818174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-05-09T05:58:43.817982+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-05-09T05:58:43.817982+0000","last_clean_scrub_stamp":"2024-05-09T05:58:43.817982+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:52:31.395834+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"29'8","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:46.755004+0000","last_change":"2024-05-09T05:58:46.755075+0000","last_active":"2024-05-09T05:58:46.755004+0000","last_peered":"2024-05-09T05:58:46.755004+0000","last_clean":"2024-05-09T05:58:46.755004+0000","last_became_active":"2024-05-09T05:53:24.128870+0000","last_became_peered":"2024-05-09T05:53:24.128870+0000","last_unstale":"2024-05-09T05:58:46.755004+0000","last_undegraded":"2024-05-09T05:58:46.755004+0000","last_fullsized":"2024-05-09T05:58:46.755004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-09T05:58:46.754803+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-09T05:58:46.754803+0000","last_clean_scrub_stamp":"2024-05-09T05:58:46.754803+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:02:20.384584+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"29'10","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:48.791179+0000","last_change":"2024-05-09T05:58:48.791309+0000","last_active":"2024-05-09T05:58:48.791179+0000","last_peered":"2024-05-09T05:58:48.791179+0000","last_clean":"2024-05-09T05:58:48.791179+0000","last_became_active":"2024-05-09T05:53:24.132688+0000","last_became_peered":"2024-05-09T05:53:24.132688+0000","last_unstale":"2024-05-09T05:58:48.791179+0000","last_undegraded":"2024-05-09T05:58:48.791179+0000","last_fullsized":"2024-05-09T05:58:48.791179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-09T05:58:48.790928+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-09T05:58:48.790928+0000","last_clean_scrub_stamp":"2024-05-09T05:58:48.790928+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:15:49.375135+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"29'7","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:53.812944+0000","last_change":"2024-05-09T05:58:53.813013+0000","last_active":"2024-05-09T05:58:53.812944+0000","last_peered":"2024-05-09T05:58:53.812944+0000","last_clean":"2024-05-09T05:58:53.812944+0000","last_became_active":"2024-05-09T05:53:24.142280+0000","last_became_peered":"2024-05-09T05:53:24.142280+0000","last_unstale":"2024-05-09T05:58:53.812944+0000","last_undegraded":"2024-05-09T05:58:53.812944+0000","last_fullsized":"2024-05-09T05:58:53.812944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-05-09T05:58:53.812755+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-05-09T05:58:53.812755+0000","last_clean_scrub_stamp":"2024-05-09T05:58:53.812755+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:24:43.084628+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"29'6","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:54.786360+0000","last_change":"2024-05-09T05:58:54.786520+0000","last_active":"2024-05-09T05:58:54.786360+0000","last_peered":"2024-05-09T05:58:54.786360+0000","last_clean":"2024-05-09T05:58:54.786360+0000","last_became_active":"2024-05-09T05:53:24.144381+0000","last_became_peered":"2024-05-09T05:53:24.144381+0000","last_unstale":"2024-05-09T05:58:54.786360+0000","last_undegraded":"2024-05-09T05:58:54.786360+0000","last_fullsized":"2024-05-09T05:58:54.786360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-09T05:58:54.786099+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-09T05:58:54.786099+0000","last_clean_scrub_stamp":"2024-05-09T05:58:54.786099+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:54:56.044842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"29'16","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:48.803371+0000","last_change":"2024-05-09T05:58:48.803449+0000","last_active":"2024-05-09T05:58:48.803371+0000","last_peered":"2024-05-09T05:58:48.803371+0000","last_clean":"2024-05-09T05:58:48.803371+0000","last_became_active":"2024-05-09T05:53:24.131218+0000","last_became_peered":"2024-05-09T05:53:24.131218+0000","last_unstale":"2024-05-09T05:58:48.803371+0000","last_undegraded":"2024-05-09T05:58:48.803371+0000","last_fullsized":"2024-05-09T05:58:48.803371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-05-09T05:58:48.803166+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-05-09T05:58:48.803166+0000","last_clean_scrub_stamp":"2024-05-09T05:58:48.803166+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:46:19.864725+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"29'11","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:45.495530+0000","last_change":"2024-05-09T05:58:45.495598+0000","last_active":"2024-05-09T05:58:45.495530+0000","last_peered":"2024-05-09T05:58:45.495530+0000","last_clean":"2024-05-09T05:58:45.495530+0000","last_became_active":"2024-05-09T05:53:24.139473+0000","last_became_peered":"2024-05-09T05:53:24.139473+0000","last_unstale":"2024-05-09T05:58:45.495530+0000","last_undegraded":"2024-05-09T05:58:45.495530+0000","last_fullsized":"2024-05-09T05:58:45.495530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'11","last_scrub_stamp":"2024-05-09T05:58:45.495349+0000","last_deep_scrub":"29'11","last_deep_scrub_stamp":"2024-05-09T05:58:45.495349+0000","last_clean_scrub_stamp":"2024-05-09T05:58:45.495349+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:21:36.200041+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"29'9","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:52.876803+0000","last_change":"2024-05-09T05:58:52.876877+0000","last_active":"2024-05-09T05:58:52.876803+0000","last_peered":"2024-05-09T05:58:52.876803+0000","last_clean":"2024-05-09T05:58:52.876803+0000","last_became_active":"2024-05-09T05:53:24.143053+0000","last_became_peered":"2024-05-09T05:53:24.143053+0000","last_unstale":"2024-05-09T05:58:52.876803+0000","last_undegraded":"2024-05-09T05:58:52.876803+0000","last_fullsized":"2024-05-09T05:58:52.876803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-05-09T05:58:52.876572+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-05-09T05:58:52.876572+0000","last_clean_scrub_stamp":"2024-05-09T05:58:52.876572+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:23:49.737399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"29'5","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:55.771689+0000","last_change":"2024-05-09T05:58:55.771817+0000","last_active":"2024-05-09T05:58:55.771689+0000","last_peered":"2024-05-09T05:58:55.771689+0000","last_clean":"2024-05-09T05:58:55.771689+0000","last_became_active":"2024-05-09T05:53:24.145150+0000","last_became_peered":"2024-05-09T05:53:24.145150+0000","last_unstale":"2024-05-09T05:58:55.771689+0000","last_undegraded":"2024-05-09T05:58:55.771689+0000","last_fullsized":"2024-05-09T05:58:55.771689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-05-09T05:58:55.771302+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-05-09T05:58:55.771302+0000","last_clean_scrub_stamp":"2024-05-09T05:58:55.771302+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:27:44.851705+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"29'6","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:42.565921+0000","last_change":"2024-05-09T05:58:42.565967+0000","last_active":"2024-05-09T05:58:42.565921+0000","last_peered":"2024-05-09T05:58:42.565921+0000","last_clean":"2024-05-09T05:58:42.565921+0000","last_became_active":"2024-05-09T05:53:24.129339+0000","last_became_peered":"2024-05-09T05:53:24.129339+0000","last_unstale":"2024-05-09T05:58:42.565921+0000","last_undegraded":"2024-05-09T05:58:42.565921+0000","last_fullsized":"2024-05-09T05:58:42.565921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-09T05:58:42.565827+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-09T05:58:42.565827+0000","last_clean_scrub_stamp":"2024-05-09T05:58:42.565827+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:59:55.093867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"29'4","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:51.788477+0000","last_change":"2024-05-09T05:58:51.788548+0000","last_active":"2024-05-09T05:58:51.788477+0000","last_peered":"2024-05-09T05:58:51.788477+0000","last_clean":"2024-05-09T05:58:51.788477+0000","last_became_active":"2024-05-09T05:53:24.138499+0000","last_became_peered":"2024-05-09T05:53:24.138499+0000","last_unstale":"2024-05-09T05:58:51.788477+0000","last_undegraded":"2024-05-09T05:58:51.788477+0000","last_fullsized":"2024-05-09T05:58:51.788477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-09T05:58:51.788274+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-09T05:58:51.788274+0000","last_clean_scrub_stamp":"2024-05-09T05:58:51.788274+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:59:48.715614+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"29'8","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:48.532325+0000","last_change":"2024-05-09T05:58:48.532455+0000","last_active":"2024-05-09T05:58:48.532325+0000","last_peered":"2024-05-09T05:58:48.532325+0000","last_clean":"2024-05-09T05:58:48.532325+0000","last_became_active":"2024-05-09T05:53:24.143890+0000","last_became_peered":"2024-05-09T05:53:24.143890+0000","last_unstale":"2024-05-09T05:58:48.532325+0000","last_undegraded":"2024-05-09T05:58:48.532325+0000","last_fullsized":"2024-05-09T05:58:48.532325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-09T05:58:48.531982+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-09T05:58:48.531982+0000","last_clean_scrub_stamp":"2024-05-09T05:58:48.531982+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:35:45.237691+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"29'7","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:56.978147+0000","last_change":"2024-05-09T05:58:56.978219+0000","last_active":"2024-05-09T05:58:56.978147+0000","last_peered":"2024-05-09T05:58:56.978147+0000","last_clean":"2024-05-09T05:58:56.978147+0000","last_became_active":"2024-05-09T05:53:24.151674+0000","last_became_peered":"2024-05-09T05:53:24.151674+0000","last_unstale":"2024-05-09T05:58:56.978147+0000","last_undegraded":"2024-05-09T05:58:56.978147+0000","last_fullsized":"2024-05-09T05:58:56.978147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-05-09T05:58:56.977887+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-05-09T05:58:56.977887+0000","last_clean_scrub_stamp":"2024-05-09T05:58:56.977887+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:59:49.685408+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"29'4","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:57.985166+0000","last_change":"2024-05-09T05:58:57.985238+0000","last_active":"2024-05-09T05:58:57.985166+0000","last_peered":"2024-05-09T05:58:57.985166+0000","last_clean":"2024-05-09T05:58:57.985166+0000","last_became_active":"2024-05-09T05:53:24.151418+0000","last_became_peered":"2024-05-09T05:53:24.151418+0000","last_unstale":"2024-05-09T05:58:57.985166+0000","last_undegraded":"2024-05-09T05:58:57.985166+0000","last_fullsized":"2024-05-09T05:58:57.985166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-09T05:58:57.984921+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-09T05:58:57.984921+0000","last_clean_scrub_stamp":"2024-05-09T05:58:57.984921+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:16:39.536674+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"29'8","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-09T05:58:52.809294+0000","last_change":"2024-05-09T05:58:52.809429+0000","last_active":"2024-05-09T05:58:52.809294+0000","last_peered":"2024-05-09T05:58:52.809294+0000","last_clean":"2024-05-09T05:58:52.809294+0000","last_became_active":"2024-05-09T05:53:24.140589+0000","last_became_peered":"2024-05-09T05:53:24.140589+0000","last_unstale":"2024-05-09T05:58:52.809294+0000","last_undegraded":"2024-05-09T05:58:52.809294+0000","last_fullsized":"2024-05-09T05:58:52.809294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-09T05:58:52.809040+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-09T05:58:52.809040+0000","last_clean_scrub_stamp":"2024-05-09T05:58:52.809040+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:17:34.396269+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9216,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9217,"ondisk_log_size":9217,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":503,"ondisk_log_size":503,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":222778,"num_objects":99,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":153,"num_read_kb":159,"num_write":358,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":696320,"data_stored":445556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":420,"ondisk_log_size":420,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509516,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71708,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94300132,"statfs":{"total":96636764160,"available":96563335168,"internally_reserved":0,"allocated":348160,"data_stored":131030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":73071050},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509519,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71688,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94300152,"statfs":{"total":96636764160,"available":96563355648,"internally_reserved":0,"allocated":327680,"data_stored":132991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":73071047},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509519,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49788,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94322052,"statfs":{"total":96636764160,"available":96585781248,"internally_reserved":0,"allocated":577536,"data_stored":345366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509516,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58072,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313768,"statfs":{"total":96636764160,"available":96577298432,"internally_reserved":0,"allocated":540672,"data_stored":343596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509518,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68108,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94303732,"statfs":{"total":96636764160,"available":96567021568,"internally_reserved":0,"allocated":921600,"data_stored":721229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68811205},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509518,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53720,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94318120,"statfs":{"total":96636764160,"available":96581754880,"internally_reserved":0,"allocated":344064,"data_stored":133153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574924,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50132,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321708,"statfs":{"total":96636764160,"available":96585428992,"internally_reserved":0,"allocated":929792,"data_stored":721752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574925,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67552,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94304288,"statfs":{"total":96636764160,"available":96567590912,"internally_reserved":0,"allocated":352256,"data_stored":132751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68811207},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":3706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":233472,"data_stored":214149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":270336,"data_stored":215919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T05:59:24.638 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-05-09T05:59:24.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.838+0000 7f9ae853a640 1 Processor -- start 2024-05-09T05:59:24.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.838+0000 7f9ae853a640 1 -- start start 2024-05-09T05:59:24.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.838+0000 7f9ae853a640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9ae01537d0 0x7f9ae0074740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:24.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.838+0000 7f9ae853a640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ae00c72c0 con 0x7f9ae0161d70 2024-05-09T05:59:24.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.842+0000 7f9ae853a640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ae00c7bb0 con 0x7f9ae00c77a0 2024-05-09T05:59:24.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.842+0000 7f9ae853a640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f9ae0074c80 con 0x7f9ae01537d0 2024-05-09T05:59:24.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.842+0000 7f9ae5ad5640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9ae01537d0 0x7f9ae0074740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:24.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.842+0000 7f9ae5ad5640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9ae01537d0 0x7f9ae0074740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60044/0 (socket says 172.21.15.72:60044) 2024-05-09T05:59:24.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.842+0000 7f9ae5ad5640 1 -- 172.21.15.72:0/2009651439 learned_addr learned my addr 172.21.15.72:0/2009651439 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:59:24.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.842+0000 7f9ae5ad5640 1 -- 172.21.15.72:0/2009651439 >> v1:172.21.15.110:6789/0 conn(0x7f9ae00c77a0 legacy=0x7f9ae0072e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:59:24.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.842+0000 7f9ae5ad5640 1 -- 172.21.15.72:0/2009651439 >> v1:172.21.15.72:6789/0 conn(0x7f9ae0161d70 legacy=0x7f9ae0164190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:59:24.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.842+0000 7f9ae5ad5640 1 -- 172.21.15.72:0/2009651439 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ae0153be0 con 0x7f9ae01537d0 2024-05-09T05:59:24.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.842+0000 7f9ae5ad5640 1 --2- 172.21.15.72:0/2009651439 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ae01537d0 0x7f9ae0074740 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f9ad0009870 tx=0x7f9ad001e740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ee05b9cfbbd9cc5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:59:24.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.842+0000 7f9ae52d4640 1 -- 172.21.15.72:0/2009651439 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ad00a8610 con 0x7f9ae01537d0 2024-05-09T05:59:24.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.842+0000 7f9ae52d4640 1 -- 172.21.15.72:0/2009651439 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ad00a87b0 con 0x7f9ae01537d0 2024-05-09T05:59:24.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.842+0000 7f9ae52d4640 1 -- 172.21.15.72:0/2009651439 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ad00a8b80 con 0x7f9ae01537d0 2024-05-09T05:59:24.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.846+0000 7f9ae853a640 1 -- 172.21.15.72:0/2009651439 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ae01537d0 msgr2=0x7f9ae0074740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:59:24.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.846+0000 7f9ae853a640 1 --2- 172.21.15.72:0/2009651439 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ae01537d0 0x7f9ae0074740 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f9ad0009870 tx=0x7f9ad001e740 comp rx=0 tx=0).stop 2024-05-09T05:59:24.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.846+0000 7f9ae853a640 1 -- 172.21.15.72:0/2009651439 shutdown_connections 2024-05-09T05:59:24.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.846+0000 7f9ae853a640 1 --2- 172.21.15.72:0/2009651439 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ae01537d0 0x7f9ae0074740 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:24.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.846+0000 7f9ae853a640 1 -- 172.21.15.72:0/2009651439 >> 172.21.15.72:0/2009651439 conn(0x7f9ae00cde90 msgr2=0x7f9ae00ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:59:24.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.846+0000 7f9ae853a640 1 -- 172.21.15.72:0/2009651439 shutdown_connections 2024-05-09T05:59:24.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.846+0000 7f9ae853a640 1 -- 172.21.15.72:0/2009651439 wait complete. 2024-05-09T05:59:24.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.846+0000 7f9ae853a640 1 Processor -- start 2024-05-09T05:59:24.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.846+0000 7f9ae853a640 1 -- start start 2024-05-09T05:59:24.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.850+0000 7f9ae853a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ae00c77a0 0x7f9ae01495e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:24.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.850+0000 7f9ae853a640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ae01537d0 0x7f9ae015c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:24.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.850+0000 7f9ae853a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9ae0161d70 0x7f9ae01f22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:24.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.850+0000 7f9ae853a640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae0072940 con 0x7f9ae01537d0 2024-05-09T05:59:24.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.850+0000 7f9ae853a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae00740b0 con 0x7f9ae00c77a0 2024-05-09T05:59:24.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.850+0000 7f9ae853a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f9ae00c4cb0 con 0x7f9ae0161d70 2024-05-09T05:59:24.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.850+0000 7f9ae5ad5640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ae01537d0 0x7f9ae015c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:24.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.850+0000 7f9ae5ad5640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ae01537d0 0x7f9ae015c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60058/0 (socket says 172.21.15.72:60058) 2024-05-09T05:59:24.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.850+0000 7f9ae5ad5640 1 -- 172.21.15.72:0/1141763873 learned_addr learned my addr 172.21.15.72:0/1141763873 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:59:24.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.850+0000 7f9ae62d6640 1 --2- 172.21.15.72:0/1141763873 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ae00c77a0 0x7f9ae01495e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:24.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.850+0000 7f9ae6ad7640 1 --2- 172.21.15.72:0/1141763873 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9ae0161d70 0x7f9ae01f22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:24.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.850+0000 7f9ae5ad5640 1 -- 172.21.15.72:0/1141763873 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9ae0161d70 msgr2=0x7f9ae01f22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:59:24.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.850+0000 7f9ae5ad5640 1 --2- 172.21.15.72:0/1141763873 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9ae0161d70 0x7f9ae01f22b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:24.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.850+0000 7f9ae5ad5640 1 -- 172.21.15.72:0/1141763873 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ae00c77a0 msgr2=0x7f9ae01495e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:59:24.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.850+0000 7f9ae5ad5640 1 --2- 172.21.15.72:0/1141763873 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ae00c77a0 0x7f9ae01495e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:24.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.850+0000 7f9ae5ad5640 1 -- 172.21.15.72:0/1141763873 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ae0162830 con 0x7f9ae01537d0 2024-05-09T05:59:24.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.850+0000 7f9ae6ad7640 1 --2- 172.21.15.72:0/1141763873 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9ae0161d70 0x7f9ae01f22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:59:24.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.850+0000 7f9ae5ad5640 1 --2- 172.21.15.72:0/1141763873 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ae01537d0 0x7f9ae015c3e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9ad001b350 tx=0x7f9ad001b4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:59:24.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.850+0000 7f9ad6ffd640 1 -- 172.21.15.72:0/1141763873 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ad00b28d0 con 0x7f9ae01537d0 2024-05-09T05:59:24.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.850+0000 7f9ad6ffd640 1 -- 172.21.15.72:0/1141763873 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ad00b2a70 con 0x7f9ae01537d0 2024-05-09T05:59:24.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.850+0000 7f9ae853a640 1 -- 172.21.15.72:0/1141763873 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ae0162550 con 0x7f9ae01537d0 2024-05-09T05:59:24.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.850+0000 7f9ad6ffd640 1 -- 172.21.15.72:0/1141763873 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ad00b2e60 con 0x7f9ae01537d0 2024-05-09T05:59:24.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.850+0000 7f9ae853a640 1 -- 172.21.15.72:0/1141763873 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ae015bbe0 con 0x7f9ae01537d0 2024-05-09T05:59:24.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.850+0000 7f9ae853a640 1 -- 172.21.15.72:0/1141763873 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ae01622b0 con 0x7f9ae01537d0 2024-05-09T05:59:24.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.850+0000 7f9ad6ffd640 1 -- 172.21.15.72:0/1141763873 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f9ad00bb480 con 0x7f9ae01537d0 2024-05-09T05:59:24.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.850+0000 7f9ad6ffd640 1 --2- 172.21.15.72:0/1141763873 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f9ac406f400 0x7f9ac4071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:24.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.850+0000 7f9ad6ffd640 1 -- 172.21.15.72:0/1141763873 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6762+0+0 (secure 0 0 0) 0x7f9ad012bf30 con 0x7f9ae01537d0 2024-05-09T05:59:24.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.854+0000 7f9ae62d6640 1 --2- 172.21.15.72:0/1141763873 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f9ac406f400 0x7f9ac4071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:24.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.854+0000 7f9ae62d6640 1 --2- 172.21.15.72:0/1141763873 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f9ac406f400 0x7f9ac4071910 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9ae00c41c0 tx=0x7f9adc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:59:24.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:24.858+0000 7f9ad6ffd640 1 -- 172.21.15.72:0/1141763873 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f9ae01622b0 con 0x7f9ae01537d0 2024-05-09T05:59:25.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.018+0000 7f9ae853a640 1 -- 172.21.15.72:0/1141763873 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f9ae006a520 con 0x7f9ae01537d0 2024-05-09T05:59:25.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.026+0000 7f9ad6ffd640 1 -- 172.21.15.72:0/1141763873 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) ==== 123+0+0 (secure 0 0 0) 0x7f9ad00c0060 con 0x7f9ae01537d0 2024-05-09T05:59:25.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.026+0000 7f9ad6ffd640 1 -- 172.21.15.72:0/1141763873 <== mon.0 v2:172.21.15.72:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9ad00f7e10 con 0x7f9ae01537d0 2024-05-09T05:59:25.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.030+0000 7f9ae853a640 1 -- 172.21.15.72:0/1141763873 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f9ac406f400 msgr2=0x7f9ac4071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:59:25.017 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.030+0000 7f9ae853a640 1 --2- 172.21.15.72:0/1141763873 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f9ac406f400 0x7f9ac4071910 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9ae00c41c0 tx=0x7f9adc009040 comp rx=0 tx=0).stop 2024-05-09T05:59:25.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.030+0000 7f9ae853a640 1 -- 172.21.15.72:0/1141763873 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ae01537d0 msgr2=0x7f9ae015c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:59:25.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.030+0000 7f9ae853a640 1 --2- 172.21.15.72:0/1141763873 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ae01537d0 0x7f9ae015c3e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9ad001b350 tx=0x7f9ad001b4e0 comp rx=0 tx=0).stop 2024-05-09T05:59:25.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.030+0000 7f9ae853a640 1 -- 172.21.15.72:0/1141763873 shutdown_connections 2024-05-09T05:59:25.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.030+0000 7f9ae853a640 1 --2- 172.21.15.72:0/1141763873 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f9ac406f400 0x7f9ac4071910 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:25.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.030+0000 7f9ae853a640 1 --2- 172.21.15.72:0/1141763873 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9ae0161d70 0x7f9ae01f22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:25.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.030+0000 7f9ae853a640 1 --2- 172.21.15.72:0/1141763873 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ae01537d0 0x7f9ae015c3e0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:25.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.030+0000 7f9ae853a640 1 --2- 172.21.15.72:0/1141763873 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ae00c77a0 0x7f9ae01495e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:25.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.030+0000 7f9ae853a640 1 -- 172.21.15.72:0/1141763873 >> 172.21.15.72:0/1141763873 conn(0x7f9ae00cde90 msgr2=0x7f9ae00c91b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:59:25.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.030+0000 7f9ae853a640 1 -- 172.21.15.72:0/1141763873 shutdown_connections 2024-05-09T05:59:25.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.030+0000 7f9ae853a640 1 -- 172.21.15.72:0/1141763873 wait complete. 2024-05-09T05:59:25.037 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-09T05:59:25.037 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:59:25.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.186+0000 7f25a8665640 1 Processor -- start 2024-05-09T05:59:25.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.186+0000 7f25a8665640 1 -- start start 2024-05-09T05:59:25.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.186+0000 7f25a8665640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f25a01537d0 0x7f25a0074740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:25.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.186+0000 7f25a8665640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25a00c72c0 con 0x7f25a0161d70 2024-05-09T05:59:25.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.186+0000 7f25a8665640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25a00c7bb0 con 0x7f25a00c77a0 2024-05-09T05:59:25.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.186+0000 7f25a8665640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f25a0074c80 con 0x7f25a01537d0 2024-05-09T05:59:25.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.186+0000 7f25a6c02640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f25a0161d70 0x7f25a0164190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:46350/0 (socket says 172.21.15.72:46350) 2024-05-09T05:59:25.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.186+0000 7f25a6c02640 1 -- 172.21.15.72:0/4098060686 learned_addr learned my addr 172.21.15.72:0/4098060686 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:59:25.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.186+0000 7f25a5c00640 1 --2- 172.21.15.72:0/4098060686 >> v2:172.21.15.72:3300/0 conn(0x7f25a01537d0 0x7f25a0074740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:25.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.186+0000 7f25a53ff640 1 -- 172.21.15.72:0/4098060686 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 899255780 0 0) 0x7f25a00c72c0 con 0x7f25a0161d70 2024-05-09T05:59:25.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.186+0000 7f25a53ff640 1 -- 172.21.15.72:0/4098060686 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f258c003530 con 0x7f25a0161d70 2024-05-09T05:59:25.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.186+0000 7f25a5c00640 1 -- 172.21.15.72:0/4098060686 >> v1:172.21.15.110:6789/0 conn(0x7f25a00c77a0 legacy=0x7f25a0072e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:59:25.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.186+0000 7f25a5c00640 1 -- 172.21.15.72:0/4098060686 >> v1:172.21.15.72:6789/0 conn(0x7f25a0161d70 legacy=0x7f25a0164190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:59:25.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.186+0000 7f25a5c00640 1 -- 172.21.15.72:0/4098060686 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25a0153be0 con 0x7f25a01537d0 2024-05-09T05:59:25.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.190+0000 7f25a5c00640 1 --2- 172.21.15.72:0/4098060686 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25a01537d0 0x7f25a0074740 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f25900097c0 tx=0x7f259001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b168049782867d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:59:25.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.190+0000 7f25a53ff640 1 -- 172.21.15.72:0/4098060686 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25900a7070 con 0x7f25a01537d0 2024-05-09T05:59:25.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.190+0000 7f25a53ff640 1 -- 172.21.15.72:0/4098060686 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f25900b0070 con 0x7f25a01537d0 2024-05-09T05:59:25.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.190+0000 7f25a53ff640 1 -- 172.21.15.72:0/4098060686 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25900ab870 con 0x7f25a01537d0 2024-05-09T05:59:25.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.190+0000 7f25a8665640 1 -- 172.21.15.72:0/4098060686 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25a01537d0 msgr2=0x7f25a0074740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:59:25.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.190+0000 7f25a8665640 1 --2- 172.21.15.72:0/4098060686 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25a01537d0 0x7f25a0074740 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f25900097c0 tx=0x7f259001c470 comp rx=0 tx=0).stop 2024-05-09T05:59:25.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.190+0000 7f25a8665640 1 -- 172.21.15.72:0/4098060686 shutdown_connections 2024-05-09T05:59:25.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.190+0000 7f25a8665640 1 --2- 172.21.15.72:0/4098060686 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25a01537d0 0x7f25a0074740 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:25.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.190+0000 7f25a8665640 1 -- 172.21.15.72:0/4098060686 >> 172.21.15.72:0/4098060686 conn(0x7f25a00cde90 msgr2=0x7f25a00ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:59:25.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.190+0000 7f25a8665640 1 -- 172.21.15.72:0/4098060686 shutdown_connections 2024-05-09T05:59:25.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.190+0000 7f25a8665640 1 -- 172.21.15.72:0/4098060686 wait complete. 2024-05-09T05:59:25.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.190+0000 7f25a8665640 1 Processor -- start 2024-05-09T05:59:25.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.190+0000 7f25a8665640 1 -- start start 2024-05-09T05:59:25.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.194+0000 7f25a8665640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25a00c77a0 0x7f25a015b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:25.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.194+0000 7f25a8665640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25a0161d70 0x7f25a015c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:25.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.194+0000 7f25a8665640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25a01446b0 0x7f25a01483c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:25.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.194+0000 7f25a8665640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f25a0072940 con 0x7f25a01446b0 2024-05-09T05:59:25.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.194+0000 7f25a8665640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f25a00740b0 con 0x7f25a00c77a0 2024-05-09T05:59:25.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.194+0000 7f25a8665640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f25a00c4cb0 con 0x7f25a0161d70 2024-05-09T05:59:25.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.194+0000 7f25a6c02640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25a01446b0 0x7f25a01483c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:25.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.194+0000 7f25a6c02640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25a01446b0 0x7f25a01483c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60078/0 (socket says 172.21.15.72:60078) 2024-05-09T05:59:25.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.194+0000 7f25a6c02640 1 -- 172.21.15.72:0/1472634899 learned_addr learned my addr 172.21.15.72:0/1472634899 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:59:25.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.194+0000 7f25a6401640 1 --2- 172.21.15.72:0/1472634899 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25a00c77a0 0x7f25a015b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:25.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.194+0000 7f25a5c00640 1 --2- 172.21.15.72:0/1472634899 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25a0161d70 0x7f25a015c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:25.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.194+0000 7f25a6c02640 1 -- 172.21.15.72:0/1472634899 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25a0161d70 msgr2=0x7f25a015c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:59:25.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.194+0000 7f25a6c02640 1 --2- 172.21.15.72:0/1472634899 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25a0161d70 0x7f25a015c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:25.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.194+0000 7f25a6c02640 1 -- 172.21.15.72:0/1472634899 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25a00c77a0 msgr2=0x7f25a015b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:59:25.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.194+0000 7f25a6c02640 1 --2- 172.21.15.72:0/1472634899 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25a00c77a0 0x7f25a015b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:25.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.194+0000 7f25a6c02640 1 -- 172.21.15.72:0/1472634899 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25a015c8e0 con 0x7f25a01446b0 2024-05-09T05:59:25.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.194+0000 7f25a6401640 1 --2- 172.21.15.72:0/1472634899 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25a00c77a0 0x7f25a015b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:59:25.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.194+0000 7f25a6c02640 1 --2- 172.21.15.72:0/1472634899 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25a01446b0 0x7f25a01483c0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f259800cae0 tx=0x7f259800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:59:25.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.194+0000 7f2596ffd640 1 -- 172.21.15.72:0/1472634899 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f259800ac40 con 0x7f25a01446b0 2024-05-09T05:59:25.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.194+0000 7f2596ffd640 1 -- 172.21.15.72:0/1472634899 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f259800ade0 con 0x7f25a01446b0 2024-05-09T05:59:25.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.194+0000 7f25a8665640 1 -- 172.21.15.72:0/1472634899 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25a014e9f0 con 0x7f25a01446b0 2024-05-09T05:59:25.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.194+0000 7f2596ffd640 1 -- 172.21.15.72:0/1472634899 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2598012620 con 0x7f25a01446b0 2024-05-09T05:59:25.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.194+0000 7f25a8665640 1 -- 172.21.15.72:0/1472634899 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25a015a8c0 con 0x7f25a01446b0 2024-05-09T05:59:25.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.194+0000 7f25a8665640 1 -- 172.21.15.72:0/1472634899 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25a006a520 con 0x7f25a01446b0 2024-05-09T05:59:25.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.194+0000 7f2596ffd640 1 -- 172.21.15.72:0/1472634899 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f25980127c0 con 0x7f25a01446b0 2024-05-09T05:59:25.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.194+0000 7f2596ffd640 1 --2- 172.21.15.72:0/1472634899 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f258406f400 0x7f2584071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:25.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.194+0000 7f2596ffd640 1 -- 172.21.15.72:0/1472634899 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6762+0+0 (secure 0 0 0) 0x7f259808fc30 con 0x7f25a01446b0 2024-05-09T05:59:25.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.194+0000 7f25a6401640 1 --2- 172.21.15.72:0/1472634899 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f258406f400 0x7f2584071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:25.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.198+0000 7f25a6401640 1 --2- 172.21.15.72:0/1472634899 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f258406f400 0x7f2584071910 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f25a00c41c0 tx=0x7f259c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:59:25.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.202+0000 7f2596ffd640 1 -- 172.21.15.72:0/1472634899 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f259805c820 con 0x7f25a01446b0 2024-05-09T05:59:25.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.382+0000 7f25a8665640 1 -- 172.21.15.72:0/1472634899 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f25a00cab00 con 0x7f25a01446b0 2024-05-09T05:59:25.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.386+0000 7f2596ffd640 1 -- 172.21.15.72:0/1472634899 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+6917 (secure 0 0 0) 0x7f259805c120 con 0x7f25a01446b0 2024-05-09T05:59:25.373 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:59:25.373 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5139,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6834/2067223840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":2067223840},{"type":"v1","addr":"172.21.15.72:6834","nonce":2067223840}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:53:23.494975+0000","modified":"2024-05-09T05:57:05.675817+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4297,"mds_1":4287,"mds_2":4263,"mds_3":4259,"mds_4":5007},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4259":{"gid":4259,"name":"f","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.110:6838/840351907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":840351907},{"type":"v1","addr":"172.21.15.110:6838","nonce":840351907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4263":{"gid":4263,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.72:6837/1048256382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":1048256382},{"type":"v1","addr":"172.21.15.72:6837","nonce":1048256382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.110:6839/966325499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6837","nonce":966325499},{"type":"v1","addr":"172.21.15.110:6839","nonce":966325499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6836/4134424941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":4134424941},{"type":"v1","addr":"172.21.15.110:6836","nonce":4134424941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5007":{"gid":5007,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":25,"addr":"172.21.15.72:6835/1972750715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":1972750715},{"type":"v1","addr":"172.21.15.72:6835","nonce":1972750715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[5007,4297,4287,4263,4259]},"id":1}]} 2024-05-09T05:59:25.373 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 31 2024-05-09T05:59:25.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.386+0000 7f25a8665640 1 -- 172.21.15.72:0/1472634899 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f258406f400 msgr2=0x7f2584071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:59:25.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.386+0000 7f25a8665640 1 --2- 172.21.15.72:0/1472634899 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f258406f400 0x7f2584071910 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f25a00c41c0 tx=0x7f259c009040 comp rx=0 tx=0).stop 2024-05-09T05:59:25.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.386+0000 7f25a8665640 1 -- 172.21.15.72:0/1472634899 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25a01446b0 msgr2=0x7f25a01483c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:59:25.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.386+0000 7f25a8665640 1 --2- 172.21.15.72:0/1472634899 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25a01446b0 0x7f25a01483c0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f259800cae0 tx=0x7f259800a060 comp rx=0 tx=0).stop 2024-05-09T05:59:25.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.386+0000 7f25a8665640 1 -- 172.21.15.72:0/1472634899 shutdown_connections 2024-05-09T05:59:25.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.386+0000 7f25a8665640 1 --2- 172.21.15.72:0/1472634899 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f258406f400 0x7f2584071910 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:25.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.386+0000 7f25a8665640 1 --2- 172.21.15.72:0/1472634899 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25a01446b0 0x7f25a01483c0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:25.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.386+0000 7f25a8665640 1 --2- 172.21.15.72:0/1472634899 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25a0161d70 0x7f25a015c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:25.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.386+0000 7f25a8665640 1 --2- 172.21.15.72:0/1472634899 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25a00c77a0 0x7f25a015b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:25.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.386+0000 7f25a8665640 1 -- 172.21.15.72:0/1472634899 >> 172.21.15.72:0/1472634899 conn(0x7f25a00cde90 msgr2=0x7f25a0144b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:59:25.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.386+0000 7f25a8665640 1 -- 172.21.15.72:0/1472634899 shutdown_connections 2024-05-09T05:59:25.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.386+0000 7f25a8665640 1 -- 172.21.15.72:0/1472634899 wait complete. 2024-05-09T05:59:25.394 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:59:25.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.542+0000 7f9915e04640 1 Processor -- start 2024-05-09T05:59:25.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.542+0000 7f9915e04640 1 -- start start 2024-05-09T05:59:25.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.542+0000 7f9915e04640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99100c77a0 0x7f99101537d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:25.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.542+0000 7f9915e04640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9910074740 0x7f9910072e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:25.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.542+0000 7f9915e04640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99100c72c0 con 0x7f99100733b0 2024-05-09T05:59:25.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.542+0000 7f9915e04640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f99100c7bb0 con 0x7f9910074740 2024-05-09T05:59:25.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.542+0000 7f9915e04640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f9910074460 con 0x7f99100c77a0 2024-05-09T05:59:25.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.542+0000 7f990ffff640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f99100733b0 0x7f991015ca10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:46354/0 (socket says 172.21.15.72:46354) 2024-05-09T05:59:25.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.542+0000 7f990ffff640 1 -- 172.21.15.72:0/2326513129 learned_addr learned my addr 172.21.15.72:0/2326513129 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:59:25.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.542+0000 7f9906ffd640 1 --2- 172.21.15.72:0/2326513129 >> v2:172.21.15.110:3300/0 conn(0x7f9910074740 0x7f9910072e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:25.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.542+0000 7f990f7fe640 1 --2- 172.21.15.72:0/2326513129 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99100c77a0 0x7f99101537d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:25.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.542+0000 7f990effd640 1 -- 172.21.15.72:0/2326513129 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 130838181 0 0) 0x7f99100c72c0 con 0x7f99100733b0 2024-05-09T05:59:25.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.542+0000 7f990effd640 1 -- 172.21.15.72:0/2326513129 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98fc003530 con 0x7f99100733b0 2024-05-09T05:59:25.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.542+0000 7f990effd640 1 -- 172.21.15.72:0/2326513129 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 573622906 0 0) 0x7f98fc003530 con 0x7f99100733b0 2024-05-09T05:59:25.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.542+0000 7f990effd640 1 -- 172.21.15.72:0/2326513129 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99100c77a0 msgr2=0x7f99101537d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:59:25.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.542+0000 7f990effd640 1 --2- 172.21.15.72:0/2326513129 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99100c77a0 0x7f99101537d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:25.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.542+0000 7f990effd640 1 -- 172.21.15.72:0/2326513129 >> v2:172.21.15.110:3300/0 conn(0x7f9910074740 msgr2=0x7f9910072e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:59:25.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.542+0000 7f990effd640 1 --2- 172.21.15.72:0/2326513129 >> v2:172.21.15.110:3300/0 conn(0x7f9910074740 0x7f9910072e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:25.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.542+0000 7f990effd640 1 -- 172.21.15.72:0/2326513129 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9910073af0 con 0x7f99100733b0 2024-05-09T05:59:25.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.542+0000 7f990effd640 1 -- 172.21.15.72:0/2326513129 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2749052815 0 0) 0x7f9908001aa0 con 0x7f99100733b0 2024-05-09T05:59:25.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.542+0000 7f990effd640 1 -- 172.21.15.72:0/2326513129 >> v1:172.21.15.72:6789/0 conn(0x7f99100733b0 legacy=0x7f991015ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:59:25.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.542+0000 7f990effd640 1 --2- 172.21.15.72:0/2326513129 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f98fc003a10 0x7f98fc003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:25.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.542+0000 7f990effd640 1 --2- 172.21.15.72:0/2326513129 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99100c77a0 0x7f98fc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:25.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.542+0000 7f990effd640 1 --2- 172.21.15.72:0/2326513129 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98fc004d50 0x7f98fc005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:25.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.542+0000 7f990effd640 1 -- 172.21.15.72:0/2326513129 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f99100c7bb0 con 0x7f98fc004d50 2024-05-09T05:59:25.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.542+0000 7f990effd640 1 -- 172.21.15.72:0/2326513129 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f9910074460 con 0x7f98fc003a10 2024-05-09T05:59:25.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.542+0000 7f990effd640 1 -- 172.21.15.72:0/2326513129 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f98fc00ba80 con 0x7f99100c77a0 2024-05-09T05:59:25.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.542+0000 7f990ffff640 1 --2- 172.21.15.72:0/2326513129 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98fc004d50 0x7f98fc005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:25.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.542+0000 7f9906ffd640 1 --2- 172.21.15.72:0/2326513129 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99100c77a0 0x7f98fc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:25.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.542+0000 7f990ffff640 1 -- 172.21.15.72:0/2326513129 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99100c77a0 msgr2=0x7f98fc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:59:25.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.542+0000 7f990ffff640 1 --2- 172.21.15.72:0/2326513129 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99100c77a0 0x7f98fc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:25.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.542+0000 7f990ffff640 1 -- 172.21.15.72:0/2326513129 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f98fc003a10 msgr2=0x7f98fc003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:59:25.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.542+0000 7f990ffff640 1 --2- 172.21.15.72:0/2326513129 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f98fc003a10 0x7f98fc003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:25.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.542+0000 7f990ffff640 1 -- 172.21.15.72:0/2326513129 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98fc003530 con 0x7f98fc004d50 2024-05-09T05:59:25.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.546+0000 7f990ffff640 1 --2- 172.21.15.72:0/2326513129 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98fc004d50 0x7f98fc005160 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f99100c7490 tx=0x7f990801d320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1db8a98b1623c4f7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:59:25.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.546+0000 7f990effd640 1 -- 172.21.15.72:0/2326513129 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f990800a4c0 con 0x7f98fc004d50 2024-05-09T05:59:25.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.546+0000 7f990effd640 1 -- 172.21.15.72:0/2326513129 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f99080ad650 con 0x7f98fc004d50 2024-05-09T05:59:25.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.546+0000 7f990effd640 1 -- 172.21.15.72:0/2326513129 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99080ada60 con 0x7f98fc004d50 2024-05-09T05:59:25.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.546+0000 7f9915e04640 1 -- 172.21.15.72:0/2326513129 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98fc004d50 msgr2=0x7f98fc005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:59:25.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.546+0000 7f9915e04640 1 --2- 172.21.15.72:0/2326513129 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98fc004d50 0x7f98fc005160 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f99100c7490 tx=0x7f990801d320 comp rx=0 tx=0).stop 2024-05-09T05:59:25.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.546+0000 7f990ffff640 1 -- 172.21.15.72:0/2326513129 reap_dead start 2024-05-09T05:59:25.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.546+0000 7f9915e04640 1 -- 172.21.15.72:0/2326513129 shutdown_connections 2024-05-09T05:59:25.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.546+0000 7f9915e04640 1 -- 172.21.15.72:0/2326513129 >> 172.21.15.72:0/2326513129 conn(0x7f99100cde90 msgr2=0x7f99100ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:59:25.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.546+0000 7f9915e04640 1 -- 172.21.15.72:0/2326513129 shutdown_connections 2024-05-09T05:59:25.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.546+0000 7f9915e04640 1 -- 172.21.15.72:0/2326513129 wait complete. 2024-05-09T05:59:25.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.550+0000 7f9915e04640 1 Processor -- start 2024-05-09T05:59:25.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.550+0000 7f9915e04640 1 -- start start 2024-05-09T05:59:25.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.550+0000 7f9915e04640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98fc004d50 0x7f991014f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:25.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.550+0000 7f9915e04640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f991014a960 0x7f99101f6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:25.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.550+0000 7f9915e04640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99101518f0 0x7f9910147080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:25.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.550+0000 7f9915e04640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f9910074b50 con 0x7f98fc004d50 2024-05-09T05:59:25.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.550+0000 7f9915e04640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f99100740b0 con 0x7f99101518f0 2024-05-09T05:59:25.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.550+0000 7f9915e04640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f9910072940 con 0x7f991014a960 2024-05-09T05:59:25.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.550+0000 7f990f7fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98fc004d50 0x7f991014f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:25.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.550+0000 7f990f7fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98fc004d50 0x7f991014f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60100/0 (socket says 172.21.15.72:60100) 2024-05-09T05:59:25.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.550+0000 7f990f7fe640 1 -- 172.21.15.72:0/1826532327 learned_addr learned my addr 172.21.15.72:0/1826532327 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:59:25.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.550+0000 7f9906ffd640 1 --2- 172.21.15.72:0/1826532327 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f991014a960 0x7f99101f6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:25.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.550+0000 7f990ffff640 1 --2- 172.21.15.72:0/1826532327 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99101518f0 0x7f9910147080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:25.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.550+0000 7f990f7fe640 1 -- 172.21.15.72:0/1826532327 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f991014a960 msgr2=0x7f99101f6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:59:25.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.550+0000 7f990f7fe640 1 --2- 172.21.15.72:0/1826532327 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f991014a960 0x7f99101f6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:25.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.550+0000 7f990f7fe640 1 -- 172.21.15.72:0/1826532327 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99101518f0 msgr2=0x7f9910147080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:59:25.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.550+0000 7f990f7fe640 1 --2- 172.21.15.72:0/1826532327 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99101518f0 0x7f9910147080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:25.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.550+0000 7f990f7fe640 1 -- 172.21.15.72:0/1826532327 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99101f68a0 con 0x7f98fc004d50 2024-05-09T05:59:25.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.550+0000 7f990f7fe640 1 --2- 172.21.15.72:0/1826532327 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98fc004d50 0x7f991014f8e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f990000e7c0 tx=0x7f990000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:59:25.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.550+0000 7f990cff9640 1 -- 172.21.15.72:0/1826532327 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9900017070 con 0x7f98fc004d50 2024-05-09T05:59:25.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.550+0000 7f990cff9640 1 -- 172.21.15.72:0/1826532327 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f990000ee70 con 0x7f98fc004d50 2024-05-09T05:59:25.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.550+0000 7f9915e04640 1 -- 172.21.15.72:0/1826532327 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9910159090 con 0x7f98fc004d50 2024-05-09T05:59:25.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.550+0000 7f990cff9640 1 -- 172.21.15.72:0/1826532327 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f990000cb60 con 0x7f98fc004d50 2024-05-09T05:59:25.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.550+0000 7f9915e04640 1 -- 172.21.15.72:0/1826532327 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f991014e020 con 0x7f98fc004d50 2024-05-09T05:59:25.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.550+0000 7f9915e04640 1 -- 172.21.15.72:0/1826532327 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f991006a520 con 0x7f98fc004d50 2024-05-09T05:59:25.542 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.554+0000 7f990cff9640 1 -- 172.21.15.72:0/1826532327 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f990001a070 con 0x7f98fc004d50 2024-05-09T05:59:25.542 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.554+0000 7f990cff9640 1 --2- 172.21.15.72:0/1826532327 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f98f006f400 0x7f98f0071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:25.542 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.554+0000 7f990cff9640 1 -- 172.21.15.72:0/1826532327 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6762+0+0 (secure 0 0 0) 0x7f990008f880 con 0x7f98fc004d50 2024-05-09T05:59:25.542 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.554+0000 7f9906ffd640 1 --2- 172.21.15.72:0/1826532327 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f98f006f400 0x7f98f0071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:25.542 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.554+0000 7f9906ffd640 1 --2- 172.21.15.72:0/1826532327 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f98f006f400 0x7f98f0071910 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9910152540 tx=0x7f98f8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:59:25.546 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.558+0000 7f990cff9640 1 -- 172.21.15.72:0/1826532327 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f990005c3e0 con 0x7f98fc004d50 2024-05-09T05:59:25.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.738+0000 7f9915e04640 1 -- 172.21.15.72:0/1826532327 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9910070600 con 0x7f98fc004d50 2024-05-09T05:59:25.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.738+0000 7f990cff9640 1 -- 172.21.15.72:0/1826532327 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+6917 (secure 0 0 0) 0x7f990005bce0 con 0x7f98fc004d50 2024-05-09T05:59:25.728 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:59:25.729 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5139,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6834/2067223840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":2067223840},{"type":"v1","addr":"172.21.15.72:6834","nonce":2067223840}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:53:23.494975+0000","modified":"2024-05-09T05:57:05.675817+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4297,"mds_1":4287,"mds_2":4263,"mds_3":4259,"mds_4":5007},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4259":{"gid":4259,"name":"f","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.110:6838/840351907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":840351907},{"type":"v1","addr":"172.21.15.110:6838","nonce":840351907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4263":{"gid":4263,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.72:6837/1048256382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":1048256382},{"type":"v1","addr":"172.21.15.72:6837","nonce":1048256382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"d","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.110:6839/966325499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6837","nonce":966325499},{"type":"v1","addr":"172.21.15.110:6839","nonce":966325499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6836/4134424941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":4134424941},{"type":"v1","addr":"172.21.15.110:6836","nonce":4134424941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5007":{"gid":5007,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":25,"addr":"172.21.15.72:6835/1972750715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":1972750715},{"type":"v1","addr":"172.21.15.72:6835","nonce":1972750715}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[5007,4297,4287,4263,4259]},"id":1}]} 2024-05-09T05:59:25.729 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 31 2024-05-09T05:59:25.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.742+0000 7f9915e04640 1 -- 172.21.15.72:0/1826532327 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f98f006f400 msgr2=0x7f98f0071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:59:25.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.742+0000 7f9915e04640 1 --2- 172.21.15.72:0/1826532327 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f98f006f400 0x7f98f0071910 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9910152540 tx=0x7f98f8008040 comp rx=0 tx=0).stop 2024-05-09T05:59:25.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.742+0000 7f9915e04640 1 -- 172.21.15.72:0/1826532327 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98fc004d50 msgr2=0x7f991014f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:59:25.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.742+0000 7f9915e04640 1 --2- 172.21.15.72:0/1826532327 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98fc004d50 0x7f991014f8e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f990000e7c0 tx=0x7f990000ec80 comp rx=0 tx=0).stop 2024-05-09T05:59:25.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.742+0000 7f9915e04640 1 -- 172.21.15.72:0/1826532327 shutdown_connections 2024-05-09T05:59:25.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.742+0000 7f9915e04640 1 --2- 172.21.15.72:0/1826532327 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f98f006f400 0x7f98f0071910 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:25.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.742+0000 7f9915e04640 1 --2- 172.21.15.72:0/1826532327 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99101518f0 0x7f9910147080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:25.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.742+0000 7f9915e04640 1 --2- 172.21.15.72:0/1826532327 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f991014a960 0x7f99101f6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:25.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.742+0000 7f9915e04640 1 --2- 172.21.15.72:0/1826532327 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98fc004d50 0x7f991014f8e0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:25.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.742+0000 7f9915e04640 1 -- 172.21.15.72:0/1826532327 >> 172.21.15.72:0/1826532327 conn(0x7f99100cde90 msgr2=0x7f9910159e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:59:25.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.742+0000 7f9915e04640 1 -- 172.21.15.72:0/1826532327 shutdown_connections 2024-05-09T05:59:25.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.742+0000 7f9915e04640 1 -- 172.21.15.72:0/1826532327 wait complete. 2024-05-09T05:59:25.750 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T05:59:25.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.898+0000 7f6bfc655640 1 Processor -- start 2024-05-09T05:59:25.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.898+0000 7f6bfc655640 1 -- start start 2024-05-09T05:59:25.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.898+0000 7f6bfc655640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6bf40c77a0 0x7f6bf41537d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:25.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.898+0000 7f6bfc655640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6bf4161d70 0x7f6bf4164190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:25.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.898+0000 7f6bfc655640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bf40c72c0 con 0x7f6bf4074740 2024-05-09T05:59:25.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.898+0000 7f6bfc655640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f6bf40c7bb0 con 0x7f6bf4161d70 2024-05-09T05:59:25.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.898+0000 7f6bfc655640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f6bf4074460 con 0x7f6bf40c77a0 2024-05-09T05:59:25.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.898+0000 7f6bf9bf0640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f6bf4074740 0x7f6bf4072e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:46362/0 (socket says 172.21.15.72:46362) 2024-05-09T05:59:25.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.898+0000 7f6bf9bf0640 1 -- 172.21.15.72:0/2146903788 learned_addr learned my addr 172.21.15.72:0/2146903788 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:59:25.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.898+0000 7f6bfabf2640 1 --2- 172.21.15.72:0/2146903788 >> v2:172.21.15.110:3300/0 conn(0x7f6bf4161d70 0x7f6bf4164190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:25.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.898+0000 7f6bfa3f1640 1 --2- 172.21.15.72:0/2146903788 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6bf40c77a0 0x7f6bf41537d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:25.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.898+0000 7f6bf93ef640 1 -- 172.21.15.72:0/2146903788 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1899021769 0 0) 0x7f6bf40c72c0 con 0x7f6bf4074740 2024-05-09T05:59:25.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.898+0000 7f6bf93ef640 1 -- 172.21.15.72:0/2146903788 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6be0003530 con 0x7f6bf4074740 2024-05-09T05:59:25.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.898+0000 7f6bf93ef640 1 -- 172.21.15.72:0/2146903788 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2396726029 0 0) 0x7f6be0003530 con 0x7f6bf4074740 2024-05-09T05:59:25.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.898+0000 7f6bf93ef640 1 -- 172.21.15.72:0/2146903788 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6bf40c77a0 msgr2=0x7f6bf41537d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:59:25.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.898+0000 7f6bf93ef640 1 --2- 172.21.15.72:0/2146903788 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6bf40c77a0 0x7f6bf41537d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:25.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.898+0000 7f6bf93ef640 1 -- 172.21.15.72:0/2146903788 >> v2:172.21.15.110:3300/0 conn(0x7f6bf4161d70 msgr2=0x7f6bf4164190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:59:25.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.898+0000 7f6bf93ef640 1 --2- 172.21.15.72:0/2146903788 >> v2:172.21.15.110:3300/0 conn(0x7f6bf4161d70 0x7f6bf4164190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:25.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.898+0000 7f6bf93ef640 1 -- 172.21.15.72:0/2146903788 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bf4073af0 con 0x7f6bf4074740 2024-05-09T05:59:25.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.898+0000 7f6bf93ef640 1 -- 172.21.15.72:0/2146903788 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2749052815 0 0) 0x7f6be4001720 con 0x7f6bf4074740 2024-05-09T05:59:25.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.898+0000 7f6bf93ef640 1 -- 172.21.15.72:0/2146903788 >> v1:172.21.15.72:6789/0 conn(0x7f6bf4074740 legacy=0x7f6bf4072e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:59:25.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.898+0000 7f6bf93ef640 1 --2- 172.21.15.72:0/2146903788 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6be0003a10 0x7f6be0003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:25.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.898+0000 7f6bf93ef640 1 --2- 172.21.15.72:0/2146903788 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6be0004810 0x7f6be0004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:25.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.898+0000 7f6bf93ef640 1 --2- 172.21.15.72:0/2146903788 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6bf40c77a0 0x7f6be0005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:25.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.898+0000 7f6bf93ef640 1 -- 172.21.15.72:0/2146903788 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf40c7bb0 con 0x7f6be0004810 2024-05-09T05:59:25.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.898+0000 7f6bf93ef640 1 -- 172.21.15.72:0/2146903788 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf4074460 con 0x7f6be0003a10 2024-05-09T05:59:25.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.898+0000 7f6bf93ef640 1 -- 172.21.15.72:0/2146903788 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f6be000ba80 con 0x7f6bf40c77a0 2024-05-09T05:59:25.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.898+0000 7f6bf9bf0640 1 --2- 172.21.15.72:0/2146903788 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6be0004810 0x7f6be0004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:25.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.898+0000 7f6bfa3f1640 1 --2- 172.21.15.72:0/2146903788 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6be0003a10 0x7f6be0003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:25.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.898+0000 7f6bf9bf0640 1 -- 172.21.15.72:0/2146903788 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6bf40c77a0 msgr2=0x7f6be0005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:59:25.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.898+0000 7f6bf9bf0640 1 --2- 172.21.15.72:0/2146903788 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6bf40c77a0 0x7f6be0005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:25.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.898+0000 7f6bf9bf0640 1 -- 172.21.15.72:0/2146903788 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6be0003a10 msgr2=0x7f6be0003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:59:25.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.898+0000 7f6bf9bf0640 1 --2- 172.21.15.72:0/2146903788 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6be0003a10 0x7f6be0003e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:25.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.898+0000 7f6bf9bf0640 1 -- 172.21.15.72:0/2146903788 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6be0003530 con 0x7f6be0004810 2024-05-09T05:59:25.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.902+0000 7f6bf9bf0640 1 --2- 172.21.15.72:0/2146903788 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6be0004810 0x7f6be0004c20 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f6bf40ce620 tx=0x7f6be401f2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c21d6e042bd130c2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:59:25.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.902+0000 7f6bf93ef640 1 -- 172.21.15.72:0/2146903788 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be4007d70 con 0x7f6be0004810 2024-05-09T05:59:25.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.902+0000 7f6bf93ef640 1 -- 172.21.15.72:0/2146903788 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f6be4005ae0 con 0x7f6be0004810 2024-05-09T05:59:25.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.902+0000 7f6bf93ef640 1 -- 172.21.15.72:0/2146903788 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be4007070 con 0x7f6be0004810 2024-05-09T05:59:25.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.902+0000 7f6bfc655640 1 -- 172.21.15.72:0/2146903788 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6be0004810 msgr2=0x7f6be0004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:59:25.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.902+0000 7f6bfc655640 1 --2- 172.21.15.72:0/2146903788 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6be0004810 0x7f6be0004c20 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f6bf40ce620 tx=0x7f6be401f2d0 comp rx=0 tx=0).stop 2024-05-09T05:59:25.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.902+0000 7f6bfabf2640 1 -- 172.21.15.72:0/2146903788 reap_dead start 2024-05-09T05:59:25.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.902+0000 7f6bfc655640 1 -- 172.21.15.72:0/2146903788 shutdown_connections 2024-05-09T05:59:25.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.902+0000 7f6bfc655640 1 -- 172.21.15.72:0/2146903788 >> 172.21.15.72:0/2146903788 conn(0x7f6bf40cde90 msgr2=0x7f6bf40ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:59:25.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.902+0000 7f6bfc655640 1 -- 172.21.15.72:0/2146903788 shutdown_connections 2024-05-09T05:59:25.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.902+0000 7f6bfc655640 1 -- 172.21.15.72:0/2146903788 wait complete. 2024-05-09T05:59:25.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.906+0000 7f6bfc655640 1 Processor -- start 2024-05-09T05:59:25.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.906+0000 7f6bfc655640 1 -- start start 2024-05-09T05:59:25.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.906+0000 7f6bfc655640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6bf415dc90 0x7f6bf40c20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:25.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.906+0000 7f6bfc655640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6bf4161360 0x7f6bf40c84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:25.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.906+0000 7f6bfc655640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bf40c89f0 0x7f6bf41f2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:25.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.906+0000 7f6bfc655640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf4074b50 con 0x7f6bf40c89f0 2024-05-09T05:59:25.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.906+0000 7f6bfc655640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf40740b0 con 0x7f6bf415dc90 2024-05-09T05:59:25.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.906+0000 7f6bfc655640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f6bf4072940 con 0x7f6bf4161360 2024-05-09T05:59:25.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.906+0000 7f6bfabf2640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bf40c89f0 0x7f6bf41f2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:25.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.906+0000 7f6bfabf2640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bf40c89f0 0x7f6bf41f2b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60118/0 (socket says 172.21.15.72:60118) 2024-05-09T05:59:25.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.906+0000 7f6bfabf2640 1 -- 172.21.15.72:0/304553495 learned_addr learned my addr 172.21.15.72:0/304553495 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:59:25.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.906+0000 7f6bfa3f1640 1 --2- 172.21.15.72:0/304553495 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6bf415dc90 0x7f6bf40c20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:25.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.906+0000 7f6bf9bf0640 1 --2- 172.21.15.72:0/304553495 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6bf4161360 0x7f6bf40c84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:25.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.906+0000 7f6bfabf2640 1 -- 172.21.15.72:0/304553495 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6bf4161360 msgr2=0x7f6bf40c84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:59:25.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.906+0000 7f6bfabf2640 1 --2- 172.21.15.72:0/304553495 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6bf4161360 0x7f6bf40c84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:25.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.906+0000 7f6bfabf2640 1 -- 172.21.15.72:0/304553495 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6bf415dc90 msgr2=0x7f6bf40c20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:59:25.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.906+0000 7f6bfabf2640 1 --2- 172.21.15.72:0/304553495 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6bf415dc90 0x7f6bf40c20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:25.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.906+0000 7f6bfabf2640 1 -- 172.21.15.72:0/304553495 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bf40c0190 con 0x7f6bf40c89f0 2024-05-09T05:59:25.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.906+0000 7f6bfabf2640 1 --2- 172.21.15.72:0/304553495 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bf40c89f0 0x7f6bf41f2b50 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f6bf40c6fe0 tx=0x7f6bec00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:59:25.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.906+0000 7f6beaffd640 1 -- 172.21.15.72:0/304553495 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bec00bae0 con 0x7f6bf40c89f0 2024-05-09T05:59:25.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.906+0000 7f6beaffd640 1 -- 172.21.15.72:0/304553495 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f6bec019070 con 0x7f6bf40c89f0 2024-05-09T05:59:25.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.906+0000 7f6bfc655640 1 -- 172.21.15.72:0/304553495 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bf415d7f0 con 0x7f6bf40c89f0 2024-05-09T05:59:25.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.906+0000 7f6beaffd640 1 -- 172.21.15.72:0/304553495 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bec0039a0 con 0x7f6bf40c89f0 2024-05-09T05:59:25.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.906+0000 7f6bfc655640 1 -- 172.21.15.72:0/304553495 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bf41f6360 con 0x7f6bf40c89f0 2024-05-09T05:59:25.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.906+0000 7f6bfc655640 1 -- 172.21.15.72:0/304553495 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bf406a520 con 0x7f6bf40c89f0 2024-05-09T05:59:25.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.910+0000 7f6beaffd640 1 -- 172.21.15.72:0/304553495 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f6bec013070 con 0x7f6bf40c89f0 2024-05-09T05:59:25.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.910+0000 7f6beaffd640 1 --2- 172.21.15.72:0/304553495 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f6bd806f400 0x7f6bd8071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:25.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.910+0000 7f6beaffd640 1 -- 172.21.15.72:0/304553495 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6762+0+0 (secure 0 0 0) 0x7f6bec08f950 con 0x7f6bf40c89f0 2024-05-09T05:59:25.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.910+0000 7f6bfa3f1640 1 --2- 172.21.15.72:0/304553495 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f6bd806f400 0x7f6bd8071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:25.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.910+0000 7f6bfa3f1640 1 --2- 172.21.15.72:0/304553495 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f6bd806f400 0x7f6bd8071910 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6bf00090e0 tx=0x7f6bf0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:59:25.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:25.914+0000 7f6beaffd640 1 -- 172.21.15.72:0/304553495 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f6bec023020 con 0x7f6bf40c89f0 2024-05-09T05:59:26.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.062+0000 7f6bfc655640 1 -- 172.21.15.72:0/304553495 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6bf4072c50 con 0x7f6bf40c89f0 2024-05-09T05:59:26.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.066+0000 7f6beaffd640 1 -- 172.21.15.72:0/304553495 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18848 (secure 0 0 0) 0x7f6bec05c4b0 con 0x7f6bf40c89f0 2024-05-09T05:59:26.054 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-09T05:59:26.054 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":29,"fsid":"44c88cb9-b39b-4787-a871-80ddf0ad6292","created":"2024-05-09T05:52:59.591187+0000","modified":"2024-05-09T05:56:44.361800+0000","last_up_change":"2024-05-09T05:53:10.902489+0000","last_in_change":"2024-05-09T05:53:02.200254+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T05:53:10.503537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T05:53:21.364958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T05:53:22.461477+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-09T05:53:26.171144+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e4af2aa1-ba5c-4411-a72a-a0e38e589a74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":331913921},{"type":"v1","addr":"172.21.15.72:6817","nonce":331913921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":331913921},{"type":"v1","addr":"172.21.15.72:6819","nonce":331913921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":331913921},{"type":"v1","addr":"172.21.15.72:6823","nonce":331913921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":331913921},{"type":"v1","addr":"172.21.15.72:6821","nonce":331913921}]},"public_addr":"172.21.15.72:6817/331913921","cluster_addr":"172.21.15.72:6819/331913921","heartbeat_back_addr":"172.21.15.72:6823/331913921","heartbeat_front_addr":"172.21.15.72:6821/331913921","state":["exists","up"]},{"osd":1,"uuid":"052504f5-a523-4922-bdc7-ce2890faa5ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2197151836},{"type":"v1","addr":"172.21.15.72:6801","nonce":2197151836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2197151836},{"type":"v1","addr":"172.21.15.72:6803","nonce":2197151836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":2197151836},{"type":"v1","addr":"172.21.15.72:6811","nonce":2197151836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6805","nonce":2197151836},{"type":"v1","addr":"172.21.15.72:6807","nonce":2197151836}]},"public_addr":"172.21.15.72:6801/2197151836","cluster_addr":"172.21.15.72:6803/2197151836","heartbeat_back_addr":"172.21.15.72:6811/2197151836","heartbeat_front_addr":"172.21.15.72:6807/2197151836","state":["exists","up"]},{"osd":2,"uuid":"28bc1c95-6d0d-4263-baad-314d86e6a670","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":1273581990},{"type":"v1","addr":"172.21.15.72:6825","nonce":1273581990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":1273581990},{"type":"v1","addr":"172.21.15.72:6827","nonce":1273581990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":1273581990},{"type":"v1","addr":"172.21.15.72:6831","nonce":1273581990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":1273581990},{"type":"v1","addr":"172.21.15.72:6829","nonce":1273581990}]},"public_addr":"172.21.15.72:6825/1273581990","cluster_addr":"172.21.15.72:6827/1273581990","heartbeat_back_addr":"172.21.15.72:6831/1273581990","heartbeat_front_addr":"172.21.15.72:6829/1273581990","state":["exists","up"]},{"osd":3,"uuid":"edcc86cb-f178-4533-8069-de9d781531ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2180866263},{"type":"v1","addr":"172.21.15.72:6806","nonce":2180866263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2180866263},{"type":"v1","addr":"172.21.15.72:6810","nonce":2180866263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2180866263},{"type":"v1","addr":"172.21.15.72:6815","nonce":2180866263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2180866263},{"type":"v1","addr":"172.21.15.72:6813","nonce":2180866263}]},"public_addr":"172.21.15.72:6806/2180866263","cluster_addr":"172.21.15.72:6810/2180866263","heartbeat_back_addr":"172.21.15.72:6815/2180866263","heartbeat_front_addr":"172.21.15.72:6813/2180866263","state":["exists","up"]},{"osd":4,"uuid":"8d138128-4829-4109-87a1-25f339f3e953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":3437318248},{"type":"v1","addr":"172.21.15.110:6817","nonce":3437318248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":3437318248},{"type":"v1","addr":"172.21.15.110:6819","nonce":3437318248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":3437318248},{"type":"v1","addr":"172.21.15.110:6823","nonce":3437318248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":3437318248},{"type":"v1","addr":"172.21.15.110:6821","nonce":3437318248}]},"public_addr":"172.21.15.110:6817/3437318248","cluster_addr":"172.21.15.110:6819/3437318248","heartbeat_back_addr":"172.21.15.110:6823/3437318248","heartbeat_front_addr":"172.21.15.110:6821/3437318248","state":["exists","up"]},{"osd":5,"uuid":"99a4a914-0a0e-4d25-94ae-3e86b8b1aa4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":977576181},{"type":"v1","addr":"172.21.15.110:6825","nonce":977576181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":977576181},{"type":"v1","addr":"172.21.15.110:6827","nonce":977576181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":977576181},{"type":"v1","addr":"172.21.15.110:6831","nonce":977576181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":977576181},{"type":"v1","addr":"172.21.15.110:6829","nonce":977576181}]},"public_addr":"172.21.15.110:6825/977576181","cluster_addr":"172.21.15.110:6827/977576181","heartbeat_back_addr":"172.21.15.110:6831/977576181","heartbeat_front_addr":"172.21.15.110:6829/977576181","state":["exists","up"]},{"osd":6,"uuid":"6e04b295-afc9-4f80-80f7-3df1f5168608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":1817638786},{"type":"v1","addr":"172.21.15.110:6809","nonce":1817638786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":1817638786},{"type":"v1","addr":"172.21.15.110:6811","nonce":1817638786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":1817638786},{"type":"v1","addr":"172.21.15.110:6815","nonce":1817638786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":1817638786},{"type":"v1","addr":"172.21.15.110:6813","nonce":1817638786}]},"public_addr":"172.21.15.110:6809/1817638786","cluster_addr":"172.21.15.110:6811/1817638786","heartbeat_back_addr":"172.21.15.110:6815/1817638786","heartbeat_front_addr":"172.21.15.110:6813/1817638786","state":["exists","up"]},{"osd":7,"uuid":"835de5c9-1e2c-41d8-bd28-d7ffe5ad8fdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":214675920},{"type":"v1","addr":"172.21.15.110:6801","nonce":214675920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":214675920},{"type":"v1","addr":"172.21.15.110:6803","nonce":214675920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":214675920},{"type":"v1","addr":"172.21.15.110:6807","nonce":214675920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":214675920},{"type":"v1","addr":"172.21.15.110:6805","nonce":214675920}]},"public_addr":"172.21.15.110:6801/214675920","cluster_addr":"172.21.15.110:6803/214675920","heartbeat_back_addr":"172.21.15.110:6807/214675920","heartbeat_front_addr":"172.21.15.110:6805/214675920","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.849761+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.670554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.743789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:08.516367+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.665550+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.518775+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.786468+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:53:07.794984+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":0,"to":7}]},{"pgid":"4.6","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:6834/1142956298":"2024-05-10T05:56:44.361730+0000","172.21.15.72:6832/1142956298":"2024-05-10T05:56:44.361730+0000","172.21.15.72:6835/3946563056":"2024-05-10T05:55:14.344999+0000","172.21.15.72:6833/3946563056":"2024-05-10T05:55:14.344999+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T05:59:26.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.066+0000 7f6bfc655640 1 -- 172.21.15.72:0/304553495 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f6bd806f400 msgr2=0x7f6bd8071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:59:26.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.066+0000 7f6bfc655640 1 --2- 172.21.15.72:0/304553495 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f6bd806f400 0x7f6bd8071910 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6bf00090e0 tx=0x7f6bf0008040 comp rx=0 tx=0).stop 2024-05-09T05:59:26.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.066+0000 7f6bfc655640 1 -- 172.21.15.72:0/304553495 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bf40c89f0 msgr2=0x7f6bf41f2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:59:26.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.066+0000 7f6bfc655640 1 --2- 172.21.15.72:0/304553495 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bf40c89f0 0x7f6bf41f2b50 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f6bf40c6fe0 tx=0x7f6bec00b480 comp rx=0 tx=0).stop 2024-05-09T05:59:26.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.066+0000 7f6bfc655640 1 -- 172.21.15.72:0/304553495 shutdown_connections 2024-05-09T05:59:26.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.066+0000 7f6bfc655640 1 --2- 172.21.15.72:0/304553495 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f6bd806f400 0x7f6bd8071910 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:26.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.066+0000 7f6bfc655640 1 --2- 172.21.15.72:0/304553495 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bf40c89f0 0x7f6bf41f2b50 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:26.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.066+0000 7f6bfc655640 1 --2- 172.21.15.72:0/304553495 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6bf4161360 0x7f6bf40c84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:26.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.066+0000 7f6bfc655640 1 --2- 172.21.15.72:0/304553495 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6bf415dc90 0x7f6bf40c20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:26.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.066+0000 7f6bfc655640 1 -- 172.21.15.72:0/304553495 >> 172.21.15.72:0/304553495 conn(0x7f6bf40cde90 msgr2=0x7f6bf4152e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:59:26.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.066+0000 7f6bfc655640 1 -- 172.21.15.72:0/304553495 shutdown_connections 2024-05-09T05:59:26.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.066+0000 7f6bfc655640 1 -- 172.21.15.72:0/304553495 wait complete. 2024-05-09T05:59:26.076 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-09T05:59:26.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.222+0000 7f3fce9ed640 1 Processor -- start 2024-05-09T05:59:26.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.222+0000 7f3fce9ed640 1 -- start start 2024-05-09T05:59:26.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.226+0000 7f3fce9ed640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3fc815c190 0x7f3fc8159730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:26.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.226+0000 7f3fce9ed640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3fc8073160 0x7f3fc8152e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:26.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.226+0000 7f3fce9ed640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3fc806fc00 0x7f3fc8070010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:26.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.226+0000 7f3fce9ed640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f3fc81533a0 con 0x7f3fc8073160 2024-05-09T05:59:26.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.226+0000 7f3fce9ed640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f3fc80724b0 con 0x7f3fc815c190 2024-05-09T05:59:26.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.226+0000 7f3fce9ed640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f3fc8072770 con 0x7f3fc806fc00 2024-05-09T05:59:26.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.226+0000 7f3fc77fe640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3fc8073160 0x7f3fc8152e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:26.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.226+0000 7f3fc77fe640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3fc8073160 0x7f3fc8152e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60134/0 (socket says 172.21.15.72:60134) 2024-05-09T05:59:26.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.226+0000 7f3fc77fe640 1 -- 172.21.15.72:0/3643739448 learned_addr learned my addr 172.21.15.72:0/3643739448 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:59:26.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.226+0000 7f3fc7fff640 1 --2- 172.21.15.72:0/3643739448 >> v2:172.21.15.110:3300/0 conn(0x7f3fc815c190 0x7f3fc8159730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:26.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.226+0000 7f3fc77fe640 1 -- 172.21.15.72:0/3643739448 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3fc806fc00 msgr2=0x7f3fc8070010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:59:26.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.226+0000 7f3fc77fe640 1 --2- 172.21.15.72:0/3643739448 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3fc806fc00 0x7f3fc8070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:26.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.226+0000 7f3fc77fe640 1 -- 172.21.15.72:0/3643739448 >> v2:172.21.15.110:3300/0 conn(0x7f3fc815c190 msgr2=0x7f3fc8159730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:59:26.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.226+0000 7f3fc77fe640 1 --2- 172.21.15.72:0/3643739448 >> v2:172.21.15.110:3300/0 conn(0x7f3fc815c190 0x7f3fc8159730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:26.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.226+0000 7f3fc77fe640 1 -- 172.21.15.72:0/3643739448 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fc8072a50 con 0x7f3fc8073160 2024-05-09T05:59:26.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.226+0000 7f3fc7fff640 1 --2- 172.21.15.72:0/3643739448 >> v2:172.21.15.110:3300/0 conn(0x7f3fc815c190 0x7f3fc8159730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:59:26.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.230+0000 7f3fc77fe640 1 --2- 172.21.15.72:0/3643739448 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fc8073160 0x7f3fc8152e60 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f3fc8071b70 tx=0x7f3fbc01ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e14064528ff6f089 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:59:26.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.230+0000 7f3fc6ffd640 1 -- 172.21.15.72:0/3643739448 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fbc0b5070 con 0x7f3fc8073160 2024-05-09T05:59:26.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.230+0000 7f3fc6ffd640 1 -- 172.21.15.72:0/3643739448 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f3fbc0a89f0 con 0x7f3fc8073160 2024-05-09T05:59:26.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.230+0000 7f3fc6ffd640 1 -- 172.21.15.72:0/3643739448 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fbc0a8de0 con 0x7f3fc8073160 2024-05-09T05:59:26.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.230+0000 7f3fce9ed640 1 -- 172.21.15.72:0/3643739448 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fc8073160 msgr2=0x7f3fc8152e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:59:26.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.230+0000 7f3fce9ed640 1 --2- 172.21.15.72:0/3643739448 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fc8073160 0x7f3fc8152e60 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f3fc8071b70 tx=0x7f3fbc01ed30 comp rx=0 tx=0).stop 2024-05-09T05:59:26.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.230+0000 7f3fce9ed640 1 -- 172.21.15.72:0/3643739448 shutdown_connections 2024-05-09T05:59:26.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.230+0000 7f3fce9ed640 1 --2- 172.21.15.72:0/3643739448 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3fc806fc00 0x7f3fc8070010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:26.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.230+0000 7f3fce9ed640 1 --2- 172.21.15.72:0/3643739448 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fc8073160 0x7f3fc8152e60 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:26.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.230+0000 7f3fce9ed640 1 --2- 172.21.15.72:0/3643739448 >> v2:172.21.15.110:3300/0 conn(0x7f3fc815c190 0x7f3fc8159730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:26.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.230+0000 7f3fce9ed640 1 -- 172.21.15.72:0/3643739448 >> 172.21.15.72:0/3643739448 conn(0x7f3fc80cde90 msgr2=0x7f3fc80ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:59:26.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.230+0000 7f3fce9ed640 1 -- 172.21.15.72:0/3643739448 shutdown_connections 2024-05-09T05:59:26.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.230+0000 7f3fce9ed640 1 -- 172.21.15.72:0/3643739448 wait complete. 2024-05-09T05:59:26.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.230+0000 7f3fce9ed640 1 Processor -- start 2024-05-09T05:59:26.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.230+0000 7f3fce9ed640 1 -- start start 2024-05-09T05:59:26.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.234+0000 7f3fce9ed640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fc806fc00 0x7f3fc8152030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:26.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.234+0000 7f3fce9ed640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3fc8073160 0x7f3fc81f3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:26.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.234+0000 7f3fce9ed640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fc815c190 0x7f3fc815b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:26.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.234+0000 7f3fce9ed640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f3fc8158c20 con 0x7f3fc806fc00 2024-05-09T05:59:26.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.234+0000 7f3fce9ed640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f3fc8159210 con 0x7f3fc815c190 2024-05-09T05:59:26.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.234+0000 7f3fce9ed640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f3fc8073570 con 0x7f3fc8073160 2024-05-09T05:59:26.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.234+0000 7f3fc7fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fc806fc00 0x7f3fc8152030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:26.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.234+0000 7f3fc7fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fc806fc00 0x7f3fc8152030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60136/0 (socket says 172.21.15.72:60136) 2024-05-09T05:59:26.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.234+0000 7f3fc7fff640 1 -- 172.21.15.72:0/2291709922 learned_addr learned my addr 172.21.15.72:0/2291709922 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:59:26.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.234+0000 7f3fccf8a640 1 --2- 172.21.15.72:0/2291709922 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fc815c190 0x7f3fc815b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:26.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.234+0000 7f3fc77fe640 1 --2- 172.21.15.72:0/2291709922 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3fc8073160 0x7f3fc81f3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:26.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.234+0000 7f3fc7fff640 1 -- 172.21.15.72:0/2291709922 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3fc8073160 msgr2=0x7f3fc81f3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:59:26.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.234+0000 7f3fc7fff640 1 --2- 172.21.15.72:0/2291709922 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3fc8073160 0x7f3fc81f3d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:26.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.234+0000 7f3fc7fff640 1 -- 172.21.15.72:0/2291709922 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fc815c190 msgr2=0x7f3fc815b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:59:26.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.234+0000 7f3fc7fff640 1 --2- 172.21.15.72:0/2291709922 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fc815c190 0x7f3fc815b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:26.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.234+0000 7f3fc7fff640 1 -- 172.21.15.72:0/2291709922 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fc81477b0 con 0x7f3fc806fc00 2024-05-09T05:59:26.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.234+0000 7f3fccf8a640 1 --2- 172.21.15.72:0/2291709922 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fc815c190 0x7f3fc815b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:59:26.223 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.234+0000 7f3fc7fff640 1 --2- 172.21.15.72:0/2291709922 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fc806fc00 0x7f3fc8152030 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f3fb800c7f0 tx=0x7f3fb800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:59:26.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.234+0000 7f3fc4ff9640 1 -- 172.21.15.72:0/2291709922 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fb8015070 con 0x7f3fc806fc00 2024-05-09T05:59:26.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.234+0000 7f3fc4ff9640 1 -- 172.21.15.72:0/2291709922 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f3fb8007820 con 0x7f3fc806fc00 2024-05-09T05:59:26.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.234+0000 7f3fce9ed640 1 -- 172.21.15.72:0/2291709922 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fc814ffb0 con 0x7f3fc806fc00 2024-05-09T05:59:26.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.234+0000 7f3fc4ff9640 1 -- 172.21.15.72:0/2291709922 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fb8007c30 con 0x7f3fc806fc00 2024-05-09T05:59:26.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.234+0000 7f3fce9ed640 1 -- 172.21.15.72:0/2291709922 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fc8146070 con 0x7f3fc806fc00 2024-05-09T05:59:26.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.234+0000 7f3fce9ed640 1 -- 172.21.15.72:0/2291709922 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fc81f42b0 con 0x7f3fc806fc00 2024-05-09T05:59:26.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.234+0000 7f3fc4ff9640 1 -- 172.21.15.72:0/2291709922 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f3fb8018070 con 0x7f3fc806fc00 2024-05-09T05:59:26.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.234+0000 7f3fc4ff9640 1 --2- 172.21.15.72:0/2291709922 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f3fb406f400 0x7f3fb4071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:26.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.234+0000 7f3fc4ff9640 1 -- 172.21.15.72:0/2291709922 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6762+0+0 (secure 0 0 0) 0x7f3fb808f930 con 0x7f3fc806fc00 2024-05-09T05:59:26.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.234+0000 7f3fc77fe640 1 --2- 172.21.15.72:0/2291709922 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f3fb406f400 0x7f3fb4071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:26.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.238+0000 7f3fc77fe640 1 --2- 172.21.15.72:0/2291709922 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f3fb406f400 0x7f3fb4071910 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc0b2000 tx=0x7f3fbc0aa070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:59:26.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.242+0000 7f3fc4ff9640 1 -- 172.21.15.72:0/2291709922 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f3fb805c400 con 0x7f3fc806fc00 2024-05-09T05:59:26.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.422+0000 7f3fce9ed640 1 -- 172.21.15.72:0/2291709922 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f3fc806a520 con 0x7f3fc806fc00 2024-05-09T05:59:26.413 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.426+0000 7f3fc4ff9640 1 -- 172.21.15.72:0/2291709922 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v32) ==== 161+0+0 (secure 0 0 0) 0x7f3fb805bd00 con 0x7f3fc806fc00 2024-05-09T05:59:26.413 INFO:teuthology.orchestra.run.smithi072.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-09T05:59:26.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.434+0000 7f3fce9ed640 1 -- 172.21.15.72:0/2291709922 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f3fb406f400 msgr2=0x7f3fb4071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:59:26.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.434+0000 7f3fce9ed640 1 --2- 172.21.15.72:0/2291709922 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f3fb406f400 0x7f3fb4071910 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc0b2000 tx=0x7f3fbc0aa070 comp rx=0 tx=0).stop 2024-05-09T05:59:26.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.434+0000 7f3fce9ed640 1 -- 172.21.15.72:0/2291709922 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fc806fc00 msgr2=0x7f3fc8152030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:59:26.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.434+0000 7f3fce9ed640 1 --2- 172.21.15.72:0/2291709922 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fc806fc00 0x7f3fc8152030 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f3fb800c7f0 tx=0x7f3fb800ccb0 comp rx=0 tx=0).stop 2024-05-09T05:59:26.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.434+0000 7f3fce9ed640 1 -- 172.21.15.72:0/2291709922 shutdown_connections 2024-05-09T05:59:26.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.434+0000 7f3fce9ed640 1 --2- 172.21.15.72:0/2291709922 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f3fb406f400 0x7f3fb4071910 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:26.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.434+0000 7f3fce9ed640 1 --2- 172.21.15.72:0/2291709922 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fc815c190 0x7f3fc815b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:26.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.434+0000 7f3fce9ed640 1 --2- 172.21.15.72:0/2291709922 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3fc8073160 0x7f3fc81f3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:26.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.434+0000 7f3fce9ed640 1 --2- 172.21.15.72:0/2291709922 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fc806fc00 0x7f3fc8152030 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:26.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.434+0000 7f3fce9ed640 1 -- 172.21.15.72:0/2291709922 >> 172.21.15.72:0/2291709922 conn(0x7f3fc80cde90 msgr2=0x7f3fc8073a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:59:26.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.434+0000 7f3fce9ed640 1 -- 172.21.15.72:0/2291709922 shutdown_connections 2024-05-09T05:59:26.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.434+0000 7f3fce9ed640 1 -- 172.21.15.72:0/2291709922 wait complete. 2024-05-09T05:59:26.444 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-09T05:59:26.483 INFO:tasks.ceph.mds.c.smithi072.stdout:starting mds.c at 2024-05-09T05:59:26.503 INFO:tasks.ceph.mds.a.smithi072.stdout:starting mds.a at 2024-05-09T05:59:26.531 INFO:tasks.ceph.mds.d.smithi110.stdout:starting mds.d at 2024-05-09T05:59:26.538 INFO:tasks.ceph.mds.f.smithi110.stdout:starting mds.f at 2024-05-09T05:59:26.541 INFO:tasks.ceph.mds.b.smithi110.stdout:starting mds.b at 2024-05-09T05:59:26.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.598+0000 7fcc6102e640 1 Processor -- start 2024-05-09T05:59:26.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.598+0000 7fcc6102e640 1 -- start start 2024-05-09T05:59:26.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.602+0000 7fcc6102e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc5c153950 0x7fcc5c0cac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:26.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.602+0000 7fcc6102e640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc5c0c9fb0 con 0x7fcc5c0cb650 2024-05-09T05:59:26.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.602+0000 7fcc6102e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc5c0ca290 con 0x7fcc5c073ea0 2024-05-09T05:59:26.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.602+0000 7fcc6102e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fcc5c0ca890 con 0x7fcc5c153950 2024-05-09T05:59:26.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.602+0000 7fcc5b59e640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fcc5c0cb650 0x7fcc5c0cba60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:46378/0 (socket says 172.21.15.72:46378) 2024-05-09T05:59:26.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.602+0000 7fcc5b59e640 1 -- 172.21.15.72:0/1927070861 learned_addr learned my addr 172.21.15.72:0/1927070861 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:59:26.591 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.602+0000 7fcc53fff640 1 --2- 172.21.15.72:0/1927070861 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc5c153950 0x7fcc5c0cac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:26.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.602+0000 7fcc5a59c640 1 -- 172.21.15.72:0/1927070861 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3134325402 0 0) 0x7fcc5c0c9fb0 con 0x7fcc5c0cb650 2024-05-09T05:59:26.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.602+0000 7fcc5a59c640 1 -- 172.21.15.72:0/1927070861 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc48003530 con 0x7fcc5c0cb650 2024-05-09T05:59:26.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.602+0000 7fcc5a59c640 1 -- 172.21.15.72:0/1927070861 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2189206578 0 0) 0x7fcc5c0ca290 con 0x7fcc5c073ea0 2024-05-09T05:59:26.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.602+0000 7fcc5a59c640 1 -- 172.21.15.72:0/1927070861 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc5c0c9fb0 con 0x7fcc5c073ea0 2024-05-09T05:59:26.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.602+0000 7fcc5a59c640 1 -- 172.21.15.72:0/1927070861 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2830554104 0 0) 0x7fcc48003530 con 0x7fcc5c0cb650 2024-05-09T05:59:26.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.602+0000 7fcc5a59c640 1 -- 172.21.15.72:0/1927070861 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc5c153950 msgr2=0x7fcc5c0cac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:59:26.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.602+0000 7fcc5a59c640 1 --2- 172.21.15.72:0/1927070861 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc5c153950 0x7fcc5c0cac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:26.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.602+0000 7fcc5a59c640 1 -- 172.21.15.72:0/1927070861 >> v1:172.21.15.110:6789/0 conn(0x7fcc5c073ea0 legacy=0x7fcc5c0c81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:59:26.592 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.602+0000 7fcc5a59c640 1 -- 172.21.15.72:0/1927070861 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc5c0c75b0 con 0x7fcc5c0cb650 2024-05-09T05:59:26.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.602+0000 7fcc5a59c640 1 -- 172.21.15.72:0/1927070861 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2749052815 0 0) 0x7fcc54001a80 con 0x7fcc5c0cb650 2024-05-09T05:59:26.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.602+0000 7fcc5a59c640 1 -- 172.21.15.72:0/1927070861 >> v1:172.21.15.72:6789/0 conn(0x7fcc5c0cb650 legacy=0x7fcc5c0cba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:59:26.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.602+0000 7fcc5a59c640 1 --2- 172.21.15.72:0/1927070861 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc48003c70 0x7fcc480040c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:26.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.602+0000 7fcc5a59c640 1 --2- 172.21.15.72:0/1927070861 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc48004810 0x7fcc48004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:26.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.602+0000 7fcc5a59c640 1 --2- 172.21.15.72:0/1927070861 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc48005270 0x7fcc4800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:26.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.602+0000 7fcc5a59c640 1 -- 172.21.15.72:0/1927070861 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fcc4800c1a0 con 0x7fcc48005270 2024-05-09T05:59:26.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.602+0000 7fcc5a59c640 1 -- 172.21.15.72:0/1927070861 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fcc4800c350 con 0x7fcc48004810 2024-05-09T05:59:26.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.602+0000 7fcc5a59c640 1 -- 172.21.15.72:0/1927070861 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fcc4800c550 con 0x7fcc48003c70 2024-05-09T05:59:26.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.602+0000 7fcc53fff640 1 --2- 172.21.15.72:0/1927070861 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc5c153950 0x7fcc5c0cac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T05:59:26.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.602+0000 7fcc5b59e640 1 --2- 172.21.15.72:0/1927070861 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc48005270 0x7fcc4800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:26.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.602+0000 7fcc5ad9d640 1 --2- 172.21.15.72:0/1927070861 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc48003c70 0x7fcc480040c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:26.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.602+0000 7fcc53fff640 1 --2- 172.21.15.72:0/1927070861 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc48004810 0x7fcc48004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:26.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.602+0000 7fcc5b59e640 1 -- 172.21.15.72:0/1927070861 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc48003c70 msgr2=0x7fcc480040c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:59:26.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.602+0000 7fcc5b59e640 1 --2- 172.21.15.72:0/1927070861 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc48003c70 0x7fcc480040c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:26.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.602+0000 7fcc5b59e640 1 -- 172.21.15.72:0/1927070861 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc48004810 msgr2=0x7fcc48004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:59:26.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.602+0000 7fcc5b59e640 1 --2- 172.21.15.72:0/1927070861 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc48004810 0x7fcc48004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:26.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.602+0000 7fcc5b59e640 1 -- 172.21.15.72:0/1927070861 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc48003530 con 0x7fcc48005270 2024-05-09T05:59:26.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.602+0000 7fcc5b59e640 1 --2- 172.21.15.72:0/1927070861 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc48005270 0x7fcc4800b9d0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fcc5400a7e0 tx=0x7fcc5401f9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b99b24b80aa79e0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:59:26.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.602+0000 7fcc5a59c640 1 -- 172.21.15.72:0/1927070861 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc5400a3b0 con 0x7fcc48005270 2024-05-09T05:59:26.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.602+0000 7fcc5a59c640 1 -- 172.21.15.72:0/1927070861 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fcc540b1070 con 0x7fcc48005270 2024-05-09T05:59:26.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.602+0000 7fcc5a59c640 1 -- 172.21.15.72:0/1927070861 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc540ac920 con 0x7fcc48005270 2024-05-09T05:59:26.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.606+0000 7fcc6102e640 1 -- 172.21.15.72:0/1927070861 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc48005270 msgr2=0x7fcc4800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:59:26.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.606+0000 7fcc6102e640 1 --2- 172.21.15.72:0/1927070861 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc48005270 0x7fcc4800b9d0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fcc5400a7e0 tx=0x7fcc5401f9c0 comp rx=0 tx=0).stop 2024-05-09T05:59:26.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.606+0000 7fcc5b59e640 1 -- 172.21.15.72:0/1927070861 reap_dead start 2024-05-09T05:59:26.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.606+0000 7fcc6102e640 1 -- 172.21.15.72:0/1927070861 shutdown_connections 2024-05-09T05:59:26.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.606+0000 7fcc6102e640 1 -- 172.21.15.72:0/1927070861 >> 172.21.15.72:0/1927070861 conn(0x7fcc5c06dab0 msgr2=0x7fcc5c06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:59:26.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.606+0000 7fcc6102e640 1 -- 172.21.15.72:0/1927070861 shutdown_connections 2024-05-09T05:59:26.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.606+0000 7fcc6102e640 1 -- 172.21.15.72:0/1927070861 wait complete. 2024-05-09T05:59:26.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.606+0000 7fcc6102e640 1 Processor -- start 2024-05-09T05:59:26.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.606+0000 7fcc6102e640 1 -- start start 2024-05-09T05:59:26.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.606+0000 7fcc6102e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc48005270 0x7fcc5c1efc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:26.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.606+0000 7fcc6102e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc5c0ce940 0x7fcc5c149420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:26.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.606+0000 7fcc6102e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc5c0ced50 0x7fcc5c1460a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:26.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.606+0000 7fcc6102e640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fcc5c0c88d0 con 0x7fcc5c0ce940 2024-05-09T05:59:26.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.606+0000 7fcc6102e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fcc5c0c7b70 con 0x7fcc5c0ced50 2024-05-09T05:59:26.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.606+0000 7fcc6102e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fcc5c0c8a50 con 0x7fcc48005270 2024-05-09T05:59:26.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.606+0000 7fcc53fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc5c0ce940 0x7fcc5c149420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:26.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.606+0000 7fcc53fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc5c0ce940 0x7fcc5c149420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60186/0 (socket says 172.21.15.72:60186) 2024-05-09T05:59:26.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.606+0000 7fcc53fff640 1 -- 172.21.15.72:0/515590598 learned_addr learned my addr 172.21.15.72:0/515590598 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:59:26.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.606+0000 7fcc5b59e640 1 --2- 172.21.15.72:0/515590598 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc5c0ced50 0x7fcc5c1460a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:26.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.606+0000 7fcc5ad9d640 1 --2- 172.21.15.72:0/515590598 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc48005270 0x7fcc5c1efc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:26.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.610+0000 7fcc53fff640 1 -- 172.21.15.72:0/515590598 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc48005270 msgr2=0x7fcc5c1efc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:59:26.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.610+0000 7fcc53fff640 1 --2- 172.21.15.72:0/515590598 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc48005270 0x7fcc5c1efc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:26.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.610+0000 7fcc53fff640 1 -- 172.21.15.72:0/515590598 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc5c0ced50 msgr2=0x7fcc5c1460a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:59:26.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.610+0000 7fcc53fff640 1 --2- 172.21.15.72:0/515590598 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc5c0ced50 0x7fcc5c1460a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:26.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.610+0000 7fcc53fff640 1 -- 172.21.15.72:0/515590598 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc5c1f0150 con 0x7fcc5c0ce940 2024-05-09T05:59:26.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.610+0000 7fcc5b59e640 1 --2- 172.21.15.72:0/515590598 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc5c0ced50 0x7fcc5c1460a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:59:26.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.610+0000 7fcc53fff640 1 --2- 172.21.15.72:0/515590598 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc5c0ce940 0x7fcc5c149420 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fcc440119c0 tx=0x7fcc44011e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:59:26.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.610+0000 7fcc537fe640 1 -- 172.21.15.72:0/515590598 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc44004240 con 0x7fcc5c0ce940 2024-05-09T05:59:26.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.610+0000 7fcc537fe640 1 -- 172.21.15.72:0/515590598 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fcc440043e0 con 0x7fcc5c0ce940 2024-05-09T05:59:26.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.610+0000 7fcc6102e640 1 -- 172.21.15.72:0/515590598 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc5c14de60 con 0x7fcc5c0ce940 2024-05-09T05:59:26.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.610+0000 7fcc537fe640 1 -- 172.21.15.72:0/515590598 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc4400c970 con 0x7fcc5c0ce940 2024-05-09T05:59:26.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.610+0000 7fcc6102e640 1 -- 172.21.15.72:0/515590598 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc5c14e400 con 0x7fcc5c0ce940 2024-05-09T05:59:26.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.610+0000 7fcc6102e640 1 -- 172.21.15.72:0/515590598 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc5c06a520 con 0x7fcc5c0ce940 2024-05-09T05:59:26.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.610+0000 7fcc537fe640 1 -- 172.21.15.72:0/515590598 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fcc4400cb10 con 0x7fcc5c0ce940 2024-05-09T05:59:26.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.610+0000 7fcc537fe640 1 --2- 172.21.15.72:0/515590598 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fcc3c06f430 0x7fcc3c071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:26.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.610+0000 7fcc537fe640 1 -- 172.21.15.72:0/515590598 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 7192+0+0 (secure 0 0 0) 0x7fcc44091ea0 con 0x7fcc5c0ce940 2024-05-09T05:59:26.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.610+0000 7fcc5ad9d640 1 --2- 172.21.15.72:0/515590598 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fcc3c06f430 0x7fcc3c071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:26.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.614+0000 7fcc5ad9d640 1 --2- 172.21.15.72:0/515590598 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fcc3c06f430 0x7fcc3c071940 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c007fd0 tx=0x7fcc4c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:59:26.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.614+0000 7fcc537fe640 1 -- 172.21.15.72:0/515590598 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fcc4405e8a0 con 0x7fcc5c0ce940 2024-05-09T05:59:26.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:26.822+0000 7fcc6102e640 1 -- 172.21.15.72:0/515590598 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fcc5c0caa50 con 0x7fcc5c0ce940 2024-05-09T05:59:27.228 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T05:59:27.231 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T05:59:27.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.434+0000 7fcc537fe640 1 -- 172.21.15.72:0/515590598 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v33) ==== 104+0+0 (secure 0 0 0) 0x7fcc4405e1a0 con 0x7fcc5c0ce940 2024-05-09T05:59:27.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.438+0000 7fcc6102e640 1 -- 172.21.15.72:0/515590598 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fcc3c06f430 msgr2=0x7fcc3c071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:59:27.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.438+0000 7fcc6102e640 1 --2- 172.21.15.72:0/515590598 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fcc3c06f430 0x7fcc3c071940 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c007fd0 tx=0x7fcc4c009040 comp rx=0 tx=0).stop 2024-05-09T05:59:27.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.438+0000 7fcc6102e640 1 -- 172.21.15.72:0/515590598 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc5c0ce940 msgr2=0x7fcc5c149420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:59:27.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.438+0000 7fcc6102e640 1 --2- 172.21.15.72:0/515590598 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc5c0ce940 0x7fcc5c149420 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fcc440119c0 tx=0x7fcc44011e80 comp rx=0 tx=0).stop 2024-05-09T05:59:27.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.438+0000 7fcc6102e640 1 -- 172.21.15.72:0/515590598 shutdown_connections 2024-05-09T05:59:27.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.438+0000 7fcc6102e640 1 --2- 172.21.15.72:0/515590598 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7fcc3c06f430 0x7fcc3c071940 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:27.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.438+0000 7fcc6102e640 1 --2- 172.21.15.72:0/515590598 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc5c0ced50 0x7fcc5c1460a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:27.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.438+0000 7fcc6102e640 1 --2- 172.21.15.72:0/515590598 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc5c0ce940 0x7fcc5c149420 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:27.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.438+0000 7fcc6102e640 1 --2- 172.21.15.72:0/515590598 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc48005270 0x7fcc5c1efc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:27.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.438+0000 7fcc6102e640 1 -- 172.21.15.72:0/515590598 >> 172.21.15.72:0/515590598 conn(0x7fcc5c06dab0 msgr2=0x7fcc5c075e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:59:27.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.438+0000 7fcc6102e640 1 -- 172.21.15.72:0/515590598 shutdown_connections 2024-05-09T05:59:27.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.438+0000 7fcc6102e640 1 -- 172.21.15.72:0/515590598 wait complete. 2024-05-09T05:59:27.454 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-09T05:59:27.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.622+0000 7f9e15547640 1 Processor -- start 2024-05-09T05:59:27.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.622+0000 7f9e15547640 1 -- start start 2024-05-09T05:59:27.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.622+0000 7f9e15547640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9e10153860 0x7f9e100c6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:27.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.622+0000 7f9e15547640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9e100c7210 0x7f9e10163d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:27.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.622+0000 7f9e15547640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e10072b00 con 0x7f9e10159ed0 2024-05-09T05:59:27.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.622+0000 7f9e15547640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f9e10153c70 con 0x7f9e100c7210 2024-05-09T05:59:27.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.622+0000 7f9e15547640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f9e10072540 con 0x7f9e10153860 2024-05-09T05:59:27.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.622+0000 7f9e0f7fe640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9e100c7210 0x7f9e10163d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:27.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.622+0000 7f9e0effd640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f9e10159ed0 0x7f9e10072f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:46380/0 (socket says 172.21.15.72:46380) 2024-05-09T05:59:27.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.622+0000 7f9e0effd640 1 -- 172.21.15.72:0/2623496975 learned_addr learned my addr 172.21.15.72:0/2623496975 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-09T05:59:27.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.622+0000 7f9e067fc640 1 --2- 172.21.15.72:0/2623496975 >> v2:172.21.15.110:3300/0 conn(0x7f9e10153860 0x7f9e100c6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:27.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.622+0000 7f9e0f7fe640 1 -- 172.21.15.72:0/2623496975 >> v2:172.21.15.110:3300/0 conn(0x7f9e10153860 msgr2=0x7f9e100c6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:59:27.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.622+0000 7f9e0f7fe640 1 --2- 172.21.15.72:0/2623496975 >> v2:172.21.15.110:3300/0 conn(0x7f9e10153860 0x7f9e100c6cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:27.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.622+0000 7f9e0f7fe640 1 -- 172.21.15.72:0/2623496975 >> v1:172.21.15.72:6789/0 conn(0x7f9e10159ed0 legacy=0x7f9e10072f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:59:27.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.622+0000 7f9e0f7fe640 1 -- 172.21.15.72:0/2623496975 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e10072820 con 0x7f9e100c7210 2024-05-09T05:59:27.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.622+0000 7f9e0e7fc640 1 -- 172.21.15.72:0/2623496975 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 543641333 0 0) 0x7f9e10072b00 con 0x7f9e10159ed0 2024-05-09T05:59:27.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.622+0000 7f9e0f7fe640 1 --2- 172.21.15.72:0/2623496975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e100c7210 0x7f9e10163d80 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f9e10071e50 tx=0x7f9e0801f110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a30d78ce06b909fd server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:59:27.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.622+0000 7f9e0e7fc640 1 -- 172.21.15.72:0/2623496975 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e080b4070 con 0x7f9e100c7210 2024-05-09T05:59:27.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.622+0000 7f9e0e7fc640 1 -- 172.21.15.72:0/2623496975 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9e080af600 con 0x7f9e100c7210 2024-05-09T05:59:27.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.622+0000 7f9e0e7fc640 1 -- 172.21.15.72:0/2623496975 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e080af9f0 con 0x7f9e100c7210 2024-05-09T05:59:27.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.626+0000 7f9e15547640 1 -- 172.21.15.72:0/2623496975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e100c7210 msgr2=0x7f9e10163d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:59:27.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.626+0000 7f9e15547640 1 --2- 172.21.15.72:0/2623496975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e100c7210 0x7f9e10163d80 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f9e10071e50 tx=0x7f9e0801f110 comp rx=0 tx=0).stop 2024-05-09T05:59:27.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.626+0000 7f9e15547640 1 -- 172.21.15.72:0/2623496975 shutdown_connections 2024-05-09T05:59:27.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.626+0000 7f9e15547640 1 --2- 172.21.15.72:0/2623496975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e100c7210 0x7f9e10163d80 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:27.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.626+0000 7f9e15547640 1 --2- 172.21.15.72:0/2623496975 >> v2:172.21.15.110:3300/0 conn(0x7f9e10153860 0x7f9e100c6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:27.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.626+0000 7f9e15547640 1 -- 172.21.15.72:0/2623496975 >> 172.21.15.72:0/2623496975 conn(0x7f9e100cde90 msgr2=0x7f9e100ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:59:27.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.626+0000 7f9e15547640 1 -- 172.21.15.72:0/2623496975 shutdown_connections 2024-05-09T05:59:27.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.626+0000 7f9e15547640 1 -- 172.21.15.72:0/2623496975 wait complete. 2024-05-09T05:59:27.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.626+0000 7f9e15547640 1 Processor -- start 2024-05-09T05:59:27.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.626+0000 7f9e15547640 1 -- start start 2024-05-09T05:59:27.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.626+0000 7f9e15547640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9e100c7210 0x7f9e1014a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:27.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.626+0000 7f9e15547640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e10153860 0x7f9e10156330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:27.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.626+0000 7f9e15547640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9e10159ed0 0x7f9e10158e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:27.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.626+0000 7f9e15547640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f9e100c4920 con 0x7f9e10153860 2024-05-09T05:59:27.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.626+0000 7f9e15547640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f9e100c7620 con 0x7f9e100c7210 2024-05-09T05:59:27.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.626+0000 7f9e15547640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f9e100c4cb0 con 0x7f9e10159ed0 2024-05-09T05:59:27.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.626+0000 7f9e067fc640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e10153860 0x7f9e10156330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:27.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.630+0000 7f9e067fc640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e10153860 0x7f9e10156330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60198/0 (socket says 172.21.15.72:60198) 2024-05-09T05:59:27.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.630+0000 7f9e067fc640 1 -- 172.21.15.72:0/2589128663 learned_addr learned my addr 172.21.15.72:0/2589128663 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:59:27.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.630+0000 7f9e0effd640 1 --2- 172.21.15.72:0/2589128663 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9e100c7210 0x7f9e1014a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:27.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.630+0000 7f9e0f7fe640 1 --2- 172.21.15.72:0/2589128663 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9e10159ed0 0x7f9e10158e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:27.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.630+0000 7f9e067fc640 1 -- 172.21.15.72:0/2589128663 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9e10159ed0 msgr2=0x7f9e10158e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:59:27.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.630+0000 7f9e067fc640 1 --2- 172.21.15.72:0/2589128663 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9e10159ed0 0x7f9e10158e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:27.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.630+0000 7f9e067fc640 1 -- 172.21.15.72:0/2589128663 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9e100c7210 msgr2=0x7f9e1014a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:59:27.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.630+0000 7f9e067fc640 1 --2- 172.21.15.72:0/2589128663 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9e100c7210 0x7f9e1014a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:27.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.630+0000 7f9e067fc640 1 -- 172.21.15.72:0/2589128663 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e10156870 con 0x7f9e10153860 2024-05-09T05:59:27.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.630+0000 7f9e0effd640 1 --2- 172.21.15.72:0/2589128663 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9e100c7210 0x7f9e1014a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:59:27.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.630+0000 7f9e067fc640 1 --2- 172.21.15.72:0/2589128663 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e10153860 0x7f9e10156330 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f9df800d7d0 tx=0x7f9df800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:59:27.619 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.630+0000 7f9e07fff640 1 -- 172.21.15.72:0/2589128663 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df800b6c0 con 0x7f9e10153860 2024-05-09T05:59:27.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.630+0000 7f9e07fff640 1 -- 172.21.15.72:0/2589128663 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9df8019070 con 0x7f9e10153860 2024-05-09T05:59:27.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.630+0000 7f9e15547640 1 -- 172.21.15.72:0/2589128663 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e10070b00 con 0x7f9e10153860 2024-05-09T05:59:27.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.630+0000 7f9e07fff640 1 -- 172.21.15.72:0/2589128663 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df800baa0 con 0x7f9e10153860 2024-05-09T05:59:27.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.630+0000 7f9e15547640 1 -- 172.21.15.72:0/2589128663 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e10148bb0 con 0x7f9e10153860 2024-05-09T05:59:27.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.630+0000 7f9e15547640 1 -- 172.21.15.72:0/2589128663 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e1006a520 con 0x7f9e10153860 2024-05-09T05:59:27.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.630+0000 7f9e07fff640 1 -- 172.21.15.72:0/2589128663 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f9df800bc40 con 0x7f9e10153860 2024-05-09T05:59:27.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.630+0000 7f9e07fff640 1 --2- 172.21.15.72:0/2589128663 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f9df006f430 0x7f9df0071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:27.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.630+0000 7f9e07fff640 1 -- 172.21.15.72:0/2589128663 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 7192+0+0 (secure 0 0 0) 0x7f9df808fd40 con 0x7f9e10153860 2024-05-09T05:59:27.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.630+0000 7f9e0effd640 1 --2- 172.21.15.72:0/2589128663 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f9df006f430 0x7f9df0071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:27.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.630+0000 7f9e0effd640 1 --2- 172.21.15.72:0/2589128663 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f9df006f430 0x7f9df0071940 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9e00007fd0 tx=0x7f9e00009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:59:27.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.634+0000 7f9e07fff640 1 -- 172.21.15.72:0/2589128663 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f9e10156870 con 0x7f9e10153860 2024-05-09T05:59:27.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:27.798+0000 7f9e15547640 1 -- 172.21.15.72:0/2589128663 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9e1014b2f0 con 0x7f9e10153860 2024-05-09T05:59:28.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.726+0000 7f9e07fff640 1 -- 172.21.15.72:0/2589128663 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v31) ==== 181+0+0 (secure 0 0 0) 0x7f9df805c660 con 0x7f9e10153860 2024-05-09T05:59:28.712 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_metadata' removed 2024-05-09T05:59:28.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.730+0000 7f9e15547640 1 -- 172.21.15.72:0/2589128663 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f9df006f430 msgr2=0x7f9df0071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:59:28.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.730+0000 7f9e15547640 1 --2- 172.21.15.72:0/2589128663 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f9df006f430 0x7f9df0071940 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9e00007fd0 tx=0x7f9e00009040 comp rx=0 tx=0).stop 2024-05-09T05:59:28.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.730+0000 7f9e15547640 1 -- 172.21.15.72:0/2589128663 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e10153860 msgr2=0x7f9e10156330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:59:28.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.730+0000 7f9e15547640 1 --2- 172.21.15.72:0/2589128663 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e10153860 0x7f9e10156330 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f9df800d7d0 tx=0x7f9df800dc90 comp rx=0 tx=0).stop 2024-05-09T05:59:28.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.730+0000 7f9e15547640 1 -- 172.21.15.72:0/2589128663 shutdown_connections 2024-05-09T05:59:28.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.730+0000 7f9e15547640 1 --2- 172.21.15.72:0/2589128663 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f9df006f430 0x7f9df0071940 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:28.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.730+0000 7f9e15547640 1 --2- 172.21.15.72:0/2589128663 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9e10159ed0 0x7f9e10158e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:28.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.730+0000 7f9e15547640 1 --2- 172.21.15.72:0/2589128663 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e10153860 0x7f9e10156330 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:28.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.730+0000 7f9e15547640 1 --2- 172.21.15.72:0/2589128663 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9e100c7210 0x7f9e1014a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:28.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.730+0000 7f9e15547640 1 -- 172.21.15.72:0/2589128663 >> 172.21.15.72:0/2589128663 conn(0x7f9e100cde90 msgr2=0x7f9e1006f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:59:28.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.730+0000 7f9e15547640 1 -- 172.21.15.72:0/2589128663 shutdown_connections 2024-05-09T05:59:28.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.734+0000 7f9e15547640 1 -- 172.21.15.72:0/2589128663 wait complete. 2024-05-09T05:59:28.749 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-09T05:59:28.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.910+0000 7f52c682d640 1 Processor -- start 2024-05-09T05:59:28.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.910+0000 7f52c682d640 1 -- start start 2024-05-09T05:59:28.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.914+0000 7f52c682d640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f52c015c190 0x7f52c0159730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:28.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.914+0000 7f52c682d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f52c0073160 0x7f52c0152e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:28.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.914+0000 7f52c682d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f52c006fc00 0x7f52c0070010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:28.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.914+0000 7f52c682d640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f52c01533a0 con 0x7f52c015c190 2024-05-09T05:59:28.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.914+0000 7f52c682d640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f52c00724b0 con 0x7f52c0073160 2024-05-09T05:59:28.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.914+0000 7f52c682d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f52c0072770 con 0x7f52c006fc00 2024-05-09T05:59:28.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.914+0000 7f52bffff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f52c015c190 0x7f52c0159730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:28.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.914+0000 7f52bffff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f52c015c190 0x7f52c0159730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60200/0 (socket says 172.21.15.72:60200) 2024-05-09T05:59:28.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.914+0000 7f52bffff640 1 -- 172.21.15.72:0/2512888821 learned_addr learned my addr 172.21.15.72:0/2512888821 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:59:28.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.914+0000 7f52c4dca640 1 --2- 172.21.15.72:0/2512888821 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f52c006fc00 0x7f52c0070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:28.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.914+0000 7f52bf7fe640 1 --2- 172.21.15.72:0/2512888821 >> v2:172.21.15.110:3300/0 conn(0x7f52c0073160 0x7f52c0152e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:28.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.914+0000 7f52bffff640 1 -- 172.21.15.72:0/2512888821 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f52c006fc00 msgr2=0x7f52c0070010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:59:28.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.914+0000 7f52bffff640 1 --2- 172.21.15.72:0/2512888821 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f52c006fc00 0x7f52c0070010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:28.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.914+0000 7f52bffff640 1 -- 172.21.15.72:0/2512888821 >> v2:172.21.15.110:3300/0 conn(0x7f52c0073160 msgr2=0x7f52c0152e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:59:28.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.914+0000 7f52bffff640 1 --2- 172.21.15.72:0/2512888821 >> v2:172.21.15.110:3300/0 conn(0x7f52c0073160 0x7f52c0152e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:28.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.914+0000 7f52bffff640 1 -- 172.21.15.72:0/2512888821 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52c0072a50 con 0x7f52c015c190 2024-05-09T05:59:28.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.914+0000 7f52bffff640 1 --2- 172.21.15.72:0/2512888821 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52c015c190 0x7f52c0159730 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f52c00754b0 tx=0x7f52b001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96411a07bf2603fb server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:59:28.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.914+0000 7f52beffd640 1 -- 172.21.15.72:0/2512888821 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52b00b5070 con 0x7f52c015c190 2024-05-09T05:59:28.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.918+0000 7f52beffd640 1 -- 172.21.15.72:0/2512888821 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f52b00a89d0 con 0x7f52c015c190 2024-05-09T05:59:28.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.918+0000 7f52beffd640 1 -- 172.21.15.72:0/2512888821 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52b00a8dc0 con 0x7f52c015c190 2024-05-09T05:59:28.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.918+0000 7f52c682d640 1 -- 172.21.15.72:0/2512888821 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52c015c190 msgr2=0x7f52c0159730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:59:28.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.918+0000 7f52c682d640 1 --2- 172.21.15.72:0/2512888821 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52c015c190 0x7f52c0159730 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f52c00754b0 tx=0x7f52b001ed10 comp rx=0 tx=0).stop 2024-05-09T05:59:28.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.918+0000 7f52c682d640 1 -- 172.21.15.72:0/2512888821 shutdown_connections 2024-05-09T05:59:28.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.918+0000 7f52c682d640 1 --2- 172.21.15.72:0/2512888821 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f52c006fc00 0x7f52c0070010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:28.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.918+0000 7f52c682d640 1 --2- 172.21.15.72:0/2512888821 >> v2:172.21.15.110:3300/0 conn(0x7f52c0073160 0x7f52c0152e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:28.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.918+0000 7f52c682d640 1 --2- 172.21.15.72:0/2512888821 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52c015c190 0x7f52c0159730 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:28.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.918+0000 7f52c682d640 1 -- 172.21.15.72:0/2512888821 >> 172.21.15.72:0/2512888821 conn(0x7f52c00cde90 msgr2=0x7f52c00ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:59:28.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.918+0000 7f52c682d640 1 -- 172.21.15.72:0/2512888821 shutdown_connections 2024-05-09T05:59:28.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.918+0000 7f52c682d640 1 -- 172.21.15.72:0/2512888821 wait complete. 2024-05-09T05:59:28.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.918+0000 7f52c682d640 1 Processor -- start 2024-05-09T05:59:28.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.918+0000 7f52c682d640 1 -- start start 2024-05-09T05:59:28.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.922+0000 7f52c682d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52c006fc00 0x7f52c01f0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:28.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.922+0000 7f52c682d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f52c0073160 0x7f52c014e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:28.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.922+0000 7f52c682d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52c015c190 0x7f52c00cc880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:28.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.922+0000 7f52c682d640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f52c0158c20 con 0x7f52c015c190 2024-05-09T05:59:28.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.922+0000 7f52c682d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f52c0159210 con 0x7f52c006fc00 2024-05-09T05:59:28.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.922+0000 7f52c682d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f52c0073570 con 0x7f52c0073160 2024-05-09T05:59:28.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.922+0000 7f52c4dca640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52c015c190 0x7f52c00cc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:28.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.922+0000 7f52c4dca640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52c015c190 0x7f52c00cc880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60210/0 (socket says 172.21.15.72:60210) 2024-05-09T05:59:28.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.922+0000 7f52c4dca640 1 -- 172.21.15.72:0/2636365586 learned_addr learned my addr 172.21.15.72:0/2636365586 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:59:28.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.922+0000 7f52bf7fe640 1 --2- 172.21.15.72:0/2636365586 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f52c0073160 0x7f52c014e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:28.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.922+0000 7f52bffff640 1 --2- 172.21.15.72:0/2636365586 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52c006fc00 0x7f52c01f0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:28.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.922+0000 7f52c4dca640 1 -- 172.21.15.72:0/2636365586 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f52c0073160 msgr2=0x7f52c014e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:59:28.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.922+0000 7f52c4dca640 1 --2- 172.21.15.72:0/2636365586 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f52c0073160 0x7f52c014e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:28.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.922+0000 7f52c4dca640 1 -- 172.21.15.72:0/2636365586 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52c006fc00 msgr2=0x7f52c01f0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:59:28.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.922+0000 7f52c4dca640 1 --2- 172.21.15.72:0/2636365586 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52c006fc00 0x7f52c01f0dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:28.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.922+0000 7f52c4dca640 1 -- 172.21.15.72:0/2636365586 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52c01f1300 con 0x7f52c015c190 2024-05-09T05:59:28.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.922+0000 7f52c4dca640 1 --2- 172.21.15.72:0/2636365586 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52c015c190 0x7f52c00cc880 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f52b8007cc0 tx=0x7f52b800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:59:28.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.922+0000 7f52bcff9640 1 -- 172.21.15.72:0/2636365586 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52b8014420 con 0x7f52c015c190 2024-05-09T05:59:28.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.922+0000 7f52bcff9640 1 -- 172.21.15.72:0/2636365586 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f52b8019070 con 0x7f52c015c190 2024-05-09T05:59:28.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.922+0000 7f52c682d640 1 -- 172.21.15.72:0/2636365586 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52c0158860 con 0x7f52c015c190 2024-05-09T05:59:28.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.922+0000 7f52bcff9640 1 -- 172.21.15.72:0/2636365586 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52b8014820 con 0x7f52c015c190 2024-05-09T05:59:28.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.922+0000 7f52c682d640 1 -- 172.21.15.72:0/2636365586 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52c014d6d0 con 0x7f52c015c190 2024-05-09T05:59:28.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.922+0000 7f52c682d640 1 -- 172.21.15.72:0/2636365586 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52c006a520 con 0x7f52c015c190 2024-05-09T05:59:28.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.922+0000 7f52bcff9640 1 -- 172.21.15.72:0/2636365586 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f52b80149c0 con 0x7f52c015c190 2024-05-09T05:59:28.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.922+0000 7f52bcff9640 1 --2- 172.21.15.72:0/2636365586 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f52ac06f430 0x7f52ac071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:28.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.922+0000 7f52bcff9640 1 -- 172.21.15.72:0/2636365586 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6754+0+0 (secure 0 0 0) 0x7f52b808fe70 con 0x7f52c015c190 2024-05-09T05:59:28.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.926+0000 7f52bffff640 1 --2- 172.21.15.72:0/2636365586 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f52ac06f430 0x7f52ac071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:28.910 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.926+0000 7f52bffff640 1 --2- 172.21.15.72:0/2636365586 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f52ac06f430 0x7f52ac071940 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f52b00b2000 tx=0x7f52b00aa070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:59:28.913 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:28.930+0000 7f52bcff9640 1 -- 172.21.15.72:0/2636365586 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f52b805c940 con 0x7f52c015c190 2024-05-09T05:59:29.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.090+0000 7f52c682d640 1 -- 172.21.15.72:0/2636365586 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f52c014e7c0 con 0x7f52c015c190 2024-05-09T05:59:29.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.738+0000 7f52bcff9640 1 -- 172.21.15.72:0/2636365586 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v32) ==== 169+0+0 (secure 0 0 0) 0x7f52b805c240 con 0x7f52c015c190 2024-05-09T05:59:29.724 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_data' removed 2024-05-09T05:59:29.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.742+0000 7f52c682d640 1 -- 172.21.15.72:0/2636365586 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f52ac06f430 msgr2=0x7f52ac071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:59:29.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.742+0000 7f52c682d640 1 --2- 172.21.15.72:0/2636365586 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f52ac06f430 0x7f52ac071940 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f52b00b2000 tx=0x7f52b00aa070 comp rx=0 tx=0).stop 2024-05-09T05:59:29.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.742+0000 7f52c682d640 1 -- 172.21.15.72:0/2636365586 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52c015c190 msgr2=0x7f52c00cc880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:59:29.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.742+0000 7f52c682d640 1 --2- 172.21.15.72:0/2636365586 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52c015c190 0x7f52c00cc880 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f52b8007cc0 tx=0x7f52b800e4b0 comp rx=0 tx=0).stop 2024-05-09T05:59:29.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.742+0000 7f52c682d640 1 -- 172.21.15.72:0/2636365586 shutdown_connections 2024-05-09T05:59:29.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.742+0000 7f52c682d640 1 --2- 172.21.15.72:0/2636365586 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f52ac06f430 0x7f52ac071940 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:29.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.742+0000 7f52c682d640 1 --2- 172.21.15.72:0/2636365586 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52c015c190 0x7f52c00cc880 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:29.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.742+0000 7f52c682d640 1 --2- 172.21.15.72:0/2636365586 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f52c0073160 0x7f52c014e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:29.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.742+0000 7f52c682d640 1 --2- 172.21.15.72:0/2636365586 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52c006fc00 0x7f52c01f0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:29.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.742+0000 7f52c682d640 1 -- 172.21.15.72:0/2636365586 >> 172.21.15.72:0/2636365586 conn(0x7f52c00cde90 msgr2=0x7f52c014c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:59:29.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.750+0000 7f52c682d640 1 -- 172.21.15.72:0/2636365586 shutdown_connections 2024-05-09T05:59:29.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.750+0000 7f52c682d640 1 -- 172.21.15.72:0/2636365586 wait complete. 2024-05-09T05:59:29.761 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-05-09T05:59:29.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.934+0000 7f848ec4c640 1 Processor -- start 2024-05-09T05:59:29.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.934+0000 7f848ec4c640 1 -- start start 2024-05-09T05:59:29.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.934+0000 7f848ec4c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f848815dea0 0x7f84880745b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:29.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.934+0000 7f848ec4c640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8488074af0 0x7f8488164e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:29.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.934+0000 7f848ec4c640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84880c7c80 con 0x7f848815da90 2024-05-09T05:59:29.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.934+0000 7f848ec4c640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f84881513f0 con 0x7f8488074af0 2024-05-09T05:59:29.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.934+0000 7f848ec4c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f848815a4f0 con 0x7f848815dea0 2024-05-09T05:59:29.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.934+0000 7f848d1e9640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8488074af0 0x7f8488164e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:29.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.934+0000 7f848d1e9640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8488074af0 0x7f8488164e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60224/0 (socket says 172.21.15.72:60224) 2024-05-09T05:59:29.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.934+0000 7f848d1e9640 1 -- 172.21.15.72:0/3102278069 learned_addr learned my addr 172.21.15.72:0/3102278069 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:59:29.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.938+0000 7f8487fff640 1 --2- 172.21.15.72:0/3102278069 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f848815dea0 0x7f84880745b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:29.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.938+0000 7f848d1e9640 1 -- 172.21.15.72:0/3102278069 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f848815dea0 msgr2=0x7f84880745b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:59:29.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.938+0000 7f848d1e9640 1 --2- 172.21.15.72:0/3102278069 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f848815dea0 0x7f84880745b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:29.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.938+0000 7f848d1e9640 1 -- 172.21.15.72:0/3102278069 >> v1:172.21.15.110:6789/0 conn(0x7f848815da90 legacy=0x7f84880c7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:59:29.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.938+0000 7f848d1e9640 1 -- 172.21.15.72:0/3102278069 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84880c84f0 con 0x7f8488074af0 2024-05-09T05:59:29.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.938+0000 7f8487fff640 1 --2- 172.21.15.72:0/3102278069 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f848815dea0 0x7f84880745b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:59:29.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.938+0000 7f848d1e9640 1 --2- 172.21.15.72:0/3102278069 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8488074af0 0x7f8488164e70 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f8480009e50 tx=0x7f848001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=188dd3dbac692c6f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:59:29.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.938+0000 7f84877fe640 1 -- 172.21.15.72:0/3102278069 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84800a5670 con 0x7f8488074af0 2024-05-09T05:59:29.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.938+0000 7f84877fe640 1 -- 172.21.15.72:0/3102278069 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f84800a5810 con 0x7f8488074af0 2024-05-09T05:59:29.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.938+0000 7f84877fe640 1 -- 172.21.15.72:0/3102278069 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84800a5c00 con 0x7f8488074af0 2024-05-09T05:59:29.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.938+0000 7f848ec4c640 1 -- 172.21.15.72:0/3102278069 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8488074af0 msgr2=0x7f8488164e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:59:29.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.938+0000 7f848ec4c640 1 --2- 172.21.15.72:0/3102278069 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8488074af0 0x7f8488164e70 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f8480009e50 tx=0x7f848001ca30 comp rx=0 tx=0).stop 2024-05-09T05:59:29.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.938+0000 7f848ec4c640 1 -- 172.21.15.72:0/3102278069 shutdown_connections 2024-05-09T05:59:29.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.938+0000 7f848ec4c640 1 --2- 172.21.15.72:0/3102278069 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8488074af0 0x7f8488164e70 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:29.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.938+0000 7f848ec4c640 1 --2- 172.21.15.72:0/3102278069 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f848815dea0 0x7f84880745b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:29.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.938+0000 7f848ec4c640 1 -- 172.21.15.72:0/3102278069 >> 172.21.15.72:0/3102278069 conn(0x7f84880cde90 msgr2=0x7f84880ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:59:29.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.938+0000 7f848ec4c640 1 -- 172.21.15.72:0/3102278069 shutdown_connections 2024-05-09T05:59:29.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.938+0000 7f848ec4c640 1 -- 172.21.15.72:0/3102278069 wait complete. 2024-05-09T05:59:29.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.942+0000 7f848ec4c640 1 Processor -- start 2024-05-09T05:59:29.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.942+0000 7f848ec4c640 1 -- start start 2024-05-09T05:59:29.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.942+0000 7f848ec4c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8488074af0 0x7f84881f5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:29.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.942+0000 7f848ec4c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f848815da90 0x7f84880c9f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:29.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.942+0000 7f848ec4c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f848815dea0 0x7f848814de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:29.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.942+0000 7f848ec4c640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f84880c70e0 con 0x7f8488074af0 2024-05-09T05:59:29.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.942+0000 7f848ec4c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f848815ad70 con 0x7f848815dea0 2024-05-09T05:59:29.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.942+0000 7f848ec4c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f84880c81b0 con 0x7f848815da90 2024-05-09T05:59:29.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.942+0000 7f848c9e8640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8488074af0 0x7f84881f5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:29.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.942+0000 7f848c9e8640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8488074af0 0x7f84881f5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60230/0 (socket says 172.21.15.72:60230) 2024-05-09T05:59:29.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.942+0000 7f848c9e8640 1 -- 172.21.15.72:0/1285300233 learned_addr learned my addr 172.21.15.72:0/1285300233 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-09T05:59:29.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.942+0000 7f848d1e9640 1 --2- 172.21.15.72:0/1285300233 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f848815dea0 0x7f848814de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:29.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.942+0000 7f8487fff640 1 --2- 172.21.15.72:0/1285300233 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f848815da90 0x7f84880c9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:29.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.942+0000 7f848c9e8640 1 -- 172.21.15.72:0/1285300233 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f848815da90 msgr2=0x7f84880c9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:59:29.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.942+0000 7f848c9e8640 1 --2- 172.21.15.72:0/1285300233 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f848815da90 0x7f84880c9f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:29.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.942+0000 7f848c9e8640 1 -- 172.21.15.72:0/1285300233 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f848815dea0 msgr2=0x7f848814de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:59:29.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.942+0000 7f848c9e8640 1 --2- 172.21.15.72:0/1285300233 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f848815dea0 0x7f848814de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:29.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.942+0000 7f848c9e8640 1 -- 172.21.15.72:0/1285300233 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84881f55d0 con 0x7f8488074af0 2024-05-09T05:59:29.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.942+0000 7f8487fff640 1 --2- 172.21.15.72:0/1285300233 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f848815da90 0x7f84880c9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:59:29.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.942+0000 7f848c9e8640 1 --2- 172.21.15.72:0/1285300233 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8488074af0 0x7f84881f5090 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f847800b3e0 tx=0x7f847800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:59:29.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.942+0000 7f84857fa640 1 -- 172.21.15.72:0/1285300233 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8478015020 con 0x7f8488074af0 2024-05-09T05:59:29.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.942+0000 7f84857fa640 1 -- 172.21.15.72:0/1285300233 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8478011830 con 0x7f8488074af0 2024-05-09T05:59:29.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.942+0000 7f848ec4c640 1 -- 172.21.15.72:0/1285300233 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84880ccbf0 con 0x7f8488074af0 2024-05-09T05:59:29.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.942+0000 7f84857fa640 1 -- 172.21.15.72:0/1285300233 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8478011c80 con 0x7f8488074af0 2024-05-09T05:59:29.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.946+0000 7f848ec4c640 1 -- 172.21.15.72:0/1285300233 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84880cd190 con 0x7f8488074af0 2024-05-09T05:59:29.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.946+0000 7f848ec4c640 1 -- 172.21.15.72:0/1285300233 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f848806a520 con 0x7f8488074af0 2024-05-09T05:59:29.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.946+0000 7f84857fa640 1 -- 172.21.15.72:0/1285300233 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f8478018020 con 0x7f8488074af0 2024-05-09T05:59:29.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.946+0000 7f84857fa640 1 --2- 172.21.15.72:0/1285300233 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f847406f400 0x7f8474071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:59:29.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.946+0000 7f84857fa640 1 -- 172.21.15.72:0/1285300233 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6311+0+0 (secure 0 0 0) 0x7f847808f500 con 0x7f8488074af0 2024-05-09T05:59:29.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.946+0000 7f8487fff640 1 --2- 172.21.15.72:0/1285300233 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f847406f400 0x7f8474071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:59:29.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.946+0000 7f8487fff640 1 --2- 172.21.15.72:0/1285300233 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f847406f400 0x7f8474071910 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8488157920 tx=0x7f847c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:59:29.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:29.954+0000 7f84857fa640 1 -- 172.21.15.72:0/1285300233 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f847801f020 con 0x7f8488074af0 2024-05-09T05:59:30.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:30.122+0000 7f848ec4c640 1 -- 172.21.15.72:0/1285300233 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f84880c8b30 con 0x7f8488074af0 2024-05-09T05:59:30.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:30.750+0000 7f84857fa640 1 -- 172.21.15.72:0/1285300233 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v33) ==== 178+0+0 (secure 0 0 0) 0x7f8478011e20 con 0x7f8488074af0 2024-05-09T05:59:30.733 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_data_ec' removed 2024-05-09T05:59:30.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:30.758+0000 7f848ec4c640 1 -- 172.21.15.72:0/1285300233 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f847406f400 msgr2=0x7f8474071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:59:30.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:30.758+0000 7f848ec4c640 1 --2- 172.21.15.72:0/1285300233 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f847406f400 0x7f8474071910 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8488157920 tx=0x7f847c008040 comp rx=0 tx=0).stop 2024-05-09T05:59:30.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:30.758+0000 7f848ec4c640 1 -- 172.21.15.72:0/1285300233 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8488074af0 msgr2=0x7f84881f5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:59:30.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:30.758+0000 7f848ec4c640 1 --2- 172.21.15.72:0/1285300233 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8488074af0 0x7f84881f5090 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f847800b3e0 tx=0x7f847800b8a0 comp rx=0 tx=0).stop 2024-05-09T05:59:30.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:30.758+0000 7f848ec4c640 1 -- 172.21.15.72:0/1285300233 shutdown_connections 2024-05-09T05:59:30.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:30.758+0000 7f848ec4c640 1 --2- 172.21.15.72:0/1285300233 >> [v2:172.21.15.110:6832/1113420672,v1:172.21.15.110:6833/1113420672] conn(0x7f847406f400 0x7f8474071910 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:30.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:30.758+0000 7f848ec4c640 1 --2- 172.21.15.72:0/1285300233 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f848815dea0 0x7f848814de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:30.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:30.758+0000 7f848ec4c640 1 --2- 172.21.15.72:0/1285300233 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f848815da90 0x7f84880c9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:30.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:30.758+0000 7f848ec4c640 1 --2- 172.21.15.72:0/1285300233 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8488074af0 0x7f84881f5090 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:59:30.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:30.758+0000 7f848ec4c640 1 -- 172.21.15.72:0/1285300233 >> 172.21.15.72:0/1285300233 conn(0x7f84880cde90 msgr2=0x7f848815e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:59:30.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:30.766+0000 7f848ec4c640 1 -- 172.21.15.72:0/1285300233 shutdown_connections 2024-05-09T05:59:30.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-09T05:59:30.770+0000 7f848ec4c640 1 -- 172.21.15.72:0/1285300233 wait complete. 2024-05-09T05:59:30.794 INFO:teuthology.misc:Shutting down mds daemons... 2024-05-09T05:59:30.794 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-09T05:59:30.794 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T05:59:30.807 INFO:tasks.ceph.mds.a:Stopped 2024-05-09T05:59:30.807 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-09T05:59:30.807 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T05:59:30.863 INFO:tasks.ceph.mds.c:Stopped 2024-05-09T05:59:30.863 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-05-09T05:59:30.863 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T05:59:30.917 INFO:tasks.ceph.mds.e:Stopped 2024-05-09T05:59:30.917 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-09T05:59:30.917 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T05:59:30.931 INFO:tasks.ceph.mds.b:Stopped 2024-05-09T05:59:30.931 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-09T05:59:30.931 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T05:59:30.986 INFO:tasks.ceph.mds.d:Stopped 2024-05-09T05:59:30.986 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-05-09T05:59:30.986 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T05:59:31.044 INFO:tasks.ceph.mds.f:Stopped 2024-05-09T05:59:31.044 INFO:teuthology.misc:Shutting down osd daemons... 2024-05-09T05:59:31.044 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-05-09T05:59:31.044 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T05:59:31.141 INFO:tasks.ceph.osd.0:Stopped 2024-05-09T05:59:31.141 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-05-09T05:59:31.141 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T05:59:31.238 INFO:tasks.ceph.osd.1:Stopped 2024-05-09T05:59:31.238 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-05-09T05:59:31.238 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T05:59:31.246 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2024-05-09T05:59:31.246 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~0s 2024-05-09T05:59:31.246 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-05-09T05:59:31.246 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-05-09T05:59:31.246 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~0s 2024-05-09T05:59:37.255 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-05-09T05:59:37.255 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2024-05-09T05:59:37.255 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e has been restored 2024-05-09T05:59:37.255 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-05-09T05:59:37.255 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-05-09T05:59:37.255 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f has been restored 2024-05-09T05:59:37.339 INFO:tasks.ceph.osd.2:Stopped 2024-05-09T05:59:37.340 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-05-09T05:59:37.340 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T05:59:37.435 INFO:tasks.ceph.osd.3:Stopped 2024-05-09T05:59:37.435 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-05-09T05:59:37.436 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T05:59:43.061 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-05-09T05:59:43.062 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-05-09T05:59:43.537 INFO:tasks.ceph.osd.4:Stopped 2024-05-09T05:59:43.537 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-05-09T05:59:43.537 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T05:59:43.612 INFO:tasks.ceph.osd.5:Stopped 2024-05-09T05:59:43.612 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-05-09T05:59:43.612 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T05:59:48.667 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-05-09T05:59:48.667 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-05-09T05:59:49.713 INFO:tasks.ceph.osd.6:Stopped 2024-05-09T05:59:49.714 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-05-09T05:59:49.714 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T05:59:49.783 INFO:tasks.ceph.osd.7:Stopped 2024-05-09T05:59:49.784 INFO:teuthology.misc:Shutting down mgr daemons... 2024-05-09T05:59:49.784 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-05-09T05:59:49.784 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T05:59:49.813 INFO:tasks.ceph.mgr.y:Stopped 2024-05-09T05:59:49.813 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-05-09T05:59:49.813 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T05:59:49.844 INFO:tasks.ceph.mgr.x:Stopped 2024-05-09T05:59:49.844 INFO:teuthology.misc:Shutting down mon daemons... 2024-05-09T05:59:49.844 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-05-09T05:59:49.844 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T05:59:49.878 INFO:tasks.ceph.mon.a:Stopped 2024-05-09T05:59:49.878 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-05-09T05:59:49.878 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T05:59:49.910 INFO:tasks.ceph.mon.b:Stopped 2024-05-09T05:59:49.911 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-05-09T05:59:49.911 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T05:59:49.975 INFO:tasks.ceph.mon.c:Stopped 2024-05-09T05:59:49.975 INFO:tasks.ceph:Checking cluster log for badness... 2024-05-09T05:59:49.976 DEBUG:teuthology.orchestra.run.smithi072:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v 'Replacing daemon mds' | head -n 1 2024-05-09T05:59:50.002 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi072.front.sepia.ceph.com 2024-05-09T05:59:50.002 DEBUG:teuthology.orchestra.run.smithi072:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-05-09T05:59:50.274 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi072.front.sepia.ceph.com 2024-05-09T05:59:50.275 DEBUG:teuthology.orchestra.run.smithi072:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-05-09T05:59:50.518 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi072.front.sepia.ceph.com 2024-05-09T05:59:50.518 DEBUG:teuthology.orchestra.run.smithi072:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-05-09T05:59:50.735 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi072.front.sepia.ceph.com 2024-05-09T05:59:50.735 DEBUG:teuthology.orchestra.run.smithi072:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-05-09T05:59:50.987 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi110.front.sepia.ceph.com 2024-05-09T05:59:50.987 DEBUG:teuthology.orchestra.run.smithi110:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-05-09T05:59:51.312 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi110.front.sepia.ceph.com 2024-05-09T05:59:51.312 DEBUG:teuthology.orchestra.run.smithi110:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-05-09T05:59:51.533 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi110.front.sepia.ceph.com 2024-05-09T05:59:51.533 DEBUG:teuthology.orchestra.run.smithi110:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-05-09T05:59:51.723 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi110.front.sepia.ceph.com 2024-05-09T05:59:51.724 DEBUG:teuthology.orchestra.run.smithi110:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-05-09T05:59:51.906 INFO:tasks.ceph:Archiving mon data... 2024-05-09T05:59:51.915 DEBUG:teuthology.misc:Transferring archived files from smithi072:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7699143/data/mon.a.tgz 2024-05-09T05:59:51.915 DEBUG:teuthology.orchestra.run.smithi072:> mktemp 2024-05-09T05:59:51.922 INFO:teuthology.orchestra.run.smithi072.stdout:/tmp/tmp.VKjNEBWjRx 2024-05-09T05:59:51.923 DEBUG:teuthology.orchestra.run.smithi072:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.VKjNEBWjRx 2024-05-09T05:59:52.065 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 0666 /tmp/tmp.VKjNEBWjRx 2024-05-09T05:59:52.131 DEBUG:teuthology.orchestra.remote:smithi072:/tmp/tmp.VKjNEBWjRx is 385KB 2024-05-09T05:59:52.199 DEBUG:teuthology.orchestra.run.smithi072:> rm -fr /tmp/tmp.VKjNEBWjRx 2024-05-09T05:59:52.205 DEBUG:teuthology.misc:Transferring archived files from smithi110:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7699143/data/mon.b.tgz 2024-05-09T05:59:52.205 DEBUG:teuthology.orchestra.run.smithi110:> mktemp 2024-05-09T05:59:52.212 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/tmp.A77Jl2fPuu 2024-05-09T05:59:52.213 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.A77Jl2fPuu 2024-05-09T05:59:52.377 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0666 /tmp/tmp.A77Jl2fPuu 2024-05-09T05:59:52.436 DEBUG:teuthology.orchestra.remote:smithi110:/tmp/tmp.A77Jl2fPuu is 508KB 2024-05-09T05:59:52.499 DEBUG:teuthology.orchestra.run.smithi110:> rm -fr /tmp/tmp.A77Jl2fPuu 2024-05-09T05:59:52.504 DEBUG:teuthology.misc:Transferring archived files from smithi110:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7699143/data/mon.c.tgz 2024-05-09T05:59:52.504 DEBUG:teuthology.orchestra.run.smithi110:> mktemp 2024-05-09T05:59:52.553 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/tmp.dJUWorbYWS 2024-05-09T05:59:52.553 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.dJUWorbYWS 2024-05-09T05:59:52.717 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0666 /tmp/tmp.dJUWorbYWS 2024-05-09T05:59:52.779 DEBUG:teuthology.orchestra.remote:smithi110:/tmp/tmp.dJUWorbYWS is 508KB 2024-05-09T05:59:52.847 DEBUG:teuthology.orchestra.run.smithi110:> rm -fr /tmp/tmp.dJUWorbYWS 2024-05-09T05:59:52.852 INFO:tasks.ceph:Cleaning ceph cluster... 2024-05-09T05:59:52.852 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-09T05:59:52.855 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-09T05:59:52.913 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-09T05:59:52.952 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-09T05:59:52.953 INFO:tasks.ceph:Archiving crash dumps... 2024-05-09T05:59:52.955 DEBUG:teuthology.misc:Transferring archived files from smithi072:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7699143/remote/smithi072/crash 2024-05-09T05:59:52.955 DEBUG:teuthology.orchestra.run.smithi072:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-09T05:59:52.970 DEBUG:teuthology.misc:Transferring archived files from smithi110:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7699143/remote/smithi110/crash 2024-05-09T05:59:52.971 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-09T05:59:53.008 INFO:tasks.ceph:Shutting down logrotate 2024-05-09T05:59:53.008 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T05:59:53.018 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T05:59:53.092 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-09T05:59:53.105 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-09T05:59:53.144 INFO:tasks.ceph:Compressing logs... 2024-05-09T05:59:53.145 DEBUG:teuthology.orchestra.run.smithi072:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-09T05:59:53.150 DEBUG:teuthology.orchestra.run.smithi110:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-09T05:59:53.168 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27627.log 2024-05-09T05:59:53.168 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35982.log 2024-05-09T05:59:53.169 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.27627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37268.log 2024-05-09T05:59:53.169 INFO:teuthology.orchestra.run.smithi072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.27627.log.gz 2024-05-09T05:59:53.169 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.35982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33538.log 2024-05-09T05:59:53.170 INFO:teuthology.orchestra.run.smithi072.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35982.log.gz 2024-05-09T05:59:53.170 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36658.log 2024-05-09T05:59:53.170 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.37268.log: gzip/var/log/ceph/ceph-client.admin.33538.log: -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-05-09T05:59:53.172 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.36658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34139.log 2024-05-09T05:59:53.172 INFO:teuthology.orchestra.run.smithi072.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.33538.log.gz 2024-05-09T05:59:53.172 INFO:teuthology.orchestra.run.smithi072.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36658.log.gz 2024-05-09T05:59:53.172 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36124.log 2024-05-09T05:59:53.172 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37268.log.gz 2024-05-09T05:59:53.172 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.34139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35181.log 2024-05-09T05:59:53.172 INFO:teuthology.orchestra.run.smithi072.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.34139.log.gz 2024-05-09T05:59:53.172 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.36124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34348.log 2024-05-09T05:59:53.172 INFO:teuthology.orchestra.run.smithi072.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36124.log.gz 2024-05-09T05:59:53.173 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34832.log 2024-05-09T05:59:53.176 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.35181.log: /var/log/ceph/ceph-client.admin.34348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36234.log 2024-05-09T05:59:53.176 INFO:teuthology.orchestra.run.smithi072.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34348.log.gz 2024-05-09T05:59:53.176 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.34832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35599.log 2024-05-09T05:59:53.176 INFO:teuthology.orchestra.run.smithi072.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.35181.log.gz 2024-05-09T05:59:53.176 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34832.log.gz 2024-05-09T05:59:53.177 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.36234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36941.log 2024-05-09T05:59:53.177 INFO:teuthology.orchestra.run.smithi072.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36234.log.gz 2024-05-09T05:59:53.177 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.35599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36605.log 2024-05-09T05:59:53.177 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.36941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37372.log 2024-05-09T05:59:53.177 INFO:teuthology.orchestra.run.smithi072.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35599.log.gz 2024-05-09T05:59:53.177 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.36605.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36941.log.gz 2024-05-09T05:59:53.177 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-05-09T05:59:53.177 INFO:teuthology.orchestra.run.smithi072.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.36605.log.gz 2024-05-09T05:59:53.177 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33278.log/var/log/ceph/ceph-client.admin.37372.log: 2024-05-09T05:59:53.177 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose --/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.33859.log 2024-05-09T05:59:53.177 INFO:teuthology.orchestra.run.smithi072.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37372.log.gz 2024-05-09T05:59:53.177 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.33278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27736.log 2024-05-09T05:59:53.177 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33278.log.gz 2024-05-09T05:59:53.177 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.33859.log: 94.0% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-05-09T05:59:53.177 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33168.log 2024-05-09T05:59:53.178 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.27736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36260.log 2024-05-09T05:59:53.178 INFO:teuthology.orchestra.run.smithi072.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33859.log.gz 2024-05-09T05:59:53.183 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.33168.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.27736.log.gz 2024-05-09T05:59:53.183 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37398.log 2024-05-09T05:59:53.183 INFO:teuthology.orchestra.run.smithi072.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.33168.log.gz 2024-05-09T05:59:53.184 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35729.log 2024-05-09T05:59:53.184 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.36260.log: /var/log/ceph/ceph-client.admin.37398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33358.log 2024-05-09T05:59:53.184 INFO:teuthology.orchestra.run.smithi072.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36260.log.gz 2024-05-09T05:59:53.184 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.35729.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37398.log.gz 2024-05-09T05:59:53.184 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36286.log 2024-05-09T05:59:53.184 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35729.log.gz 2024-05-09T05:59:53.184 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.33358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34350.log 2024-05-09T05:59:53.184 INFO:teuthology.orchestra.run.smithi072.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33358.log.gz 2024-05-09T05:59:53.184 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.36286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36042.log 2024-05-09T05:59:53.184 INFO:teuthology.orchestra.run.smithi072.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.36286.log.gz 2024-05-09T05:59:53.184 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37815.log 2024-05-09T05:59:53.184 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.34350.log: /var/log/ceph/ceph-client.admin.36042.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34350.log.gz 2024-05-09T05:59:53.184 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33488.log 2024-05-09T05:59:53.184 INFO:teuthology.orchestra.run.smithi072.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36042.log.gz 2024-05-09T05:59:53.185 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.37815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33989.log 2024-05-09T05:59:53.185 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.33488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37712.log 2024-05-09T05:59:53.185 INFO:teuthology.orchestra.run.smithi072.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37815.log.gz 2024-05-09T05:59:53.185 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.33989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37739.log 2024-05-09T05:59:53.185 INFO:teuthology.orchestra.run.smithi072.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33989.log.gz 2024-05-09T05:59:53.185 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.37712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37242.log 2024-05-09T05:59:53.185 INFO:teuthology.orchestra.run.smithi072.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.33488.log.gz 2024-05-09T05:59:53.185 INFO:teuthology.orchestra.run.smithi072.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37712.log.gz 2024-05-09T05:59:53.185 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.37739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38011.log 2024-05-09T05:59:53.185 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.37242.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-05-09T05:59:53.185 INFO:teuthology.orchestra.run.smithi072.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37739.log.gz 2024-05-09T05:59:53.185 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.38011.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37242.log.gz 2024-05-09T05:59:53.185 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34355.log 2024-05-09T05:59:53.185 INFO:teuthology.orchestra.run.smithi072.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38011.log.gz 2024-05-09T05:59:53.186 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36861.log 2024-05-09T05:59:53.186 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.34355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36016.log 2024-05-09T05:59:53.186 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.36861.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34355.log.gz 2024-05-09T05:59:53.186 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-05-09T05:59:53.186 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36861.log.gz 2024-05-09T05:59:53.186 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.36016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33332.log 2024-05-09T05:59:53.193 INFO:teuthology.orchestra.run.smithi072.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36016.log.gz 2024-05-09T05:59:53.193 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33250.log 2024-05-09T05:59:53.193 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.33332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36776.log 2024-05-09T05:59:53.193 INFO:teuthology.orchestra.run.smithi072.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33332.log.gz 2024-05-09T05:59:53.193 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.33250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34973.log 2024-05-09T05:59:53.193 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37658.log 2024-05-09T05:59:53.193 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.36776.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33250.log.gz 2024-05-09T05:59:53.193 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.34973.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.36776.log.gz 2024-05-09T05:59:53.193 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36746.log 2024-05-09T05:59:53.193 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33196.log 2024-05-09T05:59:53.193 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.37658.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34973.log.gz 2024-05-09T05:59:53.193 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.36746.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37658.log.gz 2024-05-09T05:59:53.193 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37632.log 2024-05-09T05:59:53.194 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.33196.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36746.log.gz 2024-05-09T05:59:53.194 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37554.log 2024-05-09T05:59:53.194 INFO:teuthology.orchestra.run.smithi072.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33196.log.gz 2024-05-09T05:59:53.194 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.37632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36208.log 2024-05-09T05:59:53.194 INFO:teuthology.orchestra.run.smithi072.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37632.log.gz 2024-05-09T05:59:53.194 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34947.log 2024-05-09T05:59:53.194 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.37554.log: /var/log/ceph/ceph-client.admin.36208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37893.log 2024-05-09T05:59:53.194 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.34947.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37554.log.gz 2024-05-09T05:59:53.194 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37095.log 2024-05-09T05:59:53.194 INFO:teuthology.orchestra.run.smithi072.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36208.log.gz 2024-05-09T05:59:53.194 INFO:teuthology.orchestra.run.smithi072.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34947.log.gz 2024-05-09T05:59:53.194 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.37893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37048.log 2024-05-09T05:59:53.194 INFO:teuthology.orchestra.run.smithi072.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37893.log.gz 2024-05-09T05:59:53.194 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34015.log 2024-05-09T05:59:53.195 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.37095.log: /var/log/ceph/ceph-client.admin.37048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35755.log 2024-05-09T05:59:53.195 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37095.log.gz 2024-05-09T05:59:53.195 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.34015.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37048.log.gz 2024-05-09T05:59:53.195 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37528.log 2024-05-09T05:59:53.195 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34015.log.gz 2024-05-09T05:59:53.195 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33384.log 2024-05-09T05:59:53.195 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.35755.log: /var/log/ceph/ceph-client.admin.37528.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35755.log.gz 2024-05-09T05:59:53.195 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36970.log 2024-05-09T05:59:53.195 INFO:teuthology.orchestra.run.smithi072.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37528.log.gz 2024-05-09T05:59:53.195 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34041.log 2024-05-09T05:59:53.195 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.33384.log: /var/log/ceph/ceph-client.admin.36970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35025.log 2024-05-09T05:59:53.195 INFO:teuthology.orchestra.run.smithi072.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36970.log.gz 2024-05-09T05:59:53.195 INFO:teuthology.orchestra.run.smithi072.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.33384.log.gz 2024-05-09T05:59:53.195 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.34041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33807.log 2024-05-09T05:59:53.195 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37476.log 2024-05-09T05:59:53.196 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.35025.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34041.log.gz 2024-05-09T05:59:53.196 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.33807.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35025.log.gz 2024-05-09T05:59:53.196 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35078.log 2024-05-09T05:59:53.196 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.37476.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.33807.log.gz 2024-05-09T05:59:53.196 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34568.log 2024-05-09T05:59:53.196 INFO:teuthology.orchestra.run.smithi072.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37476.log.gz 2024-05-09T05:59:53.206 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.35078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34569.log 2024-05-09T05:59:53.206 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27846.log 2024-05-09T05:59:53.206 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.34568.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.35078.log.gz 2024-05-09T05:59:53.207 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.34569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37580.log 2024-05-09T05:59:53.207 INFO:teuthology.orchestra.run.smithi072.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34568.log.gz 2024-05-09T05:59:53.207 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-05-09T05:59:53.207 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.27846.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34569.log.gz 2024-05-09T05:59:53.207 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.37580.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.27846.log.gz 2024-05-09T05:59:53.207 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34566.log 2024-05-09T05:59:53.207 INFO:teuthology.orchestra.run.smithi072.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37580.log.gz 2024-05-09T05:59:53.207 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34999.log 2024-05-09T05:59:53.207 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-osd.3.log: /var/log/ceph/ceph-client.admin.34566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34572.log 2024-05-09T05:59:53.207 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.34999.log: gzip 88.2% -5 -- replaced with /var/log/ceph/ceph-client.admin.34566.log.gz --verbose 2024-05-09T05:59:53.207 INFO:teuthology.orchestra.run.smithi072.stderr: -- /var/log/ceph/ceph-client.admin.36631.log 2024-05-09T05:59:53.207 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.34572.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34999.log.gz 2024-05-09T05:59:53.207 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35848.log 2024-05-09T05:59:53.208 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34572.log.gz/var/log/ceph/ceph-client.admin.36631.log: 2024-05-09T05:59:53.208 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37606.log 2024-05-09T05:59:53.208 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36631.log.gz 2024-05-09T05:59:53.208 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.35848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34895.log 2024-05-09T05:59:53.208 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35573.log 2024-05-09T05:59:53.208 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.37606.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.35848.log.gz 2024-05-09T05:59:53.208 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.34895.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37606.log.gz 2024-05-09T05:59:53.208 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35521.log 2024-05-09T05:59:53.208 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33462.log 2024-05-09T05:59:53.208 INFO:teuthology.orchestra.run.smithi072.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34895.log.gz 2024-05-09T05:59:53.208 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.35573.log: /var/log/ceph/ceph-client.admin.35521.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-05-09T05:59:53.208 INFO:teuthology.orchestra.run.smithi072.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35573.log.gz 2024-05-09T05:59:53.208 INFO:teuthology.orchestra.run.smithi072.stderr: 89.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35281.log 2024-05-09T05:59:53.208 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35521.log.gz/var/log/ceph/ceph-client.admin.33462.log: 2024-05-09T05:59:53.208 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37985.log 2024-05-09T05:59:53.209 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33462.log.gz 2024-05-09T05:59:53.209 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.35281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33436.log 2024-05-09T05:59:53.209 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35052.log 2024-05-09T05:59:53.209 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.37985.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.35281.log.gz/var/log/ceph/ceph-client.admin.33436.log: 2024-05-09T05:59:53.209 INFO:teuthology.orchestra.run.smithi072.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37985.log.gz 2024-05-09T05:59:53.209 INFO:teuthology.orchestra.run.smithi072.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33436.log.gz 2024-05-09T05:59:53.209 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34805.log 2024-05-09T05:59:53.209 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.35052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33142.log 2024-05-09T05:59:53.209 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3%/var/log/ceph/ceph-client.admin.34805.log: -- replaced with /var/log/ceph/ceph-client.admin.35052.log.gz 2024-05-09T05:59:53.209 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33306.log 2024-05-09T05:59:53.209 INFO:teuthology.orchestra.run.smithi072.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34805.log.gz 2024-05-09T05:59:53.209 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.33142.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.33142.log.gz 2024-05-09T05:59:53.209 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36364.log 2024-05-09T05:59:53.209 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.33306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34067.log 2024-05-09T05:59:53.210 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3%/var/log/ceph/ceph-client.admin.36364.log: -- replaced with /var/log/ceph/ceph-client.admin.33306.log.gz 2024-05-09T05:59:53.210 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34354.log 2024-05-09T05:59:53.210 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36364.log.gz 2024-05-09T05:59:53.210 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.34067.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34067.log.gz 2024-05-09T05:59:53.210 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33885.log 2024-05-09T05:59:53.210 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.34354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36098.log 2024-05-09T05:59:53.210 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4%/var/log/ceph/ceph-client.admin.33885.log: -- replaced with /var/log/ceph/ceph-client.admin.34354.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34352.log 2024-05-09T05:59:53.210 INFO:teuthology.orchestra.run.smithi072.stderr: 2024-05-09T05:59:53.210 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33885.log.gz 2024-05-09T05:59:53.210 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.36098.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36098.log.gz 2024-05-09T05:59:53.210 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35625.log 2024-05-09T05:59:53.210 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.34352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36524.log 2024-05-09T05:59:53.214 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1%/var/log/ceph/ceph-client.admin.35625.log: -- replaced with /var/log/ceph/ceph-client.admin.34352.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36182.log 2024-05-09T05:59:53.214 INFO:teuthology.orchestra.run.smithi072.stderr: 2024-05-09T05:59:53.215 INFO:teuthology.orchestra.run.smithi072.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35625.log.gz 2024-05-09T05:59:53.215 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.36524.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36524.log.gz 2024-05-09T05:59:53.215 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37763.log 2024-05-09T05:59:53.215 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.36182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34545.log 2024-05-09T05:59:53.215 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.37763.log: gzip 88.7% -5 -- replaced with /var/log/ceph/ceph-client.admin.36182.log.gz 2024-05-09T05:59:53.215 INFO:teuthology.orchestra.run.smithi072.stderr: --verbose -- /var/log/ceph/ceph-client.admin.33666.log 2024-05-09T05:59:53.215 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37763.log.gz 2024-05-09T05:59:53.215 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.34545.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34545.log.gz 2024-05-09T05:59:53.215 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-09T05:59:53.215 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.33666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37424.log 2024-05-09T05:59:53.215 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35903.log 2024-05-09T05:59:53.215 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.37424.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37424.log.gz 2024-05-09T05:59:53.215 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37002.log 2024-05-09T05:59:53.215 INFO:teuthology.orchestra.run.smithi072.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.33666.log.gz 2024-05-09T05:59:53.216 INFO:teuthology.orchestra.run.smithi072.stderr: 86.0% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-09T05:59:53.216 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.35903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32994.log 2024-05-09T05:59:53.216 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35903.log.gz 2024-05-09T05:59:53.216 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.37002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35468.log 2024-05-09T05:59:53.216 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.32994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34131.log 2024-05-09T05:59:53.216 INFO:teuthology.orchestra.run.smithi072.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37002.log.gz 2024-05-09T05:59:53.216 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.35468.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32994.log.gz 2024-05-09T05:59:53.217 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37346.log 2024-05-09T05:59:53.218 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.34131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34353.log 2024-05-09T05:59:53.218 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.37346.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34131.log.gz 2024-05-09T05:59:53.218 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37346.log.gz 2024-05-09T05:59:53.220 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36472.log 2024-05-09T05:59:53.221 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.34353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37320.log 2024-05-09T05:59:53.222 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.36472.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34353.log.gz 2024-05-09T05:59:53.222 INFO:teuthology.orchestra.run.smithi072.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36472.log.gz 2024-05-09T05:59:53.222 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33781.log 2024-05-09T05:59:53.223 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.37320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35131.log 2024-05-09T05:59:53.235 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27856.log 2024-05-09T05:59:53.235 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27736.log 2024-05-09T05:59:53.235 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.27856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27904.log 2024-05-09T05:59:53.235 INFO:teuthology.orchestra.run.smithi110.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.27856.log.gz 2024-05-09T05:59:53.235 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.27736.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-05-09T05:59:53.235 INFO:teuthology.orchestra.run.smithi110.stderr: 87.9%/var/log/ceph/ceph-client.admin.27904.log: -- replaced with /var/log/ceph/ceph-client.admin.27736.log.gz 2024-05-09T05:59:53.236 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-05-09T05:59:53.236 INFO:teuthology.orchestra.run.smithi110.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.27904.log.gz 2024-05-09T05:59:53.236 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5/var/log/ceph/ceph-osd.7.log: --verbose -- /var/log/ceph/ceph-client.admin.27880.log 2024-05-09T05:59:53.236 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-05-09T05:59:53.236 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.27880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27832.log 2024-05-09T05:59:53.236 INFO:teuthology.orchestra.run.smithi110.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.27880.log.gz 2024-05-09T05:59:53.236 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27784.log 2024-05-09T05:59:53.236 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.27832.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-05-09T05:59:53.236 INFO:teuthology.orchestra.run.smithi110.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.27832.log.gz 2024-05-09T05:59:53.236 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.27784.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2024-05-09T05:59:53.236 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27760.log 2024-05-09T05:59:53.236 INFO:teuthology.orchestra.run.smithi110.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.27784.log.gz 2024-05-09T05:59:53.236 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-09T05:59:53.236 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.27760.log: gzip -5 --verbose -- 87.8% -- replaced with /var/log/ceph/ceph-client.admin.27760.log.gz 2024-05-09T05:59:53.237 INFO:teuthology.orchestra.run.smithi110.stderr: /var/log/ceph/ceph-client.admin.27808.log 2024-05-09T05:59:53.237 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-05-09T05:59:53.237 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.27808.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-09T05:59:53.237 INFO:teuthology.orchestra.run.smithi110.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.27808.log.gz 2024-05-09T05:59:53.237 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-05-09T05:59:53.237 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph.audit.log: 92.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-09T05:59:53.237 INFO:teuthology.orchestra.run.smithi110.stderr: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-09T05:59:53.237 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-05-09T05:59:53.237 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-05-09T05:59:53.240 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.33781.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37320.log.gz 2024-05-09T05:59:53.240 INFO:teuthology.orchestra.run.smithi072.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.33781.log.gz 2024-05-09T05:59:53.240 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34145.log 2024-05-09T05:59:53.240 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.35131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35651.log 2024-05-09T05:59:53.240 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.34145.log: 89.3% 90.9% -- replaced with /var/log/ceph/ceph-client.admin.34145.log.gz 2024-05-09T05:59:53.240 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35131.log.gz 2024-05-09T05:59:53.240 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33833.log 2024-05-09T05:59:53.240 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.35651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35231.log 2024-05-09T05:59:53.241 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2%/var/log/ceph/ceph-client.admin.33833.log: -- replaced with /var/log/ceph/ceph-client.admin.35651.log.gz 2024-05-09T05:59:53.241 INFO:teuthology.orchestra.run.smithi072.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33833.log.gz 2024-05-09T05:59:53.241 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33751.log 2024-05-09T05:59:53.241 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.35231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34573.log 2024-05-09T05:59:53.241 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.33751.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.35231.log.gz 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33751.log.gz 2024-05-09T05:59:53.241 INFO:teuthology.orchestra.run.smithi072.stderr: 2024-05-09T05:59:53.241 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36551.log 2024-05-09T05:59:53.241 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.34573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37867.log 2024-05-09T05:59:53.241 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.36551.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.34573.log.gz 2024-05-09T05:59:53.241 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36551.log.gz 2024-05-09T05:59:53.242 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35877.log 2024-05-09T05:59:53.242 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32937.log 2024-05-09T05:59:53.242 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.37867.log: /var/log/ceph/ceph-client.admin.35877.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37867.log.gz 2024-05-09T05:59:53.242 INFO:teuthology.orchestra.run.smithi072.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35877.log.gz 2024-05-09T05:59:53.242 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34571.log 2024-05-09T05:59:53.242 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.32937.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32937.log.gz 2024-05-09T05:59:53.242 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33911.log 2024-05-09T05:59:53.242 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34147.log 2024-05-09T05:59:53.242 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.34571.log: /var/log/ceph/ceph-client.admin.33911.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34571.log.gz 2024-05-09T05:59:53.242 INFO:teuthology.orchestra.run.smithi072.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33911.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34129.log 2024-05-09T05:59:53.242 INFO:teuthology.orchestra.run.smithi072.stderr: 2024-05-09T05:59:53.242 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.34147.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34147.log.gz 2024-05-09T05:59:53.242 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36498.log 2024-05-09T05:59:53.242 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35955.log 2024-05-09T05:59:53.243 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.34129.log: /var/log/ceph/ceph-client.admin.36498.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34129.log.gz 2024-05-09T05:59:53.243 INFO:teuthology.orchestra.run.smithi072.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36498.log.gz 2024-05-09T05:59:53.243 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33030.log 2024-05-09T05:59:53.243 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.35955.log: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-09T05:59:53.243 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35955.log.gz 2024-05-09T05:59:53.243 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.33030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35677.log 2024-05-09T05:59:53.243 INFO:teuthology.orchestra.run.smithi072.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.33030.log.gz 2024-05-09T05:59:53.243 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph.audit.log: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-09T05:59:53.243 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-05-09T05:59:53.243 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37122.log 2024-05-09T05:59:53.243 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.35677.log: /var/log/ceph/ceph-mds.c.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35677.log.gz 2024-05-09T05:59:53.245 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34093.log 2024-05-09T05:59:53.245 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.37122.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37122.log.gz 2024-05-09T05:59:53.245 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34570.log 2024-05-09T05:59:53.245 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.34093.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34093.log.gz 2024-05-09T05:59:53.245 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-05-09T05:59:53.245 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.34570.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34570.log.gz 2024-05-09T05:59:53.246 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37190.log 2024-05-09T05:59:53.248 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-05-09T05:59:53.265 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36315.log 2024-05-09T05:59:53.266 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.37190.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37190.log.gz 2024-05-09T05:59:53.271 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-osd.4.log: 92.3% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2024-05-09T05:59:53.273 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33224.log 2024-05-09T05:59:53.274 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.36315.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36315.log.gz 2024-05-09T05:59:53.274 INFO:teuthology.orchestra.run.smithi072.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-05-09T05:59:53.274 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37216.log 2024-05-09T05:59:53.275 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.33224.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.33224.log.gz 2024-05-09T05:59:53.275 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35547.log 2024-05-09T05:59:53.276 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.37216.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37216.log.gz 2024-05-09T05:59:53.277 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34142.log 2024-05-09T05:59:53.278 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.35547.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35547.log.gz 2024-05-09T05:59:53.278 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36068.log 2024-05-09T05:59:53.278 INFO:teuthology.orchestra.run.smithi072.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-05-09T05:59:53.279 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.34142.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34142.log.gz 2024-05-09T05:59:53.279 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36578.log 2024-05-09T05:59:53.280 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36888.log 2024-05-09T05:59:53.281 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.36068.log: /var/log/ceph/ceph-client.admin.36578.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36068.log.gz 2024-05-09T05:59:53.281 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36578.log.gz 2024-05-09T05:59:53.281 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37684.log 2024-05-09T05:59:53.281 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35929.log 2024-05-09T05:59:53.282 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.36888.log: /var/log/ceph/ceph-client.admin.37684.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36888.log.gz 2024-05-09T05:59:53.282 INFO:teuthology.orchestra.run.smithi072.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37684.log.gz 2024-05-09T05:59:53.282 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33937.log 2024-05-09T05:59:53.283 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.35929.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35929.log.gz 2024-05-09T05:59:53.283 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33724.log 2024-05-09T05:59:53.283 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35781.log 2024-05-09T05:59:53.284 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.33937.log: /var/log/ceph/ceph-client.admin.33724.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.33937.log.gz 2024-05-09T05:59:53.284 INFO:teuthology.orchestra.run.smithi072.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33724.log.gz 2024-05-09T05:59:53.284 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35343.log 2024-05-09T05:59:53.285 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37502.log 2024-05-09T05:59:53.285 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.35343.log: /var/log/ceph/ceph-client.admin.35781.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35781.log.gz 2024-05-09T05:59:53.285 INFO:teuthology.orchestra.run.smithi072.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.35343.log.gz 2024-05-09T05:59:53.286 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37294.log 2024-05-09T05:59:53.287 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36832.log 2024-05-09T05:59:53.287 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.37502.log: /var/log/ceph/ceph-client.admin.37294.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37502.log.gz 2024-05-09T05:59:53.287 INFO:teuthology.orchestra.run.smithi072.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37294.log.gz 2024-05-09T05:59:53.287 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35703.log 2024-05-09T05:59:53.288 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34339.log 2024-05-09T05:59:53.288 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.36832.log: /var/log/ceph/ceph-client.admin.35703.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36832.log.gz 2024-05-09T05:59:53.288 INFO:teuthology.orchestra.run.smithi072.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.35703.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34858.log 2024-05-09T05:59:53.288 INFO:teuthology.orchestra.run.smithi072.stderr: 2024-05-09T05:59:53.289 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.34339.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34339.log.gz 2024-05-09T05:59:53.289 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34779.log 2024-05-09T05:59:53.289 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36914.log 2024-05-09T05:59:53.290 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.34858.log: /var/log/ceph/ceph-client.admin.34779.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34858.log.gz 2024-05-09T05:59:53.290 INFO:teuthology.orchestra.run.smithi072.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34779.log.gz 2024-05-09T05:59:53.290 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34753.log 2024-05-09T05:59:53.291 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35822.log 2024-05-09T05:59:53.292 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.36914.log: /var/log/ceph/ceph-client.admin.34753.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36914.log.gz 2024-05-09T05:59:53.292 INFO:teuthology.orchestra.run.smithi072.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34753.log.gz 2024-05-09T05:59:53.292 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33116.log 2024-05-09T05:59:53.293 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36720.log 2024-05-09T05:59:53.293 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.35822.log: /var/log/ceph/ceph-client.admin.33116.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35822.log.gz 2024-05-09T05:59:53.293 INFO:teuthology.orchestra.run.smithi072.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33116.log.gz 2024-05-09T05:59:53.293 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37164.log 2024-05-09T05:59:53.294 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.22821.log 2024-05-09T05:59:53.294 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.36720.log: /var/log/ceph/ceph-client.admin.37164.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36720.log.gz 2024-05-09T05:59:53.294 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37164.log.gz 2024-05-09T05:59:53.294 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37789.log 2024-05-09T05:59:53.295 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34146.log 2024-05-09T05:59:53.296 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph.tmp-client.admin.22821.log: /var/log/ceph/ceph-client.admin.37789.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.22821.log.gz 2024-05-09T05:59:53.296 INFO:teuthology.orchestra.run.smithi072.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37789.log.gz 2024-05-09T05:59:53.296 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2024-05-09T05:59:53.296 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37450.log 2024-05-09T05:59:53.297 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.34146.log: /var/log/ceph/ceph-mds.e.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34146.log.gz 2024-05-09T05:59:53.297 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34921.log 2024-05-09T05:59:53.297 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.37450.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37450.log.gz 2024-05-09T05:59:53.298 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36804.log 2024-05-09T05:59:53.299 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.34921.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34921.log.gz 2024-05-09T05:59:53.299 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33963.log 2024-05-09T05:59:53.300 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.36804.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36804.log.gz 2024-05-09T05:59:53.300 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34345.log 2024-05-09T05:59:53.302 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.33963.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33963.log.gz 2024-05-09T05:59:53.302 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36694.log 2024-05-09T05:59:53.303 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.34345.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34345.log.gz 2024-05-09T05:59:53.303 INFO:teuthology.orchestra.run.smithi072.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2024-05-09T05:59:53.304 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34144.log 2024-05-09T05:59:53.304 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37841.log 2024-05-09T05:59:53.304 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.36694.log: /var/log/ceph/ceph-client.admin.34144.log: 87.8% 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36694.log.gz 2024-05-09T05:59:53.305 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34144.log.gz 2024-05-09T05:59:53.305 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36154.log 2024-05-09T05:59:53.305 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33410.log 2024-05-09T05:59:53.306 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.37841.log: /var/log/ceph/ceph-client.admin.36154.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37841.log.gz 2024-05-09T05:59:53.306 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36154.log.gz 2024-05-09T05:59:53.306 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37959.log 2024-05-09T05:59:53.307 INFO:teuthology.orchestra.run.smithi110.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-05-09T05:59:53.308 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.33410.log: /var/log/ceph/ceph-client.admin.37959.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33410.log.gz 2024-05-09T05:59:53.308 INFO:teuthology.orchestra.run.smithi072.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37959.log.gz 2024-05-09T05:59:53.312 INFO:teuthology.orchestra.run.smithi110.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-05-09T05:59:53.388 INFO:teuthology.orchestra.run.smithi110.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-05-09T05:59:53.402 INFO:teuthology.orchestra.run.smithi110.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-05-09T05:59:53.463 INFO:teuthology.orchestra.run.smithi110.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-05-09T05:59:53.607 INFO:teuthology.orchestra.run.smithi072.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-05-09T05:59:53.667 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-05-09T05:59:58.237 INFO:teuthology.orchestra.run.smithi072.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-05-09T06:00:00.121 INFO:teuthology.orchestra.run.smithi110.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-05-09T06:00:00.325 INFO:teuthology.orchestra.run.smithi110.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-05-09T06:00:00.624 INFO:teuthology.orchestra.run.smithi072.stderr: 96.9% -- replaced with /var/log/ceph/ceph-client.0.35468.log.gz 2024-05-09T06:00:00.808 INFO:teuthology.orchestra.run.smithi110.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-05-09T06:00:00.956 INFO:teuthology.orchestra.run.smithi072.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-05-09T06:00:01.187 INFO:teuthology.orchestra.run.smithi110.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-05-09T06:00:01.188 INFO:teuthology.orchestra.run.smithi110.stderr: 2024-05-09T06:00:01.188 INFO:teuthology.orchestra.run.smithi110.stderr:real 0m7.988s 2024-05-09T06:00:01.188 INFO:teuthology.orchestra.run.smithi110.stderr:user 0m29.244s 2024-05-09T06:00:01.188 INFO:teuthology.orchestra.run.smithi110.stderr:sys 0m0.977s 2024-05-09T06:00:01.426 INFO:teuthology.orchestra.run.smithi072.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-05-09T06:00:03.070 INFO:teuthology.orchestra.run.smithi072.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-05-09T06:00:03.071 INFO:teuthology.orchestra.run.smithi072.stderr: 2024-05-09T06:00:03.071 INFO:teuthology.orchestra.run.smithi072.stderr:real 0m9.919s 2024-05-09T06:00:03.071 INFO:teuthology.orchestra.run.smithi072.stderr:user 0m37.700s 2024-05-09T06:00:03.071 INFO:teuthology.orchestra.run.smithi072.stderr:sys 0m1.379s 2024-05-09T06:00:03.072 INFO:tasks.ceph:Archiving logs... 2024-05-09T06:00:03.072 DEBUG:teuthology.misc:Transferring archived files from smithi072:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7699143/remote/smithi072/log 2024-05-09T06:00:03.073 DEBUG:teuthology.orchestra.run.smithi072:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-09T06:00:07.607 DEBUG:teuthology.misc:Transferring archived files from smithi110:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7699143/remote/smithi110/log 2024-05-09T06:00:07.608 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-09T06:00:11.606 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-09T06:00:11.622 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-09T06:00:11.622 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-09T06:00:11.625 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-09T06:00:11.695 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-09T06:00:11.705 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-09T06:00:11.705 DEBUG:teuthology.orchestra.run.smithi072:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-09T06:00:11.709 DEBUG:teuthology.orchestra.run.smithi110:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-09T06:00:11.719 INFO:teuthology.orchestra.run.smithi072.stdout: remote refid st t when poll reach delay offset jitter 2024-05-09T06:00:11.719 INFO:teuthology.orchestra.run.smithi072.stdout:============================================================================== 2024-05-09T06:00:11.719 INFO:teuthology.orchestra.run.smithi072.stdout:+hv01.front.sepi 67.205.162.81 3 u 52 64 377 0.093 -5.622 2.104 2024-05-09T06:00:11.719 INFO:teuthology.orchestra.run.smithi072.stdout:+hv02.front.sepi 63.231.80.2 3 u 47 64 377 0.071 -1.188 1.927 2024-05-09T06:00:11.720 INFO:teuthology.orchestra.run.smithi072.stdout:*hv03.front.sepi 74.6.168.72 3 u 46 64 377 0.081 -2.398 2.624 2024-05-09T06:00:11.720 INFO:teuthology.orchestra.run.smithi072.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 +0.000 0.000 2024-05-09T06:00:11.723 INFO:teuthology.orchestra.run.smithi110.stdout: remote refid st t when poll reach delay offset jitter 2024-05-09T06:00:11.723 INFO:teuthology.orchestra.run.smithi110.stdout:============================================================================== 2024-05-09T06:00:11.723 INFO:teuthology.orchestra.run.smithi110.stdout:+hv01.front.sepi 67.205.162.81 3 u 46 64 377 0.074 -2.675 1.654 2024-05-09T06:00:11.723 INFO:teuthology.orchestra.run.smithi110.stdout:+hv02.front.sepi 63.231.80.2 3 u 47 64 377 0.067 -1.168 1.424 2024-05-09T06:00:11.723 INFO:teuthology.orchestra.run.smithi110.stdout:*hv03.front.sepi 74.6.168.72 3 u 44 64 377 0.074 +0.715 1.267 2024-05-09T06:00:11.723 INFO:teuthology.orchestra.run.smithi110.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 +0.000 0.000 2024-05-09T06:00:11.724 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-09T06:00:11.736 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-09T06:00:11.737 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-09T06:00:11.778 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-09T06:00:11.819 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-09T06:00:11.861 INFO:teuthology.task.internal:Duration was 1079.589992 seconds 2024-05-09T06:00:11.862 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-09T06:00:11.945 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-09T06:00:11.945 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-09T06:00:11.948 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-09T06:00:11.987 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-09T06:00:11.987 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi072.front.sepia.ceph.com 2024-05-09T06:00:11.987 DEBUG:teuthology.orchestra.run.smithi072:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-09T06:00:12.033 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi110.front.sepia.ceph.com 2024-05-09T06:00:12.034 DEBUG:teuthology.orchestra.run.smithi110:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-09T06:00:12.047 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-09T06:00:12.047 DEBUG:teuthology.orchestra.run.smithi072:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-09T06:00:12.082 DEBUG:teuthology.orchestra.run.smithi110:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-09T06:00:12.117 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-09T06:00:12.117 DEBUG:teuthology.orchestra.run.smithi072:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-09T06:00:12.154 DEBUG:teuthology.orchestra.run.smithi110:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-09T06:00:12.216 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-09T06:00:12.226 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-09T06:00:12.227 DEBUG:teuthology.orchestra.run.smithi072:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-09T06:00:12.239 DEBUG:teuthology.orchestra.run.smithi110:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-09T06:00:12.251 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-09T06:00:12.287 DEBUG:teuthology.orchestra.run.smithi072:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-09T06:00:12.289 DEBUG:teuthology.orchestra.run.smithi110:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-09T06:00:12.299 INFO:teuthology.orchestra.run.smithi072.stdout:kernel.core_pattern = core 2024-05-09T06:00:12.302 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern = core 2024-05-09T06:00:12.373 DEBUG:teuthology.orchestra.run.smithi072:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-09T06:00:12.378 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T06:00:12.379 DEBUG:teuthology.orchestra.run.smithi110:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-09T06:00:12.421 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T06:00:12.421 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-09T06:00:12.432 INFO:teuthology.task.internal:Transferring archived files... 2024-05-09T06:00:12.432 DEBUG:teuthology.misc:Transferring archived files from smithi072:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7699143/remote/smithi072 2024-05-09T06:00:12.433 DEBUG:teuthology.orchestra.run.smithi072:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-09T06:00:12.457 DEBUG:teuthology.misc:Transferring archived files from smithi110:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7699143/remote/smithi110 2024-05-09T06:00:12.457 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-09T06:00:12.485 INFO:teuthology.task.internal:Removing archive directory... 2024-05-09T06:00:12.485 DEBUG:teuthology.orchestra.run.smithi072:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-09T06:00:12.494 DEBUG:teuthology.orchestra.run.smithi110:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-09T06:00:12.529 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-09T06:00:12.545 INFO:teuthology.task.internal:Not uploading archives. 2024-05-09T06:00:12.545 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-09T06:00:12.612 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-09T06:00:12.612 DEBUG:teuthology.orchestra.run.smithi072:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-09T06:00:12.615 DEBUG:teuthology.orchestra.run.smithi110:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-09T06:00:12.619 INFO:teuthology.orchestra.run.smithi072.stdout: 658641 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 9 06:00 /home/ubuntu/cephtest 2024-05-09T06:00:12.621 INFO:teuthology.orchestra.run.smithi110.stdout: 658636 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 9 06:00 /home/ubuntu/cephtest 2024-05-09T06:00:12.622 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-09T06:00:12.660 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-09T06:00:12.739 INFO:teuthology.run:Summary data: description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mds 2-workunit/suites/iozone}} duration: 1079.589991569519 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-05-09T06:00:12.739 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-09T06:00:12.827 INFO:teuthology.run:pass